Got the solution at last.... The culprit is browser IE10 and IE11.
Solution I followed : Go to Tools -> F12 Developer Tools
(at the bottom of the browser window) Select Browser Mode = Internet Explorer 10 Compatibility View.
Report Manager in this mode is working fine. If someone has a better alternate please reply.