You are right, the performance gain is related to the drop-downs in the parameters not being populated. This can often be slow, especially if they are query driven.

Editing the CSS will only hide the control from view in your client, it will not stop the toolbar controls being generated, which will be server side or through AJAX, and populated which is why you are still get the delay.