Favorite answer, it depends.
Check the execution plan. It might do TOP on its own. In which case, ignore me. But if it's doing aggregate functions there, modifying it could be a huge performance boost.
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt
Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning