I'd strongly recommend getting the execution plan and understanding how SQL Server is interpreting your T-SQL. That will drive you towards making positive choices in optimizing the code.
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt
Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning