"One other thing would really help, the actual execution plan."

This IS the ACTUAL execution plan

"Also, do you really drop the temporary table as soon as it is populated as it appears in the code you posted?"

NO -- I extracted the query from the stored proc in which it resides