First thing is that there's absolutely no need for the temp table. Just do the select straight with the order by included.

Which tables is it scanning and what do the indexes on that table look like?

While it's running, look in sysprocesses and see if there's a last wait type. If so, what is it?