Most likely you've come across a piece of bad application code that doesn't clean up after itself.

All temporary objects created in tempdb must be dropped when you're done with them.

You can check this by running a trace and looking at the actual SQL code. Anything that's created and not dropped at the end of a transaction is part of the problem.