If you want to use an IN try this?

WHERE RealTableColumn IN (SELECT TempTableColumn FROM TempTable)

EXISTS can be fast too but not sure in this scenario.

WHERE EXISTS (SELECT TempTableColumn FROM TempTable WHERE TempTableColumn...