Look at the estimated query plans for each and see if the differences tell a story.

Also run sp_whoisactive during the execution and see various things you can see with that.