Yeah you should check the actual query plan.

One more thing maybe you should check the amount of IO or scanning actually happened using Set statistics io on then execute your query or sp.