Read this http://www.sqlservercentral.com/articles/SQLServerCentral/66909/

Your memory theory sounds plausible but I would look at query optimization first before you throw money at the problem.