It's not necessarily memory, and physical memory doesn't matter all the time. SQL Server has its own memory management and limits.

Perhaps you could start from the beginning and explain how you are querying the data, what client,and what is happening that you notice. Is your query showing as executing if you check SQL Server?