SQL Server is already taking all the memory it can. That's why lowering the Max Memory allocation didn't change anything.

What other programs or processes are running on this server? Does this machine have 12 GB of memory available or does it only have 6? Is this a virtual server where there is another server taking that memory?