Have you given the ‘Lock pages in memory’ right to the account used by the SQL Server instance?

Also the task manager is not a right place to look for how much memory SQL server is using.

Run DBCC MEMORYSTATUS to see the actual values.