How do other memory intensive queries (large sorts) perform on the virtual server?

Is it possible that the physical host is overcommitted in terms of memory?

What may look to you as CPU churning through memory on your VM would actually be paging on the physical host.