Some time ago, we had problems with memory pressure that seemed to come from CLR assemblies. After quite a bit of reading, we installed SP3 and the problem magically went away.

I'd also completely agree with Erland and recommend moving up to a 64-bit version.