I understand your suggestion regarding columns. We got round this one-off testing problem by borrowing a server with 128GB of memory.

However, I was really trying to understand the figures...

Thank you for your suggestion.

I believe the three options I have are to increase the server memory, rewrite the package, or reduce the amount of data it is processing....