Then as now. The answer to major performance problems is reduced data sets.
I recently had to recommend this for a Humana open enrollment period. Over a billion records, and an estimated runtime of 21 days.
Broke it up into 100,000 records at a time, and it took 36 hours.