I think this is more or less the outcome of the discussion so far, but I think a combination of limiting the server memory and DBCC FREEPROCCACHE before executing the procedure would be the way forward to cover both the "memory pressure" and the "fair comparison" elements of the question.

Note that a CHECKPOINT immediately before the performance test is recommended to also write the dirty

buffers to disk.