Each connection uses a certain amount of memory, which is what they use. They do not hold memory beyond the duration of their particular batch.

DBCC MemoryStatus (http://support.microsoft.com/?id=271624) gives info on overall memory.