Is it the distribution database itself, or the transaction log that is growing?

If it's the transaction log, check the recovery model. If it's anything other than simple, you need to make sure you're running transaction log backups.