The plan is to process the files into staging tables and then put a message in a queue announcing their arrival with a batch id.