ETL changes instant

• erics44

  SSCertifiable

  Points: 6150

  More actions

  March 24, 2015 at 4:29 am

  #296321

  Hi

  I am building an etl and theres a lot of data.

  I have built it in a way that the reporting will be down/unstable for one minute at the end of the etl.

  so all the main data is compiled in histroy tables and then the reporting tables are populated from the history tables and that takes a minute right at the end.

  I am now asked to investigate this in the hope of turning this minute into 0 seconds.

  one option i can think of is having 2 sets of reporting tables and switching between them, so the etl runs once and populates reporting tables set 1, then the next time the etl runs it populates reporting tables set 2 and the reporting swtches to this set once the etl has finished, then the next time it runs it goes to set 1.

  My question is, is there a more technical/out of teh box solution to use? or has anyone any better suggestions?

  Thanks in advance