Continuously running SSIS Package

• Asangaai

  SSC Enthusiast

  Points: 177

  More actions

  August 18, 2011 at 12:08 pm

  #242319

  Hi ,

  I am planning to create a continuously running SSIS package. Idea is to extract data from 80 different geographical locations.Each of them have foxpro database. My project is to centralize them. Any advice on , is this good idea ..?

  Thank in advance.

• Phil Parkin

  SSC Guru

  Points: 247158

  More actions

  August 18, 2011 at 2:27 pm

  #1370402

  Please provide more info. How much data, how frequently and why continuously? You make it sound like a migration, rather than something which needs to run over and over again. Will the centralised database replace the others? If not, what is the point?

  ---

• Asangaai

  SSC Enthusiast

  Points: 177

  More actions

  August 18, 2011 at 2:45 pm

  #1370413

  Hi Phil,

  This project is to integrate distributed foxpro database and create a real time, online centralized data repository. So we can have a clear overall picture of what is happening in the organization.( Foxpro db is the billing system,invoices)

  1. Why continuously:So I need to extract data from all the distributed locations continuously 24x7.

  2. How frequently : every 3 mins (at least, smaller the better )

  3. This is not a migration. No system , db is getting replaced /Upgraded. Just creating centralized repository.

  4. I did the system analysis. Number of extraction will be 2000 records per minutes (from all 80 locations).

  eg: need to write 2000 records per min to the centralized location.

  Source files are (dbf) just over 300 MB.

  I hope this clarifies the scenario.

  Thanks.