Post reply

Data Extraction Methods Part 1

  • April 5, 2006 at 12:40 pm

    #167801

    Comments posted to this topic are about the content posted at http://www.sqlservercentral.com/columnists/vRainardi/dataextractionmethodspart1.asp

  • April 25, 2006 at 4:51 am

    #633963

    I appreciate the content of this well written article. I have been doing some of this myself, but have never had it described and documented. I look forward to Part 2.

    Greg Bogard

    Omaha NE

    Regards,

    Greg Bogard

  • April 25, 2006 at 6:36 am

    #633986

    It is very useful article to everyone, I got lot of answers from this article, thanks in advance for next article.

     

    thanking you

    sreeni

  • April 25, 2006 at 9:25 am

    #634075

    Excellent article.  I appreciate the testing you have done to verify your theories and also the explanation behind each approcach.

    Keep up the good work.

  • April 25, 2006 at 9:44 am

    #634088

    Could somebody explain the math for 58 records should take less than a second at 100 Mbps - Thanks already

  • May 2, 2006 at 8:56 am

    #635332

    Hi Skarai, it's just based on my experience, not based on math. A table which contains 1000 to 5000 records (say 10 to 100 columns) on 100M LAN normally takes 1 to 5 seconds to download from DB2 on AS/400 using iSeries OLE DB driver or from Informix on Unix using Informix native OLE DB driver into a staging table with no index in SQL Server on Windows 2000 or 2003 server, configured with RAID 5 for MDF and RAID 1 for LDF using 15k RPM disks, running on DELL 2850 with 8 MB memory, performed using DTS or SSIS with no transformation or scripting (just plain direct column to column mapping).

    Kind regards,

    Vincent Rainardi

  • May 2, 2006 at 10:40 am

    #635376

    Thanks for the follow up Vincent. I understand your earlier statemet now given the added explanation/observation.  - Sassan

  • May 4, 2006 at 3:31 am

    #635861

    I don't recommend that you get in the habit of downloading entire tables.  It may only have 10,000 records today, but a year from now, how many will it have.  We had a consultant use that method on our database, and at first the download took hours (lots of tables).  After a couple of months, it was taking longer.  I then had to rework it to only take the records modified or added that day.  The download not only took less time, but the incremental increase was no longer there.

    My recommendation:  avoid the need to rewrite in the future and go with an incremental strategy.

  • April 25, 2007 at 10:14 am

    #702426

    Very good explanation. Waiting for the part2

Viewing 9 posts - 1 through 8 (of 8 total)

You must be logged in to reply to this topic. Login to reply