Home Forums SQL Server 2005 SQL Server 2005 Performance Tuning Best way to select a large amount of data? RE: Best way to select a large amount of data?

  • August 20, 2010 at 11:32 am

    #1209834

    ricardo_chicas (8/20/2010)

    Ok lets do this, forget about the original problem

    what I really want to know is for a suggestion on what is the best way to retrieve large amount of data, without blocking tables, without using no log, using a select, when I use oracle I was able to do something like that using a bulk select ( I set the select to retrieve chunks of 10000 rows), I am not sure if that kind of stuff works in sql server, but i want something like that

    Thank you

    as everyone else is telling you; 5 million rows takes time to move.

    the right thing to do is not move the data at all, and look at what the process is doing with the data.

    whatever that process is, it can be fixed and cleaned up so it doesn't take so long and doesn't block the server.

    grabbing 5 million rows in 10K bites is not going to do anything faster for you; you need to tackle it a different way; for example, how often is that 5million rows downloaded ? more than once? why is it not cached?

    As someone else already said, the secondary process that does stuff to the 5 million rows should be looked at so that a single summarizing statement that is executed on SQL server is used to replace that process.

    Lowell

    --help us help you! If you post a question, make sure you include a CREATE TABLE... statement and INSERT INTO... statement into that table to give the volunteers here representative data. with your description of the problem, we can provide a tested, verifiable solution to your question! asking the question the right way gets you a tested answer the fastest way possible!