InstantForum.NET v2.9.0SQLServerCentralhttp://www.sqlservercentral.com/Forums/notifications@sqlservercentral.comWed, 19 Jun 2013 12:53:29 GMT20http://www.sqlservercentral.com/Forums/Topic1055908-146-1.aspxGiven that you have massive volumes of data to work with and yet are asking basic questions I really must encourage you to get a professional to help you with your migration efforts. I will throw out that it can often be much more efficient to drop (some or all) indexes on tables that are going to have large amounts of data added to them in an ETL process and then rebuild them after load completion.Mon, 31 Jan 2011 07:45:07 GMTTheSQLGuruhttp://www.sqlservercentral.com/Forums/Topic1055908-146-1.aspx[quote][b]free_mascot (1/31/2011)[/b][hr]When you are transfering large data to new table; I suggest you create just basic structure of the table i.e. without indexes, rules etc. Once transfer is done you can create the required indexes depending on your queries.This will be much faster.HTH[/quote]Maybe, maybe not. Inserts into tables with a well-constructed clustered index are faster than inserts into a heap table. It's all the additional non-clustered indexes and foreign key constraints that can slow down inserts. But even these may benefit inserts depending on how the inserts are being done. You really have to address each situation individually and not use a blanket approach.Mon, 31 Jan 2011 05:57:18 GMTGrant Fritcheyhttp://www.sqlservercentral.com/Forums/Topic1055908-146-1.aspxWhen you are transfering large data to new table; I suggest you create just basic structure of the table i.e. without indexes, rules etc. Once transfer is done you can create the required indexes depending on your queries.This will be much faster.HTHMon, 31 Jan 2011 02:43:31 GMTfree_mascothttp://www.sqlservercentral.com/Forums/Topic1055908-146-1.aspx[quote][b]avinash jobanputra (1/30/2011)[/b][hr]1) We have created a number of indexes to improve the read time of some queries. However these tables then have large inserts going into them. Does indexing not slow down the insert.[/quote]Yes. Indexing is a tradeoff. Test and see what kind of hit you take on the inserts. Usually a small number of indexes is fine, but do test.[quote]2) This specific migration is going to be running consecutively for over 24 hours. As a test I did a rebuild and reorganise half way through and this helped. Is this something valid to suggest in production.[/quote]Absolutely. You should be doing regular index maintenance. Not rebuild and reorg, the latter is redundant, but something. This script's good if the DB is large. [url]http://sqlfool.com/2010/04/index-defrag-script-v4-0/[/url]Sun, 30 Jan 2011 22:37:28 GMTGilaMonsterhttp://www.sqlservercentral.com/Forums/Topic1055908-146-1.aspxHI Im working as a SQL DBA where im currently supporting a lage volume of data migration from a legacy system to a brand new product.One of the migrations consist of a large volume of data with billions of rows of data in some staging tables. I have a couple of questions here which im hoping the experts can contribute to in terms of performance tuning.1) We have created a number of indexes to improve the read time of some queries. However these tables then have large inserts going into them. Does indexing not slow down the insert.2) This specific migration is going to be running consecutively for over 24 hours. As a test I did a rebuild and reorganise half way through and this helped. Is this something valid to suggest in production.ThanksSun, 30 Jan 2011 11:04:56 GMTavinash jobanputra