No, no... no transfer of data from TableA to TableB... it'll take too long. Go back and look at what we wrote...

Just a thought, folks... Much like Loner's process, I do a lot of ETL using Bulk Insert with format files. The difference is that I have all the files...

Loner (11/6/2007)

---

I used to load multiple text files with different format into different tables in a database.

I created a table called TextFileInfo with TextfileName, Path directory, formatfilename with path directory,

table...

Yes all of the files in the same format ..

I would like to merge data from all of the files into one table. do you have any sugguestion or sample...

It's simple... convert all of those formats to datetime using just CAST... they'll all "fly" correctly... and convert them back to your YYYY-MM-DD format...

Heh... no question that with that many rows of data that you need to do some data marting and that you're not actually trying to create reports from nearly 400...

You didn't answer my question, though... Do you expect the right most bit of each of those groups to represent 2⁰ in your returned decimal number?

First of all, you need to count the bits from the right... not the left... and they should be counted as powers of 2 starting with the exponent 0... then...

We don't have a single report that takes longer than 30 seconds to retrieve (typically they're in the 0-2 second range), thanks to some careful marting...

...Once I've gotten the data...

karthikeyan (11/6/2007)

---

If we take any performance related article or document, definetely it highlight the below point ' don't use distinct keyword in your query.It decrease your performance'.

Thats why i posted...

David McFarland (11/6/2007)

---

Do you use covering indexes to optimize all of your reports? I don't, as I don't have the terabytes of extra storage I'd need to do so. If...

karthikeyan (11/6/2007)

---

I agreed all your experts answer. But in memory level where worktable will be stored ?

For example if i create # table then it will be stored in TempDatabase.

But...

Perfect... I'm at work right now... I'll try to set something up tonight... thanks, Matt!

Sure, John... kind of... hope you don't mind a bit of psuedo code because I don't ever use DTS except for ad-hoc transfers...

Create two identical tables to hold the data......

Kewl! Anyone interested in a million row duration test on this? 😀 I'd need some help 'cause I don't have 2k5...