November 7, 2009 at 1:38 pm
Hello,
I've to perform a merge inner join and i have two data source
which gets records after performing joins
I've to sort both of the data source on 4 columns
Source A has: 1,34,000 recods and has 15 columns
Source B has: 1,74,000 recods and has 4 columns
How ever data source gets all 1,34,000 records but it do not sort the records on my local maching, It kept running for 3 hrs...
please suggest!!!
Pavas
Dream The Dream
Explore the World
Experince The Exhilaration
November 9, 2009 at 9:09 pm
The sort task is very slow and only suitable for small files.
If the data is coming from a database, you could use the order by command to sort the rows.
If the data is coming from flat files, one possibility is to have some work tables set up in a database so you can use the order by. If this is not possible, see if dumping the data to raw files and reading them in with sorting will help.
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply