I am also facing the problem with similar kind of Issue. I hope you can help me on this.
My task is to store the count(which is nothing but the total records present in the specific SQL table.As they are millions of rows, it is taking
My task includes:
1) Getting the count(which is nothing but the total number of records present in the specific SQL table.As they are millions of rows, it is taking a lot of time to run the count() query). I need to get the count before I write that data from data flow task(source) to the flat file destination tasks, as I need to write the total count of records as well in the flat file.
2)I tried to use the RowCount task,and tried to save that rowcount and to further use that in the next task.But it doesn't work for me.
3) As there are millions of rows in the sql table, it is taking 6 mins(for getting the data) and 6 mins(to get the count() of the records in before step). My manager really asked me to cut down the running time a lot. So, I am trying to run the query once for getting both the count and data(from data flow task to flat file destination).
Can you please advise me on how step 3 works, like getting both at the same time and to reduce the running time for this whole task?
I hope someone can help me out..
Thanks in Advance!!