July 23, 2013 at 11:17 pm
I have a package with design as below
1.I have DFT to load a Total_table with 90k records
2.it is connected to a for loop container-- to process the 90k reocrds in a batch of 10k
3. In FLC 1st I load Batch_table with 10k from Total_table
4. inside FLC container , sequence container is added , which is connected by the batch load task
5. within sequence container {six (DFT1,DFT2,DFT3,DFT4,DFT5,DFT6) DFTs connected in sequence , which populate individual table using the Batch_table 10k records.}
If sequnce container sucessfull then update the Total_table as processed (0 to 1) for the current 10k batch
if the container fails i have a DFT to delete the current batch records from all the table using lookup.
then for loop restarts after sucessfull batch load and repeats until FLC evaluates 'recordsprocessed>=90k'
then a successmail.
** can I use transactions to rollback only the current batch?
** how can i set the FLC to continue with next , even after a failed batch
** Here I want get the records count in all six DFTs to a custom_log table/Send mail task. As the package is running in a batch process I rowcount sould be sum of
[rowcount from each batch].
After the batch process is complete i should get notified about the rocords processed in each table.
please suggest
Thanks in advance.
Viewing 0 posts
You must be logged in to reply to this topic. Login to reply