If you have ten files, you can create ten dataflows and have them run in parallel OR have ten different packages and call them in parallel with a master package....

sqldriver (8/27/2014)

---

I ran into this method in an Itzik Ben-Gan article, which looks more complicated, but of course somehow manages to run a bit faster where I've tested it against...

Agreed, if you have not...

Following up on the BCP suggestion this is actually a good idea >

Open a command line window and type something like

bcp "adventureWorks2008R2.Person.address" out "c:\myBcpOut.txt" -c -T

If...

For example, for a particular employee there might be 141 records in this "huge dumping table" but when I perform the SCD, only 14 records make it to the DW...

Brandie Tarvin (8/21/2014)

---

Except when buying a car, I have no intention of offering the highest possible price first....

These are not the best ways likely, but a couple of ideas I have are:

1) Use SSIS and a script component with a dataflow to add text qualifiers...

Brandie Tarvin (8/18/2014)

---

M Joomun (8/18/2014)

---

Hello both,

Thanks for your replies.

As to the table schema, tblPerson - tblManagementOfBleeding is a 1 ~ 1. I've attached screenshots which give more detail. Do you...

There is a small piece in one of my books about this. I'll do some reading and get back to you tomorrow likely. The SCD transform is process intensive because...

Salary.com has some good information that will give you an indication of where the salaries are in your area. So it is a start.

You can mention what you think...

Hi Romina,

Are you still using the looping? I don't think that will help. Just use a SCD transform and select it as a 'Historical Attribute' for the change type property...

One of the things a ETL developer will invariably encounter is data that is not trustworthy. And though we can argue that it should be (It should be!), it still...

Something like this ?

WITH myCTE

AS (

SELECT row_number() over (partition by EmployeeID, Firstname,Salary

ORDER BY EmployeeID, FirstName, Salart ) as Colm1,*

from Employee_salary

)

DELETE From myCTE where Colm1> 1

If you are concerned about how it will run in a job, you can deploy it to a test machine with the job service running under the same credentials ...security...

Hi,

Since I don't have sample data to work with I took the AdventurWorks database as my foundation. I am not totally clear how your data looks like but below is...