If you import the data into a table using all of the available outputs, is the data you require imported as part of that (contained in one of the imported...

This might be of interest:

https://www.sqlservercentral.com/articles/cross-tabs-and-pivots-part-2-dynamic-cross-tabs

I think that the temp table is scoped to the subprocess spawned by the EXEC statement.

If you concat the INSERT and SELECT statements to your @sql variable, with semicolon delimiters,...

Is this a SQL Server question? Not sure I follow.

I've now tried migrating from SSIS to Data Factory twice. The first time (three years ago) failed because DF could not do the things we needed. The second time was...

Hi Phil - this is adding an ID of zero into the 'unioned' result - I need the second part of this union to effectively inherit the ID from...

No problem. Just create a fake matching column in the STRUCTURE dataset (make sure its datatype matches what's in SOURCE)

SELECT Cols, Id
from Source 
UNION ALL
Select Cols, Id...

SELECT cols FROM TableA
UNION ALL 
SELECT Cols FROM TableB b 
WHERE NOT EXISTS (SELECT 1 FROM TableA a WHERE a.START = b.START)

Something like this, perhaps?

UPDATE dt
SET dt.tagid = nt.id
FROM dbo.DataTable dt
    JOIN dbo.OldTable ot
        ON ot.id = dt.tagid
...

Bravo!

Once you have created your set-based update code, consider adding an OUTPUT clause to it. This will allow you to capture the before and after state of the rows which...

Not sure who marked your last post as spam, it wasn't me.

That is a mega query. Not one for someone who is 'new to the development side', in my opinion...

There must be more...

Right after the final ), add the following and see what happens:

SELECT d.Code
      ,d.CoName
      ,d.TerName
  ...

Well, it should work, but without seeing your code, we cannot diagnose your issue. Try running this, for example

DROP TABLE IF EXISTS #SomeData;

CREATE TABLE #SomeData
(
  ...