No problem. Just create a fake matching column in the STRUCTURE dataset (make sure its datatype matches what's in SOURCE)

SELECT Cols, Id
from Source 
UNION ALL
Select Cols, Id...

SELECT cols FROM TableA
UNION ALL 
SELECT Cols FROM TableB b 
WHERE NOT EXISTS (SELECT 1 FROM TableA a WHERE a.START = b.START)

Something like this, perhaps?

UPDATE dt
SET dt.tagid = nt.id
FROM dbo.DataTable dt
    JOIN dbo.OldTable ot
        ON ot.id = dt.tagid
...

Bravo!

Once you have created your set-based update code, consider adding an OUTPUT clause to it. This will allow you to capture the before and after state of the rows which...

Not sure who marked your last post as spam, it wasn't me.

That is a mega query. Not one for someone who is 'new to the development side', in my opinion...

There must be more...

Right after the final ), add the following and see what happens:

SELECT d.Code
      ,d.CoName
      ,d.TerName
  ...

Well, it should work, but without seeing your code, we cannot diagnose your issue. Try running this, for example

DROP TABLE IF EXISTS #SomeData;

CREATE TABLE #SomeData
(
  ...

Good point Phil. I do believe DATEADD(year, -3, GETDATE()) Takes leap year into account, I'm too lazy to load test data. also I would not delete data from a...

On another note, you shouldn't be using double quotes around your field names.  If you want to use anything, you should use open and close square brackets.  "["...

You can add to your SP after records are created or execute another SP that deletes the records over 3 years old. You need to have a date for...

• This reply was modified 8 months, 2 weeks ago by Phil Parkin.

By fall off, do you mean get deleted?

Why not keep all the data and simply have a view which select the last three years?

Otherwise, create a daily SQL Agent job...

Instead of moving processed files to a single archive folder, create a timestamped folder in the target folder and move the file there.

You will never get collisions if you do...

You think it's funny that people are trying to help you...