the above queries work fine in sql server now, but donot know how to automate job schedule to scan network folder for csv files and run those queries on the csv files.

i think i should not go ahead with PIVOTING the 2 tables that are produced after running the above queries on the csv file, but rather work with those 2 tables themselves as they contain all the KPI's starting after column 'EAN'.

BTW, as per your earlier suggestion, i am reading on cubes and think they might be the right approach - however, donot know how to create a cube from a single denormalized table containing everything, but not having a primary key.

please advice.