How to reorganize flatfile data in a database?

  • Hi!

    My provider stores survey data that I can consume with a REST API. The data are stored as follows:

    There is a Json file that stores the column names for each survey: E.g.

    Survey1: v1|v2|v3

    Survey2: Name|v1|v2|OpenQuestion1|

    and there is a JSON file for each survey that holds the data for that survey: E.g.

    FileType1:

    1|5|1

    3|3|5

    ...

    Filetype2:

    MyCompany|1|3|I love it here|

    YourCompany|3|3|I hat it here|

    ...

    Up till now I have downloaded the JSON files with a script component and stored the data in a flat file. Then I created two stagging tables in my db. One for the column information one for the data. Looping over the company data files and reading the column data file I read the data into my offline database. Now I want to split the data into different tables (e.g. I have information about the hierarchy in filetype 2. The problem, I have no idea how to start. Should I do this in SSIS or in TSQL? Anyone here who can give me advice or a good tutorial?

    Thanks in advance!

  • Powershell can talk .json easily. Its also more compatible with earlier versions of SQL than 2016, which is the only version of SQl that can talk JSon natively.

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply