Azure Data Factory

  • Steve Jones - SSC Editor

    SSC Guru

    Points: 715375

    Comments posted to this topic are about the item Azure Data Factory

  • This was removed by the editor as SPAM

  • Iulian -207023

    SSCertifiable

    Points: 7507

    Nice one, thank you.

  • higgim

    SSCarpal Tunnel

    Points: 4090

    Azure data factory is rather cool. We use this a great deal in our shop.

  • Koen Verbeeck

    SSC Guru

    Points: 258927

    Nice question, thanks.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • akljfhnlaflkj

    SSC Guru

    Points: 76202

    Thanks for the question. Had to do a little research. Ended up reading a lot. These question do serve a good purpose.

  • Ed Wagner

    SSC Guru

    Points: 286958

  • Duran

    SSChampion

    Points: 13259

    Hello,

    As there is no Data Factory specific forum option (could we have one, please?), then I'll post a question here. I have been calling an JSON API and storing the output in Blob to be used as a dataset for the next activity. What I am wondering is, could I use the output of the JSON API for the next activity without having to store it in blob? FYI, the next activity will be extracting the information using OPENJSON and storing it into a SQL 2016 landing table.

    Thank you for any suggestions or ideas. If I work it out in the meantime, I'll post back.

    Regards,
    D.

  • xsevensinzx

    One Orange Chip

    Points: 25531

    Duran - Tuesday, December 4, 2018 3:33 PM

    Hello,

    As there is no Data Factory specific forum option (could we have one, please?), then I'll post a question here. I have been calling an JSON API and storing the output in Blob to be used as a dataset for the next activity. What I am wondering is, could I use the output of the JSON API for the next activity without having to store it in blob? FYI, the next activity will be extracting the information using OPENJSON and storing it into a SQL 2016 landing table.

    Thank you for any suggestions or ideas. If I work it out in the meantime, I'll post back.

    Regards,
    D.

    Can you not just make the copy activity convert the JSON input to Text output as it copies the entire JSON dataset into SQL Server directly? Last I check, you can convert the input of a data stream to something entirely separate with the output. For example, you can read in a TSV file and have data factory output the data as a CSV with a custom delimiter.

    Also, what's stopping you from just saving this as something else than JSON? I work with a lot of API's myself and I always convert the data to CSV or similar as it writes the file. Therefore, what would be in BLOB would be the actual CSV file.

  • Steve Jones - SSC Editor

    SSC Guru

    Points: 715375

    Please don't post a question here. If there isn't a forum, pick a forum that's close and start a new thread. Don't hijack others.

    I've added an ADF forum here: https://www.sqlservercentral.com/Forums/Cloud-Computing/Azure-Data-Factory

Viewing 10 posts - 1 through 10 (of 10 total)

You must be logged in to reply to this topic. Login to reply