The Art of Data Ingestion - Part 1

  • Comments posted to this topic are about the item The Art of Data Ingestion - Part 1

  • What I would add to your list of questions is anything that covers the sensitivity of the data and data protection laws! Does it contain any PII or PHI information? What kind of data protection rules or restrictions apply (GDPRD, Schrems II, local law or others?). Working with data, specially in a global environment, has become a bit of a mine field in the recent years unfortunately. If in doubt, call your lawyer 🙂

  • Good point!  Thanks for sharing.

  • This article assumes data is defined and dropped for us. Most of the time we have to fetch it for ourselves, whether from direct database access or via API connectivity. This can then include working out which data items are needed from which tables or views or API calls. Often the users requiring the data have no idea of how it is stored.

Viewing 4 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply