I am developing an SSIS package right now where I have to pull large amounts of data (~45 million rows) from a MySQL DB.
DB: MySQL 8.0.11
Driver: MySQL 8.0 ODBC Unicode Driver (32-bit)
It works pretty well when querying only a small amount of data (let's say 2 million rows), but when I try to fetch all rows, it sends an 'Invalid column name' error ('HY000'. Code: 517).
Has anyone encountered this problem before?
On ODBC side,
- allow big results set
- enable automatic reconnect
- allow multiple statements
Any feedback/help appreciated!