• Jeff Moden - Monday, September 11, 2017 11:04 PM

    Personally, I think all of the "new" ways of sharing data are just stupid.  XML, JSON, EDI, whatever.  It's all stupid.  If it's not tag bloated hierarchical crap that does need to be, its some other junk the you need a 100 page spec to write the code to disassemble the garbage into normalized tables.  I was really excited when XML first came out with the promise of "not having to know the structure of the data".  Nothing could be further from the truth.

    I think back to when I was using DB2 and DB3 ("DBF" files) for a short while.  THAT was amazing. If someone want to me to have the data in 3 related tables, we wouldn't go through all this hierarchical XML junk.  They would just send me 3 files that I could attach to a database and it was a done deal because the header of the file (the DB III structure) had the column names and the datatypes described in it and the rest of the rows were data.  ASCII in all it's glory sans tag bloat, hierarchical nonsense, or having to be careful about special characters.

    Personally, trying to conform the world to one way of thinking or one tool or one format is extremely hard. It's better to focus on how you can cut through all the politics and come to some type of middle ground that bridges the gaps. Maybe not so much in smaller organizations where you have more control, but in larger ones, especially where you may have NoSQL and RDBMS teams, it can be counter productive to even think about it.

    On the article, I do think it's easier said than done to bridge the worlds to using the same agreed upon schemas so they compliment each other and make things like plucking out data from one system and easily putting it into another system. This is kind of like where roles like mine should shine (the data architect) in trying to ensure that can happen or at least foresee that it WILL happen at some point down the line. But, it's extremely complicated much like it's even still extremely complicated to build a single data warehouse where everyone can agree on the final model and what questions or potentially new questions that warehouse should be answering for the business and it's units.