Tue, 25 Aug 2009
XML sucks for big data, or hadn't you noticed?
Courtesy of Rich Enbody, this blog post, How XML Threatens Big Data -- Dataspora, elicited a big "duh" from me.
You don't solve any of the semantic problems with data by elaborating on a textual format. You may bring them into the light, but along with the visibility comes "bureaucracy" -- technology, acronyms, proponents and opponents, and the usual cruft.
I find the "embrace lazy data modeling" rule rather funny, personally, because it is the data-world's counterpart to agile methodologies in software development: solve problems you actually have, rather than all the potential ones you see.
I do like the "15 minute" rule: if I can't parse some useful information out of your data format in 15 minutes, you've done something very wrong.
--titus
posted at: 20:40 | path: /aug-09 | 2 comments
Comments:
Posted by Carl T. at Wed Aug 26 07:36:21 2009:
The decision to go with XML for big data is often a strategic one made without the dev's or dba's consent. Ease of use and common sense often aren't big factors in these decisions.
At that point, it's up to the end user to get creative with text processing to circumvent the performance limitations (not that I've ever done this sort of thing . . .).
But yes, it does suck.
Carl T.
Posted by Harry at Wed Aug 26 14:26:54 2009:
"I do like the "15 minute" rule: if I can't parse some useful information out of your data format in 15 minutes, you've done something very wrong."
+1