DenkzeitWiki

Processing Large Xml

• http://dataspora.com/blog/xml-and-big-data/
  
  
• http://old.nabble.com/Parsing-large-xml-files-td23654420.html
  
  
• Parallel and Distributed Approach for Processing Large-Scale XML Datasets

WAX

• http://www.ociweb.com/wax/
• http://www.youtube.com/watch?v=22aiGJhzbX8 - batman explains WAX

XOM

• http://www.xom.nu/
  • http://github.com/marktriggs/xml-picker-seq -- wrapper for Clojure

StAX

• http://stax.codehaus.org/

VTD-XML

Virtual Token Descriptor for eXtensible Markup Language (VTD-XML) refers to a collection of cross-platform XML processing technologies centered around a non-extractive[1] XML, "document-centric" parsing technique called Virtual Token Descriptor (VTD).[1]

• random access
• high performance
• low memory usage
  
  
• http://vtd-xml.sourceforge.net/
  
  
• http://www.codeproject.com/KB/cs/vtd-xml_examples.aspx - first in a series
  • '''http://www.codeproject.com/KB/XML/xml_processing_future.aspx - document-centric processing/manipulating of XML
  • http://www.codeproject.com/KB/XML/VTD-XML-indexing.aspx - persisting the parser's result
    
  • The Performance Woe of Binary XML
    
  
  
• Simplify XML processing with VTD-XML