[Date Prev][Date Next][Thread Prev][Thread Next]
[Date Index]
[Thread Index]
- Subject: Re: Parsing big compressed XML files
- From: Oliver Kroth <oliver.kroth@...>
- Date: Thu, 03 Apr 2014 18:28:47 +0200
Hello Valerio,
yes, actually I am using exactly this library in my project.
You won't get rid of the overall time to decompress the data, but you may
- decrease the delay between starting to read the compressed file and
parsing the XML
- reduce the memory and disk space used during the parsing
Is your XML data just plain deflated or is there a PKZIP archive
structure around it? Then you would need something to navigate through
it, which can be done in pure Lua
-- Oliver
Hello Olivier,
do you suggest something like : https://github.com/brimworks/lua-zlib ?
Saving the decompressing time would be indeed awesome, but I thought
bzcat is basically doing the same, no ?