Hello and excuse for reopen this thread. I have
developed some compression algorithms so perhaps
i can guide you on this topic. It looks like you
need a fast compress/decompress library and you
currently use deflate family implementations
(gzip/zlib). Also there were words about lzma,
lzf and lzo. FYI, there are codecs faster than
hard disk I/O (and lzo) like thor or slug among
others. Fast codecs uses lzp or lz78 plus huffman
codes and gets compression between 50-60% for
text. Check original LZP1 code from cbloom
homepage, it´s (if i remember correctly) opensource code.