[Testing corpus](https://github.com/iczelia/bzip3/releases/download/corpus/corpus.7z) ``` 17256 bee_movie.txt.bz3 18109 bzip2/bee_movie.txt.bz2 55315 bee_movie.txt 72320 bzip3-master.tar.bz3 77575 bzip2/bzip3-master.tar.bz2 501760 bzip3-master.tar 256680 lua-5.4.4.tar.bz3 285841 bzip2/lua-5.4.4.tar.bz2 1361920 lua-5.4.4.tar 468272 cantrbry.tar.bz3 570856 bzip2/cantrbry.tar.bz2 2821120 cantrbry.tar 807959 calgary.tar.bz3 891321 bzip2/calgary.tar.bz2 3265536 calgary.tar 1229840 shakespeare.txt.bz3 1479261 bzip2/shakespeare.txt.bz2 5458199 shakespeare.txt 2347278 decoda.tar.bz3 2580600 bzip2/decoda.tar.bz2 6154240 decoda.tar 2052611 2b2t_signs.txt.bz3 2388597 bzip2/2b2t_signs.txt.bz2 9635520 2b2t_signs.txt 41187299 audio.tar.bz3 95526840 bzip2/audio.tar.bz2 115742720 audio.tar 12753530 chinese.txt.bz3 17952181 bzip2/chinese.txt.bz2 79912971 chinese.txt 22677651 enwik8.bz3 29008758 bzip2/enwik8.bz2 100000000 enwik8 47227855 silesia.tar.bz3 54538771 bzip2/silesia.tar.bz2 211968000 silesia.tar 8437731 lisp.mb.bz3 13462295 bzip2/lisp.mb.bz2 371331415 lisp.mb 83624620 gcc.tar.bz3 109065903 bzip2/gcc.tar.bz2 824309760 gcc.tar 157642102 dna.tar.bz3 180075480 bzip2/dna.tar.bz2 685619200 dna.tar 129023171 linux.tar.bz3 157810434 bzip2/linux.tar.bz2 1215221760 linux.tar 406343457 Windows NT 4.0.vmdk.bz3 437184515 bzip2/Windows NT 4.0.vmdk.bz2 804192256 Windows NT 4.0.vmdk ``` ## Benchmark on the Calgary corpus Downloaded from http://corpus.canterbury.ac.nz/resources/calgary.tar.gz Results: ``` % wc -c corpus/calgary.tar.bz2 corpus/calgary.tar.lzma corpus/calgary.tar.gz corpus/calgary.tar 891321 corpus/calgary.tar.bz2 853112 corpus/calgary.tar.lzma 1062584 corpus/calgary.tar.gz 3265536 corpus/calgary.tar ``` Performance: ``` Benchmark 1: gzip -9 -k -f corpus/calgary.tar Time (mean ± σ): 224.3 ms ± 2.6 ms [User: 221.4 ms, System: 2.5 ms] Range (min … max): 219.9 ms … 230.9 ms 30 runs Benchmark 2: lzma -9 -k -f corpus/calgary.tar Time (mean ± σ): 787.9 ms ± 9.6 ms [User: 753.6 ms, System: 33.7 ms] Range (min … max): 764.8 ms … 813.1 ms 30 runs Benchmark 3: bzip3 -e -b 3 corpus/calgary.tar corpus/calgary.tar.bz3 Time (mean ± σ): 265.3 ms ± 1.8 ms [User: 257.6 ms, System: 5.9 ms] Range (min … max): 262.5 ms … 269.0 ms 11 runs Benchmark 4: bzip2 -9 -k -f corpus/calgary.tar Time (mean ± σ): 172.9 ms ± 2.4 ms [User: 168.4 ms, System: 4.4 ms] Range (min … max): 169.5 ms … 179.4 ms 30 runs ``` Memory usage (as reported by `zsh`'s `time`): ``` bzip2 8M memory bzip3 17M memory lzma 95M memory gzip 5M memory ``` ## Benchmark on the Linux kernel ``` bzip3 -e -b 16 corpus/linux.tar corpus/linux.tar.bz3 76.93s user 0.41s system 99% cpu 89M memory 1:17.38 total bzip2 -9 -k linux.tar 61.23s user 0.35s system 99% cpu 8M memory 1:01.58 total gzip -9 -k linux.tar 43.08s user 0.35s system 99% cpu 4M memory 43.435 total lzma -9 -k linux.tar 397.30s user 0.90s system 99% cpu 675M memory 6:38.28 total ``` ``` wc -c linux.tar* 1215221760 linux.tar 157810434 linux.tar.bz2 208100532 linux.tar.gz 125725455 linux.tar.lzma ``` ## The Silesia corpus ``` lzma -9 -k silesia.tar 76.88s user 0.31s system 99% cpu 675M memory 1:17.20 total bzip3 -e -b 16 silesia.tar 17.42s user 0.08s system 99% cpu 98M memory 17.510 total zstd -19 silesia.tar 83.43s user 0.20s system 100% cpu 237M memory 1:23.47 total % wc -c silesia* 211968000 silesia.tar 47227855 silesia.tar.bz3 48761670 silesia.tar.lzma 53000145 silesia.tar.zst ```