| 1 |
2014-03-26 Mikolaj Izdebski <[email protected]> |
| 2 |
|
| 3 |
Release version 2.5 |
| 4 |
|
| 5 |
Fix performance bug in sequential compressor code |
| 6 |
* src/compress.c (do_collect_seq): Release collect semaphore before |
| 7 |
compressing block. This improves performance a lot. |
| 8 |
|
| 9 |
Fix block ordering during compression |
| 10 |
* src/compress.c: Replace order deque with next position pointer |
| 11 |
stored in work block. This way block order doesn't have to be defined |
| 12 |
sequentially. |
| 13 |
|
| 14 |
2014-03-09 Mikolaj Izdebski <[email protected]> |
| 15 |
|
| 16 |
Release version 2.4 |
| 17 |
|
| 18 |
Update copyright notice in usage help |
| 19 |
|
| 20 |
Add release notes for version 2.4 |
| 21 |
|
| 22 |
Document --small |
| 23 |
|
| 24 |
Document --sequential |
| 25 |
|
| 26 |
Add ---sequential CLI switch |
| 27 |
|
| 28 |
Don't remove build-aux/.gitignore during cleanup |
| 29 |
|
| 30 |
2014-02-16 Mikolaj Izdebski <[email protected]> |
| 31 |
|
| 32 |
Avoid scanning in sequential mode |
| 33 |
|
| 34 |
2014-02-09 Mikolaj Izdebski <[email protected]> |
| 35 |
|
| 36 |
Implement sequential collector |
| 37 |
|
| 38 |
Introduce order queue to compressor |
| 39 |
|
| 40 |
Implement restartable collector |
| 41 |
Now collector can potentially be stopped and restarted, allowing input |
| 42 |
blocks to be much smaller than compression block. This feature used |
| 43 |
to be implemented in older versions of yambi. |
| 44 |
|
| 45 |
Reorder code in package_merge() |
| 46 |
|
| 47 |
2014-02-08 Mikolaj Izdebski <[email protected]> |
| 48 |
|
| 49 |
Cache current leaf weight at current depth in curr_weight[] |
| 50 |
|
| 51 |
Reduce branching in Package-Merge |
| 52 |
Add sentinel at the beginning of leaf_weight[] allows skipping bounds |
| 53 |
check, which reduces branches in a tight loop. |
| 54 |
|
| 55 |
Use memcpy() instead of bcopy() |
| 56 |
memcpy() can be faster for non-overlapping memory regions. Also using |
| 57 |
constant length should be faster as optimizing compilers are expected |
| 58 |
to fully inline and unroll the whole memcpy() call. |
| 59 |
|
| 60 |
2014-02-02 Mikolaj Izdebski <[email protected]> |
| 61 |
|
| 62 |
Wrap lines which exceed 80 characters |
| 63 |
|
| 64 |
Rewrite cost computation code |
| 65 |
|
| 66 |
Code length counts don't need to be global |
| 67 |
|
| 68 |
Optimize assign_codes() and add tracing code |
| 69 |
|
| 70 |
Rename confusing variable lookup to code |
| 71 |
|
| 72 |
Make variables names in prefix encoder more human-readable |
| 73 |
|
| 74 |
Integrate Package-Merge with encoder |
| 75 |
|
| 76 |
Port new Package-Merge implementation from Java |
| 77 |
|
| 78 |
Compute cost when assigning prefix code |
| 79 |
|
| 80 |
Remove old implementation of Package-Merge |
| 81 |
|
| 82 |
Add .gitignore files |
| 83 |
|
| 84 |
2014-01-27 Mikolaj Izdebski <[email protected]> |
| 85 |
|
| 86 |
Update copyright notices |
| 87 |
|
| 88 |
Fix parser bug (overrun2) |
| 89 |
* src/parse.c (parse): Backport parser bugfix from lbzip2-java |
| 90 |
commit 4424921. |
| 91 |
|
| 92 |
Rewrite Package-Merge |
| 93 |
* src/encode.c (package_merge): Rewrite from scratch basing on |
| 94 |
Java implementation in lbzip2-java. |
| 95 |
|
| 96 |
2014-01-18 Mikolaj Izdebski <[email protected]> |
| 97 |
|
| 98 |
Add reproducer for parser bug |
| 99 |
|
| 100 |
2013-12-10 Mikolaj Izdebski <[email protected]> |
| 101 |
|
| 102 |
Document code in process.h |
| 103 |
|
| 104 |
Document block header parsing functions |
| 105 |
|
| 106 |
Remove dead code |
| 107 |
* src/parse.c (parse): Remove code that is executed |
| 108 |
under condition that is asserted to be false. |
| 109 |
|
| 110 |
Explain existence of two different block parsing algorithms |
| 111 |
|
| 112 |
Avoid integer overflow with some 32-bit versions of Perl |
| 113 |
build-aux/make-crctab.pl: Avoid using arthmetic operators |
| 114 |
in favor of bit shift and immediate constants. |
| 115 |
|
| 116 |
2013-10-27 Mikolaj Izdebski <[email protected]> |
| 117 |
|
| 118 |
Fix another typo in tests/codelen20.c |
| 119 |
|
| 120 |
Fix a typo in tests/codelen20.c |
| 121 |
|
| 122 |
Add test case for bug #12 (rhbz#1017957) |
| 123 |
|
| 124 |
Properly initialize base code sentinel in make_tree() |
| 125 |
* src/decode.c (make_tree): make sure that base code sentinel |
| 126 |
(base[21]) is always set to plus infinity. Fixes #12. |
| 127 |
|
| 128 |
2013-10-13 Mikolaj Izdebski <[email protected]> |
| 129 |
|
| 130 |
Update automake to 1.14 |
| 131 |
* configure.ac: Bump automake version to 1.14. |
| 132 |
* tests/Makefile.am: Update to use new test driver API. |
| 133 |
* build-aux/autogen.sh: Remove build-aux/compile during cleanup. |
| 134 |
|
| 135 |
2013-09-22 Mikolaj Izdebski <[email protected]> |
| 136 |
|
| 137 |
Release version 2.3 |
| 138 |
|
| 139 |
Complete ChangeLog |
| 140 |
|
| 141 |
Add Serhii Khilinich to THANKS |
| 142 |
|
| 143 |
Add website link to --version report |
| 144 |
|
| 145 |
Add website link to manual page |
| 146 |
|
| 147 |
Add website link to README |
| 148 |
|
| 149 |
2013-07-21 Mikolaj Izdebski <[email protected]> |
| 150 |
|
| 151 |
Fix assertion |
| 152 |
* src/encode.c (package_merge): Fix assertion about remaining number |
| 153 |
of non-singleton trees uppon Package Merge completion. |
| 154 |
|
| 155 |
Small comment improvements |
| 156 |
|
| 157 |
2013-06-30 Mikolaj Izdebski <[email protected]> |
| 158 |
|
| 159 |
Fix typos in prefix decoder code |
| 160 |
|
| 161 |
2013-06-29 Mikolaj Izdebski <[email protected]> |
| 162 |
|
| 163 |
Remove unused retriever FSM state |
| 164 |
* src/decode.c: Remove S_TRAILER enum. |
| 165 |
|
| 166 |
2013-06-26 Mikolaj Izdebski <[email protected]> |
| 167 |
|
| 168 |
Optimize Huffman algorithm |
| 169 |
* src/encode.c (build_tree): Rewrite loop body to minimize number of |
| 170 |
comparisons and branches. |
| 171 |
|
| 172 |
Extract transmission cost computation as a separate function |
| 173 |
* src/encode.c (transmission_cost): New function. |
| 174 |
|
| 175 |
2013-06-23 Mikolaj Izdebski <[email protected]> |
| 176 |
|
| 177 |
Fix a typo in ALGORITHM |
| 178 |
|
| 179 |
Avoid compiler warnings in Package Merge mode |
| 180 |
* src/encode.c (make_code_lengths): Define V only when it's used. |
| 181 |
|
| 182 |
Add prefix coder sanity check |
| 183 |
* src/encode.c (make_code_lengths): Verify if Kraft's inequality is |
| 184 |
satisfied. |
| 185 |
|
| 186 |
Reimplement Package Merge algorithm |
| 187 |
* src/encode.c (package_merge): Rewrite from scratch. |
| 188 |
|
| 189 |
2013-06-22 Mikolaj Izdebski <[email protected]> |
| 190 |
|
| 191 |
During cleanup remove all files genared by autotools |
| 192 |
build-aux/autogen.sh: Remove test-driver during cleanup. |
| 193 |
|
| 194 |
2013-03-30 Mikołaj Izdebski <[email protected]> |
| 195 |
|
| 196 |
Fix incorrect usage of foreach() macro |
| 197 |
src/signals.c (pending): Call foreach() macro with second argument |
| 198 |
as array, not pointer to array. |
| 199 |
|
| 200 |
2013-03-28 Mikołaj Izdebski <[email protected]> |
| 201 |
|
| 202 |
Improve comments in decode.c |
| 203 |
|
| 204 |
2013-03-27 Mikołaj Izdebski <[email protected]> |
| 205 |
|
| 206 |
Don't hardcode MAX_CODE_LENGTH |
| 207 |
* src/deocde.c (make_tree): Use constant MAX_CODE_LENGTH instead of |
| 208 |
hardcoding its value. |
| 209 |
|
| 210 |
2013-03-02 Mikolaj Izdebski <[email protected]> |
| 211 |
|
| 212 |
Add release note for Debian bug 700680 |
| 213 |
|
| 214 |
Fix Debian bug 700680 |
| 215 |
src/main.c (input_init): Allow input files not to be regular files when |
| 216 |
outputting to stdout or to the bit bucket. |
| 217 |
|
| 218 |
2012-10-28 Mikolaj Izdebski <[email protected]> |
| 219 |
|
| 220 |
Document copying with -cdf |
| 221 |
|
| 222 |
Copy files only with --stdout |
| 223 |
process.c (work): Allow copying files only when output fd is stdout. |
| 224 |
|
| 225 |
Add NEWS entry for v2.3 |
| 226 |
|
| 227 |
2012-10-21 Mikolaj Izdebski <[email protected]> |
| 228 |
|
| 229 |
Assert that the first group is always coded by the first tree |
| 230 |
|
| 231 |
Fix a deadlock and enable file copying with -d -f |
| 232 |
src/process.c (copy_on_input_avail): Decrement out_slots semaphore. |
| 233 |
(copy_on_write_complete): Increment out_slots semaphore. |
| 234 |
(copy_terminate): Rename from never; raise SIGUSR2 if terminal |
| 235 |
condition is met. |
| 236 |
|
| 237 |
2012-10-20 Mikolaj Izdebski <[email protected]> |
| 238 |
|
| 239 |
Avoid shadowing auto variable |
| 240 |
|
| 241 |
Fix assertion failure, closes #8 |
| 242 |
src/encode.c (generate_initial_trees): Rewrite from scratch. |
| 243 |
|
| 244 |
2012-09-14 Mikolaj Izdebski <[email protected]> |
| 245 |
|
| 246 |
Minor comment improvements and whitespace changes |
| 247 |
|
| 248 |
2012-09-11 Mikolaj Izdebski <[email protected]> |
| 249 |
|
| 250 |
Fix dead initialization bug |
| 251 |
|
| 252 |
2012-08-06 Mikolaj Izdebski <[email protected]> |
| 253 |
|
| 254 |
Ignore --small |
| 255 |
src/main.c (main): Reset small to zero. |
| 256 |
|
| 257 |
Improve initial tree generation |
| 258 |
* src/encode.c (generate_initial_trees): During initial set |
| 259 |
paritioning round set cardinalities to the nearest instead of |
| 260 |
rounding up. This decreases standard deviation of the size of trees |
| 261 |
and thus improves compression. |
| 262 |
|
| 263 |
Add THANKS |
| 264 |
|
| 265 |
Document bugs fixed |
| 266 |
|
| 267 |
Explicitly license auxiliary programs under GPLv3+ |
| 268 |
* tests/minbzcat.c: Relicense under GPLv3+. |
| 269 |
* tests/timeout.c: Add explicit license terms. |
| 270 |
|
| 271 |
Rebase to the newest version of yambi |
| 272 |
* ALGORITHM: Fix a typo. |
| 273 |
* Makefile.am: Remove yambi subdirectory. |
| 274 |
* build-aux/autogen.sh: Implement new directory structure layout. |
| 275 |
* build-aux/make-crctab.pl: Likewise. |
| 276 |
* build-aux/style-check.pl: Likewise. |
| 277 |
* configure.ac: Lower autoconf requirement. Optimize runtime by adding |
| 278 |
gl_ASSERT_NO_GNULIB_TESTS and gl_ASSERT_NO_GNULIB_POSIXCHECK. Add |
| 279 |
new compiler warnings. Implement new option "--enable-tracing". |
| 280 |
Implement new directory structure layout. |
| 281 |
* src/Makefile.am: Import from newer version of yambi. |
| 282 |
* src/common.h: Likewise. |
| 283 |
* src/compress.c: Likewise. |
| 284 |
* src/decode.c: Likewise. |
| 285 |
* src/decode.h: Likewise. |
| 286 |
* src/divbwt.c: Likewise. |
| 287 |
* src/encode.c: Likewise. |
| 288 |
* src/encode.h: Likewise. |
| 289 |
* src/expand.c: Likewise. |
| 290 |
* src/main.c: Likewise. |
| 291 |
* src/main.h: Likewise. |
| 292 |
* src/parse.c: Likewise. |
| 293 |
* src/process.c: Likewise. |
| 294 |
* src/process.h: Likewise. |
| 295 |
* src/signals.c: Likewise. |
| 296 |
* src/signals.h: Likewise. |
| 297 |
* tests/Makefile.am: Likewise. |
| 298 |
* tests/cve2.bz2: Likewise. |
| 299 |
* src/lbunzip2.c: Remove file. |
| 300 |
* src/lbunzip2.h: Likewise. |
| 301 |
* src/lbzip2.c: Likewise. |
| 302 |
* src/lbzip2.h: Likewise. |
| 303 |
* src/pqueue.c: Likewise. |
| 304 |
* src/pqueue.h: Likewise. |
| 305 |
* yambi/Makefile.am: Likewise. |
| 306 |
* yambi/collect.c: Likewise. |
| 307 |
* yambi/decode.c: Likewise. |
| 308 |
* yambi/decode.h: Likewise. |
| 309 |
* yambi/divsufsort.c: Likewise. |
| 310 |
* yambi/emit.c: Likewise. |
| 311 |
* yambi/encode.c: Likewise. |
| 312 |
* yambi/encode.h: Likewise. |
| 313 |
* yambi/prefix.c: Likewise. |
| 314 |
* yambi/private.h: Likewise. |
| 315 |
* yambi/retrieve.c: Likewise. |
| 316 |
* yambi/transmit.c: Likewise. |
| 317 |
* yambi/yambi.h: Likewise. |
| 318 |
|
| 319 |
2012-06-23 Mikolaj Izdebski <[email protected]> |
| 320 |
|
| 321 |
Update ChangeLog |
| 322 |
|
| 323 |
Bump version to 2.2 |
| 324 |
|
| 325 |
Simplify AUTHORS file |
| 326 |
|
| 327 |
Add workaround for Debian bug #673378 |
| 328 |
* yambi/retrieve.c (YBdec_retrieve): Return YB_UNDERFLOW if in_avail is 0. |
| 329 |
This Works around dDebian bug #673378. |
| 330 |
|
| 331 |
Revert "Implement double-ended queue." |
| 332 |
* src/deque.c: Delete file. |
| 333 |
* src/deque.h: Likewise. |
| 334 |
|
| 335 |
2012-02-22 Mikołaj Izdebski <[email protected]> |
| 336 |
|
| 337 |
Implement double-ended queue. |
| 338 |
* src/deque.c: New file. |
| 339 |
* src/deque.h: New file. |
| 340 |
* src/Makefile.am: Add deque.[ch]. |
| 341 |
|
| 342 |
Make pqueue_pop() return the popped element |
| 343 |
* src/pqueue.c (pqueue_pop): Return popped element. |
| 344 |
* src/pqueue.h (pqueue_pop): Change function prototype. |
| 345 |
|
| 346 |
Don't print EPIPE and EFBIG fatal errors |
| 347 |
* src/main.c (DEF): Skip printing fatal error messages if error number |
| 348 |
is EPIPE or EFGIG. |
| 349 |
|
| 350 |
Cleanup yambi code |
| 351 |
* yambi/divsufsort.h: Delete header file. |
| 352 |
* yambi/Makefile.am: Remove reference to divsufsort.h. |
| 353 |
* yambi/divsufsort.c: Include encode.h instead of divsufsort.h. |
| 354 |
Change cyclic_divbwt() function name to YBpriv_cyclic_divbwt(). |
| 355 |
* yambi/encode.h (YBpriv_block_sort, YBpriv_sais): Remove prototypes |
| 356 |
of previously removed functions. |
| 357 |
* yambi/encode.c (YBenc_work): Replace reference to cyclic_divbwt() |
| 358 |
with YBpriv_cyclic_divbwt(). |
| 359 |
* yambi/private.h (SLong): Remove unused type definition. |
| 360 |
|
| 361 |
2012-02-21 Mikołaj Izdebski <[email protected]> |
| 362 |
|
| 363 |
Implement new error handling |
| 364 |
|
| 365 |
Fix a bug in tandem repeat sort code |
| 366 |
* yambi/divsufsort.c (trsort): Fix a bug introduced in 336008f |
| 367 |
by altering the main trsort loop invariant. Adding a pre-condition |
| 368 |
of `-n < *SA' seems to fix the issue. |
| 369 |
|
| 370 |
2012-02-16 Mikołaj Izdebski <[email protected]> |
| 371 |
|
| 372 |
Remove obsolete shallow factor |
| 373 |
* yambi/collect.c, yambi/encode.h: Get rid of shallow_factor. |
| 374 |
* yambi/yambi.h: Remove YB_DEFAULT_SHALLOW #definition. |
| 375 |
* src/lbzip2.c (work_compr): Remove YB_DEFAULT_SHALLOW |
| 376 |
|
| 377 |
2012-02-02 Mikołaj Izdebski <[email protected]> |
| 378 |
|
| 379 |
Update copyright dates |
| 380 |
|
| 381 |
Disable load0 test |
| 382 |
|
| 383 |
Add version 2.2 entry in NEWS |
| 384 |
|
| 385 |
Update references in ALGORITHM |
| 386 |
|
| 387 |
Deprecate `--exponential' |
| 388 |
* build-aux/pretty-usage.pl, man/lbzip2.1: Update `--exponential' info. |
| 389 |
* src/main.c, src/lbzip2.c, src/lbzip2.h: Drop support for exponential. |
| 390 |
|
| 391 |
2012-01-09 Mikołaj Izdebski <[email protected]> |
| 392 |
|
| 393 |
Fix undefined behavior in divsufsort |
| 394 |
* yambi/divsufsort.c (trsort): Add bounds checks before moving pointer |
| 395 |
beyond allocated space. |
| 396 |
|
| 397 |
Extend bugfix from ca8e703c |
| 398 |
* yambi/divsufsort.c: Apply patch provided by Yuta Mori. |
| 399 |
|
| 400 |
Fix a bug with sorting periodic strings |
| 401 |
yambi/divsufsort.c (tr_introsort): Add depth condition. |
| 402 |
|
| 403 |
Integrate divsufsort with yambi |
| 404 |
* yambi/collect.c, yambi/encode.h: Let mtfv[] and SA[] share space |
| 405 |
and block[] be a separate array. |
| 406 |
* yambi/encode.c: Use divsufsort instead of old blocksort code. |
| 407 |
|
| 408 |
Adjust divsufsort to yambi |
| 409 |
* yambi/divsufsort.c: Remove include guardians. Define sauchar_t, |
| 410 |
saint_t and saidx_t in terms of <inttypes.h>. Remove __inline. |
| 411 |
(MAX): Remove unused macro. (construct_SA): Remove unused function. |
| 412 |
(construct_BWT): Remove unused parameter `m'. (cyclic_divsufsort): |
| 413 |
Remove unused function. (cyclic_divbwt): Write resulting BWT |
| 414 |
transform to SA[] instead of separate output array. Replace malloc() |
| 415 |
with xmalloc(). Optimize code for case with no B* suffixes. |
| 416 |
* yambi/divsufsort.h: Remove C++ code. Remove unused prototype. |
| 417 |
|
| 418 |
Import code from cyclic-divsufsort-lite |
| 419 |
yambi/divsufsort.c, yambi/divsufsort.h: New files. |
| 420 |
|
| 421 |
Remove existing block-sorting code |
| 422 |
yambi/blocksort.c, yambi/sais.c: Remove files. |
| 423 |
|
| 424 |
2012-01-07 Mikołaj Izdebski <[email protected]> |
| 425 |
|
| 426 |
Integrate new block-sorting code with yambi |
| 427 |
yambi/collect.c: Share block[] and mtfv[] space for better cache |
| 428 |
perfoemance and lower memory usage. |
| 429 |
yambi/encode.c: Read BWT characters from bwt[] and not block[]. |
| 430 |
yambi/encode.h: Add YBpriv_sais() prototype. Add bwt field to YBenc_s. |
| 431 |
yambi/private.h: Implement peekb() and pokeb() macros. |
| 432 |
build-aux/style-check.pl, yambi/Makefile.am: Mention yambi/sais.c. |
| 433 |
|
| 434 |
Refactor block-sorting code |
| 435 |
yambi/blocksort.c: Refactor quicksort and bucket sort code for better |
| 436 |
readability. Remove BPR code. Remove code copyrighted by Juliad Seward |
| 437 |
and the corresponding license block. |
| 438 |
|
| 439 |
Import cyclic-sais |
| 440 |
yambi/sais.c: Import from cyclic-sais 1.0 by Yuta Mori. |
| 441 |
|
| 442 |
2011-12-25 Mikolaj Izdebski <[email protected]> |
| 443 |
|
| 444 |
Remove unused constants |
| 445 |
* src/lbunzip2.c: Remove magic_mask and magic_hdr definitions. |
| 446 |
|
| 447 |
Remove unused constant definition |
| 448 |
* yambi/yambi.h: Remove YB_CANCELED macro definition. |
| 449 |
|
| 450 |
2011-12-23 Mikolaj Izdebski <[email protected]> |
| 451 |
|
| 452 |
Import new test case -- load0 |
| 453 |
* tests/load0.bz2: Initial version. |
| 454 |
* tests/Makefile.am: Add load0.bz2 as a new test. |
| 455 |
|
| 456 |
Limit time and memory usage during tests |
| 457 |
* tests/timeout.c: Initial version. |
| 458 |
* tests/Makefile.am: Build timeout from timeout.c. |
| 459 |
* tests/Tester: Try limiting virtual memory usage with `ulimit -v'. |
| 460 |
Run decompresion subprocesses with alarm set to 1 minute. |
| 461 |
|
| 462 |
Make minbzcat be more compatible with bzip2 |
| 463 |
* tests/minbzcat.c (main): Count block size digit as part of stream |
| 464 |
header. Fixes #3. |
| 465 |
|
| 466 |
Add check for fatal signals in tester |
| 467 |
* tests/Tester: Add checks for subprocess exit codes >= 128. All tests |
| 468 |
in which either lbzip2 or minbzcat exited because of unhandled signals |
| 469 |
are treated as failed. |
| 470 |
|
| 471 |
2011-12-04 Mikołaj Izdebski <[email protected]> |
| 472 |
|
| 473 |
Add two more test cases. |
| 474 |
* tests/incomp: Initial version. |
| 475 |
* tests/incomp-1.bz2, tests/incomp-2.bz2: Generate using tests/incomp. |
| 476 |
* tests/README: Update to mention incomp-[12].bz2. |
| 477 |
* tests/Makefile.am: Add the new test cases. |
| 478 |
|
| 479 |
Fix bug #5 |
| 480 |
* src/lbunzip2.c (work_decompr): Assign w2w_blk->bs100k |
| 481 |
to w2m_blk->bs100k only if YB_OK == ybret. Fixes: #5. This bug caused |
| 482 |
files with input blocks larger than 1 MiB to be rejected by lbunzip2. |
| 483 |
* tests/ch255.bz2: Add as a regression test for bug #5. |
| 484 |
* tests/Makefile.am: Re-enable crc1.bz2, add ch255.bz2. |
| 485 |
|
| 486 |
Workaround bug #5 |
| 487 |
* src/lbunzip2.c (mux): Disable stream CRC check. Fixes #5. |
| 488 |
* tests/Makefile.am: Exclude crc1.bz2 from test cases. |
| 489 |
|
| 490 |
2011-11-24 Mikołaj Izdebski <[email protected]> |
| 491 |
|
| 492 |
Get rid of AM_MAINTAINER_MODE |
| 493 |
* configure.ac: Remove AM_MAINTAINER_MODE, which was included by |
| 494 |
accident. |
| 495 |
|
| 496 |
2011-11-23 Mikołaj Izdebski <[email protected]> |
| 497 |
|
| 498 |
Bump version to 2.1 |
| 499 |
|
| 500 |
Fix a use-after-free vulnerability in lbunzip2 |
| 501 |
* src/lbunzip2.c (work_retrieve.c): Move access to s2w_blk before |
| 502 |
work_release() call. Fixes #4. |
| 503 |
|
| 504 |
2011-11-11 Mikołaj Izdebski <[email protected]> |
| 505 |
|
| 506 |
Fix build error on OpenBSD 5.0 |
| 507 |
* src/main.c (opts_setup): Use _SC_THREAD_THREADS_MAX conditionally. |
| 508 |
|
| 509 |
2011-11-05 Mikołaj Izdebski <[email protected]> |
| 510 |
|
| 511 |
Update autogen.sh to remove gitlog-to-changelog |
| 512 |
* build-aux/autogen.sh: Remove gitlog-to-changelog with -r option. |
| 513 |
|
| 514 |
2011-11-02 Mikołaj Izdebski <[email protected]> |
| 515 |
|
| 516 |
Update and improve documentation |
| 517 |
* README: Add Laszlo Ersek's copyright notice. |
| 518 |
* yambi/blocksort.c: Add example Manber-Myers algorithm implementation. |
| 519 |
|
| 520 |
2011-10-31 Mikołaj Izdebski <[email protected]> |
| 521 |
|
| 522 |
Include ChangeLog.old in tarball |
| 523 |
* Makefile.am: Add ChangeLog.old to EXTRA_DIST. |
| 524 |
|
| 525 |
Create changelogs |
| 526 |
* build-aux/autogen.sh: Add gitlog-to-changelog Gnulib module. |
| 527 |
* ChangeLog.old: Import from v0.23. |
| 528 |
* ChangeLog: Generate with build-aux/gitlog-to-changelog. |
| 529 |
|
| 530 |
2011-10-30 Mikołaj Izdebski <[email protected]> |
| 531 |
|
| 532 |
Minor documentation cleanup |
| 533 |
|
| 534 |
Add BOOTSTRAP |
| 535 |
|
| 536 |
Add filenames and short desc to license blocks |
| 537 |
|
| 538 |
Run automated spelling check |
| 539 |
|
| 540 |
Make tests/Tester more portable |
| 541 |
|
| 542 |
2011-10-29 Mikołaj Izdebski <[email protected]> |
| 543 |
|
| 544 |
Make install and uninstall targets work |
| 545 |
|
| 546 |
Add list of subdirs to README |
| 547 |
|
| 548 |
Extend AUTHORS |
| 549 |
|
| 550 |
Import ALGORITHM |
| 551 |
|
| 552 |
Add a minimal README |
| 553 |
|
| 554 |
Cleanup manpage |
| 555 |
|
| 556 |
2011-10-28 Mikołaj Izdebski <[email protected]> |
| 557 |
|
| 558 |
Add scantab.h to noinst_HEADERS |
| 559 |
|
| 560 |
2011-10-27 Mikołaj Izdebski <[email protected]> |
| 561 |
|
| 562 |
Minor code cleanups to avoid gcc warnings |
| 563 |
* Add extra braces in generated scantab.h |
| 564 |
* Add __attribute__((printf, ...)) to log_fatal() |
| 565 |
* Add extra switch case in lbunzip2 parser |
| 566 |
|
| 567 |
Make file sizes unsigned integers (uintmax_t) |
| 568 |
|
| 569 |
Remove SETX from lbunzip2 |
| 570 |
|
| 571 |
2011-10-23 Mikołaj Izdebski <[email protected]> |
| 572 |
|
| 573 |
Fix Tester to support VPATH builds |
| 574 |
|
| 575 |
Display progress info during decompression |
| 576 |
|
| 577 |
Improve error messages in lbunzip2 muxer |
| 578 |
|
| 579 |
Move progress info printing code to main.c |
| 580 |
|
| 581 |
Fix a bug that prevented VPATH build from working |
| 582 |
|
| 583 |
Reimplement lbunzip2 magic pattern scanner as DFA |
| 584 |
|
| 585 |
2011-10-22 Mikołaj Izdebski <[email protected]> |
| 586 |
|
| 587 |
Cleanup and improve lbunzip2 header parser |
| 588 |
Improvements implemented: |
| 589 |
* block overruns are detected (fixes `overrun.bz2') |
| 590 |
* stream CRCs are computed and checked (fixes `crc1.bz2') |
| 591 |
* initial stream headers are parsed (fixes `trash.bz2' and `void.bz2') |
| 592 |
* files with gaps between streams are rejected (fixes `gap.bz2') |
| 593 |
* minor speed enchancements |
| 594 |
|
| 595 |
NEWS were updated to reflect recent improvements. |
| 596 |
|
| 597 |
2011-10-22 Mikołaj Izdebski <[email protected]> |
| 598 |
|
| 599 |
Implement initial header parser for lbunzip2 |
| 600 |
Partly fixes `gap.bz2' bug. For now the parser isn't detecting |
| 601 |
parse errors and parsing results (CRC and bs100k) are unused. |
| 602 |
|
| 603 |
Reorder scanner code in lbunzip2.c |
| 604 |
|
| 605 |
Pad lbunzip2 input blocks to multiple of 32 bits |
| 606 |
|
| 607 |
2011-10-20 Mikołaj Izdebski <[email protected]> |
| 608 |
|
| 609 |
Add more files to EXTRA_DIST |
| 610 |
Fix a typo in style-check.pl naming. |
| 611 |
|
| 612 |
2011-10-18 Mikołaj Izdebski <[email protected]> |
| 613 |
|
| 614 |
Fix a minor bug in autogen.sh |
| 615 |
|
| 616 |
2011-10-17 Mikołaj Izdebski <[email protected]> |
| 617 |
|
| 618 |
Reimplement BPR algorithm |
| 619 |
|
| 620 |
2011-10-13 Mikołaj Izdebski <[email protected]> |
| 621 |
|
| 622 |
Improve comments in blocksort.c, prefix.c and retrieve.c |
| 623 |
|
| 624 |
2011-10-08 Laszlo Ersek <[email protected]> |
| 625 |
|
| 626 |
trivial typo fix in man page |
| 627 |
|
| 628 |
2011-10-07 Mikołaj Izdebski <[email protected]> |
| 629 |
|
| 630 |
Fix -Wno-unknown-warning-option |
| 631 |
|
| 632 |
Narrow usage text width to 79 characters |
| 633 |
|
| 634 |
Add missing _Noreturn attributes |
| 635 |
|
| 636 |
Add -Wno-unknown-warning-option for clang |
| 637 |
|
| 638 |
Remove Trace() macros |
| 639 |
|
| 640 |
Turn off warnings about unreachable code |
| 641 |
|
| 642 |
Link lbunzip2 and lbzcat manpages to lbzip2 |
| 643 |
|
| 644 |
Use uintmax_t for block identifiers |
| 645 |
|
| 646 |
Import a newer version of minbzcat |
| 647 |
|
| 648 |
2011-10-04 Mikołaj Izdebski <[email protected]> |
| 649 |
|
| 650 |
Unset LBZIP2 et al. in tests/Tester |
| 651 |
|
| 652 |
Import and extend lbzip2 manpage |
| 653 |
|
| 654 |
2011-09-27 Mikołaj Izdebski <[email protected]> |
| 655 |
|
| 656 |
Print version and usage info on stdout, not stderr |
| 657 |
Add build-aux/pretty-usage.pl to help maintaining usage message. |
| 658 |
|
| 659 |
2011-09-23 Mikołaj Izdebski <[email protected]> |
| 660 |
|
| 661 |
autogen.sh: set IFS to space-tab-newline |
| 662 |
|
| 663 |
Add make-crctab.pl |
| 664 |
|
| 665 |
Style fixups based on style-check.pl report |
| 666 |
|
| 667 |
Add build-aux/style-check.pl |
| 668 |
|
| 669 |
2011-09-22 Mikołaj Izdebski <[email protected]> |
| 670 |
|
| 671 |
Move autogen.sh to build-aux/ |
| 672 |
|
| 673 |
Fix a bug with displaying an error message |
| 674 |
|
| 675 |
2011-09-20 Mikołaj Izdebski <[email protected]> |
| 676 |
|
| 677 |
Fix a typo in tests/cve.c |
| 678 |
A typo in tests/cve.c caused tests/cve.bz2 to be invalid. Update both. |
| 679 |
|
| 680 |
2011-09-19 Mikołaj Izdebski <[email protected]> |
| 681 |
|
| 682 |
minbzcat: add checks for Kraft's inequality |
| 683 |
|
| 684 |
Fix a typo in yambi/Makefile.am |
| 685 |
|
| 686 |
Write initial NEWS |
| 687 |
|
| 688 |
Import basic test cases |
| 689 |
|
| 690 |
Add noinst_HEADERS in src and yambi subdirs |
| 691 |
|
| 692 |
2011-09-14 Mikołaj Izdebski <[email protected]> |
| 693 |
|
| 694 |
Replace AC_SYS_LARGEFILE with largefile Gnulib module |
| 695 |
Downgrade to autoconf 2.67 to ease development on Debian stable. |
| 696 |
Import realloc-gnu module. Remove redundant checks from configure.ac. |
| 697 |
|
| 698 |
2011-09-12 Mikołaj Izdebski <[email protected]> |
| 699 |
|
| 700 |
Rename the project back to lbzip2 |
| 701 |
|
| 702 |
2011-09-11 Mikołaj Izdebski <[email protected]> |
| 703 |
|
| 704 |
In lbunzip2 initialise `scan' with all ones, not all zeros |
| 705 |
This decreases probability of finding false-positives when looking |
| 706 |
for the magic bit pattern. |
| 707 |
|
| 708 |
Remove split_chkstart() |
| 709 |
Upcoming stream parser obsoletes split_chkstart(). |
| 710 |
|
| 711 |
Prioritize decompressing earlier blocks |
| 712 |
Decompress retrieved blocks basing on their position within the |
| 713 |
stream, not FCFS. |
| 714 |
|
| 715 |
Replace lacos_rbtree with pqueue |
| 716 |
|
| 717 |
Fix a bug related to htonl() usage |
| 718 |
|
| 719 |
Drop fupport for LBZIP2_TRACE_ALLOC |
| 720 |
Replace home-made xalloc() with xmalloc() provided by Gnulib. |
| 721 |
|
| 722 |
Disable compiler warnings about aggregate return |
| 723 |
|
| 724 |
2011-09-10 Mikołaj Izdebski <[email protected]> |
| 725 |
|
| 726 |
Reduce memory usage during decompression |
| 727 |
|
| 728 |
2011-09-09 Mikołaj Izdebski <[email protected]> |
| 729 |
|
| 730 |
Remove emacs file variables |
| 731 |
|
| 732 |
Add missing copyright notices |
| 733 |
|
| 734 |
Implement smarter scanner in lbunzip2 |
| 735 |
Redesign yambi's retrieve pass. Remove IBS structure and related |
| 736 |
functions from yambi API. Perform yambi's retrieve pass directly |
| 737 |
during lbunzip2's scan pass and not during decompress pass. |
| 738 |
|
| 739 |
2011-09-07 Mikołaj Izdebski <[email protected]> |
| 740 |
|
| 741 |
Read 32 bits at time in lbunzip2 |
| 742 |
|
| 743 |
Add #include <sys/types.h> for size_t |
| 744 |
Include sys/types.h instead of stddef.h for size_t. |
| 745 |
|
| 746 |
Guard config.h inclusions |
| 747 |
Surround #include <config.h> with #ifdef HAVE_CONFIG_H. |
| 748 |
|
| 749 |
Make use of SIZE_MAX |
| 750 |
Replace (size_t)-1 with SIZE_MAX. |
| 751 |
|
| 752 |
Improve configure.ac |
| 753 |
|
| 754 |
Added -r option to autogen.sh |
| 755 |
|
| 756 |
Delete corr-perf.sh, malloc_trace.pl and test.sh |
| 757 |
|
| 758 |
Optimize lbunzip2 state machine |
| 759 |
|
| 760 |
2011-08-28 Mikołaj Izdebski <[email protected]> |
| 761 |
|
| 762 |
Restore atime and mtime with nanosec accuracy |
| 763 |
|
| 764 |
Convert gettimeofday() calls to gettime() |
| 765 |
|
| 766 |
Don't display file name with progress info |
| 767 |
|
| 768 |
2011-08-26 Mikołaj Izdebski <[email protected]> |
| 769 |
|
| 770 |
Add a configure switch to enable warnings |
| 771 |
|
| 772 |
2011-08-25 Mikołaj Izdebski <[email protected]> |
| 773 |
|
| 774 |
Rename to bzimp2 |
| 775 |
Update externally visible names to bzimp2. Remove man page. |
| 776 |
Split usage and version printing options. |
| 777 |
|
| 778 |
Fix GCC compatibility bugs |
| 779 |
|
| 780 |
2011-08-23 Mikołaj Izdebski <[email protected]> |
| 781 |
|
| 782 |
Remove .cvsignore |
| 783 |
|
| 784 |
Add more checks to configure.ac |
| 785 |
|
| 786 |
2011-08-20 Mikołaj Izdebski <[email protected]> |
| 787 |
|
| 788 |
Include <config.h> in all source files |
| 789 |
|
| 790 |
Replace utime() with fdutimens() |
| 791 |
|
| 792 |
Create autogen.sh |
| 793 |
|
| 794 |
Migrate to GNU build system |
| 795 |
Move lbzip2 source files to "src" subdirectory. Remove Makefiles. |
| 796 |
Create initial "configure.ac" and "Makefile.am" files. |
| 797 |
|
| 798 |
2011-08-19 Mikołaj Izdebski <[email protected]> |
| 799 |
|
| 800 |
Display progress info during compression |
| 801 |
|
| 802 |
Display compression ratio in verbose mode |
| 803 |
|
| 804 |
2011-08-16 Mikołaj Izdebski <[email protected]> |
| 805 |
|
| 806 |
Remove redundant includes |
| 807 |
|
| 808 |
2011-08-15 Mikołaj Izdebski <[email protected]> |
| 809 |
|
| 810 |
Fix a compatibility bug |
| 811 |
|
| 812 |
2011-08-14 Mikołaj Izdebski <[email protected]> |
| 813 |
|
| 814 |
Add support for decompressing randomized blocks |
| 815 |
|
| 816 |
2011-08-13 Mikołaj Izdebski <[email protected]> |
| 817 |
|
| 818 |
Minor comments and code cleanup |
| 819 |
Add more coments on prefix code decoding. Remove a potential |
| 820 |
incompatibility with platforms that don't use U2 encoding for signed |
| 821 |
integers. Remove unused auto variables. Replace loops zeroing bigger |
| 822 |
arrays with calls to bzero(). |
| 823 |
|
| 824 |
2011-08-12 Mikołaj Izdebski <[email protected]> |
| 825 |
|
| 826 |
Minor formatting cleanup |
| 827 |
|
| 828 |
Eliminate SIZES() macro |
| 829 |
Get rid of SIZES() to simplify the code. |
| 830 |
|
| 831 |
Introduce xread() and xwrite() |
| 832 |
Generalize existing I/O code and create xread() and xwrite() to ease |
| 833 |
maintaintenance. Pack "fd", "sep" and "fmt" into struct filespec |
| 834 |
to emphasise their close relationship and simplify the code. |
| 835 |
|
| 836 |
2011-08-11 Mikołaj Izdebski <[email protected]> |
| 837 |
|
| 838 |
Clean up the code |
| 839 |
Minor code cleanups: |
| 840 |
* move nested function declaration to global scope, |
| 841 |
* convert K&R function definitions to ANSI, |
| 842 |
* move common macros to header file, |
| 843 |
* remove unused auto variables, |
| 844 |
* make pointer casts not strip the const qualifier, |
| 845 |
* change some variable types between signed and unsigned, |
| 846 |
* add missing copyright notices, |
| 847 |
* correct intentation in lbzip2.c, |
| 848 |
* remove white spaces from end of lines, |
| 849 |
* replace tabs by spaces (except from Makefiles). |
| 850 |
|
| 851 |
Improve compression performance |
| 852 |
The main block sorting algorithm is reworked to behave better |
| 853 |
in average case while remaining fast enough in the worst case. |
| 854 |
|
| 855 |
2011-08-09 Mikołaj Izdebski <[email protected]> |
| 856 |
|
| 857 |
Make decompression error messages more datailed |
| 858 |
Implement Yberr_detail() -- a function returning a textual |
| 859 |
representation of decompression error codes. Make use of |
| 860 |
Yberr_detail() in lbunzip2.c. |
| 861 |
|
| 862 |
2011-07-30 Mikołaj Izdebski <[email protected]> |
| 863 |
|
| 864 |
Fix a buffer overflow in yambi decompression code |
| 865 |
Fix a security vulnerability. A specially crafted compressed file |
| 866 |
could potentially cause a buffer overflow in YBibs_retrieve. |
| 867 |
|
| 868 |
Some minor optimizations and cleanups: |
| 869 |
* utilize htonl() and nothl() for (hopefully) faster memory access |
| 870 |
* remove outdated code that wasn't used anyways |
| 871 |
* change default values of some yambi tuning parameters |
| 872 |
* reorder some struct members; move bigger arrays to the end |
| 873 |
* remove some automatic variables to reduce register pollution |
| 874 |
|
| 875 |
2011-07-30 Mikołaj Izdebski <[email protected]> |
| 876 |
|
| 877 |
Fix a bug in sorting algorithm implementation |
| 878 |
Fix a bug in main sorting algorithm implementation. |
| 879 |
|
| 880 |
Fix two different bugs |
| 881 |
Fix a bug in decompression code that was caused by a typo. |
| 882 |
Fix a compatibility issue in yambi/private.h. |
| 883 |
|
| 884 |
2011-07-29 Mikołaj Izdebski <[email protected]> |
| 885 |
|
| 886 |
Fix a bug in lbzip2 compresion code |
| 887 |
This commit fixes a bug that was introduced in the previous commit. |
| 888 |
|
| 889 |
Minor enchancements: |
| 890 |
* implement --exponential command line switch with the same semantics |
| 891 |
as bzip2's equivalent |
| 892 |
* reduce average-case memory consumption in compression mode |
| 893 |
by about 3.5 MB per worker |
| 894 |
|
| 895 |
Minor cleanups: |
| 896 |
* remove unused code |
| 897 |
* remove whitespaces from end of source code lines |
| 898 |
* replace some tabs with spaces |
| 899 |
* correct line indentation |
| 900 |
* remove bogus __builtin_prefetch'es |
| 901 |
* remove GPLv2 as now the code in under GPLv3+ only |
| 902 |
* remove README as it doesn't reflect current code |
| 903 |
* remove ChangeLog as it was obsoleted by migration to git |
| 904 |
|
| 905 |
2011-07-28 Mikołaj Izdebski <[email protected]> |
| 906 |
|
| 907 |
Import a newer version of yambi |
| 908 |
Import a newer version of yambi, which contains compression code. |
| 909 |
Remove libbz2 compatibility layer from yambi. Modify lbzip2 and lbunzip2 |
| 910 |
so that they use yambi's API directly, without the compatibility layer. |
| 911 |
Update Makefiles. Remove dependency on libbz2. |
| 912 |
|
| 913 |
Remove lbunzip2_single |
| 914 |
Remove lbunzip2_single, as upcoming sequential decompressor is |
| 915 |
obsoleting it. |
| 916 |
|
| 917 |
2011-07-26 Laszlo Ersek <[email protected]> |
| 918 |
|
| 919 |
base decompression on newly imported yambi |
| 920 |
Import yambi. Adapt Makefiles and decompression modules. |
| 921 |
|
| 922 |
import lbzip2-0.23 |