| 1 |
Revision history for Perl extension Text::Ngrams. |
| 2 |
|
| 3 |
0.01 Wed Jun 4 20:52:49 ADT 2003 |
| 4 |
- initial version, ported from code from 2000 |
| 5 |
|
| 6 |
0.02 Fri Jun 6 16:00:00 ADT 2003 |
| 7 |
- fixed installation of ngrams.pl man page |
| 8 |
|
| 9 |
0.03 Mon Jun 9 07:05:00 ADT 2003 |
| 10 |
- fixed test cases 3, 5, and 7 (problems found thanks to |
| 11 |
cpan-testers, Josts Smokehouse) |
| 12 |
|
| 13 |
0.04 Jun 11 2003 |
| 14 |
- added parameter 'limit' to new |
| 15 |
- added non-ordered print |
| 16 |
- added parameter 'onlyfirst' to print |
| 17 |
|
| 18 |
0.05 Wed Sep 3 13:00:43 ADT 2003 |
| 19 |
- fixed README |
| 20 |
|
| 21 |
1.0 Thu Dec 18 13:09:45 AST 2003 |
| 22 |
- added parameter 'normalize' to ngrams.pl and to_string |
| 23 |
method in Ngrams.pm |
| 24 |
|
| 25 |
1.1 Sat May 29 16:15:34 ADT 2004 |
| 26 |
- corrected typo submitted by Shlomo Yona |
| 27 |
|
| 28 |
1.2 Thu Jul 29 15:05:28 ADT 2004 |
| 29 |
- documentation improvement |
| 30 |
- introduced first and last n-gram in the output |
| 31 |
- made _reduce_to_limit more efficient (--limit parameter) |
| 32 |
thanks to observations by David Allen |
| 33 |
|
| 34 |
1.3 Mon Nov 1 12:52:02 AST 2004 |
| 35 |
- Improved for multi-line token processing |
| 36 |
- resolved efficiency issue with binary file (not reading line |
| 37 |
by line any more) |
| 38 |
- introduced parameters skipinsert and allow_iproc |
| 39 |
- thanks to Andrija Tomovic, Roger Zhang for suggestions |
| 40 |
|
| 41 |
1.4 Wed Nov 3 08:45:27 AST 2004 |
| 42 |
- Fixed minor testing bugs, a warning |
| 43 |
|
| 44 |
1.5 Wed Nov 3 14:04:30 AST 2004 |
| 45 |
- minor testing bug (rounding error) |
| 46 |
|
| 47 |
1.6 Thu Dec 2 23:00:42 AST 2004 |
| 48 |
- added utf8 type n-grams |
| 49 |
|
| 50 |
1.7 Wed Dec 8 11:01:07 AST 2004 |
| 51 |
- fixed a documentation typo (thanks to Kevin J. Ziese) |
| 52 |
- solving "our deprecated" warning |
| 53 |
|
| 54 |
1.8 Thu Dec 15 11:45:38 AST 2005 |
| 55 |
- debuging |
| 56 |
- introduced spartan option in to_string |
| 57 |
- function get_ngrams added |
| 58 |
- changed output format to include space between tokens |
| 59 |
(no token separator) |
| 60 |
|
| 61 |
1.9 Mon Nov 6 07:20:42 AST 2006 |
| 62 |
- bug fixed in get_ngrams |
| 63 |
- added option spartan to script ngrams.pl |
| 64 |
|
| 65 |
2.001 Sat Oct 25 00:10:40 ADT 2008 |
| 66 |
- fixed bug in to_string for writing to a file with given name |
| 67 |
|
| 68 |
2.002 Sat Oct 25 09:31:17 ADT 2008 |
| 69 |
- Improved documentation. |
| 70 |
- changed perl to $^X in test 06, which may cause problems |
| 71 |
with testing |
| 72 |
|
| 73 |
2.003 Wed Dec 12 23:38:15 AST 2012 |
| 74 |
- minor code improvements |
| 75 |
- documentation and report improvements |
| 76 |
- testing improvement: added 14.t |
| 77 |
- introduced n-grams type utf8_character, |
| 78 |
thanks to Magdalena Jankowska |
| 79 |
- a bug fix thanks to Magdalena Jankowska |
| 80 |
|
| 81 |
2.004 Sun Feb 17 11:28:22 AST 2013 |
| 82 |
- documentation improvements |
| 83 |
|
| 84 |
2.005 Wed Feb 8 12:49:17 AST 2017 |
| 85 |
- when sorted by frequency, introducing secondary |
| 86 |
lexicographic sorting |
| 87 |
- documentation improvements |
| 88 |
- removed $Revision variable |
| 89 |
|
| 90 |
2.006 Sun Feb 12 11:15:29 AST 2017 |
| 91 |
- fixed that files are always read in binary mode (for |
| 92 |
text/binary distinguishing systems) |