Debian Codegraph @

NEWS

raw
1 GNU Wget NEWS -- history of user-visible changes.
2
3 * Noteworthy changes in release 1.25.0 (2024-11-10) [stable]
4
5 ** [Breaking change] Drop support for shorthand FTP URLs (CVE-2024-10524)
6
7 ** [Breaking change] Switch to continuous reading from stdin pipes
8
9 ** Reimplement user-info parsing based on RFC 2396
10
11 ** Fix a build issue with libproxy and --disable-debug
12
13
14
15 * Noteworthy changes in release 1.24.5 (2024-03-10) [stable]
16
17 ** Fix how subdomain matches are checked for HSTS.
18 Fixes a minor issue where cookies may be leaked to the wrong domain
19
20 ** Wget will now also parse the srcset attribute in <source> HTML tags
21
22 ** Support reading fetchmail style "user" and "passwd" fields from netrc
23
24 ** In some cases, prevent the confusing "Cannot write to... (success)" error messages
25
26 ** Support extremely fast download speeds (TB/s).
27 Previously this would cause Wget to crash when printing the speed
28
29 ** Improve portability on OpenBSD to run the test suite
30
31 ** Ensure that CSS URLs are corectly quoted (Bug: 64082)
32
33
34 * Noteworthy changes in release 1.21.4 (2023-05-11)
35
36 ** Document --retry-on-host-error in help text
37
38 ** Increase read buffer size to 64k. This should speed up downloads on gigabit and faster connections
39
40 ** Update deprecated option '--html-extension' to '--adjust-extension' in documentation
41
42 ** Update gnulib compatibility layer.
43 Fixes HSTS test failures on i686. (Thanks to Andreas Enge for ponting it out)
44
45
46 * Noteworthy changes in release 1.21.3 (2022-02-26)
47
48 ** Fix computation of total bytes downloaded during FTP trasnfers (#61277)
49
50 ** Add option to select TLS 1.3 on the command line
51
52 ** Fix HSTS build issues on some 64-bit big-endian systems
53
54 ** Hide password during status report in --no-verbose
55
56 ** Remove a sprurious print statement that showed up even during --quiet
57
58 ** Some more cleanups and bug-fixes
59
60
61 * Noteworthy changes in release 1.21.2 (2021-09-07)
62
63 ** Support for autoconf 2.71
64
65 ** Fix a double free in FTP when using an absolute path
66
67 ** Release tarballs no longer have a dependency on Python.
68
69 ** --page-requisites will now also download links marked as "alternate
70 stylesheet" or "icon"
71
72
73 * Noteworthy changes in release 1.21.1 (2021-01-09)
74
75 ** Fix compilation on MacOS and Solaris 9
76
77 ** Resove bashism from configure.ac
78
79 ** Fix a compilation warning on 32-bit systems
80
81
82 * Changes in Wget 1.21
83
84 ** Improve the number of translated strings
85
86 ** Remove all uses of alloca
87 In some places the length of untrusted strings has been used, e.g.
88 strings from the command line or from remote.
89
90 ** Fix buffer overflows in progress bar code in some locales
91
92 ** Fix two null pointer accesses
93
94 ** Amend cookie file header to be recognized by the 'file' command
95
96 ** Post Handshake Authentication for OpenSSL
97
98 ** Require gettext version 0.19.3+
99
100 ** Add configure flags --enable-fsanitize-ubsan, --enable-fsanitize-asan
101 and --enable-fsanitize-msan for gcc and clang
102
103 ** Make several smaller fixes, enhance fuzzing, enhance building
104
105
106 * Changes in Wget 1.20.3
107
108 ** Fixed a buffer overflow vulnerability
109
110
111 * Changes in Wget 1.20.2
112
113 ** NTLM authentication will retry under certain cases
114
115
116 * Changes in Wget 1.20.1
117
118 ** --xattr is no longer default since it introduces privacy issues.
119
120 ** --xattr saves the Referer as scheme/host/port, user/pw/path/query/fragment
121 are no longer saved to prevent privacy issues.
122
123 ** --xattr saves the Original URL without user/password to prevent
124 privacy issues.
125
126
127 * Changes in Wget 1.20
128
129 ** Add new option `--retry-on-host-error` to treat local errors as transient
130 and hence Wget will retry to download the file after a brief waiting period.
131
132 ** Fixed multiple potential resource leaks as found by static analysis
133
134 ** Wget will now not create an empty wget-log file when running with -q and -b
135 switches together
136
137 ** When compiled using the GnuTLS >= 3.6.3, Wget now has support for TLSv1.3
138
139 ** Now there is support for using libpcre2 for regex pattern matching
140
141 ** When downloading over FTP recursively, one can now use the
142 --{accept,reject}-regex switches to fine-tune the downloaded files
143
144 ** Building Wget from the git sources now requires autoconf 2.63 or above.
145 Building from the Tarballs works as it used to.
146
147
148 * Changes in Wget 1.19.5
149
150 * Fix cookie injection (CVE-2018-0494)
151
152 * Enable TLS1.3 with recent OpenSSL environment
153
154 * New option --ciphers to set GnuTLS / OpenSSL ciphers directly
155
156 * Updated CSS grammar to CSS 2.2
157
158 * Fixed several memleaks found by OSS-Fuzz
159
160 * Fixed several buffer overflows found by OSS-Fuzz
161
162 * Fixed several integer overflows found by OSS-Fuzz
163
164 * Several minor bug fixes
165
166
167 * Changes in Wget 1.19.4
168
169 * A major bug that caused GZip'ed pages to never be decompressed has been fixed
170
171 * Support for Content-Encoding and Transfer-Encoding have been marked as
172 experimental and disabled by default
173
174
175 * Changes in Wget 1.19.3
176
177 * Prevent erroneous decompression of .gz and .tgz files with broken servers
178
179 * Added support for HTTP 308 Permanent Redirect response
180
181 * Fix a segfault in some cases where the Content-Type header is not sent
182
183 * Support OpenSSL 1.1 builds without using deprecated features
184
185 * Fix netrc file detection on Windows
186
187 * Several minor bug fixes
188
189
190 * Changes in Wget 1.19.2
191
192 * Fix CVE-2017-13089 (Stack overflow in HTTP protocol handling)
193
194 * Fix CVE-2017-13090 (Heap overflow in HTTP protocol handling)
195
196 * New option --compression for gzip Content-Encoding
197
198 * New option --[no]-netrc to control .netrc parsing
199
200 * Added GNU extensions to .netrc parsing
201
202 * Improved IDNA 2003 compatibility
203
204 * Fix VPATH issues
205
206 * Improved and extended the test suite
207
208 * Support Wayback Machine's X-Archive-Orig-last-modified
209
210 * Several bug fixes
211
212
213 * Changes in Wget 1.19.1
214
215 * Fix bugs, a regression, portability/build issues
216
217 * Add new option --retry-on-http-error
218
219
220 * Changes in Wget 1.19
221
222 * New option --use-askpass=COMMAND. Fetch user/password by calling
223 an external program.
224
225 * Use IDNA2008 (+ TR46 if available) through libidn2
226
227 * When processing a Metalink header, --metalink-index=<number> allows
228 to process the header's application/metalink4+xml files.
229
230 * When processing a Metalink file, --trust-server-names enables the
231 use of the destination file names specified in the Metalink file,
232 otherwise a safe destination file name is computed.
233
234 * When processing a Metalink file, enforce a safe destination path.
235 Remove any drive letter prefix under w32, i.e. 'C:D:file'. Call
236 libmetalink's metalink_check_safe_path() to prevent absolute,
237 relative, or home paths:
238 https://tools.ietf.org/html/rfc5854#section-4.1.2.1
239 https://tools.ietf.org/html/rfc5854#section-4.2.8.3
240
241 * When processing a Metalink file, --directory-prefix=<prefix> sets
242 the top of the retrieval tree to prefix for Metalink downloads.
243
244 * When processing a Metalink file, reject downloaded files which don't
245 agree with their own metalink:size value:
246 https://tools.ietf.org/html/rfc5854#section-4.2.16
247
248 * When processing a Metalink file, with --continue resume partially
249 downloaded files and keep fully downloaded files even if they fail
250 the verification.
251
252 * When processing a Metalink file, create the parent directories of a
253 "path/file" destination file name:
254 https://tools.ietf.org/html/rfc5854#section-4.1.2.1
255 https://tools.ietf.org/html/rfc5854#section-4.2.8.3
256
257 * On a recursive download, append a .tmp suffix to temporary files
258 that will be deleted after being parsed, and create them
259 readable/writable only by the owner.
260
261 * New make target 'check-valgrind'
262
263 * Fix several bugs
264
265 * Fix compatibility issues
266
267 * Changes in Wget 1.18
268
269 * By default, on server redirects to a FTP resource, use the original
270 URL to get the local file name. Close CVE-2016-4971. This
271 introduces a backward-incompatibility for HTTP->FTP redirects and
272 any script that relies on the old behaviour must use
273 --trust-server-names.
274
275 * Check the HSTS file is not world-writable before using it.
276
277 * Parse <img srcset> attributes on a recursive download.
278
279 * Fix problem with SNI server names having trailing dot(s)
280
281 * New options --bind-dns-address and --dns-servers.
282
283 * When Wget is built with libiconv, it now converts non-ASCII URIs to
284 the locale's codeset when it creates files. The encoding of the
285 remote files and URIs is taken from --remote-encoding, defaulting to
286 UTF-8. The result is that non-ASCII URIs and files downloaded via
287 HTTP/HTTPS and FTP will have names on the local filesystem that
288 correspond to their remote names.
289
290 * Changes in Wget 1.17.1
291
292 * Fix compile error when IPv6 is disabled or SSL is not present.
293
294 * Fix HSTS memory leak.
295
296 * Fix progress output in non-C locales.
297
298 * Fix SIGSEGV when -N and --content-disposition are used together.
299
300 * Add --check-certificate=quiet to tell wget to not print any warning about
301 invalid certificates.
302
303 * Changes in Wget 1.17
304
305 ** Remove FTP passive to active fallback due to privacy concerns.
306
307 ** Add support for --if-modified-since.
308
309 ** Add support for metalink through --input-metalink and --metalink-over-http.
310
311 ** Add support for HSTS through --hsts and --hsts-file.
312
313 ** Add option to restrict filenames under VMS.
314
315 ** Add support for --rejected-log which logs to a separate file the reasons why
316 URLs are being rejected and some context around it.
317
318 ** Add support for FTPS.
319
320 ** Do not download/save file on error when --spider enabled
321
322 ** Add --convert-file-only option. This option converts only the
323 filename part of the URLs, leaving the rest of the URLs untouched.
324
325 * Changes in Wget 1.16.3
326
327 ** Fix a regression introduced by wget 1.16.2 that --quiet is not
328 really quiet anymore.
329
330 * Changes in Wget 1.16.2
331
332 ** Native uuid generation on Windows
333
334 ** Fix build on Solaris
335
336 ** Allow progress bar on stderr when -o is used
337
338 ** Accept 5-digit port numbers in FTP EPSV responses.
339
340 ** Support older versions of flex.
341
342 ** Updated translations.
343
344 * Changes in Wget 1.16.1
345
346 ** Add --enable-assert configure option.
347
348 ** Use pkg-config to check for libraries presence.
349
350 ** Do not limit --secure-protocol=auto|pfs to TLSv1.0.
351
352 ** Add --secure-protocol=TLSv1_1|TLSv1_2 .
353
354 ** Full C89 source code compliance.
355
356 ** Select and use the most secure authentication scheme with HTTP connections.
357
358 ** Fix issues with turkish locales.
359
360 ** Handle 504 Gateway Timeout.
361
362 ** New option --crl-file to load Certificate Revocation Lists.
363
364 ** Add valgrind support to tests suite.
365
366 ** Fix an off-by-one problem in the progress bar (introduced in 1.16).
367
368 * Changes in Wget 1.16
369
370 ** No longer create local symbolic links by default. Closes CVE-2014-4877.
371
372 ** Use libpsl for verifying cookie domains.
373
374 ** Default progress bar output changed.
375
376 ** Introduce --show-progress to force display the progress bar.
377
378 ** Introduce --no-config. The wgetrc files will not be read.
379
380 ** Introduce --start-pos to allow starting downloads from a specified position.
381
382 ** Fix a problem with ISA Server Proxy and keep-alive connections.
383
384 * Changes in Wget 1.15
385
386 ** Add support for --method.
387
388 ** Add support for file names longer than MAX_FILE.
389
390 ** Support FTP listing for the FTP Server on Windows Server 2008 R2.
391
392 ** Fix a regression when -c and --content-disposition are used together.
393
394 ** Support shorthand URLs in an input file.
395
396 ** Fix -c with servers that don't specify a content-length.
397
398 ** Add support for MD5-SESS
399
400 ** Do not fail on non fatal GNU TLS alerts during handshake.
401
402 ** Add support for --https-only. When used wget will follow only
403 HTTPS links in recursive mode.
404
405 ** Support Perfect-Forward Secrecy in --secure-protocol.
406
407 ** Fix a problem with some IRI links that are not followed when contained in a
408 HTML document.
409
410 ** Support some FTP servers that return an empty list with "LIST -a".
411
412 ** Specify Host with the HTTP CONNECT method.
413
414 ** Use the correct HTTP method on a redirection.
415
416 * Changes in Wget 1.14
417
418 ** Add support for content-on-error. It allows to store the HTTP
419 payload on 4xx or 5xx errors.
420
421 ** Add support for WARC files.
422
423 ** Fix a memory leak problem in the GNU TLS backend.
424
425 ** Autoreconf works again for distributed tarballs.
426
427 ** Print some diagnostic messages to stderr not to stdout.
428
429 ** Report stdout close errors.
430
431 ** Accept the --report-speed option.
432
433 ** Enable client certificates when GNU TLS is used.
434
435 ** Add support for TLS Server Name Indication.
436
437 ** Accept the arguments --accept-regex and --reject-regex.
438
439 ** The GNU TLS backend honors correctly the timeout value.
440
441 ** Add support for RFC 2617 Digest Access Authentication.
442
443 * Changes in Wget 1.13.4
444
445 ** Now --version and --help work again.
446
447 ** Fix a build error on solaris 10 sparc.
448
449 ** Now --timestamping and --continue work well together.
450
451 ** Return a network failure when FTP downloads fail and --timestamping
452 is specified.
453
454 ** Fix a segfault on an incomplete STYLE tag.
455
456 * Changes in Wget 1.13.3
457
458 ** Support HTTP/1.1
459
460 ** Now by default the GNU TLS library for secure connections, instead of
461 OpenSSL.
462
463 ** Fix some portability issues.
464
465 ** Handle properly malformed status line in a HTTP response.
466
467 ** Ignore zero length domains in $no_proxy.
468
469 ** Set new cookies after an authorization failure.
470
471 ** Exit with failure if -k is specified and -O is not a regular file.
472
473 ** Cope better with unclosed html tags.
474
475 ** Print diagnostic messages to stderr, not stdout.
476
477 ** Do not use an additional HEAD request when --content-disposition is used,
478 but use directly GET.
479
480 ** Report the average transfer speed correctly when multiple URL's are specified
481 and -c influences the transferred data amount.
482
483 ** GNU TLS backend works again.
484
485 ** Now --timestamping and --continue works well together.
486
487 ** By default, on server redirects, use the original URL to get the
488 local file name. Close CVE-2010-2252. This introduces a
489 backward-incompatibility; any script that relies on the old
490 behaviour must use --trust-server-names.
491
492 ** Fix a problem when -k is used and some URLs are specified through
493 CSS.
494
495 ** Convert correctly URLs that need to be encoded to local files when following
496 links.
497
498 ** Use persistent connections with proxies supporting them.
499
500 ** Print the total download time as part of the summary for recursive downloads.
501
502 ** Now it is possible to specify a different startup configuration file through
503 the --config option.
504
505 ** Fix an infinite loop with the error '<filename> has sprung into existence'
506 on a network error and -nc is used.
507
508 ** Now --adjust-extension does not modify the file extension if the file ends
509 in .htm.
510
511 ** Support HTTP/1.1 307 redirects keep request method.
512
513 ** Now --no-parent doesn't fetch undesired files if HTTP and HTTPS are used
514 by the same host on different pages.
515
516 ** Do not attempt to remove the file if it is not in the accept rules but
517 it is the output destination file.
518
519 ** Introduce `show_all_dns_entries' to print all IP addresses corresponding to
520 a DNS name when it is resolved.
521
522 * Changes in Wget 1.12
523
524 ** Mailing list MOVED to [email protected]
525
526 ** SECURITY FIX: It had been possible to trick Wget into accepting
527 SSL certificates that don't match the host name, through the trick of
528 embedding NUL characters into the certs' common name. Fixed by Joao
529 Ferreira <[email protected]>.
530
531 ** Added support for CSS. This includes:
532 - Parsing links from CSS files, and from CSS content found in HTML
533 style tags and attributes.
534 - Supporting conversion of links found within CSS content, when
535 --convert-links is specified.
536 - Ensuring that CSS files end in the ".css" filename extension,
537 when --convert-links is specified.
538
539 CSS support in Wget is thanks to Ted Mielczarek
540 <[email protected]>.
541
542 ** Added support for Internationalized Resource Identifiers (IRIs, RFC
543 3987). When support is enabled (requires libidn and libiconv), links
544 with non-ASCII bytes are translated from their source encoding to UTF-8
545 before percent-encoding. IRI support was added by Saint Xavier
546 <[email protected]>, as his project for the Google Summer of Code.
547
548 ** Wget now provides more sensible exit status codes when downloads
549 don't proceed as expected (see the manual).
550
551 ** --default-page option (and associated wgetrc command) added to
552 support alternative default names for index.html.
553
554 ** --ask-password option (and associated wgetrc command) added to
555 support password prompts at the console.
556
557 ** The --input-file option now also handles retrieving links from
558 an external file.
559
560 ** The output generated by the --version option now includes
561 information on how it was built, and the set of configure-time options
562 that were selected.
563
564 ** --html-extension has been renamed to --adjust-extension, to reflect
565 the fact that it now also applies to CSS content. --html-extension is
566 still acceptable, but is now deprecated.
567
568 ** An "ascii" specifier is now accepted by --restrict-file-names, which
569 forces the percent-encoding of all non-ASCII bytes
570
571 ** Several previously existing, but undocumented .wgetrc options are
572 now documented: save_headers, spider, and user_agent,
573 auth_no_challenge, and keep_session_cookies. Also added documentation
574 for the "lowercase" and "uppercase" values for --restrict-file-names, which had been present since Wget 1.11.
575
576 * Changes in Wget 1.11.4
577
578 ** Fixed an issue (apparently a regression) where -O would refuse to
579 download when -nc was given, even though the file didn't exist.
580
581 ** Fixed a situation where Wget could abort with --continue if the
582 remote server gives a content-length of zero when the file exists
583 locally with content.
584
585 ** Fixed a crash on some systems, due to Wget casting a pointer-to-long
586 to a pointer-to-time_t.
587
588 ** Translation updates for Catalan.
589
590 * Changes in Wget 1.11.3
591
592 ** Downgraded -N with -O to a warning, rather than an error.
593
594 ** Translation updates
595
596 * Changes in Wget 1.11.2
597
598 ** Fixed a problem in authenticating over HTTPS through a proxy.
599 (Regression in 1.11 over 1.10.2.)
600
601 ** The combination of -r or -p with -O, which was disallowed in 1.11,
602 has been downgraded to a warning in 1.11.2. (-O and -N, which was never
603 meaningful, is still an error.)
604
605 ** Further improvements to progress bar displays in non-English locales
606 (too many spaces could be inserted, causing the display to scroll).
607
608 ** Successive invocations of Wget on FTP URLS, with --no-remove-listing
609 and --continue, was causing Wget to append, rather than replace,
610 information in the .listing file, and thereby download the same files
611 multiple times. This has been fixed in 1.11.2.
612
613 ** Wget 1.11 no longer allowed ".." to persist at the beginning of URLs,
614 for improved conformance with RFC 3986. However, this behavior presents
615 problems for some FTP setups, and so they are now preserved again, for
616 FTP URLs only.
617
618 * Changes in Wget 1.11.1.
619
620 ** Interrupted downloads no longer result in renaming the file
621 (regression in 1.11 over 1.10.2).
622
623 ** Progress bar now displays correctly in non-English locales (and a
624 related assertion failure was fixed).
625
626 ** Wget no longer issues a GET request over HTTP for files it should
627 know it's not going to download (regression in 1.11 over 1.10.2).
628
629 ** Added option --auth-no-challenge, to support broken pre-1.11
630 authentication-before-server-challenge, which turns out to still be
631 useful for some limited cases.
632
633 ** Documentation of accept/reject lists in the manual's "Types of
634 Files" section now explains various aspects of their behavior that may
635 be surprising, and notes that they may change in the future.
636
637 ** Documentation of --no-parents now explains how a trailing slash, or
638 lack thereof, in the specified URL, will affect behavior.
639
640 * Changes in Wget 1.11.
641
642 ** Timestamping now uses the value from the most recent HTTP response,
643 rather than the first one it got.
644
645 ** Authentication information is no longer sent as part of the Referer
646 header in recursive fetches.
647
648 ** No authentication credentials are sent until a challenge is issued,
649 for improved security. Authentication handling is still not
650 RFC-compliant, as once a Basic challenge has been received, it will
651 assume it can send credentials to any URL at that same host, and not
652 just the ones at or below the original authenticated location.
653 Credentials for Digest authentication are still never saved or issued
654 automatically, and continue to require a challenge for each resource.
655
656 ** Added --max-redirect option, allowing the user to specify what should
657 be the maximum number of HTTP redirects to follow.
658
659 ** Wget now supports saving HTTP downloads using file names specified by
660 the `Content-Disposition' header. This is a standard way of specifying
661 the file name used by many web dynamically generated pages. However, the
662 current implementation is inefficient, and known to have bugs. It is
663 EXPERIMENTAL only, and not enabled by default. Use --content-disposition
664 to enable it.
665
666 ** The new option `--ignore-case' makes Wget ignore case when
667 matching files, directories, and wildcards. This affects the -X, -I,
668 -A, and -R options, as well as globbing in FTP URLs.
669
670 ** ETA projection is now displayed in "dot" progress output as well as
671 in the default progress bar. (The dot progress is used by default when
672 logging Wget's output to file using the `-o' option.)
673
674 ** The "lockable boolean" argument type is no longer supported. It
675 was only used by the passive_ftp .wgetrc setting. If you're running
676 broken scripts or Perl modules that unconditionally specify
677 `--passive-ftp' and your firewall disallows it, you can override them
678 by replacing wget with a script that execs wget "$@" --no-passive-ftp.
679
680 ** The source code has been migrated to Mercurial. The repositories are
681 available at http://hg.addictivecode.org/. Prior to this, the source
682 code was hosted on Subversion (migrated from the original CVS); you can
683 still get access to older tags and branches for Wget in the Subversion
684 repository at http://addictivecode.org/svn/wget/.
685
686 * Changes in Wget 1.10.
687
688 ** Downloading files larger than 2GB, sometimes referred to as "large
689 files", now works on systems that support them. This includes the
690 majority of modern Unixes, as well as MS Windows.
691
692 ** IPv6 is now supported by Wget. Unlike the experimental code in
693 1.9, this version supports dual-family systems. The new flags
694 `--inet4' and `--inet6' (or `-4' and `-6' for short) force the use of
695 IPv4 and IPv6 respectively. Note that IPv6 support has not yet been
696 tested on Windows.
697
698 ** Microsoft's proprietary "NTLM" method of HTTP authentication is now
699 supported. This authentication method is undocumented and only used
700 by IIS. Note that *proxy* authentication is not supported in this
701 release; you can only authenticate to the target web site.
702
703 ** Wget no longer truncates partially downloaded files when download
704 has to start over because the server doesn't support Range. Instead,
705 with such servers Wget now simply ignores the data up to the byte
706 where the last attempt left off, and only then continues appending to
707 the file. That way the downloaded file never shrinks, and download
708 retries from servers without support for partial downloads work even
709 when downloading to stdout.
710
711 ** SSL/TLS changes:
712
713 *** SSL/TLS downloads now attempt to verify the server's certificate
714 against the recognized certificate authorities. This requires CA
715 certificates to have been installed in a location visible to the
716 OpenSSL library. If this is not the case, you can get the bundle
717 yourself from a source you trust (for example, the bundle extracted
718 from Mozilla available at http://curl.haxx.se/docs/caextract.html),
719 and point Wget to the PEM file using the `--ca-certificate'
720 command-line option or the corresponding `.wgetrc' command.
721
722 *** Secure downloads now verify that the host name in the URL matches
723 the "common name" in the certificate presented by the server.
724
725 *** Although the above checks provide more secure downloads, they
726 unavoidably break interoperability with some sites that worked with
727 previous versions, particularly those using self-signed, expired, or
728 otherwise invalid certificates. If you encounter "certificate
729 verification" errors or complaints that "common name doesn't match
730 requested host name" and are convinced of the site's authenticity, you
731 can use `--no-check-certificate' to bypass both checks.
732
733 *** Talking to SSL/TLS servers over proxies now actually works.
734 Previous versions of Wget erroneously sent GET requests for https
735 URLs. Wget 1.10 utilizes the CONNECT method designed for this
736 purpose.
737
738 *** The SSL/TLS-related options have been redesigned and, for the
739 first time, documented in the manual. The old, undocumented, options
740 are no longer supported.
741
742 ** Passive FTP is now the default FTP transfer mode. Use
743 `--no-passive-ftp' or specify `passive_ftp = off' in your init file to
744 revert to the old behavior.
745
746 ** The `--header' option can now be used to override generated
747 headers. For example, `wget --header="Host: foo.bar"
748 http://127.0.0.1' tells Wget to connect to localhost, but to specify
749 "foo.bar" in the `Host' header. In previous versions such use of
750 `--header' lead to duplicate headers in HTTP requests.
751
752 ** The responses without headers, aka "HTTP 0.9" responses, are
753 detected and handled. Although HTTP 0.9 has long been obsolete, it is
754 still occasionally used, sometimes by accident.
755
756 ** The progress bar is now updated regularly even when the data does
757 not arrive from the network.
758
759 ** Wget no longer preserves permissions of files retrieved by FTP by
760 default. Anonymous FTP servers frequently use permissions like "664",
761 which might not be what the user wants. The new option
762 `--preserve-permissions' and the corresponding `.wgetrc' variable can
763 be used to revert to the old behavior.
764
765 ** The new option `--protocol-directories' instructs Wget to also use
766 the protocol name as a directory component of local file names.
767
768 ** Options that previously unconditionally set or unset various flags
769 are now boolean options that can be invoked as either `--OPTION' or
770 `--no-OPTION'. Options that required an argument "on" or "off" have
771 also been changed this way, but they still accept the old syntax for
772 backward compatibility. For example, instead of `--glob=off' you can
773 write `--no-glob'.
774
775 Allowing `--no-OPTION' for every `--OPTION' and the other way around
776 is useful because it allows the user to override non-default behavior
777 specified via `.wgetrc'.
778
779 ** The new option `--keep-session-cookies' causes `--save-cookies' to
780 save session cookies (normally only kept in memory) along with the
781 permanent ones. This is useful because many sites track important
782 information, such as whether the user has authenticated, in session
783 cookies. With this option multiple Wget runs are treated as a single
784 browser session.
785
786 ** Wget now supports the --ftp-user and --ftp-password command
787 switches to set username and password for FTP, and the --user and
788 --password command switches to set username and password for both FTP
789 and HTTP. The --http-passwd and --proxy-passwd command switches have
790 been renamed to --http-password and --proxy-password respectively, and
791 the related http_passwd and proxy_passwd .wgetrc commands to
792 http_password and proxy_password respectively. The login and passwd
793 .wgetrc commands have been deprecated.
794
795 * `wget -b' now works correctly under Windows.
796
797 * Wget 1.9.1 is a bugfix release with no user-visible changes.
798
799 * Changes in Wget 1.9.
800
801 ** It is now possible to specify that POST method be used for HTTP
802 requests. For example, `wget --post-data="id=foo&data=bar" URL' will
803 send a POST request with the specified contents.
804
805 ** IPv6 support is available, although it's still experimental.
806
807 ** The `--timeout' option now also affects DNS lookup and establishing
808 the TCP connection. Previously it only affected reading and writing
809 data. Those three timeouts can be set separately using
810 `--dns-timeout', `--connection-timeout', and `--read-timeout',
811 respectively.
812
813 ** Download speed shown by the progress bar is based on the data
814 recently read, rather than the average speed of the entire download.
815 The ETA projection is still based on the overall average.
816
817 ** It is now possible to connect to FTP servers through FWTK
818 firewalls. Set ftp_proxy to an FTP URL, and Wget will automatically
819 log on to the proxy as "username@host".
820
821 ** The new option `--retry-connrefused' makes Wget retry downloads
822 even in the face of refused connections, which are otherwise
823 considered a fatal error.
824
825 ** The new option `--no-dns-cache' may be used to prevent Wget from
826 caching DNS lookups.
827
828 ** Wget no longer escapes characters in local file names based on
829 whether they're appropriate in URLs. Escaping can still occur for
830 nonprintable characters or for '/', but no longer for frequent
831 characters such as space. You can use the new option
832 --restrict-file-names to relax or strengthen these rules, which can be
833 useful if you dislike the default or if you're downloading to
834 non-native partitions.
835
836 ** Handling of HTML comments has been dumbed down to conform to what
837 users expect and other browsers do: instead of being treated as SGML
838 declaration, a comment is terminated at the first occurrence of "-->".
839 Use `--strict-comments' to revert to the old behavior.
840
841 ** Wget now correctly handles relative URIs that begin with "//", such
842 as "//img.foo.com/foo.jpg".
843
844 ** Boolean options in `.wgetrc' and on the command line now accept
845 values "yes" and "no" along with the traditional "on" and "off".
846
847 ** It is now possible to specify decimal values for timeouts, waiting
848 periods, and download rate. For instance, `--wait=0.5' now works as
849 expected, as does `--dns-timeout=0.5' and even `--limit-rate=2.5k'.
850
851 * Wget 1.8.2 is a bugfix release with no user-visible changes.
852
853 * Wget 1.8.1 is a bugfix release with no user-visible changes.
854
855 * Changes in Wget 1.8.
856
857 ** A new progress indicator is now available and used by default.
858 You can choose the progress bar type with `--progress=TYPE'. Two
859 types are available, "bar" (the new default), and "dot" (the old
860 dotted indicator). You can permanently revert to the old progress
861 indicator by putting `progress = dot' in your `.wgetrc'.
862
863 ** You can limit the download rate of the retrieval using the
864 `--limit-rate' option. For example, `wget --limit-rate=15k URL' will
865 tell Wget not to download the body of the URL faster than 15 kilobytes
866 per second.
867
868 ** Recursive retrieval and link conversion have been revamped:
869
870 *** Wget now traverses links breadth-first. This makes the
871 calculation of depth much more reliable than before. Also, recursive
872 downloads are faster and consume *significantly* less memory than
873 before.
874
875 *** Links are converted only when the entire retrieval is complete.
876 This is the only safe thing to do, as only then is it known what URLs
877 have been downloaded.
878
879 *** BASE tags are handled correctly when converting links. Since Wget
880 already resolves <base href="..."> when resolving handling URLs, link
881 conversion now makes the BASE tags point to an empty string.
882
883 *** HTML anchors are now handled correctly. Links to an anchor in the
884 same document (<a href="#anchorname">), which used to confuse Wget,
885 are now converted correctly.
886
887 *** When in page-requisites (-p) mode, no-parent (-np) is ignored when
888 retrieving for inline images, stylesheets, and other documents needed
889 to display the page.
890
891 *** Page-requisites (-p) mode now works with frames. In other words,
892 `wget -p URL-THAT-USES-FRAMES' will now download the frame HTML files,
893 and all the files that they need to be displayed properly.
894
895 ** `--base' now works conjunction with `--input-file', providing a
896 base for each URL and thereby allowing the URLs in the file to be
897 relative.
898
899 ** If a host has more than one IP address, Wget uses the other
900 addresses when accessing the first one fails.
901
902 ** Host directories now contain port information if the URL is at a
903 non-standard port.
904
905 ** Wget now supports the robots.txt directives specified in
906 <http://www.robotstxt.org/norobots-rfc.txt>.
907
908 ** URL parser has been fixed, especially the infamous overzealous
909 quoting. Wget no longer dequotes reserved characters, e.g. `%3F' is
910 no longer translated to `?', nor `%2B' to `+'. Unsafe characters
911 which are not reserved are still escaped, of course.
912
913 ** No more than 20 successive redirections are allowed.
914
915 * Wget 1.7.1 is a bugfix release with no user-visible changes.
916
917 * Changes in Wget 1.7.
918
919 ** SSL (`https') pages now work if you compile Wget with SSL support;
920 use the `--with-ssl' configure flag. You need to have OpenSSL
921 installed.
922
923 ** Cookies are now supported. Wget will accept cookies sent by the
924 server and return them in later requests. Additionally, it can load
925 and save cookies to disk, in the same format that Netscape uses.
926
927 ** "Keep-alive" (persistent) HTTP connections are now supported.
928 Using keep-alive allows Wget to share one TCP/IP connection for
929 many retrievals, making multiple-file downloads faster and less
930 stressing for the server and the network.
931
932 ** Wget now recognizes FTP directory listings generated by NT and VMS
933 servers.
934
935 ** It is now possible to recurse through FTP sites where logging in
936 puts you in some directory other than '/'.
937
938 ** You may now use `~' to mean home directory in `.wgetrc'. For
939 example, `load_cookies = ~/.netscape/cookies.txt' works as you would
940 expect.
941
942 ** The HTML parser has been rewritten. The new one works more
943 reliably, allows finer-grained control over which tags and attributes
944 are detected, and has better support for some features like correctly
945 skipping comments and declarations, decoding entities, etc. It is
946 also more general.
947
948 ** <meta name="robots"> tags are now respected.
949
950 ** Wget's internal tables now use hash tables instead of linked lists
951 where appropriate. This results in huge speedups when retrieving
952 large sites (thousands of documents).
953
954 ** Wget now has a man page, automatically generated from the Texinfo
955 documentation. (The last version that shipped with a man page was
956 1.4.5). To get this, you need to have pod2man from the Perl
957 distribution installed on your system.
958
959 * Changes in Wget 1.6
960
961 ** Administrative changes.
962
963 *** Maintainership. Due to Hrvoje being plagued with a "real job",
964 Dan Harkless is the most active maintainer (not that he doesn't have a
965 real job as well). Hrvoje still participates occasionally, and both
966 are being helped by many other people.
967
968 *** Web page. Thanks to Jan Prikryl, Wget has an "official" web page.
969 Take a look at:
970
971 http://sunsite.dk/wget/
972
973 *** Anonymous CVS. Thanks to ever-helpful Karsten Thygesen, Wget
974 sources are now available at an anonymous CVS server. Take a look at
975 the web page for downloading instructions.
976
977 ** New -K / --backup-converted / backup_converted = on option causes files
978 modified due to -k to be saved with a .orig prefix before being changed. When
979 using -N as well, it is these .orig files that are compared against the server.
980
981 ** New --follow-tags / follow_tags = ... option allows you to restrict
982 Wget to following only certain HTML tags when doing a recursive
983 retrieval. -G / --ignore-tags / ignore_tags = ... is just the
984 opposite -- all tags but the ones you specify will be followed.
985
986 ** New --waitretry / waitretry = SECONDS option allows waiting between retries
987 of failed downloads. Wget will use "linear" backoff, waiting 1 second after the
988 first failure, 2 after the second, up to SECONDS. waitretry is set to 10 by
989 default in the system wgetrc.
990
991 ** New -p / --page-requisites / page_requisites = on option causes
992 Wget to download all ancillary files necessary to display a given HTML
993 page properly (e.g. inlined images).
994
995 ** New -E / --html-extension / html_extension = on option causes Wget
996 to append ".html" to text/html filenames not ending in regexp
997 "\.[Hh][Tt][Mm][Ll]?".
998
999 ** New type of .wgetrc command -- "lockable Boolean". Can be set to on, off,
1000 always, or never. This allows the .wgetrc to override the commandline. So far,
1001 passive_ftp is the only .wgetrc command which takes a lockable Boolean.
1002
1003 ** A number of new translation files have been added.
1004
1005 ** New --bind-address / bind_address = <address> option for people on hosts
1006 bound to multiple IP addresses.
1007
1008 ** wget now accepts (illegal per HTTP spec) relative URLs in HTTP redirects.
1009
1010 * Wget 1.5.3 is a bugfix release with no user-visible changes.
1011
1012 * Wget 1.5.2 is a bugfix release with no user-visible changes.
1013
1014 * Wget 1.5.1 is a bugfix release with no user-visible changes.
1015
1016 * Changes in Wget 1.5.0
1017
1018 ** Wget speaks many languages!
1019
1020 On systems with gettext(), Wget will output messages in the language
1021 set by the current locale, if available. At this time we support
1022 Czech, German, Croatian, Italian, Norwegian and Portuguese.
1023
1024 ** Opie (Skey) is now supported with FTP.
1025
1026 ** HTTP Digest Access Authentication (RFC2069) is now supported.
1027
1028 ** The new `-b' option makes Wget go to background automatically.
1029
1030 ** The `-I' and `-X' options now accept wildcard arguments.
1031
1032 ** The `-w' option now accepts suffixes `s' for seconds, `m' for
1033 minutes, `h' for hours, `d' for days and `w' for weeks.
1034
1035 ** Upon getting SIGHUP, the whole previous log is now copied to
1036 `wget-log'.
1037
1038 ** Wget now understands proxy settings with explicit usernames and
1039 passwords, e.g. `http://user:[email protected]/'.
1040
1041 ** You can use the new `--cut-dirs' option to make Wget create less
1042 directories.
1043
1044 ** The `;type=a' appendix to FTP URLs is now recognized. For
1045 instance, the following command will retrieve the welcoming message in
1046 ASCII type transfer:
1047
1048 wget "ftp://ftp.somewhere.com/welcome.msg;type=a"
1049
1050 ** `--help' and `--version' options have been redone to conform to
1051 standards set by other GNU utilities.
1052
1053 ** Wget should now be compilable under MS Windows environment. MS
1054 Visual C++ and Watcom C have been used successfully.
1055
1056 ** If the file length is known, percentages are displayed during
1057 download.
1058
1059 ** The manual page, now hopelessly out of date, is no longer
1060 distributed with Wget.
1061
1062 * Wget 1.4.5 is a bugfix release with no user-visible changes.
1063
1064 * Wget 1.4.4 is a bugfix release with no user-visible changes.
1065
1066 * Changes in Wget 1.4.3
1067
1068 ** Wget is now a GNU utility.
1069
1070 ** Can do passive FTP.
1071
1072 ** Reads .netrc.
1073
1074 ** Info documentation expanded.
1075
1076 ** Compiles on pre-ANSI compilers.
1077
1078 ** Global wgetrc now goes to /usr/local/etc (i.e. $sysconfdir).
1079
1080 ** Lots of bugfixes.
1081
1082 * Changes in Wget 1.4.2
1083
1084 ** New mirror site at ftp://sunsite.auc.dk/pub/infosystems/wget/,
1085 thanks to Karsten Thygesen.
1086
1087 ** Mailing list! Mail to [email protected] to subscribe.
1088
1089 ** New option --delete-after for proxy prefetching.
1090
1091 ** New option --retr-symlinks to retrieve symbolic links like plain
1092 files.
1093
1094 ** rmold.pl -- script to remove files deleted on the remote server
1095
1096 ** --convert-links should work now.
1097
1098 ** Minor bugfixes.
1099
1100 * Changes in Wget 1.4.1
1101
1102 ** Minor bugfixes.
1103
1104 ** Added -I (the opposite of -X).
1105
1106 ** Dot tracing is now customizable; try wget --dot-style=binary
1107
1108 * Changes in Wget 1.4.0
1109
1110 ** Wget 1.4.0 [formerly known as Geturl] is an extensive rewrite of
1111 Geturl. Although many things look suspiciously similar, most of the
1112 stuff was rewritten, like recursive retrieval, HTTP, FTP and mostly
1113 everything else. Wget should be now easier to debug, maintain and,
1114 most importantly, use.
1115
1116 ** Recursive HTTP should now work without glitches, even with Location
1117 changes, server-generated directory listings and other naughty stuff.
1118
1119 ** HTTP regetting is supported on servers that support Range
1120 specification. WWW authorization is supported -- try
1121 wget http://user:password@hostname/
1122
1123 ** FTP support was rewritten and widely enhanced. Globbing should now
1124 work flawlessly. Symbolic links are created locally. All the
1125 information the Unix-style ls listing can give is now recognized.
1126
1127 ** Recursive FTP is supported, e.g.
1128 wget -r ftp://gnjilux.cc.fer.hr/pub/unix/util/
1129
1130 ** You can specify "rejected" directories, to which you do not want to
1131 enter, e.g. with wget -X /pub
1132
1133 ** Time-stamping is supported, with both HTTP and FTP. Try wget -N URL.
1134
1135 ** A new texinfo reference manual is provided. It can be read with
1136 Emacs, standalone info, or converted to HTML, dvi or postscript.
1137
1138 ** Fixed a long-standing bug, so that Wget now works over SLIP
1139 connections.
1140
1141 ** You can have a system-wide wgetrc (/usr/local/lib/wgetrc by
1142 default). Settings in $HOME/.wgetrc override the global ones, of
1143 course :-)
1144
1145 ** You can set up quota in .wgetrc to prevent sucking too much
1146 data. Try `quota = 5M' in .wgetrc (or quota = 100K if you want your
1147 sysadmin to like you).
1148
1149 ** Download rate is printed after retrieval.
1150
1151 ** Wget now sends the `Referer' header when retrieving
1152 recursively.
1153
1154 ** With the new --no-parent option Wget can retrieve FTP recursively
1155 through a proxy server.
1156
1157 ** HTML parser, as well as the whole of Wget was rewritten to be much
1158 faster and less memory-consuming (yes, both).
1159
1160 ** Absolute links can be converted to relative links locally. Check
1161 wget -k.
1162
1163 ** Wget catches hangup, filtering the output to a log file and
1164 resuming work. Try kill -HUP %?wget.
1165
1166 ** User-defined headers can be sent. Try
1167
1168 wget http://fly.cc.her.hr/ --header='Accept-Charset: iso-8859-2'
1169
1170 ** Acceptance/Rejection lists may contain wildcards.
1171
1172 ** Wget can display HTTP headers and/or FTP server response with the
1173 new `-S' option. It can save the original HTTP headers with `-s'.
1174
1175 ** socks library is now supported (thanks to Antonio Rosella
1176 <[email protected]>). Configure with --with-socks.
1177
1178 ** There is a nicer display of REST-ed output.
1179
1180 ** Many new options (like -x to force directory hierarchy, or -m to
1181 turn on mirroring options).
1182
1183 ** Wget is now distributed under GNU General Public License (GPL).
1184
1185 ** Lots of small features I can't remember. :-)
1186
1187 ** A host of bugfixes.
1188
1189 * Changes in Geturl 1.3
1190
1191 ** Added FTP globbing support (ftp://fly.cc.fer.hr/*)
1192
1193 ** Added support for no_proxy
1194
1195 ** Added support for ftp://user:password@host/
1196
1197 ** Added support for %xx in URL syntax
1198
1199 ** More natural command-line options
1200
1201 ** Added -e switch to execute .geturlrc commands from the command-line
1202
1203 ** Added support for robots.txt
1204
1205 ** Fixed some minor bugs
1206
1207 * Geturl 1.2 is a bugfix release with no user-visible changes.
1208
1209 * Changes in Geturl 1.1
1210
1211 ** REST supported in FTP
1212
1213 ** Proxy servers supported
1214
1215 ** GNU getopt used, which enables command-line arguments to be ordered
1216 as you wish, e.g. geturl http://fly.cc.fer.hr/ -vo log is the same as
1217 geturl -vo log http://fly.cc.fer.hr/
1218
1219 ** Netscape-compatible URL syntax for HTTP supported: host[:port]/dir/file
1220
1221 ** NcFTP-compatible colon URL syntax for FTP supported: host:/dir/file
1222
1223 ** <base href="xxx"> supported
1224
1225 ** autoconf supported
1226
1227 ----------------------------------------------------------------------
1228 Copyright information:
1229
1230 Copyright (C) 1997-2024 Free Software Foundation, Inc.
1231
1232 Permission is granted to anyone to make or distribute verbatim
1233 copies of this document as received, in any medium, provided that
1234 the copyright notice and this permission notice are preserved, thus
1235 giving the recipient permission to redistribute in turn.
1236
1237 Permission is granted to distribute modified versions of this
1238 document, or of portions of it, under the above conditions,
1239 provided also that they carry prominent notices stating who last
1240 changed them.