| 1 |
Changes for Test::Nginx |
| 2 |
|
| 3 |
0.30 - 2022-05-13 |
| 4 |
|
| 5 |
* bugfix: reserved ports for stream_server_config. |
| 6 |
|
| 7 |
* feature: expanded environment values in --- tcp_listen section. |
| 8 |
|
| 9 |
* bugfix: user name with dash was not allowed, eg like 'www-data'. thanks |
| 10 |
lijunlong for the patch. |
| 11 |
|
| 12 |
* bugfix: there can be trailing spaces in HTTP 0.9. |
| 13 |
|
| 14 |
* feature: add TEST_NGINX_FAST_SHUTDOWN to stop Nginx without graceful. |
| 15 |
thanks spacewander for the patch. |
| 16 |
|
| 17 |
* bugfix: supported to parse http trailer in response body. thanks Yuansheng |
| 18 |
for the patch. |
| 19 |
|
| 20 |
* change: quic use keepalive_timeout instead of quic_max_idle_timeout now. |
| 21 |
thanks lijunlong for the patch. |
| 22 |
|
| 23 |
* bugfix: did not skip test cases that proxy_pass or directly connect to |
| 24 |
request server port. thanks lijunlong for the patch. |
| 25 |
|
| 26 |
* bugfix: should not change config line number for old test cases. |
| 27 |
thanks lijunlong for the patch. |
| 28 |
|
| 29 |
* bugfix: curl request was sent before nginx startup when running in valgrind |
| 30 |
mode. thanks lijunlong for the patch. |
| 31 |
|
| 32 |
* bugifx: waitpid failed when the process is not subprocess of perl. thanks |
| 33 |
lijunlong for the patch. |
| 34 |
|
| 35 |
* bugfix: nginx reload hangs when http3 is enabled. thanks lijunlong for the |
| 36 |
patch. |
| 37 |
|
| 38 |
* feature: support HTTP/3 testing. thanks lijunlong for the patch. |
| 39 |
|
| 40 |
* feature: added new section "--- no_access_log" which could be used to |
| 41 |
specify patterns of lines that do not appear in access.log at all. |
| 42 |
thanks levy001 for the patch. |
| 43 |
|
| 44 |
* bugfix: allow capture OpenSSL version without letter. thanks Wangchong Zhou |
| 45 |
for the patch. |
| 46 |
|
| 47 |
* feature: check if grep_error_log is defined when grep_error_log_out exists. |
| 48 |
thanks spacewander for the patch. |
| 49 |
|
| 50 |
* feature: add '--- curl_options' and '--- curl_protocol' section. |
| 51 |
thanks woodgear for the patch. |
| 52 |
|
| 53 |
* feature: added file name to name of the test case. thanks lijunlong for |
| 54 |
the patch. |
| 55 |
|
| 56 |
* feature: support FIRST to mark the beginning of test. thanks spacewander |
| 57 |
for the patch. |
| 58 |
|
| 59 |
* bugfix: perl did not exit when kill process with SIGKILL. thanks lijunlong |
| 60 |
for the patch. |
| 61 |
|
| 62 |
0.29 - 2020-11-06 |
| 63 |
|
| 64 |
* bugfix: check leak mode: use much larger number of requests for |
| 65 |
ab/weighttp to make sure we always have the load even for large |
| 66 |
TEST_NGINX_CHECK_LEAK_COUNT values. |
| 67 |
|
| 68 |
* feature: added TEST_NGINX_RAND_PORT_XXX variable to provide random ports |
| 69 |
during environment variable expansion. thanks Johnny for the patch. |
| 70 |
|
| 71 |
* bugfix: log correct server address when server_addr_for_client section |
| 72 |
is used. thanks Patrick Thiel for the patch. |
| 73 |
|
| 74 |
0.28 - 2020-07-13 |
| 75 |
|
| 76 |
* bugfix: we downgraded the bundled version of Test::Builder to avoid the |
| 77 |
extra dependency Test2::Util. |
| 78 |
|
| 79 |
0.27 - 2020-07-02 |
| 80 |
|
| 81 |
* feature: added the --- reload_fails new section to skip checking |
| 82 |
config_version after HUP reload in the HUp reload testing mode. |
| 83 |
|
| 84 |
* feature: added a "--- gen_dgram_request" section. |
| 85 |
|
| 86 |
* feature: relaxed the Server response header parsing pattern for |
| 87 |
extracting the nginx core verison number. |
| 88 |
|
| 89 |
* bugfix: when --- reload_fails is specified, we did not assume --- |
| 90 |
no_chck_leak since it would always fail in the check leak testing mode. |
| 91 |
|
| 92 |
* feature: implemented the `--- shutdown_error_log` section for |
| 93 |
checking the error logs generated during nginx exit. |
| 94 |
|
| 95 |
* feature: added new test mode enabled by the env TEST_NGINX_USE_HTTP2=1 |
| 96 |
and new section "--- http2", for enabling the HTTP/2 protocol to |
| 97 |
send the test request. |
| 98 |
|
| 99 |
* bugfix: when TEST_NGINX_USE_STAP=1 env was specified, the master process |
| 100 |
would be turned off when for test blocks without actually using --- stap. |
| 101 |
|
| 102 |
* feature: be more patient to wait for the nginx to start up in profiling |
| 103 |
and "check leak" test mode. |
| 104 |
|
| 105 |
* optimize: use perl's own remove_tree() instead of the shell command |
| 106 |
'rm -rf' since the latter may use too much memory. |
| 107 |
|
| 108 |
* feature: added support for the env TEST_NGINX_CHECK_LEAK_COUNT to control |
| 109 |
how many data points to sample in the "check leak" test mode. |
| 110 |
|
| 111 |
* feature: now we pass through the MOCKNOEAGAIN_VERBOSE and MOCKNOEAGAIN |
| 112 |
env to the nginx worker processes by default as well. |
| 113 |
|
| 114 |
* feature: added support for TEST_NGINX_WORKER_USER env for setting the user |
| 115 |
account (and user group) for nginx worker processes; defaults to root when |
| 116 |
the master is run by root. |
| 117 |
|
| 118 |
* bugfix: the value of env TEST_NGINX_WORKER_USER did not accept a single |
| 119 |
user name (without a user group name). |
| 120 |
|
| 121 |
* feature: added support for the --- access_log section for checking access |
| 122 |
log file content. |
| 123 |
|
| 124 |
* bugfix: valgrind test mode: we no longer disable nginx master process in |
| 125 |
this mode. |
| 126 |
|
| 127 |
* bugfix: we did not clean up nginx's *_cache directories under the server |
| 128 |
root directory. |
| 129 |
|
| 130 |
* feature: added support for environment variable TEST_NGINX_REUSE_PORT for |
| 131 |
enabling the reuseport parameter in the listen directive automatically |
| 132 |
generated in nginx.conf. |
| 133 |
|
| 134 |
* feature: we now check for the new "write guard" warning message to detect |
| 135 |
misuses of lua globals. |
| 136 |
|
| 137 |
* feature: added the use_hup() Perl utility function. |
| 138 |
|
| 139 |
* feature: when --- no_error_log fails, we output up to 9 lines of |
| 140 |
subsequent error log messages for better debuggability (for example, |
| 141 |
wen can have complete lua backtraces). |
| 142 |
|
| 143 |
* feature: expanded environment values in --- user_files section. |
| 144 |
|
| 145 |
* bugfix: when setting TEST_NGINX_USE_HUP=1, some directories could not be |
| 146 |
cleaned up correctly. |
| 147 |
|
| 148 |
* feature: implemented the TEST_NGINX_USE_RR=1 env for enabling Mozilla rr |
| 149 |
to record the nginx server execution. |
| 150 |
|
| 151 |
* bugfix: increased resiliency in HUP reload mode. |
| 152 |
|
| 153 |
* feature: added the '--- skip_openssl' section to skip tests depending on |
| 154 |
the OpenSSL version NGINX was built with. |
| 155 |
|
| 156 |
* bugfix: ensured we do not remove some files when using HUP mode. |
| 157 |
|
| 158 |
* bugfix: properly use a concat operator instead of a range. |
| 159 |
|
| 160 |
* bugfix: ensure servroot is cleaned up when starting NGINX for the first |
| 161 |
time. |
| 162 |
|
| 163 |
0.26 - 2017-04-09 |
| 164 |
|
| 165 |
* feature: added new Test::Nginx::Socket::Lua::Dgram module for |
| 166 |
testing UDP/datagram nginx servers. |
| 167 |
|
| 168 |
* feature: added new section, `--- response_body_filters`, to |
| 169 |
allow custom value filters applied upon the *actual* response |
| 170 |
body data before matching against the expected values. thanks |
| 171 |
detailyang for the patch. |
| 172 |
|
| 173 |
* feature: added support for env TEST_NGINX_RANDOMIZE, which when |
| 174 |
set allows parallel testing. |
| 175 |
|
| 176 |
* feature: added support for the `$TEST_NGINX_SERVER_ROOT` special |
| 177 |
macro variable in test block specs. |
| 178 |
|
| 179 |
* feature: allows extracting nginx version numbers from more |
| 180 |
forked versions of nginx. |
| 181 |
|
| 182 |
* feature: support the "SKIP" section dynamically defined by |
| 183 |
subclasses of the test scaffold calsses. |
| 184 |
|
| 185 |
* feature: `--- tcp_reply` section: allows perl subroutines as |
| 186 |
section values. thanks Robert Paprocki for the patch. |
| 187 |
|
| 188 |
* bugfix: fixed the TEST_NGINX_BINARY environment for specifying |
| 189 |
nginx binary path. thanks Thibault Charbonnier for the patch. |
| 190 |
|
| 191 |
* bugfix: ensure that kill_process() still kills the process with |
| 192 |
force if the process is still running after sending SIGQUIT. |
| 193 |
|
| 194 |
* improve: improved the nginx shut down logic. thanks Dejiang Zhu |
| 195 |
for the suggestion. |
| 196 |
|
| 197 |
* improve: improved the test message for ARRAY-typed |
| 198 |
"response_body" section values. |
| 199 |
|
| 200 |
* improve: improved the dry run skip message for no_error_log. |
| 201 |
|
| 202 |
* doc: typo fixes from Juntong Fu. |
| 203 |
|
| 204 |
0.25 - 2016-02-24 |
| 205 |
|
| 206 |
* feature: added the new test mdoule, Test::Nginx::Socket::Lua::Stream, |
| 207 |
for testing stream-typed NGINX C modules like ngx_stream_echo_module |
| 208 |
and ngx_stream_lua_module. |
| 209 |
|
| 210 |
* feature: added new section "--- server_addr_for_client" to control |
| 211 |
the value of server_addr for client. thanks Guanlan Dai for the patch. |
| 212 |
|
| 213 |
* feature: added support for the TEST_NGINX_LOAD_MODULES environment for |
| 214 |
loading dynamic NGINX modules in nginx.conf globally. |
| 215 |
|
| 216 |
* feature: added support for ASAN by passing ASAN_OPTIONS environment |
| 217 |
variable. thanks Markus Linnala for the patch. |
| 218 |
|
| 219 |
* feature: Test::Nginx::Socket::Lua: added support for |
| 220 |
the init_by_lua_block {} directive of ngx_http_lua_module. |
| 221 |
|
| 222 |
* feature: avoided variations in the absolute line numbers of user |
| 223 |
configurations so that the test cases can check nginx configuration |
| 224 |
file line numbers deterministically. |
| 225 |
|
| 226 |
* feature: implemented the env_to_nginx() Perl utility function as per |
| 227 |
Rollin Crittendon's request. for example: |
| 228 |
env_to_nginx('foo', 'bar=hello world') |
| 229 |
|
| 230 |
* feature: now we pass the environment DYLD_FORCE_FLAT_NAMESPACE to the |
| 231 |
nginx by default as well. |
| 232 |
|
| 233 |
* feature: implemented the "--- todo" section for TODOing test blocks. |
| 234 |
thanks Markus Linnala for the patch. |
| 235 |
|
| 236 |
* feature: repeat_each() also returns the value even when it is used as |
| 237 |
a setter. |
| 238 |
|
| 239 |
* bugfix: testing could not continue properly when the "--- must_die" |
| 240 |
subtest failed. |
| 241 |
|
| 242 |
* bugfix: ARRAY-typed "--- more_headers" now work with ARRAY-typed |
| 243 |
"--- request". thanks Kipras Mancevičius for the report. |
| 244 |
|
| 245 |
* bugfix: fixed the perl warning "Use of uninitialized value $val in |
| 246 |
concatenation" when "--- more_headers" has headers without values. |
| 247 |
|
| 248 |
* bugfix: use SIGTERM to kill non-responsive nginx/valgrind processes |
| 249 |
instead of SIGQUIT; otherwise the perl test process may hang forever |
| 250 |
in valgrind testing mode. |
| 251 |
|
| 252 |
* bugfix: only complain about failures of removing the nginx pid file |
| 253 |
when it still exists. |
| 254 |
|
| 255 |
* bugfix: we should bail out when `nginx -V` returns anything that we |
| 256 |
cannot understand. |
| 257 |
|
| 258 |
* bugfix: builtin udp server: fixed recv() call's error handling. |
| 259 |
|
| 260 |
* bugfix: we did not expand environments TEST_NGINX_XXX in the |
| 261 |
"--- main_config" and "--- post_main_config" data sections. |
| 262 |
|
| 263 |
* bugfix: better error handling in the mocked UDP server. |
| 264 |
|
| 265 |
* change: changed the default value of TEST_NGINX_SLEEP to 0.015 (sec). |
| 266 |
thanks Dejiang Zhu for the patch. |
| 267 |
|
| 268 |
* improvement: output the system error message when failing to remove |
| 269 |
the nginx pid file. |
| 270 |
|
| 271 |
* improvement: made the error_log test failure message clearer. thanks |
| 272 |
Nick Muerdter for the patch. |
| 273 |
|
| 274 |
* doc: fixed the module description of Test::Nginx and |
| 275 |
Test::Nginx::Socket to reflect recent changes. |
| 276 |
|
| 277 |
* doc: now we highly recommend Test::Nginx::Socket and its subclasses. |
| 278 |
|
| 279 |
* doc: documentged the default timeout value used by the client. thanks |
| 280 |
Nick Muerdter for the patch. |
| 281 |
|
| 282 |
* doc: added a link to the official user guide in the book |
| 283 |
"Programming OpenResty". |
| 284 |
|
| 285 |
0.24 - 2014-12-07 |
| 286 |
* feature: added support for the "benchmark" testing mode enabled |
| 287 |
by the TEST_NGINX_BENCHMARK environment variable. |
| 288 |
|
| 289 |
* feature: added support for the TEST_NGINX_BENCHMARK_WARMUP |
| 290 |
environment to specify the number of warm-up requests before the |
| 291 |
actual benchmark testing. |
| 292 |
|
| 293 |
* feature: added support for the "--- curl" section that generates |
| 294 |
a "curl" command line for the corresponding test request. |
| 295 |
|
| 296 |
* feature: added new section "--- server_name" to control the |
| 297 |
value of the server_name nginx config directive used for the |
| 298 |
default server {}. |
| 299 |
|
| 300 |
* feature: added new section "--- error_log_file". |
| 301 |
|
| 302 |
* feature: automatically print out warnings for [emerg] messages |
| 303 |
in nginx's error.log to stderr if it is not mentioned in "--- |
| 304 |
error_log" nor "--- no_error_log". |
| 305 |
|
| 306 |
* feature: Test::Nginx::Socket: "--- request" now supports leading |
| 307 |
comment lines prefixed by "#". |
| 308 |
|
| 309 |
* feature: the "--- user_files" section supports raw Perl data |
| 310 |
structures for specifying the user files. |
| 311 |
|
| 312 |
* feature: the "--- more_headers" section now supports perl |
| 313 |
array-ref typed values for pipelined requests. |
| 314 |
|
| 315 |
* feature: exported the "add_response_body_check" and "is_str" |
| 316 |
utility functions. |
| 317 |
|
| 318 |
* feature: the "--- udp_reply" section now accepts a Perl |
| 319 |
subroutine as its value which can be used to generate dynamic |
| 320 |
replies based on the actual query. thanks blablacio for the |
| 321 |
original patch. |
| 322 |
|
| 323 |
* feature: Test::Nginx::Socket: exported new Perl utility |
| 324 |
functions "add_cleanup_handler", "add_block_preprocessor", and |
| 325 |
"bail_out". |
| 326 |
|
| 327 |
* feature: made the special $LIBxxx_PATH variable more general in |
| 328 |
the "--- stap" section. |
| 329 |
|
| 330 |
* feature: the "--- no_error_log" section now tries to find all |
| 331 |
the matched lines in error logs instead of stopping on the first |
| 332 |
hit. |
| 333 |
|
| 334 |
* feature: added new section "--- tcp_shutdown" for shutting down |
| 335 |
read, write, or both parts of the connection in the embedded TCP |
| 336 |
server immedately after the connection is established. |
| 337 |
|
| 338 |
* feature: the value of "--- tcp_query_len" now defaults to the |
| 339 |
lenghth of the value of "--- tcp_query" (if any). |
| 340 |
|
| 341 |
* feature: added new section "--- must_die" for testing the cases |
| 342 |
that nginx fail to start (like invalid nginx configurations and |
| 343 |
etc). thanks Markus Linnala for the patch. |
| 344 |
|
| 345 |
* bugfix: when user specifies "Host" and "Connection" in "--- |
| 346 |
more_headers", then we should not add our own Host request |
| 347 |
headers. |
| 348 |
|
| 349 |
* bugfix: made the default value of the "Connection" request |
| 350 |
header to be "close" instead of "Close". |
| 351 |
|
| 352 |
* bugfix: the "check leak" testing mode might send a bogus request |
| 353 |
header via ab or weighttp. |
| 354 |
|
| 355 |
* bugfix: we should also wait for the time specified by the "--- |
| 356 |
abort" section before checking error logs for the repeated |
| 357 |
requests that are not the last one. |
| 358 |
|
| 359 |
* optimize disabled accept_mutex by default in the auto-generated |
| 360 |
nginx.conf. |
| 361 |
|
| 362 |
* bugfix: "--- skip_nginx" and "--- skip_nginx2" did not skip |
| 363 |
tests related to the mocked TCP and UDP servers. |
| 364 |
|
| 365 |
* bugfix: we did not automatically remove the .stp and .stp-out |
| 366 |
temp files created by the "--- stap" sections in the systemtap |
| 367 |
testing mode. |
| 368 |
|
| 369 |
* bugfix: "--- request" did not provide the guilty request line |
| 370 |
that it failed to parse. |
| 371 |
|
| 372 |
* bugfix: Test::Nginx::Socket: "--- error_code" might take bad |
| 373 |
values. |
| 374 |
|
| 375 |
* bugfix: we incorrectly discarded all the query data read in the |
| 376 |
mocked TCP server when timeout errors happen (due to the actual |
| 377 |
query is shorter than the expected data specified "--- |
| 378 |
tcp_query", for example). |
| 379 |
|
| 380 |
* bugfix: the "check leak" testing mode could not parse raw HTTP |
| 381 |
requests using LF instead of CRLF for line terminators. |
| 382 |
|
| 383 |
* doc: documented the section "--- init". |
| 384 |
|
| 385 |
* doc: added info for the openresty and openresty-en mailing lists |
| 386 |
for discussions. |
| 387 |
|
| 388 |
* doc: spelling fixes from Markus Linnala. |
| 389 |
|
| 390 |
0.23 - 2014-04-05 |
| 391 |
* feature: added new section --- response_body_unlike. thanks |
| 392 |
Rickey Visinski for the patch. |
| 393 |
|
| 394 |
* feature: allow use of the $ServerPort and $ServerPortForClient |
| 395 |
variables in "--- response_headers". |
| 396 |
|
| 397 |
* feature: now we automatically kill the process listening on the |
| 398 |
mocked TCP port when we have tried for more than 20 times. |
| 399 |
|
| 400 |
* feature: added new section "--- http09" to Test::Nginx::Socket |
| 401 |
to indicate use of HTTP 0.9 requests. |
| 402 |
|
| 403 |
* feature: added support for the $LIBLUA_PATH variable in "--- |
| 404 |
stap", which evaluates to the absolute path of the liblua*.so |
| 405 |
DSO loaded by the nginx server. |
| 406 |
|
| 407 |
* feature: we skipped reading the response body for 101 responses. |
| 408 |
|
| 409 |
* feature: added new section "--- post_main_config" to add custom |
| 410 |
top-level configuration snippets right after the http {} block |
| 411 |
generated by Test::Nginx. |
| 412 |
|
| 413 |
* feature: added unix domain socket support for tcp_listen. thanks |
| 414 |
Jiale Zhi for the patch. |
| 415 |
|
| 416 |
* feature: added new sections "--- grep_error_log" and "--- |
| 417 |
grep_error_log_out". |
| 418 |
|
| 419 |
* feature: added utility function check_accum_error_log for |
| 420 |
checking the accumulated error logs in "--- error_log" and "--- |
| 421 |
no_error_log". |
| 422 |
|
| 423 |
* feature: added utility Perl function server_port_for_client. |
| 424 |
thanks doujiang for the patch. |
| 425 |
|
| 426 |
* feature: added configuration Perl function server_name(). thanks |
| 427 |
doujiang for the original patch. |
| 428 |
|
| 429 |
* feature: added new module Test::Nginx::Socket::Lua. |
| 430 |
|
| 431 |
* feature: automatically test if there is any assertion failures |
| 432 |
in the nginx error logs. |
| 433 |
|
| 434 |
* feature: when nginx process is gone unexpectedly, we |
| 435 |
automatically tail the nginx error log file. |
| 436 |
|
| 437 |
* feature: added the "--- no_check_leak" section to skip test |
| 438 |
blocks in the "check leak" testing mode. |
| 439 |
|
| 440 |
* feature: "--- no_error_log" accepts a single Perl Regexp object |
| 441 |
now, just like "--- error_log". |
| 442 |
|
| 443 |
* bugfix: Test::Nginx::Socket tried to read response bodies for |
| 444 |
304 responses. |
| 445 |
|
| 446 |
* bugfix: we did not try hard enough before killing the nginx |
| 447 |
process by force. |
| 448 |
|
| 449 |
* bugfix: improved the error handling when recv() fails on the |
| 450 |
HTTP connection. |
| 451 |
|
| 452 |
* bugfix: subtests for "--- tcp_query", "--- tcp_query_len", and |
| 453 |
"--- udp_query" disabled test plan checks. |
| 454 |
|
| 455 |
* bugfix: we did not pass the LD_LIBRARY_PATH environment to nginx |
| 456 |
when systemtap is used. |
| 457 |
|
| 458 |
* bugfix: "--- error_log" should work on each test request's own |
| 459 |
logs only. |
| 460 |
|
| 461 |
* bugfix: server address should default to 127.0.0.1 instead of |
| 462 |
"localhost". |
| 463 |
|
| 464 |
* bugfix: made the test skip messages better. |
| 465 |
|
| 466 |
* change: removed "env LUA_PATH" and "env LUA_CPATH" from the |
| 467 |
default nginx configuration generated. |
| 468 |
|
| 469 |
* change: set --num-callers=100 to valgrind by default. |
| 470 |
|
| 471 |
* doc: Test::Nginx::Socket: documented the various exported Perl |
| 472 |
functions like "run_tests", "repeat_each", and "no_shuffle". |
| 473 |
|
| 474 |
0.22 - 2013-06-10 |
| 475 |
* feature: added new sections --- abort and --- shutdown to test |
| 476 |
premature client abortions. |
| 477 |
|
| 478 |
* feature: implemented new section "--- |
| 479 |
raw_response_headers_unlike". |
| 480 |
|
| 481 |
* feature: added support for custom http_config filters for |
| 482 |
subclasses. |
| 483 |
|
| 484 |
* feature: now we automatically check [alert] and [crit] messages |
| 485 |
in the nginx error logs and print them as warnings if they do |
| 486 |
not appear in either --- error_log or --- no_error_log. |
| 487 |
|
| 488 |
* feature: added new section "--- stap_out_unlike" for testing |
| 489 |
patterns which should not appear in the output systemtap. |
| 490 |
|
| 491 |
* feature: added support for the special notation "$LIBPCRE_PATH" |
| 492 |
within --- stap, which is always substituted by the absolute |
| 493 |
path to libpcre used by the current nginx. |
| 494 |
|
| 495 |
* feature: now we check if the nginx process is gone in the "check |
| 496 |
leak" testing mode (i.e., when TEST_NGINX_CHECK_LEAK=1). |
| 497 |
|
| 498 |
* feature: added new section "--- skip_eval: <subtest-count> |
| 499 |
<perl-code>" for skipping tests according to the running result |
| 500 |
of a piece of Perl code. |
| 501 |
|
| 502 |
* feature: now we allow a (unix domain) socket file path specified |
| 503 |
in the "--- udp_listen" directive value. |
| 504 |
|
| 505 |
* feature: in --- stap values, now we support the notation |
| 506 |
"F(func@file)". |
| 507 |
|
| 508 |
* feature: made the environment TEST_NGINX_SERVER_PORT always take |
| 509 |
the value so that the test cases can always reference it. |
| 510 |
|
| 511 |
* feature: added new section "--- wait" to always wait a specified |
| 512 |
amount of time before checking the systemtap outputs and/or |
| 513 |
error logs (if any). |
| 514 |
|
| 515 |
* bugfix: no longer retry connecting to the nginx server when the |
| 516 |
child process running nginx is already gone. |
| 517 |
|
| 518 |
* bugfix: no longer bail out the up to 3 test cases fail all their |
| 519 |
connecting attempts. |
| 520 |
|
| 521 |
* bugfix: TEST_NGINX_USE_HUP=1 could not work with |
| 522 |
TEST_NGINX_NO_CLEAN=1. |
| 523 |
|
| 524 |
* bugfix: the output of systemtap took the value undef when it was |
| 525 |
in fact empty. |
| 526 |
|
| 527 |
* bugfix: protect against division by zero in the "check leak" |
| 528 |
testing mode. |
| 529 |
|
| 530 |
* bugfix: disabled the test report ending when failing to parse |
| 531 |
chunked response body because the test count is surely out of |
| 532 |
sync. |
| 533 |
|
| 534 |
* bugfix: the code that searches executables in the PATH |
| 535 |
environment would always look up the current working directory |
| 536 |
first and might pick up an executable directory with the same |
| 537 |
name. |
| 538 |
|
| 539 |
* bugfix: conflicting testing modes may conflict together. |
| 540 |
|
| 541 |
* bugfix: added File::Path 2.06_05 as a minimum requirement. |
| 542 |
thanks Andreas J. König for reporting this issue. |
| 543 |
|
| 544 |
* bugfix: pass --show-possibly-lost=no to valgrind by default |
| 545 |
because nginx makes clever use of pointers almost everywhere. |
| 546 |
|
| 547 |
* bugfix: when --- abort was not specified, http client timeout |
| 548 |
was not treated as a subtest failure as specified. |
| 549 |
|
| 550 |
* bugfix: the child process running ab or weighttp might not be |
| 551 |
reaped in extreme conditions. |
| 552 |
|
| 553 |
* bugfix: we did not close STDOUT and STDERR in the child |
| 554 |
processes forked, which could confuse the "prove" harness and |
| 555 |
lead to hang. |
| 556 |
|
| 557 |
* optimize: disabled the access log altogether in the "check leak" |
| 558 |
testing mode. |
| 559 |
|
| 560 |
* docs: documented the TEST_NGINX_NO_CLEAN environment. |
| 561 |
|
| 562 |
* docs: fixed a small issue in the code sample. thanks smallfish. |
| 563 |
|
| 564 |
0.21 - 2012-09-27 |
| 565 |
* feature: added support for SystemTap: the SystemTap white-box |
| 566 |
testing mode is enabled by setting TEST_NGINX_USE_STAP=1 and by |
| 567 |
using new test sections "--- stap", "--- stap_out", and "--- |
| 568 |
stap_out_like". |
| 569 |
|
| 570 |
* feature: added support for new sections "--- udp_listen" and |
| 571 |
"--- udp_reply" for mocking an internal UDP server. |
| 572 |
|
| 573 |
* feature: added new section "--- udp_reply_delay" and also make |
| 574 |
"--- udp_reply_delay" and "--- timeout" sections accept time |
| 575 |
values with a time unit which can be either "s" or "ms". |
| 576 |
|
| 577 |
* feature: added new section "--- udp_query" to test if the UDP |
| 578 |
query sent to the embeded UDP server is expected. |
| 579 |
|
| 580 |
* feature: added new section "--- tcp_query_len" to work with |
| 581 |
mockeagain testing modes. |
| 582 |
|
| 583 |
* feature: added support for embedded TCP server by introducing |
| 584 |
new sections "--- tcp_listen", "--- tcp_query", "--- tcp_reply", |
| 585 |
and "--- tcp_reply_delay". |
| 586 |
|
| 587 |
* feature: added new section "--- tcp_no_close" to tell the |
| 588 |
embedded TCP server (if any) never close the connection |
| 589 |
actively. this is feature is mainly for mocking upstream reply |
| 590 |
read time out in the middle. |
| 591 |
|
| 592 |
* feature: added new section "--- log_level" to specify the error |
| 593 |
log level on a test-by-test basis. |
| 594 |
|
| 595 |
* bugfix: we might lose logs at config-time when |
| 596 |
TEST_NGINX_USE_HUP=1 because we sent HUP before USR1. |
| 597 |
|
| 598 |
* bugfix: be more tolarent when removing the nginx pid file while |
| 599 |
the nginx process is not running. |
| 600 |
|
| 601 |
* optimize: now we can automatically check the version of the |
| 602 |
current nginx configuration and retry dozens of times when |
| 603 |
TEST_NGINX_USE_HUP=1. this speed up the test suite in this mode |
| 604 |
a lot and also avoid accidental failures due to slow nginx |
| 605 |
reloads. |
| 606 |
|
| 607 |
* bugfix: try harder when failing to connect to the Nginx server. |
| 608 |
|
| 609 |
* refactor: now we use the standard "return" directive instead of |
| 610 |
"echo" for detecting nginx config reload completion for the "HUP |
| 611 |
reload" testing mode. |
| 612 |
|
| 613 |
* refactor: use waitpid() wherever possible. |
| 614 |
|
| 615 |
* bugfix: Parallel::ForkManager does not allow the user calling |
| 616 |
waitpid directly, or inifinite looping might happen when calling |
| 617 |
its start() method. now we no longer use this module any more |
| 618 |
and use the fork() builtin function exclusively. |
| 619 |
|
| 620 |
* bugfix: disabled the ending output "Looks like you ..." when the |
| 621 |
client socket timed out. |
| 622 |
|
| 623 |
* refactor: now we disabled the access log by default. |
| 624 |
|
| 625 |
* updated the bundled versions of Test::Builder and Test::More |
| 626 |
modules. |
| 627 |
|
| 628 |
* docs: documented the "--- skip_nginx" and "--- skip_nginx2" |
| 629 |
sections. thanks Weibin Yao for requesting it. |
| 630 |
|
| 631 |
0.20 - 2012-06-25 |
| 632 |
* feature: now "--- error_log" allows a single regexp object as its value. |
| 633 |
|
| 634 |
* feature: made client socket timeout as a test failure. |
| 635 |
|
| 636 |
* feature: added support for the environment TEST_NGINX_CHECK_LEAK=1 |
| 637 |
that enables the most general memory leak check by calling |
| 638 |
ab/weighttp + ps (for the nginx process's RSS). |
| 639 |
|
| 640 |
* feature: when the TEST_NGINX_USE_HUP environment is set to true, |
| 641 |
then HUP signal will be used to update the nginx config between |
| 642 |
different test blocks and there will be no HUP reload between |
| 643 |
every two successive test cases within the same test block when |
| 644 |
"repeat_each" is set to a number more than 1. |
| 645 |
|
| 646 |
* bugfix: fixed the TEST_NGINX_SLEEP environment support. |
| 647 |
|
| 648 |
* bugfix: we should always restore user files before each |
| 649 |
"repeat_each" iteration because some test case may modify |
| 650 |
the user files. |
| 651 |
|
| 652 |
* bugfix: setting environment TEST_NGINX_USE_HUP could not work |
| 653 |
with TEST_NGINX_USE_VALGRIND=1 properly. |
| 654 |
|
| 655 |
* bugfix: print out every test block's name when |
| 656 |
TEST_NGINX_USE_HUP=1 and TEST_NGINX_USE_VALGRIND=1. |
| 657 |
|
| 658 |
* bugfix: the "response body truncated" warning was a false alarm |
| 659 |
for HEAD requests. thanks Piotr Sikora for reporting this in |
| 660 |
github issue #1. |
| 661 |
|
| 662 |
* bugfix: do not add --gen-suppressions and --suppressions options |
| 663 |
to the valgrind command line when custom non-number |
| 664 |
TEST_NGINX_USE_VALGRIND env value is specified. |
| 665 |
|
| 666 |
* docs: documented the "--- timeout" section. |
| 667 |
|
| 668 |
* docs: added a link to António P. P. Almeida's debian package for this module. |
| 669 |
|
| 670 |
0.19 - 2012-04-29 |
| 671 |
* feature: added new section "--- error_code_like". |
| 672 |
* bugfix: tests could hang on slow machines after maximal number of connecting |
| 673 |
attempts (as well as other exceptions). Now we eliminate dying directly from |
| 674 |
within the test scaffold. Instead, we always use Test::More::BAIL_OUT. Also, |
| 675 |
we always politely clean up all the forked child processes before we quit. |
| 676 |
Finally, we add timeout protection to the connect operation. |
| 677 |
* bugfix: prevented blocking indefinitely on ForkManager's wait_all_children call. |
| 678 |
also made timeout an API provided by Test::Nginx::Util. |
| 679 |
* feature: now we preserve environment "MOCKEAGAIN" as well. |
| 680 |
* bugfix: the timestamps for the "--- user_files" directive should be GMT rather |
| 681 |
than localtime. |
| 682 |
* feature: now section "no_error_log" also supports multi-line values to mean |
| 683 |
multiple literal patterns (per line). |
| 684 |
* feature: the "--- user_files" sections now support absolute file paths and creating |
| 685 |
arbitrarily nested directories in the file path. thanks @penjin2012 for suggesting it. |
| 686 |
* feature: the "--- error_log" section now supports multiple lines to mean multiple |
| 687 |
literal patterns. |
| 688 |
* bugfix: fixed places that crash for bad responses. |
| 689 |
* bugfix: fixed another crash when no response object is constructed. |
| 690 |
|
| 691 |
0.18 - 2012-02-03 |
| 692 |
* feature: added new section "--- no_error_log" which could be used to specify |
| 693 |
patterns of lines that do not appear in error.log at all. |
| 694 |
* feature: added MOCKEAGAIN_VERBOSE, DYLD_INSERT_LIBRARIES, |
| 695 |
MOCKEAGAIN_WRITE_TIMEOUT_PATTERN, and LD_PRELOAD to the |
| 696 |
environments that should be kept through nginx reload and restart. |
| 697 |
* doc: added Naxsi and ngx_rds_csv to the user module list in the POD documentation. |
| 698 |
* feature: now we can use the environment TEST_NGINX_USE_VALGRIND to specify the |
| 699 |
valgrind command-line options, when set to 1 or other non-zero numbers, it is |
| 700 |
effectively equivalent to the value "--tool=memcheck --leak-check=full". To |
| 701 |
use Valgrind SGCheck to run the tests, just specify the environment |
| 702 |
TEST_NGINX_USE_VALGRIND="--tool=exp-sgcheck" first. |
| 703 |
* feature: added support for environment TEST_NGINX_VERBOSE. |
| 704 |
* feature: added support for environment TEST_NGINX_USE_HUP. |
| 705 |
* feature: added support for the TEST_NGINX_POSTPONE_OUTPUT environment. |
| 706 |
* feature: now we'll retry sending the QUIT signal for at most 5 times when the |
| 707 |
nginx process is refusing to quit. after 5 trials, KILL signal will be sent. |
| 708 |
* feature: exposes the "master_off" API which turns off the nginx master process. |
| 709 |
* feature: added new section "--- ignore_response" to test bad responses. |
| 710 |
* bugfix: Test::Nginx::Socket will retry 10 times if fail to connect because nginx |
| 711 |
with valgrind can be very slow to start in some systems. |
| 712 |
* feature: added new section name "--- error_log" to test error lines. requested |
| 713 |
by Piotr Sikora in the last year or so. |
| 714 |
* feature: added the TEST_NGINX_EVENT_TYPE environment to specify an event API type |
| 715 |
(like "epoll" or "select") when running the test suite. |
| 716 |
|
| 717 |
0.17 - 2011-11-04 |
| 718 |
* bugfix: do not strip trailing CRCF for response headers in |
| 719 |
Test::Nginx::Socket's response parser. |
| 720 |
* bugfix: fixed issues in Content-Length response header handling in case of |
| 721 |
pipelined reqeusts. |
| 722 |
* bugfix: fixed the pipelined_requests section support. |
| 723 |
* feature: added support for user file timestamp. |
| 724 |
|
| 725 |
0.16 - 2011-07-07 |
| 726 |
* fixed a bug that length(undef) produced lots of warnings on perl 5.10.x. |
| 727 |
thanks Guo Ying (shrimp). |
| 728 |
* now we automatically retry connecting for 3 times (1 sec delay) |
| 729 |
in Test::Nginx::Socket::send_request. this will help automatically recovering |
| 730 |
from random slow valgrind loading problems. |
| 731 |
* when the directories specified in --- user_files do not exist, Test::Nginx will create it |
| 732 |
automatically. |
| 733 |
* now we'll issue warning when there is extra bytes after the last chunk in the chunked response parser. |
| 734 |
|
| 735 |
0.15 - 2011-05-23 |
| 736 |
* fixed a bug when using arrays in the "response_body" (and other similar) section when there was only one request. |
| 737 |
* fixed presentation problems in the HTML generated from the POD. |
| 738 |
* added documentation for the TEST_NGINX_* variables. |
| 739 |
* added "local $?" in Test::Nginx::Util::END to avoid confusing Test::Builder::_ending() |
| 740 |
* removed "use Test::More" from Test::Nginx::Socket because Test::Base already loads it. |
| 741 |
|
| 742 |
0.14 - 2011-05-12 |
| 743 |
* now we require Parallel::ForkManager, Text::Diff, and Test::Base. |
| 744 |
* the --- request section now supports multiple requests and even "packeting" |
| 745 |
(see documentation for details). And it should be backward compatible. |
| 746 |
Of course, the "expected" sections have been upgraded to expect |
| 747 |
(and even require) arrays in this situation. |
| 748 |
* updated quite a bit the documentation. |
| 749 |
* deprecated request_eval and response_body_eval. If you use them, the |
| 750 |
test will pass but you will be issued a "diag" statement telling you |
| 751 |
to move to "request eval" and "response_body eval" respectively. |
| 752 |
* added new implementation for pipelined requests and raw requests. |
| 753 |
Rewrote SKIP statement to be less verbose and more in line with what |
| 754 |
is recommended on Test::Nginx. |
| 755 |
* added support for environment variable TEST_NGINX_FORCE_RESTART_ON_TEST. |
| 756 |
Defaults to 1. Must be explicitly set to 0 to avoid restarting the nginx |
| 757 |
server when the config does not change between two tests. |
| 758 |
This also brings support for allowing config not to be set. |
| 759 |
This way, using TEST_NGINX_FORCE_RESTART_ON_TEST=1 with TEST_NGINX_NO_SHUFFLE=1 |
| 760 |
and having a config section only on the first test, you can have all tests |
| 761 |
use the same config. |
| 762 |
* added support for environment variable TEST_NGINX_NO_NGINX_MANAGER (defaults |
| 763 |
to 0) which will disable the nginx management code (stop/config/start). |
| 764 |
Very useful when you want to run tests on an already running NGINX (set |
| 765 |
TEST_NGINX_NO_NGINX_MANAGER to 1 and TEST_NGINX_CLIENT_PORT to the |
| 766 |
port your running nginx is listening on). |
| 767 |
|
| 768 |
0.13 - 2011-03-08 |
| 769 |
* documented the TEST_NGINX_PORT environment. |
| 770 |
|
| 771 |
0.12 - 2011-03-08 |
| 772 |
* documented the etcproxy and valgrind integration support. |
| 773 |
* implemented the no_nginx_manager utility function |
| 774 |
* documented the difference between Test::Nginx::Socket and Test::Nginx::LWP. |
| 775 |
* allow numbers in TEST_NGINX_BLAH_BLAH_BLAH env names. |
| 776 |
* added support for --- raw_response_headers_like. |
| 777 |
* fixed a bug in the can_run sub. |
| 778 |
|
| 779 |
0.11 - 2010-10-09 |
| 780 |
* add TEST_NGINX_BUILDSLAVE and --- skip_slave. |
| 781 |
* implemented the TEST_NGINX_IGNORE_MISSING_DIRECTIVES which can |
| 782 |
force test cases to skip when the directive is not |
| 783 |
found in the current nginx. |
| 784 |
* added support for env TEST_NGINX_TIMEOUT. |
| 785 |
* implemented TEST_NGINX_XXX env expansion in --- config and --- http_config sections. |
| 786 |
|
| 787 |
0.10 - 2010-08-19 |
| 788 |
* we use our own can_run function rather than Module::Install::Can's. |
| 789 |
* added TEST_NGINX_MASTER_PROCESS, rename TEST_NGINX_ROOT to less confusing TEST_NGINX_SERVROOT and reorder priority of TEST_NGINX_{CLIENT_,SERVER_,}PORT environment options. (Piotr Sikora) |
| 790 |
* added support for TEST_NGINX_NO_SHUFFLE env as requested by Piotr Sikora :) |
| 791 |
* added support for TEST_NGINX_LOG_LEVEL env but it can be overriden on the script level by calling the log_level function. |
| 792 |
* added support for TEST_NGINX_ERROR_LOG: if this env is specified to some file path, then all the error log by all the test cases will be accumulated to that file. |
| 793 |
* Now the test script driven by Test::Nginx will tell nginx to quit by default. The TEST_NGINX_NO_CLEAN=1 env setting will give back the old behavior :) Thanks Piotr Sikora for requesting this. |
| 794 |
* added support for --- main_config. |
| 795 |
* Make Test::Nginx more friendly to the environment (Piotr Sikora) |
| 796 |
Added environment variables: |
| 797 |
TEST_NGINX_BINARY - full path to the nginx binary, |
| 798 |
TEST_NGINX_ROOT - path where server root should be created, |
| 799 |
TEST_NGINX_PORT - port number that should be used by client and server |
| 800 |
(takes precedence over _CLIENT_PORT and _SERVER_PORT), |
| 801 |
TEST_NGINX_SERVER_PORT - port number that should be used by the server. |
| 802 |
* add environment variable TEST_NGINX_SLEEP |
| 803 |
* added support for ngx_openresty in nginx version parser. |
| 804 |
|
| 805 |
0.09 - Wed 07 Jul 2010 02:57:13 PM CST |
| 806 |
* added new section --- user_files which will create user files under html/. |
| 807 |
* applied the patch from Piotr Sikora to add the --- skip_nginx2 directive. |
| 808 |
* use the latest nginx version as the default if the version number can not be parsed from "nginx -V". |
| 809 |
* added support for ! HEADER syntax to --- response_headers such that we can test if a response header exists. |
| 810 |
* fixed some bugs in --- response_headers. |
| 811 |
* now TEST_NGINX_USE_VALGRIND=1 works out of the box. one can ualso use test/valgrind.suppress file to serve as a default suppression file. |
| 812 |
* better diagnostics for socket timeout outputs. |
| 813 |
* added support for the --- charset section. |
| 814 |
* use localhost as the server_name in the test nginx.conf. |
| 815 |
* added support for the server_addr sub as well as the TEST_NGINX_CLIENT_PORT environment. |
| 816 |
* always use Time::HiRes's sleep. this issue was reported by leicheng++. |
| 817 |
* added new config function no_root_location as well as the new section --- init. |
| 818 |
|
| 819 |
0.08 - Tue 26 Jan 2010 12:20:03 PM CST |
| 820 |
* fixed a bug in the chunked parser in Test::Nginx::Socket: |
| 821 |
now we immediately stop reading more data chunks when |
| 822 |
seeing the last chunk. |
| 823 |
* added func no_long_string to Test::Nginx::Socket and |
| 824 |
Test::Nginx::LWP so that we can disable |
| 825 |
Test::LongString in the test scaffold. |
| 826 |
* added utility config functions "workers", "log_level", and |
| 827 |
"master_on" to Test::Nginx::Socket. |
| 828 |
* added ngx_rds_json and ngx_xss modules to the module |
| 829 |
list that uses Test::Nginx::Socket. |
| 830 |
|
| 831 |
0.07 - Tue 05 Jan 2010 10:06:56 AM CST |
| 832 |
* we now use IO::Select in Test::Nginx::Socket to save CPU resources |
| 833 |
while polling the non-blocking socket. |
| 834 |
* POD: added ngx_drizzle to the module list that use Test::Nginx::Socket. |
| 835 |
* added utility config functions "worker_connections" and |
| 836 |
"master_process_enabled". |
| 837 |
|
| 838 |
0.06 - Thu 24 Dec 2009 10:59:29 AM CST |
| 839 |
* we now disable the nginx daemon mode in the config file by default. |
| 840 |
* we now generate a default index.html page under the root /. |
| 841 |
* added support for the new --- http_config section so that you can |
| 842 |
put upstream foo { ... } in it. |
| 843 |
|
| 844 |
0.05 - Tue 22 Dec 2009 10:17:44 AM CST |
| 845 |
* added support for gcc profiling via the |
| 846 |
$Nginx::Util::Profiling variable. |
| 847 |
* fixed the chunked decoder for large chunks. |
| 848 |
|
| 849 |
0.04 - Fri 18 Dec 2009 04:09:02 PM CST |
| 850 |
* added new sections --- raw_request and |
| 851 |
--- raw_request_middle_delay to Test::Nginx::Socket. |
| 852 |
* added new functions config_preamble and repeat which |
| 853 |
are exported by default. |
| 854 |
|
| 855 |
0.03 - Tue 15 Dec 2009 11:35:07 AM CST |
| 856 |
- refactored a lot of duplicate code between |
| 857 |
Test::Nginx::LWP and Test::Nginx::Socket to |
| 858 |
a separate module named Test::Nginx::Util. |
| 859 |
- now Test::Nginx::Socket also restart the nginx |
| 860 |
server at every test case run. |
| 861 |
- added support for --- request_eval and |
| 862 |
--- response_eval to Test::Nginx::Socket. |
| 863 |
|
| 864 |
0.02 - Wed 09 Dec 2009 09:50:11 AM CST |
| 865 |
- skipped the POD coverage tests for now. |
| 866 |
|
| 867 |
0.01 - Tue 08 Dec 2009 11:07:51 AM CST |
| 868 |
- initial release. |
| 869 |
|