Debian Codegraph @

ChangeLog

raw
1 4.0.1: 05 Apr 2026
2
3 ** Features **
4 * [Feature] Add settings merge infrastructure with layered collect-then-merge flow
5 * [Feature] Add weak dependencies and disabled status to symcache
6 * [Feature] Add force-enable override for settings conflicts
7 * [Feature] Add dynamic block API to fuzzy storage worker
8 * [Feature] Allow custom response codes for fuzzy dynamic blocks
9 * [Feature] Expose ratelimit_whitelist check to Lua via worker method
10
11 ** Bug fixes **
12 * [Fix] Keep original fd in proxy session after milter dup (fd leak since 4.0.0)
13 * [Fix] Use task_timeout instead of upstream timeout for proxy self-scan
14 * [Fix] Use LPeg grammar for AAR header parsing (#5963)
15 * [Fix] Use ev_now() instead of rspamd_get_ticks() for dynamic ban expiry
16 * [Fix] Enable deps in pre/postfilters and fix settings flow
17 * [Fix] Create rdeps for same-stage non-filter dependencies
18 * [Fix] Add missing #include <memory> in redis_backend.cxx
19
20 4.0.0: 30 Mar 2026
21
22 ** Incompatible changes **
23 * [Rework] Replace Jump Hash with Ring Hash (Ketama) for consistent upstream hashing;
24 per-user Bayes with Redis sharding requires migration via rspamadm statistics_dump migrate
25 * [Feature] Include content URLs by default in URL API calls (include_content_urls = true);
26 set include_content_urls = false in local.d/options.inc to restore old behavior
27 * [Feature] Auto-detect SSL from bind sockets, remove ssl = true worker option
28 * [Feature] Replace libfasttext with built-in mmap-based shim; ENABLE_FASTTEXT cmake option removed
29 * [Feature] Replace builtin_suspicious TLDs with map-based configuration (conf/maps.d/suspicious_tlds.inc)
30 * [Feature] Rename neural autolearn options to match RBL module naming
31 * [Feature] proxy: Enable token bucket load balancing by default
32 * [Conf] Disable Validity SenderScore RBLs by default (requires MyValidity account)
33 * [Fix] Make unknown and broken DKIM keys behaviour conforming to RFC
34
35 ** Major features **
36 * [Feature] Add /checkv3 multipart scan endpoint with per-part zstd compression
37 * [Feature] protocol: Zero-copy piecewise writev for v3 multipart responses
38 * [Feature] protocol: Add v3 multipart response parsing for proxy and body decompression
39 * [Feature] rspamc: Add --msgpack flag for v3 protocol
40 * [Feature] Pluggable async hyperscan cache backend with Redis storage support
41 * [Feature] Route all hyperscan cache operations through Lua backend
42 * [Feature] Use async hyperscan compilation for language detection stop words
43 * [Feature] Compile small hyperscan databases in memory without file caching
44 * [Feature] Add multi-flag fuzzy hash support with Lua-based Redis update path (epoch 12)
45 * [Feature] Add dual-mode HTML fuzzy: template matching + phishing detection (FUZZY_HTML_PHISHING)
46 * [Feature] Add shard migration and multi-class support to statistics_dump
47 * [Feature] Implement HTTPS server support for workers
48 * [Feature] proxy: Implement token bucket load balancing for upstreams
49 * [Feature] Expose milter headers and extended symbols in legacy RSPAMC/SPAMC protocol
50 * [Feature] Add native UUID v7 per task with Lua binding
51 * [Feature] Add UUID v7 column support to ClickHouse plugin
52 * [Feature] Sync UUID v7 random portion with Log-Tag header
53 * [Feature] Add structured formatter to metadata_exporter with zstd compression
54 * [Feature] arc: Add trusted_authserv_id option for reuse_auth_results
55 * [Feature] Add external pretrained neural model support
56 * [Feature] Fasttext embed: multi-model, mean+max pooling, SIF word weighting
57 * [Feature] Multi-layer funnel architecture for LLM embeddings
58 * [Feature] Add language-based model/URL selection for LLM embeddings
59 * [Feature] Add expression-based autolearn for neural LLM providers
60 * [Feature] Add rspamadm autolearnstats subcommand
61 * [Feature] Rewrite rspamd_stats.pl and mapstats.pl as rspamadm Lua subcommands
62 * [Feature] headers_checks: Add Reply-To address validity checks
63 * [Feature] Store matched fuzzy hashes in Redis history
64 * [Feature] Add HTTP content negotiation framework with zstd compression for /stat
65 * [Feature] Extend /stat and /bayes/classifiers endpoints with classifier metadata
66 * [Feature] WebUI: Add multi-class classifier support to learning UI
67 * [Feature] Split attachment filenames into sub-tokens for Bayes classifier
68 * [Feature] Make GPT consensus thresholds configurable with context_augment hook
69 * [Feature] Add follow_master option for proxy mirror connections
70 * [Feature] Per-class deterministic regexp IDs in re_cache
71 * [Feature] Add GELU activation and expose dropout in KANN bindings
72 * [Feature] Add ignore_link_domains option for HTML fuzzy rules
73 * [Feature] fuzzy_storage: Enhance blacklist handler with richer context
74 * [Feature] WebUI: Add fuzzy hash copy and delist buttons
75 * [Feature] Add worker:get_mem_config() Lua method for jemalloc stats
76 * [Feature] Add missing Jinja2 filters and tests to Lupa template engine
77
78 ** Bug fixes **
79 * [CritFix] Stop ev_io watcher in fuzzy UDP session destroy
80 * [Fix] Fix CPU busy-loop in fuzzy TCP client due to EV_WRITE not being cleared
81 * [Fix] Clear inherited address family flags when creating new SPF addr nodes
82 * [Fix] Weighted round-robin not respecting upstream weights across cycles
83 * [Fix] bypass RHEL/CentOS 10+ crypto-policies for SHA-1 DKIM verification
84 * [Fix] Fix EVP_PKEY_CTX memory leak in DKIM RSA signing
85 * [Fix] ratelimit: Fix compatibility with old records
86 * [Fix] Prevent SIGSEGV when sign_headers is not a string
87 * [Fix] lua_magic: Avoid misdetecting HTML with embedded SVG as SVG
88 * [Fix] Exclude injected parts from SA body/rawbody regexp scanning
89 * [Fix] Handle OpenAI-compatible response format in Ollama GPT module
90 * [Fix] Add text attachment fallback in get_displayed_text_part
91 * [Fix] Self-healing hyperscan cache: delete stale blobs and trigger recompile
92 * [Fix] Move binary data from KEYS to ARGV in fuzzy, neural, and Bayes Redis scripts
93 * [Fix] Prevent LuaJIT GC stalls after neural training
94 * [Fix] Backward-compatible version negotiation for multi-flag fuzzy
95 * [Fix] Defeat PDF object padding evasion in extract_outer_objects
96 * [Fix] Store small PDF objects without counting toward limit
97 * [Fix] Add ASCII85 decode support for PDF text extraction
98 * [Fix] PDF ligature substitution fix in text handler
99 * [Fix] Correct CSS duplicate property handling to use last declaration
100 * [Fix] Fix JSON emission for implicit arrays in libucl
101 * [Fix] Fasttext shim: fix quantized model support and hierarchical softmax
102 * [Fix] Fasttext shim: fix binary format parsing and harden against corrupt models
103 * [Fix] Rework alternative parts detection
104 * [Fix] R_PARTS_DIFFER: handle multipart/related, empty parts, and parts without words
105 * [Fix] Fix subprocess cleanup race in spawn_process SIGCHLD handler
106 * [Fix] Add PCRE2 complexity checks before JIT compilation
107 * [Fix] Remove unsupported Delta codec from ClickHouse UUID column
108 * [Fix] Clear pending multipatterns and regexp maps on config reload to prevent use-after-free
109 * [Fix] re_cache: Always use charset-converted content for SARAWBODY matching
110 * [Fix] re_cache: Respect disable_hyperscan option in loading functions
111 * [Fix] re_cache: Fix stale hyperscan ID handling during config reload
112 * [Fix] Defer settings application for symbols registered after settings init
113 * [Fix] Default map URL path to "/" when no path component is present
114 * [Fix] Skip HELO IP address literals for SPF domain resolution
115 * [Fix] Preserve content flags for injected query URLs
116 * [Fix] Preserve duplicate URLs across MIME parts
117 * [Fix] Refactor control socket to use ID-based request/reply matching
118 * [Fix] Reduce control message size to prevent sendmsg crash
119 * [Fix] Fix proxy mirror SSL/keepalive config parsing
120 * [Fix] Use OpenMetrics base name for counter TYPE declarations
121 * [Fix] Silence zlib preset dictionary inflate errors
122 * [Fix] Skip empty In-Reply-To header in replies check
123
124 ** Minor changes **
125 * [Minor] Tune jemalloc for single-threaded multi-process architecture
126 * [Minor] Backport ucl_object_iterate_end() from libucl to fix iterator leak
127 * [Conf] Add Redis backend example and configuration support for hs_helper worker
128 * [WebUI] Add frequency stddev column and units to symbols table
129 * [WebUI] Deduplicate fuzzy hashes in multipart messages
130
131 3.14.3: 08 Jan 2026
132 * [Feature] Add task registry for safe Lua task reference validation
133 * [Feature] Add text quality analysis for PDF garbage filtering
134 * [Feature] Implement basic PDF text extraction with UTF-16 detection
135 * [Feature] Add extra tables API for clickhouse plugin
136 * [Feature] Add confighelp documentation for RBL module
137 * [Feature] WebUI: add backend API interaction error log
138 * [Fix] Neural: by default include symbols with no flags
139 * [Fix] Symcache: make FINE propagation deterministic
140 * [Fix] URL: Prevent false positives from numeric IP regeneration in mailto URLs
141 * [Fix] Settings: Allow spaces in selector regexps
142 * [Fix] Prevent use-after-free in Redis callbacks after session cleanup
143 * [Fix] Lua 5.4 compatibility in clickhouse and elastic plugins
144 * [Fix] Use exact map lookup for DKIM key_table instead of glob
145 * [Fix] Handle connection errors with io_uring backend in HTTP client
146 * [Minor] Update public suffix list
147
148 3.14.2: 10 Dec 2025
149 * [Feature] DMARC: Add --recheck-rua option to dmarc_report for RUA filtering at send time
150 * [Feature] Metadata exporter: Add multipart and msgpack formatters
151 * [Feature] Milter headers: Add remove_ar_from option for selective Authentication-Results header removal
152 * [Fix] Security: Backport security fixes from libucl 0.9.3
153 * [Fix] HTTP: Handle early server responses during request write
154 * [Fix] HTTP: Only apply early response handling for HTTP clients
155 * [Fix] MIME: Prevent splitting UTF-8 sequences in header encoding
156 * [Fix] URL: Normalize URLs with multiple slashes between host and path
157 * [Fix] URL: Use locale-independent patterns in URL encoding
158 * [Fix] Milter headers: Allow default_headers_order to be configured
159 * [Fix] Milter headers: Fix hierarchical domain matching in remove_ar_from map lookups
160 * [Fix] Aliases: Enable plugin by default to restore plus-addressing
161 * [Fix] DCC: Handle nil opts in plugin initialization
162 * [Fix] Neural: Fix Lua 5.4 compatibility issues
163 * [Fix] Reputation: Fix whitelist schema and selector-aware checking
164 * [Fix] Logging: Fix off-by-one when at the maximum tag length
165 * [Fix] Logging: Null-terminate the log tag when copying the header
166 * [Fix] Prometheus: Use double type for rspamd_scan_time_average metric
167 * [Fix] Build: FreeBSD 15 inotify build compatibility
168 * [Fix] Build: Remove deprecated OpenSSL engine.h include
169 * [Fix] Lua: Use 0 instead of LUA_OK for lua_pcall result comparison (Lua 5.1 compat)
170 * [Fix] Lua: Handle Lua 5.4 require returning two values
171 * [Fix] Lua: Use math.floor for Lua 5.4 integer division compatibility
172 * [Fix] Lua: Improve loadstring error handling for Lua 5.4 compatibility
173 * [Fix] Lua: Use userdata __gc for UCL objects in all Lua versions
174 * [Fix] Lua: Use ipairs for ordered iteration in header checks
175 * [Fix] Lua: Fix other places of Lua 5.4 rounding issues
176 * [Fix] Performance: Avoid repeated simdutf implementation detection on each call
177 * [Minor] Update public suffix list
178 * [Minor] Debian: Allow skipping ASAN build
179 * [Test] Add Lua 5.4 and cffi-lua support for testing
180 * [Test] Fix Python 3.12+ compatibility in test scripts
181 * [Test] Fix TCP tests for HTTP/1.1 compliance
182
183 3.14.1: 1 Dec 2025
184 * [Feature] Composites: Add inverted index for fast composite rule evaluation
185 * [Feature] Composites: Add bloom filter for fast negative symbol lookups
186 * [Feature] Composites: Add statistics tracking and control protocol command
187 * [Feature] Composites: Precompute atom types at config time
188 * [Feature] Multimap: Add combinator option for selector rules
189 * [Feature] SPF: Add rspamadm spf_flatten tool with macro preservation
190 * [Feature] URL: Add deep processing architecture with C-to-Lua filter consultation
191 * [Feature] URL: Add obfuscated URL detection to url_suspect plugin
192 * [Feature] URL: Add rspamd_util.decode_html_entities for HTML entity decoding
193 * [Feature] lua_shape: Add new validation library as tableshape replacement
194 * [Feature] lua_shape: Add T.callable() type for function validation
195 * [Feature] lua_shape: Add callable defaults support
196 * [Feature] Whitelist: Auto-mark symbols with SYMBOL_TYPE_FINE flag
197 * [Fix] url_suspect: Fix plugin causing massive false positives
198 * [Fix] url_suspect: Optimize for high URL volume messages
199 * [Fix] Network: Prevent infinite loop in split_networks_into_chunks()
200 * [Fix] Memory: Fix leak in custom tokenizer result handling
201 * [Fix] Composites: Fix group matchers handling in inverted index
202 * [Fix] Composites: Improve atom polarity detection in inverted index
203 * [Fix] Composites: Copy expression string to memory pool for Lua composites
204 * [Fix] lua_shape: Fix transform logic and tableshape compatibility
205 * [Fix] lua_shape: Fix registry to recursively resolve nested schemas
206 * [Fix] lua_shape: Improve error safety
207 * [Fix] Settings: Keep groups_*/symbols_* fields for runtime processing
208 * [Fix] URL: Encode redirect URLs to handle unencoded spaces and special characters
209 * [Fix] external_relay: Fix mixins and confighelp
210 * [Fix] RBL: Fix plugin transform schemas
211 * [WebUI] Update D3 libs with bug fixes and validation
212 * [WebUI] Restore hover colors for symbols
213 * [WebUI] Fix hover behavior outside status tables
214 * [Minor] Whitelist: Use contemporary API for maps
215 * [Minor] Migrate all plugins and libraries from tableshape to lua_shape
216 * [Minor] Simplify configuration by removing use_*_map flags
217 * [Minor] Add plugins registry with reworked mixins
218 * [Test] Add comprehensive tests for URL deep processing
219 * [Test] Isolate url_suspect tests with symbols_enabled
220
221 3.14.0: 10 Nov 2025
222 * [Feature] Fuzzy check: Add HTML fuzzy hashing for structural similarity matching
223 * [Feature] Fuzzy check: Add per-rule text_hashes toggle for HTML-only fuzzy rules
224 * [Feature] Fuzzy check: Add structured checks configuration with backward compatibility
225 * [Feature] Fuzzy storage: Implement full TCP protocol support with auto-switch
226 * [Feature] Fuzzy check: Add TCP connection management and error handling
227 * [Feature] URL: Add task:get_cta_urls() API for proper CTA domain extraction
228 * [Feature] URL: Move CTA processing into dedicated module
229 * [Feature] URL: Add url:get_hash() method for efficient deduplication without string conversion
230 * [Feature] GPT: Add web search context support with Redis caching
231 * [Feature] HTML: Add infrastructure for async URL rewriting with Lua bindings
232 * [Feature] HTML: Add task:rewrite_html_urls() and task:get_html_urls() Lua API
233 * [Feature] WebUI: Implement dark mode with theme toggle and auto detection
234 * [Feature] Aliases: Add advanced resolution with loop detection for converging paths
235 * [Feature] Milter: Add ESMTP argument parsing with Lua API access
236 * [Feature] Milter: Add per-recipient ESMTP args parsing and metadata access
237 * [Feature] Milter: Support array of positions for remove_headers operations
238 * [Feature] Proxy: Add client IP preservation in message headers through chain
239 * [Feature] Rspamc: Add milter.add_headers object format support to --mime
240 * [Feature] Configwizard: Add Postfix integration wizard using postconf utility
241 * [Feature] Build: Add comprehensive BSD workflows (FreeBSD, NetBSD, OpenBSD) with Lua version selection
242 * [Feature] Build: Add automated code review GitHub Actions workflow with Rspamd-specific guidelines
243 * [Feature] Build: Add Docker-based integration test suite with ASAN and real corpus
244 * [Feature] Build: Add automatic public suffix list synchronization
245 * [Feature] Multimap: Add support for symbols with leading numerals
246 * [Feature] DMARC: Add Auto-Reply-To and Precedence headers to prevent out-of-office replies
247 * [Feature] Platform: Add NetBSD memory usage tracking support
248 * [Feature] Utilities: Add fuzzy Redis migration utility
249 * [Feature] Bayes: Allow skipping local/authenticated mail in autolearn condition
250 * [Feature] ARC: Add DKIM signing key API for flexible ARC signing
251 * [Feature] Logger: Add type specifiers support for better formatting
252 * [Feature] Heap: Add rspamd_heap_push_slot to eliminate double allocation
253 * [Fix] DNS: Preserve req->pos during reply validation to prevent packet truncation on UDP-to-TCP retransmits
254 * [Fix] DNS: Regenerate transaction ID before copying to TCP buffer to avoid collisions
255 * [Fix] DNS: Fix nameserver round-robin when using /etc/resolv.conf
256 * [Fix] DNS: Fix TCP uninitialized memory leak
257 * [Fix] DMARC: Add batching and forced GC for Redis connections to prevent pool exhaustion
258 * [Fix] DMARC: Validate and normalize batch_size to prevent fractional indexing and loop errors
259 * [Fix] DMARC: Refactor reporting to use helper functions and async maps
260 * [Fix] Allocator: Fix jemalloc/system malloc mixing in getline() to prevent crashes
261 * [Fix] Allocator: Fix allocator mismatches in hiredis
262 * [Fix] Allocator: Fix allocator mismatches in libucl
263 * [Fix] Hyperscan: Use runtime version instead of compile-time for database validation
264 * [Fix] Hyperscan: Auto-recreate invalid unserialized cache files on version mismatch
265 * [Fix] Memory: Fix leaks in fuzzy storage khash tables
266 * [Fix] Memory: Fix leaks in upstream address parsing
267 * [Fix] Memory: Fix leaks in *-any address parsing
268 * [Fix] Memory: Fix OpenSSL providers cleanup
269 * [Fix] Memory: Fix UCL object memory leak in Lua integration
270 * [Fix] Memory: Fix stat metadata tokenization leak
271 * [Fix] Fuzzy TCP: Fix double-release in fuzzy_tcp_session
272 * [Fix] Fuzzy TCP: Fix refcount leak in destructor
273 * [Fix] Fuzzy TCP: Fix timeout handling and buffer overflow
274 * [Fix] Fuzzy TCP: Fix endianness mismatch in framing protocol
275 * [Fix] Fuzzy TCP: Fix race conditions and fd reuse bugs
276 * [Fix] Fuzzy TCP: Use pure ev_timer for session timeouts
277 * [Fix] Fuzzy TCP: Fix server replies and client event handling
278 * [Fix] Shutdown: Keep srv events active during shutdown to track auxiliary processes
279 * [Fix] ARC: Restore strict header ordering to comply with RFC 8617
280 * [Fix] ARC: Add ed25519 key support
281 * [Fix] Composites: Implement two-phase evaluation for postfilter dependencies
282 * [Fix] Composites: Use null-terminated string for symbol lookup
283 * [Fix] URL: Refactor extraction to prevent DoS with hash-based deduplication
284 * [Fix] URL: Add 50k URL limit with warning for DoS protection
285 * [Fix] URL: Skip HTML_DISPLAYED URLs in CTA detection
286 * [Fix] URL: Fix CTA priority preservation in extract_specific_urls
287 * [Fix] Bayes: Improve Redis server discovery
288 * [Fix] Bayes: Only bypass learn when header value matches
289 * [Fix] ESMTP: Robust per-recipient parsing in milter with safe cursor advance
290 * [Fix] ESMTP: Refcount ESMTP args in proxy_session_refresh to avoid use-after-free
291 * [Fix] ESMTP: Correct Lua stack cleanup in lua_task_get_rcpt_esmtp_args
292 * [Fix] HTML: Correct attribute value offset calculation for URL rewriting
293 * [Fix] HTML: Add HTML entity encoding for URL rewriting
294 * [Fix] HTML: Fix segfault due to incorrect HTML features access
295 * [Fix] HTML: Fix frequency-based ordering in domain hashing
296 * [Fix] HTML: Fix shingles hash generation bugs
297 * [Fix] HTML: Fix memory leaks in shingles generation
298 * [Fix] HTML: Fix memory management in html_cta.process_html_links
299 * [Fix] HTML: Fix CSS class normalization in fuzzy tokens
300 * [Fix] HTML: Fix cache key collision between text and HTML fuzzy hashes
301 * [Fix] OpenBSD: Fix kinfo_proc structure member names
302 * [Fix] OpenBSD: Disable Hyperscan (not available)
303 * [Fix] FreeBSD: Fix zstd package name
304 * [Fix] FreeBSD: Add IGNORE_OSVERSION for package version mismatches
305 * [Fix] NetBSD: Setup pkgin and PKG_PATH before installing packages
306 * [Fix] NetBSD: Fix missing dependencies and package names
307 * [Fix] BSD: Remove -j flag from ninja in all BSD workflows
308 * [Fix] Multimap: Handle symbols with leading numerals
309 * [Fix] Aliases: Prevent creation of malformed email addresses
310 * [Fix] Aliases: Fix alias loop detection for converging paths
311 * [Fix] Aliases: Fix is_local_domain to support backend objects
312 * [Fix] Aliases: Correct to_local when no recipients present
313 * [Fix] Aliases: Fix set_addr validation to prevent malformed addresses
314 * [Fix] MIME: Remove Authentication-Results and anonymize envelope-from in Received headers
315 * [Fix] Mempool: Prevent double-free in destructor cleanup
316 * [Fix] Rspamadm: Unbreak dnstool command
317 * [Fix] Integration tests: Fix ASAN configuration and startup diagnostics
318 * [Minor] Replace GHashTable with khash in fuzzy_check.c and lua_textpart_get_cta_urls
319 * [Minor] Update cache key prefix to match module name in llm_search_context
320 * [Minor] Fix llm_search_context to follow Rspamd idioms
321 * [Minor] Refactor llm_search_context to use lua_cache module
322 * [Minor] Address review comments in various modules
323 * [Minor] Fix droid usage
324 * [Minor] Use GPT-5 Codex for code reviews
325 * [Minor] Update libucl with automatic stack management
326 * [Rework] Prioritize CTA URLs in redirector and Lua helpers
327 * [Rework] RBL configuration: Add new from selectors, content_urls checks, and lower_utf8 for hashed domains
328 * [Rework] Make Bayes learn guards configurable
329 * [Rework] Refactor element visibility control to use Bootstrap classes
330 * [Rework] Use postconf utility for Postfix configuration in configwizard
331 * [Rework] Remove Lua-level HTTP header parsing in ESMTP args getters
332 * [Rework] Add CFG_REF_* macros with debug logging for config refcounting
333 * [Rework] Move OpenSSL providers from global to libs_ctx
334 * [Rework] Convert heap to fully intrusive kvec-based implementation
335 * [Rework] Add specialized pool types for long-lived and short-lived allocations
336 * [Rework] Improve memory pool destructors with smart preallocation based on pool type
337 * [Project] Restrict code review workflow to authorized maintainers
338 * [Project] Add Claude Code and Cursor AI assistant configuration
339 * [WebUI] Replace Glyphicons with FontAwesome SVG icons
340 * [WebUI] Update CodeJar to version 4.3.0
341 * [WebUI] Update Node.js and ESLint
342 * [WebUI] Update D3-based visualization libs
343 * [WebUI] Replace deprecated alert-error class with alert-danger
344 * [WebUI] Add search syntax hint to history table filter input
345 * [WebUI] Fix theme toggle default to auto
346 * [WebUI] Keep classifiers list when request is skipped
347 * [WebUI] Repopulate classifier dropdown
348 * [WebUI] Add comment for removeEventListener
349 * [WebUI] Fix icon rendering race condition in tab initialization
350 * [Test] Add comprehensive Lua unit tests for HTML URL rewriting
351 * [Test] Add unit tests for HTML URL rewriting patch engine
352 * [Test] Add functional tests for HTML fuzzy hashing
353 * [Test] Add ARC chain verification tests with multiple signatures
354 * [Test] Add e2e for classifier dropdown population
355 * [Test] Multimap symbol with leading numerals
356 * [Test] Sync public suffix list automatically
357 * [Test] Update JS linters
358 * [Test] Fix integration test environment variable passing
359 * [Test] Add detailed error output for integration test failures
360
361 3.13.2: 5 Oct 2025
362 * [Feature] Fuzzy check: Add separate encryption keys for read and write operations
363 * [Feature] DKIM: Add ED25519 support for DKIM signing and verification with OpenSSL version checks
364 * [Feature] Vault: Add HashiCorp Vault KV version 2 support for DKIM key management
365 * [Feature] MetaDefender: Add MetaDefender Cloud Lua module for SHA256 hash lookups
366 * [Feature] LLM: Add user/domain context support for LLM-based classification with Redis-based conversation context
367 * [Feature] DMARC: Add RUA address exclusion configuration option
368 * [Fix] DKIM: Fix relaxed bodyhash calculation for lines with only spaces to comply with RFC 6376
369 * [Fix] DKIM: Fix ED25519 key loading to prevent memory corruption in union handling
370 * [Fix] HTTP maps: Enforce server-controlled refresh intervals and prevent aggressive polling
371 * [Fix] HTTP maps: Prevent time_t overflow in expires header processing
372 * [Fix] Once received plugin: Fix duplicate symbol addition by changing break to return
373 * [Fix] Redis: Propagate unused Sentinel options properly
374 * [Fix] Fuzzy check: Fix reply decryption when using separate read/write keys
375 * [Fix] Fuzzy check: Add fallback when only one specific encryption key is set
376 * [Fix] Fuzzy check: Fix duplicate key filtering in reply decryption
377 * [Fix] Fuzzy ping: Allow read/write servers configuration
378 * [Minor] Fuzzy check: Refactor encryption key selection into helper functions
379 * [Minor] Fuzzy check: Stop early when found a correct key
380 * [Minor] Add cursor rules for development
381
382 3.13.1: 30 Sep 2025
383 * [Feature] Archive module: Full support for encrypted ZIP archives with ZipCrypto and AES encryption
384 * [Feature] Archive module: Both reading and writing of AES-encrypted ZIP archives is supported
385 * [Feature] Archive module: Updated Lua bindings for libarchive
386 * [Feature] Encrypted maps: Support for encrypted maps to enable new distribution scenarios
387 * [Feature] Redis TLS: Configurable TLS connections in Redis backend
388 * [Feature] Map helpers alignment: Enforce 64-byte alignment to prevent unaligned memory access
389 * [Feature] Enhanced CLI for secretbox with additional security test coverage
390 * [Fix] MIME encoding: Major overhauls and multiple fixes for MIME encoding logic
391 * [Fix] MIME encoding: Improved handling and decoding of UTF-8 in MIME headers
392 * [Fix] Learning system: Numerous fixes to learn checks and autolearn flag handling
393 * [Fix] Learning system: Prevention of duplicate message learning
394 * [Fix] Learning system: Extended multiclass learning test coverage
395 * [Fix] Critical: Fixed bug when converting zero-length strings to numbers
396 * [Fix] Critical: Fixed XML prolog detection in lua_magic module
397 * [Fix] Build: Fixed build issues on 32-bit platforms
398 * [Fix] Compatibility: Improved compatibility with Lua versions above 5.1
399 * [Fix] Empty input: Addressed issues with empty input handling in lua_magic
400 * [Fix] Testing: Improved stability of automated testing with multiple test fixes
401 * [Fix] Minor compatibility improvements (buffer allocation, missing cmath include)
402
403 3.13.0: 17 Sep 2025
404 * [Conf] Add defaults
405 * [Conf] Fix JB IDE damage
406 * [Feature] Add a signal from main to workers for workers ready state
407 * [Feature] Add lua_util.fold_header_with_encoding
408 * [Feature] Add some convenience options to rspamc
409 * [Feature] Add some more OS utility functions
410 * [Feature] Add symbols proxy for piecewise changes
411 * [Feature] Allow lua callback maps to be filled line by line
412 * [Feature] Allow selectors in regexp maps expressions
413 * [Feature] Allow to pass expression flags in the regexp plugin
414 * [Feature] Detect part types in mime parser
415 * [Feature] Resolve DNS nameservers names using getaddrinfo
416 * [Fix] Bayes: Try to be bug-to-bug compatible
417 * [Fix] Check skip_hashes for the returned hashes
418 * [Fix] Fix DL lists initialisations
419 * [Fix] Fix double free in the client...
420 * [Fix] Fix end-to-end proxy compression
421 * [Fix] Fix l= calculations again
422 * [Fix] Fix lua state setting ambiguity
423 * [Fix] Fix order of descriptor closing
424 * [Fix] Fix probabilities overflow
425 * [Fix] Fix rules setup
426 * [Fix] Fix statfiles ordering
427 * [Fix] Fix various corner cases and tests
428 * [Fix] Fix whitelist options in the arc module
429 * [Fix] GPT: Fix occasional damage
430 * [Fix] GPT: fix processing of messages with no subject
431 * [Fix] Prevent WebUI crash with empty RRD
432 * [Fix] Store html attributes that are empty
433 * [Fix] Try to fix learned order
434 * [Fix] Use C++20 standard consistently to resolve ODR violations
435 * [Fix] Use a more straightforward approach for learn cache
436 * [Fix] fix error check in lua_dkim_tools.lua
437 * [Project] Add CTA analytics engine
438 * [Project] Add ability to create custom tokenizers for languages
439 * [Project] Add controller learn endpoints
440 * [Project] Add support of granular timeouts to plugins and maps
441 * [Project] Add tests and fix stuff
442 * [Project] Add tests for LLM provider, fix various issues with metatokens
443 * [Project] Apply changes to bayes_expiry plugin
444 * [Project] Create an isolated API for external tokenizers
445 * [Project] Extract more features from HTML messages
446 * [Project] Fix Lua API and some constexpr compatibility
447 * [Project] Fix binary classification and lua scripts
448 * [Project] Fix more calculation issues
449 * [Project] Fix other classification and learning issues
450 * [Project] Fix scoped compilation again
451 * [Project] Fix symbols finalisation
452 * [Project] Fix unlearn stuff
453 * [Project] Fix various issues
454 * [Project] Fix various other issues
455 * [Project] Further updates
456 * [Project] Implement backoff for upstreams revival
457 * [Project] Implement more flexible http timeouts
458 * [Project] Implement scoped compilation
459 * [Project] Implement scoped regexp cache system
460 * [Project] Multi-class classification project baseline
461 * [Project] Rework rspamc to allow training of different neural types
462 * [Project] Rework system of html tags to allow more tag types
463 * [Project] Rework tokenizers initialisation
464 * [Project] Some rework of the CTA defaults
465 * [Project] Start implementation of the rules maps
466 * [Project] Start to implement better revive strategy for upstreams
467 * [Project] Store regexp rules state to avoid incomplete/orphaned rules
468 * [Project] Support more common html attributes
469 * [Project] Take button weight into consideration
470 * [Project] Use re_cache scopes for maps
471 * [Rework] Fix logger format string mismatch
472 * [Rework] MIME detection via Lua Magic; enforce cfg in Lua task API
473 * [Rework] Return back N-ary optimizations for arithmetic-alike expressions
474 * [Rework] Use GLib agnostic type for words
475 * [Rework]Refactor MIME detection via Lua Magic; enforce cfg in Lua task API
476 * [Rules] Make bitcoin expression to use explicit flags
477
478 3.12.1: 17 Jun 2025
479 * [Feature] Add /bayes/classifiers HTTP endpoint
480 * [Feature] Further improvements in scheduling next checks
481 * [Fix] Another fix for maps concurrent load
482 * [Fix] Do not add log tag header in milter logic
483 * [Fix] Do not explicitly add Connection header if it's there
484 * [Fix] Fix proxy headers duplication
485 * [Fix] Fix several issues with the lua_logger
486 * [Fix] Make logger more graceful when dealing with format arguments
487 * [Fix] Try to avoid incomplete writes
488 * [Rework] Eliminate maps locking
489
490 3.12.0: 09 Jun 2025
491 * [CritFix] In lua-ucl disable macros and file variables by default
492 * [Feature] Add keep-alive support
493 * [Feature] Add some convenience methods
494 * [Feature] Add support for separate read and write servers in fuzzy check
495 * [Feature] Allow CDB files as external maps
496 * [Feature] Allow to specify Redis version
497 * [Feature] Allow to specify extra headers in Rspamd proxy
498 * [Feature] Allow to specify log tag in proxy
499 * [Feature] Allow to specify max log tag length for all log messages
500 * [Feature] Allow to use HTTPS when connection to backends in proxy
501 * [Feature] Output content for all maps
502 * [Feature] Plugin to integrate with Contextal platform
503 * [Feature] Show all maps status
504 * [Fix] Add fail check for cfg transform for some corner cases
505 * [Fix] Add header with reason everytime (not only for ham) and use correct value for header
506 * [Fix] Add null check for master_conn->up in proxy backend error handler
507 * [Fix] Allow 'Hash' in Access-Control-Allow-Headers
508 * [Fix] Arc: Use tonumber when comparing
509 * [Fix] As we have replxx library, always use it
510 * [Fix] Backport some issues from libucl
511 * [Fix] Filter invalid domains in fuzzy extra data
512 * [Fix] Fix maps ids
513 * [Fix] Fix race condition in maps loading by unlocking backend on switch
514 * [Fix] Fix static maps description passing
515 * [Fix] Fix variable propagation (no functional change)
516 * [Fix] Fix various issues
517 * [Fix] Greylist: Improve body hash calculations
518 * [Fix] Known senders: More recipients test logic
519 * [Fix] Known senders: Use the same logic as in the replies module
520 * [Fix] Prevent crashes when accessing upstream address in self-scan mode
521 * [Fix] Really fix local objects filtering, sigh...
522 * [Fix] Update default URL for openphish
523 * [Fix] Use bundled libfmt everywhere
524 * [Fix] Use safe parsers everywhere except configuration
525 * [Fix] correct logic error in milter_headers.lua: skip_wanted()
526 * [Fix] initialize ollama result table
527 * [Fix] libmime: declare comparators const for doctest 2.4.12 compatibility
528 * [Project] Modernize cmake
529 * [Project] Rework OSDep
530 * [Rework] Replies: consider all recipients and use smtp ones
531 * [Rework] Store shared maps data separately
532 * [Rework] Use locks/loaded per backend for all maps
533
534 3.11.1: 08 Mar 2025
535 * [Feature] Add 'noop' redis backend for scripts running
536 * [Feature] Add Redis caching framework
537 * [Feature] Add UTF8 `sub` and `len` variants for rspamd_text
538 * [Feature] Allow adding timers to task (respecting symbols)
539 * [Feature] Allow additional categories to be defined in GPT
540 * [Feature] Allow fine-grained control on keys permissions
541 * [Feature] Allow individual `read_only` flag per key
542 * [Feature] Allow multiple lua scripts for fuzzy storage
543 * [Feature] Allow to add periodic functions in Lua API
544 * [Feature] Allow to disable rbls from map
545 * [Feature] Allow to hash any Lua types
546 * [Feature] Allow to store shingles as opaque Lua data
547 * [Feature] Cache LLM replies
548 * [Feature] GPT: Add ollama support
549 * [Feature] GPT: Support reason adding
550 * [Feature] Improve prompt and use plaintext instead of JSON
551 * [Feature] Lua_task: Allow to load data into the existing task
552 * [Feature] More additions
553 * [Feature] Pass shingles to Lua scripts
554 * [Feature] Preliminary implementation of LLM based anonymizing
555 * [Feature] Support LLM models consensus
556 * [Feature] Try to check maps earlier if their expires is too long
557 * [Feature] Use debug module name from caller in lua_cache
558 * [Fix] Add timer update before timer setting
559 * [Fix] Allow to work with no ratelimits
560 * [Fix] Always create ratelimit buckets
561 * [Fix] Avoid collision hacks in mempool variables hash
562 * [Fix] Expire neural ham and spam sets so they not hangup in redis indefinitely
563 * [Fix] Fix crash on FreeBSD when Rspamd is built without hyperscan
564 * [Fix] Make table digests consistent
565 * [Fix] RBL: fix use of `content_urls` and `images` inside `checks`
566 * [Fix] Verify key type to match DKIM signature type
567 * [Fix] connIP is not correctly added to request
568 * [Fix] properly close multipart/related boundary when adding text footer
569 * [Rework] GPT: Use cache framework
570
571 3.11.0: 16 Dec 2024
572 * [Conf] Add lua.local.d folder
573 * [Conf] Add more ways to extend Rspamd configuration
574 * [Conf] Allow to install examples conditionally
575 * [Conf] Fix comments in elastic.conf
576 * [Conf] Install examples
577 * [Conf] Use full hostnames for SURBL
578 * [CritFix] Allow to reupload scripts when Redis is restarted
579 * [CritFix] Fix ARC-Seal signing
580 * [CritFix] Properly check dynamic keys in fuzzy storage
581 * [Feature] Add LRU cache for last filled ratelimit buckets
582 * [Feature] Add include/exclude logic for headers
583 * [Feature] Add ratelimit util to manage last filled ratelimit buckets
584 * [Feature] Dump current ratelimits for fuzzy keys
585 * [Feature] GPT: Try harder to find JSON in NN reply
586 * [Feature] Improve address rotation algorithm
587 * [Feature] Show stats in rspamadm
588 * [Feature] Unify displayed part selection
589 * [Fix] Avoid null-bytes in Log-Tag header value.
590 * [Fix] Another story about char sign
591 * [Fix] Check DNS limits when resolving MX/PTR records
592 * [Fix] Dmarc: Properly encode structured headers
593 * [Fix] Do not abort when OpenSSL is broken, report that to a user
594 * [Fix] Fix dealing with happy eyeballs in SPF
595 * [Fix] Fix memory leak in `lua_new_text` invocations
596 * [Fix] Fix usage of the logging function
597 * [Fix] Load "default" provider as well as "legacy"
598 * [Fix] Milter headers: fold before encoding
599 * [Fix] More fixes to rfc2047 encoding
600 * [Fix] More things to fix
601 * [Fix] Phishing: Fix many cases of FP for the same domains
602 * [Fix] Remove USPOOF_SINGLE_SCRIPT_CONFUSABLE from the checks
603 * [Fix] Restore propagation of spam/ham learns
604 * [Fix] Sigh, another fix
605 * [Fix] Some fixes to `rspamadm ratelimit`
606 * [Fix] Some more fixes
607 * [Fix] Use `dkim_signing` for `sign_headers` option
608 * [Fix] Use correct type for keylen in lua_ucl_newindex
609 * [Fix] Use cumulative timeout when dealing with TCP connections
610 * [Fix] Use unsigned char for ragel machines
611 * [Project] Add routine to strip attachments
612 * [Project] Add tool to rspamadm
613 * [Project] Initial stuff to implement messages anonymization
614 * [Project] Keep Changelog updated
615 * [Project] Various fixes and `rspamadm mime strip` command
616 * [Rework] Allow `Content-Encoding` standard header for zstd compression
617 * [Rework] Breaking: Actualize elastic module, support Elastic 8 & OpenSearch 2, add index policy with logs retention and many more
618 * [Rework] Multimap should use only distinct text parts for content matching
619 * [Rework] Replace fastutf with simdutf
620 * [Rework] Rewrite rfc2047 encoding as it was totally broken
621 * [Rework] Update hiredis to 1.2.0
622
623 3.10.2: 21 Oct 2024
624 * [CritFix] Fix ARC-Seal signing
625 * [Fix] add EOF to openmetrics response in proxy and server
626
627 3.10.1: 16 Oct 2024
628 * [Feature] Update effective_tld_names.dat by @wdhdev in #5176
629 * [Fix] Use correct type for keylen in lua_ucl_newindex by @arkamar in #5169
630 * [Fix] Avoid null-bytes in Log-Tag header value by @smarsching in #5179
631 * [Fix] Do not abort when OpenSSL is broken, report that to a user by @vstakhov in #5188
632 * [Fix] Update hiredis library removing all hacks by @vstakhov in #5167
633 * [Fix] Remove proxy from url_redirector.conf as it not the option by @dragoangel in #5164
634 * [Fix] Some build fixes by @vstakhov in #5189
635 * [Fix] Some more fixes by @vstakhov in #5190
636
637 3.10.0: 30 Sep 2024
638 * [Conf] Add SenderScore RPBL return codes
639 * [Conf] Add SenderScore Reputationlist RBL
640 * [Conf] Increase scores for strange things in the archives
641 * [CritFix] The max size for signing key is actually 65 bytes for p256
642 * [Feature] Add rspamadm secretbox command
643 * [Feature] Add rspamd_cxx_unit_cryptobox for unit testing
644 * [Feature] Add support for OpenSSL 3.0
645 * [Feature] Add support for OpenSSL 3.0 for DKIM
646 * [Feature] Add tests for rspamd_cryptobox
647 * [Feature] Add tooling to encrypt strings in Lua
648 * [Feature] Allow differen modes for fuzzy rules
649 * [Feature] Allow to set negative group score limit via `min_score`
650 * [Feature] DMARC: Implement reporting.only_domains setting
651 * [Fix] Add workaround for the bug in OpenSSL < 3.0.8
652 * [Fix] Another fix for Redis schema
653 * [Fix] Another safe-guards for learning/classifying an empty message
654 * [Fix] Apply the same workaround for signing keys
655 * [Fix] Check message before trying to dereference pointer
656 * [Fix] Do not install doctest stuff
657 * [Fix] Encode headers that we send to milter add header
658 * [Fix] Fix DCC `rep` handling
659 * [Fix] Fix Redis scripts uploading when Redis is not ready
660 * [Fix] Fix and rework various parts
661 * [Fix] Fix compatibility with OSSL 1.0
662 * [Fix] Fix glib internals by setting locale in `rspamc`
663 * [Fix] GPT: Fix bug in condition check
664 * [Fix] Get rid of EVP_PKEY_CTX_set1_rsa_keygen_pubexp
665 * [Fix] Iterate over dynamic keys in fuzzy storage
666 * [Fix] Make tostring in UCL a bit less brain-damaged
667 * [Fix] More bogus sizes fix
668 * [Fix] Preserve the previous behaviour of RDNS_* checks
669 * [Fix] Rework DMARC to correctly handle spaces in DMARC records Issue: #4906
670 * [Fix] Sign key != encryption key, omg
671 * [Fix] Unify lua symbols registration
672 * [Fix] Use proper keys when doing asymmetric encryption
673 * [Project] Add API method to push unwrapped UCL object
674 * [Project] Add more stuff to transparent UCL
675 * [Project] Add parsing of key limits and expire date
676 * [Project] Add ratelimit parsing for fuzzy keys
677 * [Project] Allow manipulations with opaque UCL objects
678 * [Project] Allow to change log tag from HTTP request
679 * [Project] Implement expiration
680 * [Project] Implement per-key ratelimit
681 * [Project] Move ratelimit parsing stuff to a common library
682 * [Project] Remove NIST (OpenSSL) mode from cryptobox
683 * [Project] Remove NIST mode from everywhere
684 * [Project] Rework ratelimits check
685 * [Project] Some more fixes
686 * [Project] Start support of MIME UTF8
687 * [Project] Try to allow more transparent access of ucl elements
688 * [Rework] Allow more flexible keypair encoding
689 * [Rework] Breaking: Rewrite cfg transform and remove legacy
690 * [Rework] Change fuzzy error symbols
691 * [Rework] Change the logic of skipping symbols
692 * [Rework] Clean up legacy code
693 * [Rework] Implement new replies logic on the server's side
694 * [Rework] Remove control block support
695 * [Rework] Resolve rdns in a separate function
696 * [Rework] Use __builtin_cpu_supports where possible
697 * [Rework] Use a more straight structure for DKIM keys
698 * [Rules] Fix some old rules
699
700 3.9.1: 23 Jul 2024
701 * [Conf] Spf: Add R_SPF_PLUSALL symbol with some score
702 * [Feature] Spf: Treat SPF +all in a special way
703 * [Minor] Ensure some safety when checking weights
704 * [Minor] Fix several issues with flag propagation
705 * [Minor] Gpt: Improve prompt and add some conversion heursitics
706 * [Minor] Gpt: Remove top_p reduce temperature to 0
707 * [Minor] Gpt: Set response_format
708 * [Minor] Gpt: Use gpt-4o-mini by default
709
710 3.9.0: 12 Jul 2024
711 * [CritFix] Protect regexp matcher from regexps with empty patterns
712 * [Feature] Allow adding X-CMAE-Score header
713 * [Feature] Allow custom milter quarantine and tempfail messages
714 * [Feature] Allow to specify minimum weight in GPT plugin
715 * [Feature] Cloudmark: Add scores_symbols setting
716 * [Feature] Further optimization to the hot path
717 * [Feature] Make min_resolve_interval configurable
718 * [Feature] Report slow synchronous rules
719 * [Feature] Rspamc: add `files-list` option
720 * [Feature] Support metrics command in normal/proxy workers
721 * [Feature] Support reply in message pack format
722 * [Feature] Use msgpack in the client
723 * [Feature] Verify sanity of l= tag in DKIM
724 * [Feature] milter_headers: support not removing headers
725 * [Fix] Allow autolearn for the controller worker
726 * [Fix] Allow spaces in DMARC records
727 * [Fix] Allow to set 0 as number of rows to disable roll history
728 * [Fix] Always set the unlearn flag when relearning
729 * [Fix] Apply detection phase if fasttext could not detect language
730 * [Fix] Backport fixes from libucl
731 * [Fix] Backport multiple fixes from libucl
732 * [Fix] Change expiration logic for redis_cache
733 * [Fix] Check nconns when firing the final termination event
734 * [Fix] Do not apply tableshape for known senders
735 * [Fix] Do not crash if symbol is missing in the metric
736 * [Fix] Do not read out-of-boundary when doing base64 encoding
737 * [Fix] Do not save multipatterns to FS in certain cases
738 * [Fix] Fix another corner case that allows candidates to be freed without init
739 * [Fix] Fix documentation nesting
740 * [Fix] Fix dynamic_symbols in the multimap plugin
741 * [Fix] Fix inconsistent nesting in mime parts
742 * [Fix] Fix parsing of maps definitions
743 * [Fix] Fix shared memory proxying when compression is set
744 * [Fix] Fuzzy add/delete handlers are badly broken for compression
745 * [Fix] Honor dynamic thresholds for greylisting module
746 * [Fix] If we have one statfile disabled we need to disable all
747 * [Fix] Increase/decrease hash_key value for tokens depending on is_unlearn
748 * [Fix] Libucl: Fix messagepack autodetection
749 * [Fix] Resgore the collaterally removed line
750 * [Fix] Unset autolearn flag if we learn explicitly
751 * [Fix] Update `nconns` in proxy
752 * [Fix] Update greylisting threshold as it can be easily dynamic
753 * [Fix] Update is_spam in learned_ids when relearning
754 * [Fix] Use explicit timeouts in the metadata exporter
755 * [Fix] metric_exporter: avoid sending `nil` in metric values
756 * [Project] Add GPT plugin
757 * [Project] Add a tool to perform statistical analysis of classifiers
758 * [Project] Finally fix slow timer behaviour
759 * [Project] Implement fuzzy check retransmits backpressure
760 * [Project] Improve stats processing
761 * [Project] Reduce default window size of OSB tokenizer to 2
762 * [Project] Rework grow factor
763 * [Project] Start optimization of userdata hashing
764 * [Project] Use libarchive for troublesome archives
765 * [Rework] Allow metrics endpoint to be enabled for each scanner
766 * [Rework] Allow multiple conditions for dkim signing when using vault/redis
767 * [Rework] Introduce dynamic_rate_limit for ratelimits
768 * [Rework] Serialize control commands
769 * [Rework] Update fmt to version 11
770 * [Rework] Use direct hashing instead of string hashing
771 * [Rules] Added rules for detecting likely malware
772
773 3.8.2: 20 Feb 2024
774 * [Feature] Add extraction type for `from` maps
775 * [Feature] Allow to add templates to redis history prefix
776 * [Feature] Implement dynamic keys map in fuzzy storage
777 * [Feature] Lua_url: Add `to_http` method
778 * [Feature] Support JSON logging when in syslog mode
779 * [Fix] Deal with `Connection` and `Host` headers on proxying
780 * [Fix] Encode headers in metadata exporter
781 * [Fix] Fix initial maps load
782 * [Fix] Make stat tokens allocation consistent
783 * [Fix] Resolve issue with bayes stat in `rspamadm` mode
784 * [Fix] Try to fix url path issue
785 * [Rework] Breaking: Do not report module as action
786 * [Rework] Use khash instead of glib hashes for many reasons
787
788 3.8.1: 25 Jan 2024
789 * [Fix] Fix headers insertion in the ordered list
790 * [Fix] Fix learn error propagation
791 * [Fix] Fix learning with long prefixes
792 * [Fix] Fix potential double free by expclicitly zeroing pointers
793 * [Fix] Fix storing of the bayes tokens
794 * [Fix] Use short comments rather than long one
795
796 3.8.0: 19 Jan 2024
797 * [Project] Rspamadm fuzzyping command
798 * [Project] Use Redis scripts for Bayes statistics and cache
799 * [Project] Support JSON logging
800 * [CritFix] - Fix reported length of logging structure
801 * [Feature] Allow to set `max_users` for Redis bayes backend
802 * [Feature] Escape JSON when needed
803 * [Feature] Proxy: Allow `encrypted_only` option
804 * [Feature] Reiterate on gtube patterns
805 * [Feature] Support ping command in fuzzy storage
806 * [Feature] Support suppressing DMARC reporting for particular recipients
807 * [Feature] rbl: support disabling or replacing url_whitelist per RBL
808 * [Fix] Another try to fix setproctitle
809 * [Fix] Cleanup session on exit
810 * [Fix] Do not cleanup hyperscan files unless new ones are loaded
811 * [Fix] Fix bad access when printing pending events on failure path
812 * [Fix] Fix issues with the raw header on header insertion/modification
813 * [Fix] Fix overflow in fuzzy_stats command
814 * [Fix] Fix some corner cases when parsing maps with no newlines
815 * [Fix] Fix various issues with canonicalisation of the paths
816 * [Fix] Fix wrong raw_len usage
817 * [Fix] Make words selection random deterministic upon content
818 * [Fix] Properly set config field when creating tasks from Lua
819 * [Fix] Really fix the language detector statistical heuristic
820 * [Fix] Set loaded variable explicitly
821 * [Fix] dkim_signing: siging_table: lowercase before lookup
822 * [Fix] known_senders: fix config handling
823 * [Fix] rbl: fix `exclude_local`
824
825 3.7.5: 15 Dec 2023
826 * Add support for loongarch
827 * [Fix] Fix rspamadm lua logger
828 * [Fix] Fix systemd logging
829 * [Fix] dkim_signing: siging_table: lowercase before lookup
830 * [Minor] Fix build with no hyperscan
831 * [Minor] Try improve test stability
832
833 3.7.4: 14 Nov 2023
834 * [Enhancement] Add composite rule for suspicious URLs in suspicious messages
835 * [Fix] Another try to fix setproctitle
836 * [Fix] Do not cleanup hyperscan files unless new ones are loaded
837 * [Fix] Fix various issues with canonicalisation of the paths
838 * [Fix] Properly set config field when creating tasks from Lua
839 * [Fix] Set loaded variable explicitly
840 * [Fix] known_senders: fix config handling
841 * [Fix] rbl: fix `exclude_local`
842 * [Minor] Add missing <algorithm> include for gcc 14
843 * [Minor] Add rule for messages missing both X-Mailer and User-Agent header
844 * [Minor] Bundle fasttext as linux distributives are just useless
845 * [Minor] Enable fasttext on RPM based linux
846 * [Minor] Forgot it in one more place
847 * [Minor] Improve FREEMAIL_AFF capture rates
848 * [Minor] Limit fasttext to amd64 only
849 * [Minor] Properly search for fasttext include
850 * [Minor] Treat *.zpaq attachments as archives and harmful
851 * [Minor] Update to 3.7.4
852 * [Minor] force_actions: set a group for symbols
853 * [WebUI] Update map editor
854
855 3.7.3: 27 Oct 2023
856 * [Fix] Emergency fix for the hyperscan path error
857
858 3.7.2: 26 Oct 2023
859 * [Feature] rbl: support checking returncodes by CIDR
860 * [Feature] rbl: support checking returncodes by regex
861 * [Feature] rbl: support globbed return codes
862 * [Fix] DMARC reporting: fix reporting for subdomains
863 * [Fix] Deal with fmtlib exceptions properly
864 * [Fix] backport fix for dlfcn.h from backward-cpp
865 * [Rules] Blank spam detection
866
867 3.7.1: 07 Oct 2023
868 * [CritFix] Fix leak in `gzip` function
869 * [Feature] Add ICAP Content-Type and Filename
870 * [Feature] Add `logging`->`task_max_elts` option
871 * [Feature] Add utility to split string like stuff for C++ code
872 * [Feature] Allow to set HTTP auth parameters for the maps
873 * [Feature] Check for plugin configuration errors on `configtest`
874 * [Feature] `known_senders` plugin
875 * [Feature] Use backward-cpp instead of manual libunwind stuff
876 * [Feature] rbl: support checking numeric URLs in isolation
877 * [Fix] CMakeLists.txt remove whitespace added by linter as it makes tests fail
878 * [Fix] Change Date: header location to conform with RFC
879 * [Fix] Correct format pattern for RE tree tempfile name
880 * [Fix] Correct format string for unw_word_t
881 * [Fix] Do not accept invalid ucl object types
882 * [Fix] Do not pollute public headers with libev internals
883 * [Fix] Do not set output type if list application failed
884 * [Fix] Fix `url:set_redirected` method
885 * [Fix] Fix format string and some length issues
886 * [Fix] Fix grammar definition for content-disposition attributes
887 * [Fix] Fix lua schema enrichment logic for Redis params
888 * [Fix] Fix lua stack corruption when logging large tables
889 * [Fix] Fix merge table utility
890 * [Fix] Fix output of non-RSA DKIM keys
891 * [Fix] Fix some corner cases of single-host urls parsing
892 * [Fix] Fix various issues in the `url_redirector` plugin
893 * [Fix] MISSING_MIMEOLE: avoid matching messages from Android GMail app (#4561)
894 * [Fix] Prevent DNSWL sabotage
895 * [Fix] Try to fix unzip function
896 * [Fix] rbl: really fix dependency registration when symbols_prefixes is used
897 * [Fix] rspamadm mime: arguments beginning with letter `t`
898 * [Rework] Breaking: return back to semver
899 * [Rework] Move rcl logic to C++
900
901 3.6: 03 Aug 2023
902 * [Conf] Add `one_shot` to some specific multimap rules
903 * [Conf] Add language detection configuration
904 * [Conf] Add missing attributes for the language detection configuration
905 * [Conf] Remove outdated composite rules
906 * [Feature] Add `sentinel_password` option
907 * [Feature] Add ability to deny specific fuzzy flags by default
908 * [Feature] Add controller endpoint to get fuzzy hashes from messages
909 * [Feature] Add extra symbol when URL redirector reaches nested limit
910 * [Feature] Add function to transliterate utf8 to ascii with some normalisation
911 * [Feature] Add html parsing limit
912 * [Feature] Add order to urls structure
913 * [Feature] Add some missing functions to `lua_rsa` library
914 * [Feature] Allow fuzzy workers to exchange blocked information
915 * [Feature] Allow to have weak flags in fuzzy storage
916 * [Feature] Allow to read options from maps in the multimap plugin
917 * [Feature] Allow to use other methods when fasttext detection is enabled
918 * [Feature] Count stats per key per flag
919 * [Feature] Finish all features of dkim_keygen in Lua
920 * [Feature] Khash: Allow static initialisation
921 * [Feature] Maps: Add on_load support
922 * [Feature] Preliminary implementation of dynamic composites
923 * [Feature] Process HTML parts before text ones
924 * [Feature] Reorganise struct rspamd_url to be 64 bytes size
925 * [Feature] Save fuzzy ratelimit buckets
926 * [Feature] Use in-place deflation for strings
927 * [Feature] external_relay: add ip_map strategy
928 * [Fix] Avoid race between config new/free by using a counter
929 * [Fix] Do not use `rspamadm.dkim_keygen`
930 * [Fix] Feed fasttext language model with the pre-tokenized words
931 * [Fix] Fix `rspamd_has_only_html_part`
932 * [Fix] Fix an old issue with order of destruction race between redis pool and lua
933 * [Fix] Fix format string usage
934 * [Fix] Fix parsing due to old bug revealed
935 * [Fix] Fix parsing of the mask values that are invalid
936 * [Fix] Ignore non-unique stop words
937 * [Fix] Include the last character when parsing the last header with no value
938 * [Fix] More fixes to fuzzystat
939 * [Fix] Set proper counter
940 * [Fix] Try harder to clean pending bucket
941 * [Fix] Try harder to remove bad hyperscan files
942 * [Fix] Update stats before encryption...
943 * [Fix] dmarc gramar - allow spaces before ";"
944 * [Fix] rbl: fix dependency registration when symbols_prefixes is used
945 * [Fix] remove obsolete rspamd-redirector files
946 * [Fix] test external_relay: count should always be the last rule, as it have no matching condition
947 * [Project] Allow to register multimap symbols dynamically
948 * [Project] Implement fasttext language detection
949 * [Rework] Default max shots must not influence options
950 * [Rework] Write dkim keygen tool in lua
951 * [Rules] Add thread hijacking composite rule
952
953 3.5: 17 Mar 2023
954 * [Conf] Clarify `timeout` in rspamd_proxy
955 * [Conf] Fix hashbl
956 * [Conf] Add SURBL hashbl support (WIP)
957 * [Conf] RBL: Fix selector
958 * [Conf] Reduce the default timeout
959 * [CritFix] Deserialise hyperscan to the page-aligned space to prevent alignment issues
960 * [CritFix] Fill path field in hyperscan notice command
961 * [Feature] Add `thresholds` field to the scan result
962 * [Feature] Add possibility to execute lua scripts for blocked fuzzy clients
963 * [Feature] Add preliminary support of the external maps in the multimap plugin
964 * [Feature] Allow to build a map by combining tuples of selectors
965 * [Feature] Allow to query external maps for settings
966 * [Feature] Allow to specify `selector_alias` in the maps definition
967 * [Feature] Enable Mime part filters on antivirus module
968 * [Feature] Improve ratelimit redis scripts
969 * [Feature] Selectors: Add specific_urls_filter_map extractor
970 * [Feature] Some rework of the selectors framework
971 * [Fix] Add O_CREAT flag when creating a file
972 * [Fix] Add a database check function unless we have anything from Hyperscan
973 * [Fix] Add hyperscan databases sanity check
974 * [Fix] Add workaround for ENOBUFS error on sending
975 * [Fix] Do not do `lstat` when we are creating file
976 * [Fix] Finally get rid of RSPAMD_USE_47BIT_LIGHTUSERDATA_HACK
977 * [Fix] Fix boundaries that contain only dashes
978 * [Fix] Fix off-by-one error in css tokenizer
979 * [Fix] Fix url reputation plugin
980 * [Fix] Fix usage of the Redis config schema as `extra_fields`
981 * [Fix] Further checks for the hs_scratch_alloc
982 * [Fix] Honor group flag for one shot
983 * [Fix] Normalize glob paths to avoid hash table misses
984 * [Fix] Ratelimit: Use unpack for `HMGET` return value
985 * [Fix] Rbl: Fix helo check pipeline
986 * [Fix] Replace broken strict_domains with phishing_exceptions
987 * [Fix] Restore `strict_domains` support
988 * [Fix] Return true from has_urls(true) if only emails are present
989 * [Fix] Rework lists applications
990 * [Fix] Set symcache item in coroutine calls
991 * [Fix] Treat `hs_allocate_scratch` errors as non-fatal
992 * [Fix] Treat hostnames with no dots as eSLD of their own
993 * [Fix] received: filtering of artificial header
994 * [Project] Add external maps support
995 * [Rework] Breaking: Do not report soft reject in history
996 * [Rework] Convert chartable plugin to c++ for convenience
997 * [Rework] Use a different approach for customization of the settings
998 * [Rules] Mid: Add MID_END_EQ_FROM_USER_PART rule
999
1000 3.4: 01 Nov 2022
1001 * [CritFix] Restore compatibility with the integrations and headers alterations
1002 * [Feature] Milter_headers: Add `x-rspamd-action` routine
1003 * [Feature] Share hyperscan database among processes
1004 * [Fix] Another corner case in url parsing
1005 * [Fix] Another fix for the enable password
1006 * [Fix] Another try to fix close method in lua_tcp
1007 * [Fix] Fix additional fields in the Redis schema
1008 * [Fix] Fix emoji joiner FP
1009 * [Fix] Fix favicon.ico Content-Type header
1010 * [Fix] Fix hang when close is used
1011 * [Fix] Lua_tcp: Sigh, another try to fix `close` invocation
1012 * [Fix] Mx_check: Cache the fact of a missing MX record
1013 * [Fix] Try to fix parsing of the unencoded `>` characters in html attributes
1014 * [Fix] Try to fix the case where password == enable_password
1015 * [Project] (Re)implement hyperscan caching
1016 * [Project] Rework cleanup
1017 * [Project] Synchronize hyperscan caches via the main process
1018 * [Rework] Convert multipattern to use hyperscan tools
1019 * [Rework] Make http normalize path function a generic function
1020 * [Rework] Split locked and unlocked files, as mmap does not need flock normally
1021 * [Rework] Start movement of the hyperscan related routines into a single unit
1022 * [Rework] Store the current worker, so other libraries could use this information
1023 * [Rework] Use blocking socket for IPC between main and workers
1024 * [Rework] Use more predictable size for commands buffers
1025 * [Rules] Do not insert ONCE_RECEIVED_STRICT on RDNS missing
1026 * [Rules] Reduce score of HTTP_TO_HTTPS - subject to remove completely
1027
1028 3.3: 01 Oct 2022
1029 * [Conf] Add missing groups for whitelist module symbols
1030 * [CritFix] Neural: Fix keys regression after #3968
1031 * [Feature] Accept upstream in lua_tcp
1032 * [Feature] Add ability to statically maintain disabled/enabled patterns
1033 * [Feature] Add function to store upstreams for HTTP urls
1034 * [Feature] Allow augmentations set in Lua API
1035 * [Feature] Allow lua_http module to accept upstreams
1036 * [Feature] Allow to limit write access to fuzzy storage by key
1037 * [Feature] Allow to sort symbols output
1038 * [Feature] Check content for binary stuff before dumping it to Lua
1039 * [Feature] Implement symbols augmentations
1040 * [Fix] Add missing flags
1041 * [Fix] Add more sanity checks for rua in dmarc_report
1042 * [Fix] Adjust length of the fuzzy checks for short text parts
1043 * [Fix] Another try to fix add headers compatibility logic
1044 * [Fix] Another try to fix race condition in the runtime destruction
1045 * [Fix] Avoid cyclic references in symcache and fix memory leaks
1046 * [Fix] Avoid overriding IP with Sender IP
1047 * [Fix] BAD_REP_POLICIES did not trigger when message was classified as spam by Bayes
1048 * [Fix] Bind AF_UNIX DGRAM client connection to annonymous address
1049 * [Fix] Disable IPv6 lookups for Blocklist.de RBL
1050 * [Fix] Distinguish dynamic and static items
1051 * [Fix] Dkim: Ignore unknown DKIM kv pairs as stated in RFC
1052 * [Fix] Dmarc report: Use local timezone instead of GMT
1053 * [Fix] Do not exclude authenticated users from URIBL lookups
1054 * [Fix] Empty envelopes should not be emitted as arrays (json+messagepack) when populated envelopes are objects. This greatly complicates decoding in strictly typed languages.
1055 * [Fix] External_relay: Restore the originating hostname check
1056 * [Fix] Fix DKIM keys with spaces still allowing errors on invalid base64
1057 * [Fix] Fix copying of sockaddr_un addresses
1058 * [Fix] Fix crash with cname replies
1059 * [Fix] Fix dependencies propagation
1060 * [Fix] Fix iteration over milter headers
1061 * [Fix] Fix ordering when sorting symcache
1062 * [Fix] Fix reading of the cached maps
1063 * [Fix] Fix several issues with the HTTP keepalive parsing
1064 * [Fix] Fix stack smashing
1065 * [Fix] Fix synchronous auth/select in lua_redis
1066 * [Fix] Fix various symcache issues
1067 * [Fix] Ignore all (I hope) unknown DKIM signature KV pairs
1068 * [Fix] Ignore directories in RarV5 archives
1069 * [Fix] Libucl: avoid memory leak on objects merging
1070 * [Fix] Lua_tcp: Another try to fix closing logic
1071 * [Fix] Mempool: Fix alloc_array function to actually multiply nmembers by size
1072 * [Fix] Only check allowed fuzzy worker update ips for non-unix sockets
1073 * [Fix] Plug memory leak in regexp destruction with pcre2
1074 * [Fix] Properly check the original email flag
1075 * [Fix] Properly deal with `get_symbol/get_metric_symbol` ambiguity
1076 * [Fix] Properly parse expressions atoms
1077 * [Fix] Properly set `Host` in rspamd_proxy
1078 * [Fix] Rbl: Fix received positioned checks
1079 * [Fix] Remove check for a score with no symbol being registered
1080 * [Fix] Same fix for lua_tcp
1081 * [Fix] Skip cname records when processing SPF records
1082 * [Fix] Skip sending dmarc reports in no-opt mode fixes https://github.com/rspamd/rspamd/issues/4241
1083 * [Fix] Stop slow timer on task destruction
1084 * [Fix] Symcache: Do not use C style comparators in C++ sorts
1085 * [Fix] Try to avoid a corner case for `@` pattern
1086 * [Fix] Try to fix dkim reputation adjustements
1087 * [Fix] Try to fix passthrough results processing logic
1088 * [Fix] Try to fix the mess with read only flag
1089 * [Fix] Upstreams: Don't ignore revive_time config option
1090 * [Fix] Use proper format string, sigh...
1091 * [Fix] Use space category in ragel automata to resolve space characters
1092 * [Fix] Zstd: Fix compression with the new Zstd API
1093 * [Fix] milter_headers: Header fields may be inserted at wrong position.
1094 * [Project] Add experimental HTTP statistics backend
1095 * [Project] Add more methods for symbols addition
1096 * [Project] Add raii_sink file helper
1097 * [Project] Add some more methods
1098 * [Project] Add symbols processing methods
1099 * [Project] Allow `=` separated augmentations to be treated as kv pairs
1100 * [Project] Allow to extract augmentation values
1101 * [Project] Few more methods
1102 * [Project] Fix on conditions
1103 * [Project] Further efforts to make a more consistent architecture
1104 * [Project] Further rework
1105 * [Project] Further rework tracking
1106 * [Project] Further split of the code
1107 * [Project] Get rid of C style ctors/dtors
1108 * [Project] Http_stat: Notice statfiles when creating runtime
1109 * [Project] Implement dynamic items lookup and processing
1110 * [Project] Implement item finalization
1111 * [Project] Implement more methods
1112 * [Project] Implement runtime creation
1113 * [Project] Implement settings processing + some neats
1114 * [Project] Implement some conditions checks
1115 * [Project] Implement validation logic
1116 * [Project] More methods
1117 * [Project] Move runtime cache part to a separate unit
1118 * [Project] Move some more methods
1119 * [Project] Re-implement counters method
1120 * [Project] Reimplement dependencies processing
1121 * [Project] Remove obsoleted methods
1122 * [Project] Remove old code (finally)
1123 * [Project] Rework symbols execution
1124 * [Project] Some more adjustments in symbols registration
1125 * [Project] Start rewrite symcache in c++
1126 * [Project] Support augmentations with values
1127 * [Project] Symcache: Use ordered filters to avoid extra lookups
1128 * [Rework] Another movement
1129 * [Rework] Augmentations can now imply flags
1130 * [Rework] Further steps
1131 * [Rework] Further work on deps processing
1132 * [Rework] Implement cache resorting
1133 * [Rework] Isolate disable/enable logic for the configuration ucl objects
1134 * [Rework] Move item implementation to a separate header
1135 * [Rework] Multimap: Avoid prefilters usage where augmentations can be used
1136 * [Rework] Pass upstream when sending TCP requests
1137 * [Rework] Re-implement cache sorting
1138 * [Rework] Reimplement saving/loading the cache items
1139 * [Rework] Reiterate on priorities
1140 * [Rework] Rework files structure
1141 * [Rework] Rewrite rspamc in C++
1142 * [Rework] Simplify scores check and extend it to pre/post filters
1143 * [Rework] Switch minimum C++ standard version to C++20
1144 * [Rework] Try to fix the mess with types & flags
1145 * [Rework] Use another version of hash table from the same author
1146 * [Rework] Use dynamic items for calling callbacks
1147 * [Rework] Use dynamic items in the callbacks
1148 * [Rework] Use hash map for id->symbol mappings
1149 * [Rework] Use khash instead of uthash in rdns compression logic
1150
1151 3.2: 26 Mar 2022
1152 * [Conf] Score MIME_OBFUSCATED_ARCHIVE to 8 points
1153 * [Conf] Set one_shot for URIBL rules by default
1154 * [CritFix] Fix upstreams name resolution when there is also a port
1155 * [Feature] Add ROC feature to neural network plugin
1156 * [Feature] Add public suffic compilation utility
1157 * [Feature] Add support of Cloudmark
1158 * [Feature] Allow hyperscan for ppc64, as vectorscan now suports it.
1159 * [Feature] Allow to skip DNS resolution for keep-alive connections
1160 * [Feature] Aws_s3: Allow to store large parts separately
1161 * [Feature] BIMI: Add preliminary version of the BIMI plugin
1162 * [Feature] JSON endpoint for querying maps
1163 * [Feature] Lua_magic: Add a sane CSV heuristic
1164 * [Feature] Lua_mime: Add schema for message transfer
1165 * [Feature] Output average scan time in /stat endpoint
1166 * [Feature] Show average scan time in `rspamc stat` output
1167 * [Fix] Add guards to avoid race condition on TCP connection
1168 * [Fix] Allow spaces in DKIM key records
1169 * [Fix] Apply the similar fix to the url_reputation
1170 * [Fix] Avoid overwriting whitelisted_signers_map
1171 * [Fix] Backport PR from libucl
1172 * [Fix] Clear SSL errors
1173 * [Fix] ClickHouse cleanup of old partitions
1174 * [Fix] Do not double call error handler on ssl errors in the timeout path
1175 * [Fix] Do not forget to clear pointers on IOC reset
1176 * [Fix] External_relay: Remove useless check of the map value
1177 * [Fix] Find suspicious url encodings that could break url extraction
1178 * [Fix] Fix HTTP(s) client timeout
1179 * [Fix] Fix exclude flags setting
1180 * [Fix] Fix expanding of the variables
1181 * [Fix] Fix host header usage in lua_http
1182 * [Fix] Fix http maps shared memory cache cleanup
1183 * [Fix] Fix logic in HTML processing FSM
1184 * [Fix] Fix parsing of the compound mailto urls
1185 * [Fix] Fix processing captures from pcre2
1186 * [Fix] Fix removing from khash
1187 * [Fix] Fix stuctured headers pushing
1188 * [Fix] Further fix for i386 compilation
1189 * [Fix] Improve duplicate settings error reporting
1190 * [Fix] Lua: task:remove_result didn't work in some cases
1191 * [Fix] Output service parts as well
1192 * [Fix] Phishing: Deal with phishing + redirected URL
1193 * [Fix] Phishing: Fix finding domains in the phishing map
1194 * [Fix] Plug memory leak by using mempool for a copied address
1195 * [Fix] Properly find the request and the number of requested entries
1196 * [Fix] Rbl: Fix inversed logic of the url_full_hostname
1197 * [Fix] Read file maps if they were not pre-read during preload
1198 * [Fix] Restrict x86_64 assembly to x86_64
1199 * [Fix] Return a real number of recipients when dealing with aliases
1200 * [Fix] Rework unshedule DNS request function
1201 * [Fix] Support definition of ungrouped symbol in conf file, use group info from lua or other conf file
1202 * [Fix] Unschedule DNS request when clearing IO channel
1203 * [Fix] When checking for phishing, we need to convert punicode -> UTF8, not vice versa
1204 * [Fix] lua_cfg_transform - actions without score (discard)
1205 * [Fix] lua_cfg_transform - silly break break actions
1206 * [Fix] ratelimit - symbol per bucket
1207 * [Project] BIMI: Fix helper integration issues
1208 * [Project] Further DNS over TCP architecturing
1209 * [Project] Rdns: Add more functions for TCP based requests
1210 * [Project] Rdns: Add preliminary reading logic for TCP channels
1211 * [Project] Rdns: Add reaper for inactive TCP connections
1212 * [Project] Rdns: Add timeout logic for TCP requests
1213 * [Project] Rdns: Do not treat TCP channels failure as fatal
1214 * [Project] Rdns: Fix TCP connection mess
1215 * [Project] Rdns: Fix TCP stuff cleanup
1216 * [Project] Rdns: Fix various ownership issues
1217 * [Project] Rdns: Implement TCP writing logic
1218 * [Project] Rdns: Initial support of TCP IO channels
1219 * [Project] Rdns: More fixes in TCP handling
1220 * [Project] Rdns: Restore the previous EDNS0 size
1221 * [Project] Rdns: Send truncated replies via TCP
1222 * [Project] Rdns: Unregister TCP requests
1223 * [Rework] Allow to restore SSL handlers after keepalive pooling
1224 * [Rework] Allow to set a different behaviour for actions from settings
1225 * [Rework] Include SSL flag into keepalive hash
1226 * [Rework] Make `rspamadm dmarc_report` default behaviour more sane
1227 * [Rework] Mempool: Use explicit alignment
1228 * [Rework] Rdns: Use faster and more compact hash table for DNS requests
1229 * [Rework] Rework SSL flag operations
1230 * [Rework] Take disabled flag into account
1231 * [Rework] Timeouts are now global per event and not reseted by IO activity
1232 * [Rework] Use xxh3 as a default hash and fix memory/alignment issues
1233 * [Rules] Fix old rules to stop global functions usage
1234 * [Rules] Fix symbol for DKIM temporary failure
1235 * [Rules] Remove ancient and inefficient rules
1236 * [Rules] Slightly reduce MULTIPLE_FROM score
1237
1238 3.1: 01 Nov 2021
1239 * [Feature] Add junk_threshold for autolearn
1240 * [Feature] Add neural test command
1241 * [Feature] Antivirus: Allow to set fake eicar patterns for testing AV engines
1242 * [Feature] Lua_cdb: Add cdb building interface
1243 * [Feature] Ratelimit: Add per bucket configurations
1244 * [Feature] S3: Allow to store structured data in messagepack
1245 * [Fix] Add concept of uncancellable events to prevent use-after-free
1246 * [Fix] Add temporary guard to prevent linked list exploitation
1247 * [Fix] Another rework of the ucl hashing
1248 * [Fix] Another try to fix references safety
1249 * [Fix] Another try to fix rspamd_text passing in the selectors
1250 * [Fix] Avoid copy for received structure as it has raw C pointers
1251 * [Fix] Avoid dangling reference
1252 * [Fix] Correctly check numeric URLs in URL DNS lists
1253 * [Fix] Delete the correct pointer type
1254 * [Fix] Dmarc: Always lowercase domain
1255 * [Fix] Fix compilation of the hyperscan databases with errors
1256 * [Fix] Fix hash table lookup
1257 * [Fix] Fix http message flag shift
1258 * [Fix] Fix parsing of the from_hostname when it is an IP address
1259 * [Fix] Fix parsing of the unquoted attributes in HTML
1260 * [Fix] Fix passing of rspamd_text in selectors pipelines
1261 * [Fix] Fix rubbish QP sequences decoding
1262 * [Fix] Fix some complicated case with the closing tags parsing
1263 * [Fix] Fix the case when l tag is too small
1264 * [Fix] Html: Fix the case where only bgcolor is explicitly set
1265 * [Fix] Libucl: Fix deletion from ucl objects
1266 * [Fix] Namespace and add metadata for OpenMetrics, fix interleaving
1267 * [Fix] Plug memory leak in http settings reload
1268 * [Fix] Preserve SPF top record in the mempool variable
1269 * [Fix] Remove aarch64 GC64 workaround
1270 * [Fix] Remove bogus G_LIKELY
1271 * [Fix] Spf: Do not parse non TXT DNS replies as TXT replies
1272 * [Fix] Try to use on_connect/on_disconnect callbacks to handle internal Redis failures
1273 * [Fix] buffer overflow in rspamc counters
1274 * [Fix] fix static building
1275 * [Fix] lua_scanners - message_min_words logic
1276 * [Fix] src/lua/lua_mimepart.c: fix null dereference
1277 * [Project] Add constant iterators
1278 * [Project] Add helper library to handle mime strings in a more safe matter
1279 * [Project] Add preliminary support of CDB bayes dump
1280 * [Project] Add trim operations
1281 * [Project] Allow mempool allocated mime strings
1282 * [Project] Cdb: Finish backend implementation
1283 * [Project] Cdb: Fix configuration load
1284 * [Project] Cdb: Use shared data between cdb statfiles
1285 * [Project] Cdb: continue statistics backend implementation
1286 * [Project] Finish received headers rework part
1287 * [Project] Move C++ specific declarations to C++ header
1288 * [Project] Rework received headers parsing to C++
1289 * [Project] Start using of the new received structure
1290 * [Project] Start work on cdb backend
1291 * [Rework] Further rework of the redis pool
1292 * [Rework] Redis_pool: fix issues found
1293 * [Rework] Rework learn and add classify condition
1294 * [Rework] Save invisible content to a separate buffer
1295 * [Rework] Start rewriting of the redis pool logic
1296 * [Rules] Improve zero font rule
1297
1298 3.0: 19 Aug 2021
1299 * [Conf] Align ARC scores with DKIM scores
1300 * [CritFix] Neural: Fix sorting application
1301 * [Feature] Add a simple dumper for bayes tokens
1302 * [Feature] Add lua_maps.fill_config_maps function
1303 * [Feature] Add preliminary exporter to AWS S3
1304 * [Feature] Add preliminary restore bayes support
1305 * [Feature] Add race condition protection against hs_helper restarts
1306 * [Feature] Add rspamd_utf8_strcmp utility
1307 * [Feature] Add zstd streaming API
1308 * [Feature] Allow to log severity level explicitly
1309 * [Feature] Allow to save and show attachment name when inserting AV scan results
1310 * [Feature] Allow to sort urls for Lua
1311 * [Feature] Allow to specify different timeouts/retransmits for fuzzy rules
1312 * [Feature] Aws_s3: Allow to compress data stored
1313 * [Feature] CMakeLists.txt: Change check and run-test to use rspamd-test-cxx * fixes #3807
1314 * [Feature] Dmarc_report: allow sending reports in batches
1315 * [Feature] Fuzzy_check: Allow to disable subject when making short text hash
1316 * [Feature] Lua_cryptobox: Add keyed ssl hash functions via HMAC
1317 * [Feature] Lua_task: Add get_urls_filtered method
1318 * [Feature] Make monitored checks less frequent
1319 * [Feature] Milter_headers: Add x-rspamd-pre-result header
1320 * [Feature] Neural: Allow to balance FP/FN for the network
1321 * [Feature] Ppopagate monitored errors from rbl module
1322 * [Feature] Pyzor calculate score dynamically Count - WL-Count of default_score in percent
1323 * [Feature] Rbl: Distinguish flattened and non-flattened selectors in RBL requests
1324 * [Feature] Re-add pyzor support
1325 * [Feature] Settings: add ip_map check and rework structure slightly
1326 * [Feature] Spamassassin: Allow to set the default priority for SA scores
1327 * [Feature] Strip smtp comments from message id
1328 * [Feature] add SYSTEM_ZSTD cmake option To use the system zstd instead on the bundled version
1329 * [Feature] external_relay plugin
1330 * [Feature] rspamadm clickhouse neural_train subcommand
1331 * [Fix] #3400 milter_headers: fix inverted logic for extended_headers_rcpt
1332 * [Fix] ASN: fix _FAIL symbol for when main symbol is disabled
1333 * [Fix] Add a special logic for text part with no text extraction
1334 * [Fix] Add diacritics flag for several eu languages
1335 * [Fix] Another FSM fix to accomodate possibility of multiple consequent ?
1336 * [Fix] Avoid curse of dynamic array referencing
1337 * [Fix] Avoid reinitialising neural settings
1338 * [Fix] Check remain before processing TXT records
1339 * [Fix] Enable error multiplier on http errors
1340 * [Fix] Finally rework parsing entities logic
1341 * [Fix] Fix '==' parsing in the content type attributes parser
1342 * [Fix] Fix IPv6 expansion for SPF macros
1343 * [Fix] Fix Mozilla Message-ID detection
1344 * [Fix] Fix an edge case in BITCOIN_ADDR rule
1345 * [Fix] Fix brain-damaged behaviour when http request has a custom Host header
1346 * [Fix] Fix check of limits in email address parsing
1347 * [Fix] Fix copy&paste error and rework
1348 * [Fix] Fix expressions logic for and/or and float values
1349 * [Fix] Fix fuzzy retransmits
1350 * [Fix] Fix http maps with no or invalid expires data
1351 * [Fix] Fix last quote character parsing in the content-type state machine
1352 * [Fix] Fix normalisation flags propagation
1353 * [Fix] Fix overflow when appending many broken tags
1354 * [Fix] Fix parsing of rfc2047 tokens with '?' inside
1355 * [Fix] Fix phishing flag set
1356 * [Fix] Fix rfc2047 embedded into rfc2231 pieces in special headers
1357 * [Fix] Fix round-robin rotation
1358 * [Fix] Fix searching for symbols
1359 * [Fix] Fix storing of the regexps inside variant
1360 * [Fix] Fix tokenization near exceptions
1361 * [Fix] Fix visibility calculations
1362 * [Fix] Html: Attach inline tags to the structure
1363 * [Fix] Html: Do not treat empty tags as block tags
1364 * [Fix] Ical: Do not extract urls from all flags using merely specific ones
1365 * [Fix] Initialise symcache even if it cannot be loaded properly
1366 * [Fix] Lua_fuzzy: Remove text parts check when checking image dimensions
1367 * [Fix] Lua_maps: Fix adjustments for the map type in the complex map definitions
1368 * [Fix] Lua_task: Fix deleted symbols in has_symbol/get_symbol
1369 * [Fix] Move metric and symcache link from validation to the init stage
1370 * [Fix] Oletools: Another try to fix table sorting
1371 * [Fix] One more default behaviour fix
1372 * [Fix] Phishing: Rework urls processing
1373 * [Fix] RBL: was missing some config schema
1374 * [Fix] Replies: Fix 'Reply-To' handling in task:get_reply_sender
1375 * [Fix] Rework metrics handling
1376 * [Fix] Save symcache on exit
1377 * [Fix] Selectors: Filter nil elements in lists
1378 * [Fix] Selectors: Properly fix implicit tostring for nils
1379 * [Fix] Try to fix some broken code in DMARC reporting plugin
1380 * [Fix] Urls: Fix processing of html urls when it comes to the flags
1381 * [Fix] Use proper buffer length
1382 * [Fix] Various visibility fixes
1383 * [Fix]: ASN: dns cb func should also return in case of an error
1384 * [Project] Add a simple css rule definition
1385 * [Project] Add css style skeleton
1386 * [Project] Add css syntax (adopted from ebnf)
1387 * [Project] Add css_selectors
1388 * [Project] Add doctest unit testing library
1389 * [Project] Add expected library
1390 * [Project] Add fmt library for simple string ops
1391 * [Project] Add fu2 library to better functions abstractions
1392 * [Project] Add hashing method
1393 * [Project] Add parsers skeleton
1394 * [Project] Add preliminary support of vcard parser
1395 * [Project] Add process exceptions for invisible text
1396 * [Project] Add some methods for css parser
1397 * [Project] Allow static libstdc++
1398 * [Project] Another whitespace hack
1399 * [Project] CSS: Various fixes in the declarations and values parsing
1400 * [Project] Cpp: Add robin-hood hash map library
1401 * [Project] Css: Add AST debug
1402 * [Project] Css: Add colors conversion functions
1403 * [Project] Css: Add dimensions handling
1404 * [Project] Css: Add display value support
1405 * [Project] Css: Add frozen library from https://github.com/serge-sans-paille/frozen/
1406 * [Project] Css: Add opacity support
1407 * [Project] Css: Add parser helpers to simplify debugging
1408 * [Project] Css: Add preliminary stylesheet support
1409 * [Project] Css: Add rules processing functions and tests
1410 * [Project] Css: Add simple selectors unit tests
1411 * [Project] Css: Add some c++ unit tests
1412 * [Project] Css: Add some debug methods
1413 * [Project] Css: Add some debug statements for the css parser
1414 * [Project] Css: Add some logical skeleton for declarations parser
1415 * [Project] Css: Add url/function tokens
1416 * [Project] Css: Allow at rules parsing
1417 * [Project] Css: Declarations parsing logic skeleton
1418 * [Project] Css: Enable conditional css parsing support from the HTML parser
1419 * [Project] Css: Finish generic lexer cases
1420 * [Project] Css: Fix HSL conversion
1421 * [Project] Css: Fix minus parsing
1422 * [Project] Css: Fix parser consumers nesting
1423 * [Project] Css: Fix parsing of the qualified rules
1424 * [Project] Css: Fix rules merging
1425 * [Project] Css: Further fixes to lexer
1426 * [Project] Css: Further steps to parse css colors + rework
1427 * [Project] Css: Further work on parser's methods
1428 * [Project] Css: Implement backlog of css tokens
1429 * [Project] Css: Implement numbers and ident parsers
1430 * [Project] Css: Implement simple css selectors lookup
1431 * [Project] Css: Implement styles merging
1432 * [Project] Css: Make debug strings json like to simplify tests
1433 * [Project] Css: Minor adjustments
1434 * [Project] Css: More meat to the lexer
1435 * [Project] Css: Move some of the tests to the doctest
1436 * [Project] Css: Projected a parser
1437 * [Project] Css: Properties attachment logic
1438 * [Project] Css: Remove ragel from build targets (maybe keep for reference)
1439 * [Project] Css: Rework css block structure
1440 * [Project] Css: Rework flags of css properties
1441 * [Project] Css: Rework tokens structure
1442 * [Project] Css: Several fixes + tests
1443 * [Project] Css: Simplify checks
1444 * [Project] Css: Simplify debug code
1445 * [Project] Css: Start css selectors parsing logic
1446 * [Project] Css: Start semantic parsing for rules
1447 * [Project] Css: Start stylesheet implementation
1448 * [Project] Css: Tidy up lambdas
1449 * [Project] Css: rework tokeniser
1450 * [Project] Dmarc: Add dmarc report tool (WIP)
1451 * [Project] Dmarc: Add munging configuration
1452 * [Project] Dmarc: Add preliminary munging logic
1453 * [Project] Dmarc: Fix header removal
1454 * [Project] Dmarc: Fix munging logic
1455 * [Project] Dmarc: Use full recipient address instead of a domain map
1456 * [Project] Dmarc: Use zlists for dmarc reports
1457 * [Project] Dmarc_report: Add message generation logic
1458 * [Project] Dmarc_report: Add preliminary sending support
1459 * [Project] Fix lua bindings
1460 * [Project] Fix xml/sgml tags processing
1461 * [Project] Handle new modification
1462 * [Project] Html/CSS: Add transform from a CSS rule to html block
1463 * [Project] Html/CSS: Link html and css styles
1464 * [Project] Html/CSS: Switch styles parsing to css parser
1465 * [Project] Html/Css: Fix some issues found
1466 * [Project] Html/Css: Implement visibility rules for a block
1467 * [Project] Html: Add more tests cases and fix some more corner issues
1468 * [Project] Html: Add rows display type support
1469 * [Project] Html: Allow decode entities function to normalise spaces + unit tests
1470 * [Project] Html: Another rework of the tags structure
1471 * [Project] Html: Another try to fix unbalanced cases
1472 * [Project] Html: Fix crossing spans
1473 * [Project] Html: Fix parent propagation
1474 * [Project] Html: Further rework of the html parsing stuff
1475 * [Project] Html: Implement logic for tags pairing
1476 * [Project] Html: Implement rawtext state machine
1477 * [Project] Html: Insert closing tags as well :(
1478 * [Project] Html: More fixes
1479 * [Project] Html: More fixes
1480 * [Project] Html: More spaces logic fixes
1481 * [Project] Html: One more attempt to write text content
1482 * [Project] Html: Replace \0 in html content
1483 * [Project] Html: Rework img/a tags handling
1484 * [Project] Html: Rework propagation method
1485 * [Project] Html: Rework tags placement
1486 * [Project] Html: Rework transparency logic
1487 * [Project] Html: Support 'hidden' attribute
1488 * [Project] Html: Try another approach to append tags content
1489 * [Project] Html: Try to deal with bad unknown tags properly
1490 * [Project] Lua_aws: Add canonicalisation utility
1491 * [Project] Lua_aws: Add function to produce AWS Authorisation header
1492 * [Project] Lua_aws: Implement request signing
1493 * [Project] Lua_mime: Add lua_mime.modify_headers routine
1494 * [Project] Lua_task: Add modify_header method
1495 * [Project] Lua_task: Allow to extract modified headers
1496 * [Project] Make unescape code public for unit testing
1497 * [Project] More fixes for closed tags
1498 * [Project] More fixes to calculations
1499 * [Project] Rework API for the modified headers
1500 * [Project] Rework html visibility rule
1501 * [Project] Skeleton of the css library
1502 * [Project] Start headers modification API structure
1503 * [Project] Start working on AWS Lua API
1504 * [Project] Use lua_mime to modify headers
1505 * [Project] Use modified headers on dkim signing
1506 * [Project] Use string_view to constexpr variant unpacking
1507 * [Rework] Add composites manager concept
1508 * [Rework] Add tags definitions
1509 * [Rework] Allow C code to be compiled with C++ compiler
1510 * [Rework] Clickhouse: Store url flags
1511 * [Rework] Composites: Rewrite the composites logic
1512 * [Rework] Composites: Start rework of the composites framework
1513 * [Rework] Dmarc: Move check policy function to the common utils
1514 * [Rework] Dmarc: Rework reports keys structure
1515 * [Rework] Further work to make html content private
1516 * [Rework] Html/CSS: Remove css C bindings as they are useless now
1517 * [Rework] Html/CSS: Rework Lua bindings
1518 * [Rework] Html/Css: Start rework of the html blocks
1519 * [Rework] Html: Add images processing logic
1520 * [Rework] Html: Add traverse function
1521 * [Rework] Html: Another steps to get rid of gnode
1522 * [Rework] Html: Convert to variant
1523 * [Rework] Html: Deal with the utf_content part
1524 * [Rework] Html: Final rework part for the html processing code
1525 * [Rework] Html: Fix Lua bindings
1526 * [Rework] Html: Forgot to add the internal include
1527 * [Rework] Html: Further html urls rework
1528 * [Rework] Html: Further rework of the tags content extraction
1529 * [Rework] Html: Make parameters as a vector again
1530 * [Rework] Html: Move blocks part
1531 * [Rework] Html: Move images processing stuff
1532 * [Rework] Html: Rework lua bindings
1533 * [Rework] Html: Start html text extraction rework
1534 * [Rework] Html: Start refactoring of the html tags handling
1535 * [Rework] Html: Start removing of GNode stuff
1536 * [Rework] Html: Start rework of the html content structure
1537 * [Rework] Lua_magic: Try to detect text parts with 8bit characters for non-utf8 encodings
1538 * [Rework] Move HTML url functions and rework them
1539 * [Rework] Move and adopt entities handling logic
1540 * [Rework] Move common and rarely used dmarc code to the library
1541 * [Rework] Move compression routines outside of rspamd_util library
1542 * [Rework] Move entities/tags handling
1543 * [Rework] Phishing: Split from redirectors usage
1544 * [Rework] Redesign html blocks propagation logic
1545 * [Rework] Remove tag name string
1546 * [Rework] Rename phished url to a linked url
1547 * [Rework] Reorganize dmarc plugin and remove unsupported reporting code
1548 * [Rework] Reputation: Use more flexible types in get/set functions
1549 * [Rework] Require proper C++ environment for Rspamd build
1550 * [Rework] Rework extended urls output
1551 * [Rework] Rework tags parsing machine
1552 * [Rework] Slightly improve old regexp API
1553 * [Rework] Start conversion of the redis pool code to c++
1554 * [Rework] Try to resolve failed upstreams more agressively
1555 * [Rework] Use C++ utf8 library with unit tests to trim whitespaces
1556 * [Rework] Use C++ version for unicode normalisation
1557 * [Rework] Use C++ version of the lua threads pool
1558 * [Rules] Add raw addresses to MULTIPLE_FROM options
1559 * [Rules] Another fix to HTTP_TO_HTTPS rule
1560 * [Rules] Do not trigger HTML_SHORT_LINK_IMG on external images
1561 * [Rules] Extend FORGED_X_MAILER
1562 * [Rules] Extend OLD_X_MAILER
1563 * [Rules] Fix CTYPE_MIXED_BOGUS for text attachments
1564 * [Rules] Fix FPs for CTYPE_MIXED_BOGUS
1565 * [Rules] Fix HTTP_TO_HTTPS rule
1566 * [Rules] Fix HTTP_TO_HTTPS rule
1567 * [Rules] Fix zerofont rule (partially)
1568 * [Rules] Micro-optimize X_PHP_EVAL
1569 * [Rules] Reduce default weight for R_MISSING_CHARSET
1570
1571 2.7: 08 Jan 2021
1572 * [Conf] Add R_DKIM_PERMFAIL to the metric
1573 * [CritFix] Dkim: Fix simple canonicalisation if multiple signatures are presented
1574 * [CritFix] Fix controller paths normalisation
1575 * [Feature] Add INVALID_DATE rule
1576 * [Feature] Add controller endpoint for training neural
1577 * [Feature] Add sanity checks for actions thresholds
1578 * [Feature] Add support of '==' and '!=' in Rspamd expressions
1579 * [Feature] Composites: Improve composite atoms parser
1580 * [Feature] Docker: use Debian slim variant
1581 * [Feature] Elastic: Add some missing fields
1582 * [Feature] Extract text from img alt attributes
1583 * [Feature] Improve charset detection logic
1584 * [Feature] Lua_clickhouse: Add optional row callback for large selections
1585 * [Feature] Lua_dns_resolver: Add idna_convert_utf8 method
1586 * [Feature] Lua_mime: Add ability to do multipattern replacement
1587 * [Feature] Lua_trie: Allow to report start of the match
1588 * [Feature] Multimap: support adding map values as extra options
1589 * [Feature] Neural: Move PCA learning to a subprocess
1590 * [Feature] RBL: support matching content/image URLs only
1591 * [Feature] RBL: support use of multiple selectors
1592 * [Feature] Reputation: Allow to specify ip masks
1593 * [Feature] Support SMIME signed messages container
1594 * [Feature] Support multiple conditions for symbols
1595 * [Feature] Support ping in milter mode
1596 * [Feature] Support rspamd_text in selector regexps
1597 * [Feature] Use own daemonization routine
1598 * [Feature] Vadesecure: Implement settings_outbound feature as recommended by Vade
1599 * [Feature] `rspamadm clickhouse` command
1600 * [Feature] allow hyperscan for aarch64
1601 * [Fix] Allow to set priorities between post init scripts
1602 * [Fix] Allow to use maps for strings that are not zero terminated
1603 * [Fix] Apply max_lua_urls limit for emails as well
1604 * [Fix] Arc: Fix CV check on signing
1605 * [Fix] Arc: Fix signing of the broken ARC chains
1606 * [Fix] Clickhouse: escape carriage return
1607 * [Fix] Composites: Allow partial match
1608 * [Fix] Deduct type of a table methods
1609 * [Fix] Do not load errored hyperscan database
1610 * [Fix] Do not process links in ignored html tags
1611 * [Fix] Fix ClamAV result for cached encrypted file (#3395)
1612 * [Fix] Fix canonicalisation when l= tag is presented
1613 * [Fix] Fix flag shift
1614 * [Fix] Fix handling of skip/skip_process http flags
1615 * [Fix] Fix html attachments checks
1616 * [Fix] Fix issue with pushing binary formats to Lua strings
1617 * [Fix] Fix logging for rspamadm
1618 * [Fix] Fix off-by-one with init check
1619 * [Fix] Fix parsing of escape characters in quoted pairs
1620 * [Fix] Fix pushing ucl strings with \0 inside
1621 * [Fix] Fix quoted-printable soft newlines bugged case
1622 * [Fix] Fix settings in case actions are set to null (#3415)
1623 * [Fix] Fix several issues with auth results producing
1624 * [Fix] Fix smtp comments exclusion
1625 * [Fix] Fix smtp date syntax definition
1626 * [Fix] Fix substring search in case if srchlen == inlen
1627 * [Fix] Fix text selectors
1628 * [Fix] Honour `systemd` setting when logging to console (#3514)
1629 * [Fix] Html: Add entities collisions prevention logic (e.g. for mathml entities)
1630 * [Fix] Lua_auth_results: Quote potentially bad values in AR header
1631 * [Fix] Multimap: Fix flags usage
1632 * [Fix] Multimap: Fix scoring for combined maps
1633 * [Fix] Plug GList * leak in redis pool
1634 * [Fix] RBL: allow for multiple matches of the same label if types are different
1635 * [Fix] Rely on libev checks for file maps
1636 * [Fix] Restore simple dkim canonicalisation mode
1637 * [Fix] Return MimeCharset as we work with emails...
1638 * [Fix] Spamassassin: Fix pcre_only flags
1639 * [Fix] Spamassassin: Preserve 'pcre_only' flag when dealing with regexp replacements
1640 * [Fix] Try to fix GError leak
1641 * [Fix] Try to fix a mess with settings loading by adding priorities
1642 * [Fix] Try to move setings initialisation to a later stage
1643 * [Fix] Use dup fd in milter handler to avoid races with the proxy
1644 * [Fix] Use message pointer to avoid obsolete data to be cached
1645 * [Project] Rbl: Migrate to `checks`
1646 * [Project] Rbl: Move config code outside of the plugin
1647 * [Project] Ressurect empty prefilters as connection filters
1648 * [Project] Support connection filters registration from Lua
1649 * [Rework] Add final cleanup logic
1650 * [Rework] Add preliminary support of hyperscan caching for re maps
1651 * [Rework] Add stale cache removal
1652 * [Rework] Clickhouse: Improve performance
1653 * [Rework] Distinguish between strict config test mode
1654 * [Rework] Furhter logging improvements
1655 * [Rework] Milter_headers: improve extended_headers_rcpt support
1656 * [Rework] Move parsers to a separate lua library
1657 * [Rework] Neural: Skip composite symbols
1658 * [Rework] Rbl: Rework defaults logic
1659 * [Rework] Some tunes to cache saving
1660 * [Rework] Track maps origins
1661 * [Rework] Use full crypto hash for regexp maps
1662 * [Rules] Remove broken rule
1663
1664 2.6: 30 Sep 2020
1665 * [Conf] Add missing symbols
1666 * [Conf] Add missing symbols
1667 * [Conf] Fix fat-fingers typo
1668 * [Conf] Fix wrong comment in options.inc
1669 * [Conf] Neural: Fix the default name for max_trains
1670 * [Conf] Register a known symbol
1671 * [Conf] Spf: Add R_SPF_PERMFAIL symbol
1672 * [CritFix] Arc: Fix ARC validation for chains of signatures
1673 * [CritFix] Distinguish socketpairs between different fuzzy workers
1674 * [CritFix] Fix IDNA dots parsing
1675 * [CritFix] Fix test assertion method
1676 * [CritFix] Fix usage of crypto_sign it should be crypto_sign_detached!
1677 * [Feature] Add BOUNCE rule
1678 * [Feature] Add controller plugins support and selectors plugin
1679 * [Feature] Add maps query method
1680 * [Feature] Add minimal delay to fuzzy storage
1681 * [Feature] Add multiple base32 alphabets for decoding
1682 * [Feature] Add preliminary support of BCH addresses
1683 * [Feature] Add query_specific endpoint
1684 * [Feature] Allow multiple base32 encodings in Lua API
1685 * [Feature] Allow to specify nonces manually
1686 * [Feature] Controller: Allow to pass query arguments to the lua webui plugins
1687 * [Feature] Fuzzy_check: Add gen_hashes command
1688 * [Feature] Fuzzy_check: Add weight_threshold option for fuzzy rules
1689 * [Feature] Implement address retry on connection failure
1690 * [Feature] Improve limits in pdf scanning
1691 * [Feature] Initial support of subscribe command in lua_redis
1692 * [Feature] Lua_cryptobox: Add secretbox API
1693 * [Feature] Lua_text: Add encoding methods
1694 * [Feature] Milter_headers: Allow to activate routines via users settings
1695 * [Feature] PDF: Add timeouts for expensive operations
1696 * [Feature] Preliminary maps addon for controller
1697 * [Feature] Split pdf processing object and output object to allow GC
1698 * [Feature] Support BLIS blas library
1699 * [Feature] Support input vectorisation by recvmmsg call
1700 * [Feature] Support multiple base32 alphabets
1701 * [Feature] add queueid, uid, messageid and specific symbols to selectors [Minor] use only selectors to fill vars in force_actions message
1702 * [Feature] allow variables in force_actions messages
1703 * [Feature] extend lua api
1704 * [Fix] #3249
1705 * [Fix] Allow to adjust neurons in the hidden layer
1706 * [Fix] Another try to fix email names parsing
1707 * [Fix] Arc: Allow to reuse authentication results when doing multi-stage signing
1708 * [Fix] Arc: Fix bug with arc chains verification where i>1
1709 * [Fix] Arc: Sort headers by their i= value
1710 * [Fix] Change neural plugin's loss function
1711 * [Fix] Deal with double eqsigns when decoding headers
1712 * [Fix] Default ANN names in clickhouse
1713 * [Fix] Disable reuseport for TCP sockets as it causes too many troubles
1714 * [Fix] Disable text detection heuristics for encrypted parts
1715 * [Fix] Distinguish DKIM keys by md5
1716 * [Fix] Distinguish type from flags in register_symbol
1717 * [Fix] Dmarc: Unbreak reporting after cf2ae3292ac93da8b6e0624b48a62828a51803c9
1718 * [Fix] Do not flag pre-result of virus scanners as least if action is reject
1719 * [Fix] Do not use GC64 workaround on 32bit platforms, omg
1720 * [Fix] Exclude damaged urls from html parser
1721 * [Fix] Fix FREEMAIL_REPLYTO_NEQ_FROM_DOM
1722 * [Fix] Fix FROM_NEQ_ENVFROM
1723 * [Fix] Fix FWD_GOOGLE rule (#1815)
1724 * [Fix] Fix adding of the empty archive file for gzip
1725 * [Fix] Fix aliases in forged recipients and limit number of iterations
1726 * [Fix] Fix authentication results insertion
1727 * [Fix] Fix calling of methods in selectors
1728 * [Fix] Fix clen length for hiredis...
1729 * [Fix] Fix endless loop if broken arc chain has been found
1730 * [Fix] Fix false - operation
1731 * [Fix] Fix get_urls table invocation
1732 * [Fix] Fix group based composites
1733 * [Fix] Fix headers passing in rspamd_proxy
1734 * [Fix] Fix incomplete utf8 sequences handling
1735 * [Fix] Fix lua_next invocation
1736 * [Fix] Fix lua_parse_symbol_type function logic
1737 * [Fix] Fix multiple listen configuration
1738 * [Fix] Fix occasional encryption of the cached data
1739 * [Fix] Fix parsing boundaries with spaces
1740 * [Fix] Fix passing of methods arguments
1741 * [Fix] Fix poor man allocator algorithm
1742 * [Fix] Fix regexp selector and add flattening
1743 * [Fix] Fix rfc base32 encode ordering (skip inverse bits)
1744 * [Fix] Fix rfc based base32 decoding
1745 * [Fix] Fix sockets leak in the client
1746 * [Fix] Fix storing of the original smtp from
1747 * [Fix] Fix types check and types usage in lua_cryptobox
1748 * [Fix] Fix unused results
1749 * [Fix] Fuzzy_check: Disable shingles for short texts (really)
1750 * [Fix] Ical: Fix identation grammar
1751 * [Fix] Improve part:is_attachment logic
1752 * [Fix] Mmap return value must be checked versus MAP_FAILED
1753 * [Fix] One more fix to skip images that are not urls
1754 * [Fix] Pdf: Support some weird objects with no newline before endobj
1755 * [Fix] Rbl: Fix ignore_defaults in conjunction with ignore_whitelists
1756 * [Fix] Restore support for `for` and `id` parts in received headers
1757 * [Fix] Segmentation fault in contrib/lua-lpeg/lpvm.c on ppc64el
1758 * [Fix] Skip spaces at the boundary end
1759 * [Fix] Slashing fix: fix captures matching API
1760 * [Fix] Spamassassin: Rework metas processing
1761 * [Fix] Store reference of upstream list in upstreams objects
1762 * [Fix] Understand utf8 in content-disposition parser
1763 * [Fix] Unify selectors digest functions
1764 * [Fix] Use `abs` value when checking composites
1765 * [Fix] Use strict IDNA for utf8 DNS names + add sanity checks for DNS names
1766 * [Fix] Use unsigned char and better support of utf8 in ragel parser
1767 * [Fix] add missing selector_cache declaration
1768 * [Project] Add `L` flag for regexps to save start of the match in Hyperscan
1769 * [Project] Add `lower` method to lua_text
1770 * [Project] Add a simple matrix Lua library
1771 * [Project] Add implicit bitcoincash prefix
1772 * [Project] Add linalg ffi library for prototyping
1773 * [Project] Add methods to append data to fuzzy requests
1774 * [Project] Add routine to call a generic lua function
1775 * [Project] Add ssyev method interface
1776 * [Project] Add tensors index method
1777 * [Project] Add text:sub method
1778 * [Project] Allow rspamd_text based selectors
1779 * [Project] Allow to specify re_conditions for regular expressions
1780 * [Project] Attach extensions to the binary fuzzy commands
1781 * [Project] Bitcoin: BTC cash addresses needs some checksum validation
1782 * [Project] Cleanup the redis script
1783 * [Project] Convert bitcoin rules to the new regexp conditions feature
1784 * [Project] Detect memrchr in systems that supports it
1785 * [Project] Do not listen sockets in the main process
1786 * [Project] Implement 'probabilistic' learn mode for ANN
1787 * [Project] Implement BTC polymod in C as it requires 64 bit ops
1788 * [Project] Implement bitcoin cash validation in a proper way
1789 * [Project] Implement extensions logic for fuzzy storage
1790 * [Project] Implement symbols insertion in multiple results mode
1791 * [Project] Lua_text: Add method memchr
1792 * [Project] Neural: Add PCA loading logic
1793 * [Project] Neural: Fix PCA based learning
1794 * [Project] Neural: Fix matrix gemm
1795 * [Project] Neural: Further PCA fixes
1796 * [Project] Neural: Implement PCA in learning
1797 * [Project] Neural: Implement PCA learning
1798 * [Project] Neural: Implement PCA on ANN forward
1799 * [Project] Neural: Implement PCA serialisation
1800 * [Project] Neural: Start PCA implementation
1801 * [Project] Neural: Use C version of scatter matrix producing
1802 * [Project] Preliminary support of lua conditions for regexps
1803 * [Project] Preliminary usage of the reuseport
1804 * [Project] Process composites separately for each shadow result
1805 * [Project] Remove old code
1806 * [Project] Rework scan result functions to support shadow results
1807 * [Project] Rework some more functions to work with shadow results
1808 * [Project] Some more fixes
1809 * [Project] Start results chain implementation
1810 * [Project] Support fun iterators on rspamd_text objects
1811 * [Project] Support multiply, minus and divide operators in expressions
1812 * [Project] Tensor: Move scatter matrix calculation to C
1813 * [Rework] Allow to specify exat metric result when adding a symbol
1814 * [Rework] Change and improve openblas detection and usage
1815 * [Rework] Close listen sockets in main after fork
1816 * [Rework] Further rework of lua urls extraction API
1817 * [Rework] Lua_cryptobox: Allow to store output of the hash function
1818 * [Rework] Lua_task: Add more methods to deal with shadow results
1819 * [Rework] Modernize logging for expressions
1820 * [Rework] Remove empty prefilters feature - we are not prepared...
1821 * [Rework] Remove old FindLua module, disable lua fallback when LuaJIT is enabled
1822 * [Rework] Rework and refactor forged recipients plugin
1823 * [Rework] Rework expressions processing
1824 * [Rework] Rework fuzzy commands processing
1825 * [Rework] Rework url flags handling API
1826 * [Rework] Rework urls extraction
1827 * [Rework] Split operations processing and add more debug logs
1828 * [Rework] Update zstd to 1.4.5
1829 * [Rework] Use google-ced instead of libicu chardet as the former sucks
1830 * [Rework] add alias util:parse_addr for util:parse_mail_address
1831 * [Rework] get rid of util:parse_addr duplicating the util:parse_mail_address, replace where used
1832 * [Rules] Allow prefix for bitcoin cash addresses
1833 * [Rules] More fixes for bitcoin cash addresses decoding
1834 * [Rules] Refactor bleach32 addresses handling
1835
1836 2.5: 01 Apr 2020
1837 * [Conf] Mark Rspamd emailbl as ignore whitelist
1838 * [Conf] RBL: Add missing emails = true option
1839 * [Feature] Add support for scripts in fuzzy storage
1840 * [Feature] Arc: Add whitelisted_signers_map option
1841 * [Feature] Implement hosts file processing
1842 * [Feature] Neural: Introduce classes bias that allows non-equal classes learning
1843 * [Feature] Update libev to 4.33
1844 * [Fix] Another brain damage html standard adoptions
1845 * [Fix] Another fix for brain damaged obs-fws state
1846 * [Fix] Fix flags that caused force_actions failure
1847 * [Fix] Fix logging issue
1848 * [Fix] Fix lua symbols scores registration when config does not define scores
1849 * [Fix] Fix opaque maps logic
1850 * [Fix] Fix parsing of the html tags with no spaces after attributes
1851 * [Fix] Fix some corner cases in urls parsing, add limits
1852 * [Fix] Fix tlds extraction if custom composition rules are used
1853 * [Fix] Fix variables replacement in mempool
1854 * [Fix] Improve base64 detection
1855 * [Fix] Normalize dynamic scores in ANN correctly
1856 * [Fix] Plug memory leak introduced by #3153
1857 * [Fix] Stat_redis_backend: Fix memory leak and simplify learn path
1858 * [Fix] Try hard to deal with ghost workers
1859 * [Fix] metadata_exporter default formatter
1860 * [Rework] Change the way to extract URLs when dealing with alternative parts
1861 * [Rework] Fix various url extraction issues
1862 * [Rework] Re cache: Load compiled hyperscan in the main process as well
1863 * [Rework] Re cache: Load hyperscan early
1864 * [Rework] Rework URL structure: adjust tld part
1865 * [Rework] Rework URL structure: host field
1866 * [Rework] Rework URL structure: more structure optimisations
1867 * [Rework] Rework URL structure: user field
1868 * [Rework] URL: Another update for urls extraction logic
1869 * [Rework] Urls: Improve query urls handling
1870 * [Rework] Urls: adopt html related stuff
1871 * [Rework] Urls: more rework of the urls sets
1872 * [Rework] Urls: process query urls in HTML urls correctly
1873 * [Rework] Urls: rework urls hash structure
1874 * [Rework] Urls: update lua libraries
1875 * [Rework] Use multiple search tries for different url extraction types
1876
1877 2.4: 26 Feb 2020
1878 * [CritFix] Fix parsing of the content type attributes
1879 * [Feature] Clickhouse: Add extra columns support
1880 * [Feature] Rbl: Add url_compose_map option for RBL rules
1881 * [Fix] 'R' flag is for all headers regexp
1882 * [Fix] Allow to reset settings id from Lua (e.g. because of the priority)
1883 * [Fix] Avoid collisions in mempool variables by changing fuzzy caching logic
1884 * [Fix] Avoid strdup usage for symbols options
1885 * [Fix] Do not trust stat(2) it lies
1886 * [Fix] Filter all options for symbols to have sane characters
1887 * [Fix] Fix all headers iteration
1888 * [Fix] Fix allowed_settings for neural
1889 * [Fix] Fix listen socket parsing
1890 * [Fix] Fix maps expressions evaluation
1891 * [Fix] Fix sentinel connections leak by using async connections
1892 * [Fix] Fix smtp message on passthrough result
1893 * [Fix] Fix tld compositon rules
1894 * [Fix] Fuzzy_storage: Do not check for shingles if a direct hash has been found
1895 * [Fix] Lua_mime: Do not perform QP encoding for 7bit parts
1896 * [Fix] Neural: Distinguish missing symbols from symbols with low scores
1897 * [Fix] Support listening on systemd sockets by name
1898 * [Project] Add lua_urls_compose library
1899 * [Project] Allow to set a custom log function to the logger
1900 * [Project] CDB maps: Start making cdb a first class citizen
1901 * [Project] Clickhouse: Add extra columns concept
1902 * [Project] Fix urls composition rules, add unit tests
1903 * [Project] Unify cdb maps
1904 * [Rework] Logger infrastructure rework
1905 * [Rework] Refactor libraries structure
1906 * [Rework] Rework SSL caching
1907 * [Rework] Update snowball stemmer to 2.0 and remove all crap aside of UTF8
1908
1909 2.3: 04 Feb 2020
1910 * [Conf] SPF is no longer a C module
1911 * [Conf] Update spamtrap map path example
1912 * [CritFix] Fix html entities decoding
1913 * [CritFix] Fix re cache when mix of pcre and hyperscan is used
1914 * [Feature] Allow milter code to deal with multiple headers
1915 * [Feature] Antivirus: Add avast support
1916 * [Feature] Dkim_signing: Allow to sign via milter_headers
1917 * [Feature] Implement content hashes
1918 * [Feature] Lua_text: Add regexp split iterator method
1919 * [Feature] Lua_text: Implement flattening of the input tables
1920 * [Feature] Send quit command to Redis
1921 * [Feature] Speed up is_ascii function
1922 * [Feature] Spf: Add external_relay option
1923 * [Fix] Avoid double escaping
1924 * [Fix] Fix O(N^2) algorithm
1925 * [Fix] Fix arc seal validation
1926 * [Fix] Fix base tag processing according to stupid HTML renderer behaviour
1927 * [Fix] Fix dealing with `\0` in ucl strings and JSON
1928 * [Fix] Fix gpg parts misdetection
1929 * [Fix] Fix ignored symbols exporting
1930 * [Fix] Fix processing of numeric url's
1931 * [Fix] Fix processing of the closed tcp connections
1932 * [Fix] Fix regexp type check for pcre2
1933 * [Fix] Fix urls encode function
1934 * [Fix] Fix urls shifting when doing decode to include separators
1935 * [Fix] Fix white on white rule and add is_leaf flag
1936 * [Fix] Further fixes in charset detection
1937 * [Fix] Ignore diacritics in chartable module for specific languages
1938 * [Fix] Limit size of symbols options by max_opts_len option
1939 * [Fix] More fixes in html tag content calculations
1940 * [Fix] Plug memory leak in fuzzy storage
1941 * [Fix] Process high priority settings even if settings/id has been specified
1942 * [Fix] Select a different upstream on last retransmit
1943 * [Fix] Treat soft hyphen as zero width space
1944 * [Fix] Try harder to watch the lifetime of the key_stat
1945 * [Fix] Use ipv6-mapped-ipv4 addresses in radix trie
1946 * [Project] Add logic to break execution when processing symbols*
1947 * [Project] Add methods to set specific content for mime parts from Lua
1948 * [Project] Lua_content: support PDF files
1949 * [Project] Move dns_tool to using of the rspamd_spf from FFI module
1950 * [Project] Preliminary SPF plugin in Lua
1951 * [Project] Show debug stat for memory pool
1952 * [Project] Some rework about specific data that is now tagged
1953 * [Project] Start reworking of the mempool structure
1954 * [Rework] Allow to add userdata as symbols options
1955 * [Rework] Change mime part specifics handling
1956 * [Rework] Move LRU SPF cache from spf plugin
1957 * [Rework] Rework HTML tags content attachment
1958 * [Rework] Rework options hash structure
1959 * [Rework] Start lua_content library
1960 * [Rework] Stop using of uthash for http headers
1961 * [Rework] Use faster hashing approach for memory pools variables
1962 * [Rules] Add PDF related rules
1963
1964 2.2: 19 Nov 2019
1965 * [Conf] Antivirus: Fix the default config
1966 * [Feature] Add verdict library in lua
1967 * [Feature] Allow exception when choosing upstream
1968 * [Feature] Allow to disable symbols from the metric config
1969 * [Feature] Allow to limit maps per specific worker
1970 * [Feature] Always validate Rspamd protocol output
1971 * [Feature] Antivirus: Add preliminary virustotal support
1972 * [Feature] Clickhouse: Rework Clickhouse collection logic
1973 * [Feature] Improve base64 usage
1974 * [Feature] Shutdown timeout is now associated with task timeout
1975 * [Fix] #3129 Multiple classifiers on redis working incorrectly
1976 * [Fix] Allow real upstreams configuration
1977 * [Fix] Another try to fix slow callbacks and timers
1978 * [Fix] Check results of write message as SSL can bork them
1979 * [Fix] Clickhouse: Avoid potential races in collection
1980 * [Fix] Clickhouse: Fix periodic script
1981 * [Fix] Fail DNS upstream on each retransmit attempt
1982 * [Fix] Fix consistent hashing when upstreams are marked inactive
1983 * [Fix] Fix issues found
1984 * [Fix] Fix off-by-one in retries for the proxy
1985 * [Fix] Fix termination
1986 * [Fix] Fix upstreams exclusion logic
1987 * [Fix] Fix utf8 validation for symbols options and empty strings
1988 * [Fix] Oops, fix maps reload
1989 * [Fix] Rbl: Allow utf8 lookups for IDN domains
1990 * [Fix] Sigh, another try to fix brain-damaged openssl
1991 * [Project] Add fast utf8 validation library
1992 * [Project] Use own utf8 validation instead of glib
1993 * [Rework] Another phase of finish actions rework
1994 * [Rework] Further cmake system rework
1995 * [Rework] Further isolation of the controller's functions
1996 * [Rework] Make cmake structure more modular
1997 * [Rework] Move cmake modules to a dedicated path
1998 * [Rework] Replace controller functions by any scanner worker if needed
1999 * [Rework] Rework final scripts logic
2000 * [Rework] Rewrite rspamd_str_make_utf_valid function
2001
2002 2.1: 28 Oct 2019
2003 * [Conf] Update neural.conf
2004 * [CritFix] Fix dkim verification for multiple headers listed
2005 * [Feature] Add support of uudecode
2006 * [Feature] Allow to explicitly set events backend
2007 * [Feature] Implement configurable limits for SPF lookups
2008 * [Feature] Lua_scanners: Use lua magic for inclusion/exclusion logic
2009 * [Feature] Multimap: Do not check files in office archives
2010 * [Feature] Neural: Add sampling when storing training vectors
2011 * [Feature] SPF: Allow to disable AAAA checks in configuration
2012 * [Feature] Spf: Add limits configuration support
2013 * [Feature] Store etag in cached HTTP maps + better logging
2014 * [Feature] Support segwit BTC addresses, fix LTC verification
2015 * [Feature] Support uuencoding
2016 * [Fix] Add configurable number of threads for OpenBLAS
2017 * [Fix] Add workaround for ragel 7 in hyperscan related maps code
2018 * [Fix] Another fix for numeric urls parsing
2019 * [Fix] Correct EMA time calculations
2020 * [Fix] Do not treat archives as text
2021 * [Fix] Do not use strdup on data extracted from lua
2022 * [Fix] Fix a failure calcuating URL reputation.
2023 * [Fix] Fix crash due to constructors init order
2024 * [Fix] Fix crash on parts with no cd
2025 * [Fix] Fix empty prefilters that require mime structures
2026 * [Fix] Fix event loop creation
2027 * [Fix] Fix issues sending DMARC reports.
2028 * [Fix] Fix misprint
2029 * [Fix] Fix saving of the file maps
2030 * [Fix] Fix size calculations when converting from utf16
2031 * [Fix] Fix support of disable_monitoring in rbl
2032 * [Fix] Fix use-after-free
2033 * [Fix] Fix zip files check to relax requirements
2034 * [Fix] Important hiredis fixes
2035 * [Fix] Lot's of fixes in maps check logic
2036 * [Fix] Lua_tcp: Deal with temporary fails on write
2037 * [Fix] Lua_tcp: Make write errors fatal and rework error handlers
2038 * [Fix] Meta: Filter some more values
2039 * [Fix] Neural: Add protection agains infinities
2040 * [Fix] Oops, fix math.huge invocation
2041 * [Fix] Plug memory leak
2042 * [Fix] Sigh, another email to string fix
2043 * [Fix] Try to fix another ownership race in ssl connection
2044 * [Fix] Uuencode: Fix parsing of corrupted uuencode
2045 * [Fix] lua_scanners - razor rename need_check function
2046 * [Rework] Require CMake 3.9 to work, remove manual lto crap
2047
2048 2.0: 11 Oct 2019
2049 * [Conf] Add BROKEN_HEADERS_MAILLIST composite
2050 * [Conf] Add path to greylist-whitelist-domains.inc
2051 * [Conf] Clarify documentation in the config files
2052 * [Conf] Introduce maps.d directories
2053 * [Conf] Log settings id by default
2054 * [Conf] Make LEAKED_PASSWORD_SCAM a composite rule again
2055 * [Conf] Move all surbl/emails rules to rbl
2056 * [Conf] Register new Spamhaus codes
2057 * [Conf] Remove configs for deleted modules
2058 * [Conf] Remove surbl parts, fix hash_format attribute
2059 * [Conf] Show autolearn sample
2060 * [Conf] Slashing: Change default stats backend to Redis
2061 * [Conf] Surbl: Utilise new `check_emails` option
2062 * [Conf] Update header
2063 * [Conf] Use multi-prefixes RBLs in the default config
2064 * [CritFix] Deal with case-sensivity in Content-Disposition parser
2065 * [CritFix] Eliminate old endpoint
2066 * [CritFix] Fix case sensivity when parsing Content-Type
2067 * [CritFix] Fix loading of DKIM public keys
2068 * [CritFix] Fix procesing of urls
2069 * [CritFix] Fix whitelisting when both spf and dkim are required to be valid
2070 * [CritFix] Langdet: Fix language detection where no stop words found
2071 * [Feature] Add description to the groups
2072 * [Feature] Add limit for number of URLs in Lua
2073 * [Feature] Add logging of groups to the log_format
2074 * [Feature] Add lua_smtp library
2075 * [Feature] Add maps cache and type refinement
2076 * [Feature] Add p0f scanner
2077 * [Feature] Adopt emails module to use lua_maps
2078 * [Feature] Allow options matching in composites
2079 * [Feature] Allow selectors in rbl module
2080 * [Feature] Allow to output group results
2081 * [Feature] Asn: Allow to use bgpdump when NET::MRT is broken
2082 * [Feature] Calculate tokens occurrences distribution
2083 * [Feature] Clickhouse: Add authenticated user and settings id columns
2084 * [Feature] Clickhouse: Store groups data
2085 * [Feature] Clickhouse: Utilise LowCardinality feature
2086 * [Feature] Implement Redis prefixes registration logic
2087 * [Feature] Implement settings id propagation between deps
2088 * [Feature] Improve AV results caching
2089 * [Feature] Improve autolearning
2090 * [Feature] Improve logging locking logic (remove it actually)
2091 * [Feature] Improve settings processing
2092 * [Feature] Langdet: Limit number of stop words to be checked
2093 * [Feature] Libucl: Allow to sort keys in ucl objects
2094 * [Feature] Lua_config: Extend get symbols method
2095 * [Feature] Lua_maps: Allow static maps for key-value pairs
2096 * [Feature] Lua_mimepart: Add function filter_words
2097 * [Feature] Lua_selectors: Add `words` selector
2098 * [Feature] Lua_selectors: Add sort and uniq transform functions
2099 * [Feature] Lua_selectors: Allow table arguments for selectors
2100 * [Feature] Lua_tcp: Add preliminary support of SSL connections
2101 * [Feature] Lua_trie: More flexible API
2102 * [Feature] Lua_util: Add filter_specific_url function
2103 * [Feature] Lua_util: table_digest can now recursively traverse tables
2104 * [Feature] Maillist: Improve detection
2105 * [Feature] Maps: Allow caching for complex maps
2106 * [Feature] Monitored: Support random lookups
2107 * [Feature] Multimap: Add combined maps prototype
2108 * [Feature] Multimap: Add dependend maps via redis keys selectors
2109 * [Feature] Multimap: Allow multiple email addresses matches
2110 * [Feature] Multimap: Also check detected charset when do filename checks
2111 * [Feature] Output number of messages processed to proctitle
2112 * [Feature] Perform clean SSL shutdown
2113 * [Feature] Performance: Do not use base64 SIMD version for bad inputs
2114 * [Feature] RBL: Support bit results in replies
2115 * [Feature] RBL: Support type specific prefixes
2116 * [Feature] Ratelimit: Consider number of SMTP recipients
2117 * [Feature] Rbl: Add ability to check urls
2118 * [Feature] Rbl: Add resolve_ip based RBLs
2119 * [Feature] Rbl: Make config checks much more strict
2120 * [Feature] Rbl: Support per-rule whitelists
2121 * [Feature] Rbl: Support process script
2122 * [Feature] Rbl: Support replyto addresses
2123 * [Feature] SURBL: Allow to check email domains
2124 * [Feature] Selectors: Add `list` generator
2125 * [Feature] Selectors: Add `specific_urls` extractor
2126 * [Feature] Selectors: Add flatten function
2127 * [Feature] Selectors: Support filter_map and apply_map functions
2128 * [Feature] Store Clickhouse data outside of lua alloc
2129 * [Feature] Support caching for encrypted files and macros
2130 * [Feature] Support images when extracting urls
2131 * [Feature] Support more hyperscan flags
2132 * [Feature] Support protocol flags
2133 * [Feature] URL: Apply stringprep to hostnames to filter garbage
2134 * [Feature] Upstreams: Add lazy resolving logic to all upstreams
2135 * [Feature] Upstreams: Set noresolve flag on numeric upstreams
2136 * [Feature] Use `scores` in apply section
2137 * [Feature] Use maps logic from lua_maps for multimap
2138 * [Feature] Use random monitored in rbl module
2139 * [Feature] lua_scanners - add Razor support
2140 * [Fix] Add another safe-guard in urls processing
2141 * [Fix] Add debug to ssl, fixed write hangs
2142 * [Fix] Add missing groups to C callback symbols
2143 * [Fix] Add more checks for ghosts symbols
2144 * [Fix] Allow to enable or add new actions via settings
2145 * [Fix] Allow to set 0 size for spf/dkim caches
2146 * [Fix] Another bunch of fixes towards protocol mess
2147 * [Fix] Another fix to deal with bad URLs
2148 * [Fix] Arc: Another bunch of fixes for arc signing
2149 * [Fix] Arc: More arc signing fixes
2150 * [Fix] Avoid another overflow in fpconv
2151 * [Fix] Clickhouse: Fix quoting
2152 * [Fix] Clickhouse: Fix retention query quoting
2153 * [Fix] Distinguish empty and non-empty prefilters
2154 * [Fix] Distinguish remote and local addrs parsing
2155 * [Fix] Do not assert if length of sig is bad, just fail verification
2156 * [Fix] Do not assert if we have broken mime boundary in the headers
2157 * [Fix] Do not call implicit strlen to avoid issues
2158 * [Fix] Do not count images urls when checking url regexps for compatibility
2159 * [Fix] Do not output rbl suffix in symbol option
2160 * [Fix] Do not use config pool to avoid issues with double reload
2161 * [Fix] Do not use ephemeral string
2162 * [Fix] Do not use lightuserdata for traceback
2163 * [Fix] Do not use priority in metric registration
2164 * [Fix] Emails: Check email sanity before testing on BL
2165 * [Fix] Emails: Fix misprint in key name
2166 * [Fix] Escape utf in regexp to dodge ragel/hyperscan issue
2167 * [Fix] Extend task_timeout to postfilters stage
2168 * [Fix] Fix ARC signing after fixing another bug in it...
2169 * [Fix] Fix AV scan logic
2170 * [Fix] Fix DMARC_NA behaviour in case of no valid policies
2171 * [Fix] Fix LRU hash iteration logic
2172 * [Fix] Fix alignment mess
2173 * [Fix] Fix configuring symbols without scores
2174 * [Fix] Fix disabling of the actions
2175 * [Fix] Fix dkim signing exceptions
2176 * [Fix] Fix embedded images linking logic
2177 * [Fix] Fix events leak
2178 * [Fix] Fix eviction corner case
2179 * [Fix] Fix fuzzy image score calculation #2962
2180 * [Fix] Fix hang in fuzzy_learn when explicit rotation is set
2181 * [Fix] Fix headers propagation logic
2182 * [Fix] Fix hearbeats restart issue
2183 * [Fix] Fix history reset
2184 * [Fix] Fix log parameter
2185 * [Fix] Fix lua_ip_equal logic
2186 * [Fix] Fix more issues with nested messages + tests
2187 * [Fix] Fix normalization of non-alphabet based languages
2188 * [Fix] Fix offsets when parsing message/rfc822 in multipart
2189 * [Fix] Fix options in rbl symbols
2190 * [Fix] Fix out of bound access in lua logger
2191 * [Fix] Fix out-of-bound read in qp decode
2192 * [Fix] Fix parent CTE propagation
2193 * [Fix] Fix parsing of the received headers with empty part
2194 * [Fix] Fix pending checks for events
2195 * [Fix] Fix printing of NULL pointer with fixed length
2196 * [Fix] Fix race condition in watcher handler
2197 * [Fix] Fix read-after-end in quoted printable decoding
2198 * [Fix] Fix redis sentinel support
2199 * [Fix] Fix registry leak in case of DNS errors
2200 * [Fix] Fix reload logic
2201 * [Fix] Fix sending of large entries via HTTPS
2202 * [Fix] Fix settings reload
2203 * [Fix] Fix some more corner cases for fpconv
2204 * [Fix] Fix trie code when there are regexps and Hyperscan is absent
2205 * [Fix] Further fixes to printing of the FP numbers
2206 * [Fix] Fuzzy_check: Fix timeouts
2207 * [Fix] Grrr, fix empty ip case
2208 * [Fix] Html: Fix processing of fjlig entity
2209 * [Fix] Lang_det: Try better to distinguish Chinese and Japanese
2210 * [Fix] Lua_mime: Fix reversed extensions map
2211 * [Fix] Lua_task: Fix message-less API
2212 * [Fix] Lua_tcp: Report connection failures
2213 * [Fix] Lua_tcp: Various fixes and debugging improvements
2214 * [Fix] Metadata_exporter: This plugin is idempotent not a postfilter
2215 * [Fix] More fixes to extract_specific_urls
2216 * [Fix] More stages fixes
2217 * [Fix] Neural: Another bunch of fixes
2218 * [Fix] Neural: use version in ANN key profile
2219 * [Fix] Postpone lua state destruction to allow lua dtors to be used
2220 * [Fix] Prefer surbl/emails rule on rbl to preserve compatibility
2221 * [Fix] RBL: Fix behaviour of emails_domainonly
2222 * [Fix] Ratelimit: Fix dynamic score
2223 * [Fix] Rbl: Fix emailbl functions
2224 * [Fix] Really fix hyperscan workaround
2225 * [Fix] Set sanity limits for pcre2
2226 * [Fix] Settings: Fix settings check flags
2227 * [Fix] Sort keys when getting data from Lua when filling rules
2228 * [Fix] Statistics: Do not query Redis tokens when there are no learns
2229 * [Fix] Stop IO event on write finished in http connection
2230 * [Fix] Use heuristically detected text parts data
2231 * [Fix] Various fixes to QP encoding algorithm
2232 * [Fix] Various fixes to SSL state machine handler
2233 * [Fix] Various fixes to asn module
2234 * [Fix] Workaround for empty charset in rfc2231 encoding
2235 * [Project] Switch from torch to KANN
2236 * [Project] Add heartbeat events
2237 * [Project] Add preliminary support of the Kaspersky Scan Engine
2238 * [Project] Add preliminary version of maps expressions
2239 * [Project] Add preprocessed settings to the config structure
2240 * [Project] Add simple forward propagation function
2241 * [Project] Add small helpers for migration simplifications
2242 * [Project] Allow to replace body in milter
2243 * [Project] Bundle libev
2244 * [Project] First refactoring step libevent->libev
2245 * [Project] Implement syntax highlighting for Lua
2246 * [Project] Lua_magic: Adopt lua_magic stuff in mime_types
2247 * [Project] Remove libfann, gd and other unsupported stuff
2248 * [Project] Remove torch
2249 * [Project] Rework upstreams
2250 * [Rework] Allow execution of async events when hs compiles regexps
2251 * [Rework] Bayes expiry: eliminate `default` expiration mode
2252 * [Rework] Dkim: Remove signing code
2253 * [Rework] Dkim_signing: Move sign condition to dkim_signing
2254 * [Rework] Do not lowercase all data send to ClickHouse
2255 * [Rework] Drop url tags
2256 * [Rework] Eliminate lua_squeeze as it has shown no improvements
2257 * [Rework] Eliminate virtual scan time as it is useless
2258 * [Rework] Lua core: Use lightuserdata to index classes
2259 * [Rework] Lua_util: Another rework for extract_specific_urls
2260 * [Rework] Migrate from ip_score to reputation
2261 * [Rework] Move mime modification functions to lua_mime library
2262 * [Rework] Rbl: Major whitelisting logic rework
2263 * [Rework] Remove deprecated plugins
2264 * [Rework] Remove log helper worker
2265 * [Rework] Remove rspamd.classifiers.lua
2266 * [Rework] Rename filter.h to a more sane name
2267 * [Rework] Reorganise selectors implementation
2268 * [Rework] Replace linenoise with replxx
2269 * [Rework] Reputation: Remove ipnet from the ip reputation
2270 * [Rework] Reputation: Slashing - change name of symbols
2271 * [Rework] Rework children operations
2272 * [Rework] Rework config reload
2273 * [Rework] Rework expression API
2274 * [Rework] Rework image urls processing
2275 * [Rework] Rework initialisation to reduce static leaks count
2276 * [Rework] Rework request headers processing
2277 * [Rework] Slashing: Change versioning schema - move to 2.0
2278 * [Rework] Slashing: Turn off postfilters when passthrough result is set
2279 * [Rework] Start moving to replxx
2280 * [Rework] Stop support of signed HTTP maps to simplify code
2281 * [Rework] Store ASN as UInt32 in ClickHouse
2282 * [Rework] Url_redirector: Rewrite plugin
2283 * [Rework] Use a dedicated library for autolearn
2284 * [Rework] Use libsodium instead of hand crafted crypto implementations
2285 * [Rework] Use opaque structure to store a table of mime headers
2286 * [Rules] Add dedicated bitcoin addresses filter rule
2287 * [Rules] Add more detection to LEAKED_PASSWORD_SCAM
2288 * [Rules] Catch LTC addresses
2289 * [Rules] Reduce weight of RSPAMD_EMAILBL
2290 * [Rules] Rework LEAKED_PASSWORD_SCAM rule one more time
2291
2292 1.9.4: 23 May 2019
2293 * [CritFix] Fix case sensitivity when parsing Content-Type
2294 * [Fix] Arc: Another bunch of fixes for arc signing
2295 * [Fix] Arc: More arc signing fixes
2296 * [Fix] Avoid another overflow in fpconv
2297 * [Fix] Fix ARC signing after fixing another bug in it...
2298 * [Fix] Fix dkim signing exceptions
2299 * [Fix] Fix some more corner cases for fpconv
2300 * [Fix] Further fixes to printing of the FP numbers
2301 * [Fix] Ratelimit: Fix dynamic score
2302
2303 1.9.3: 13 May 2019
2304 * [Conf] Add IP_SCORE_FREEMAIL composite rule
2305 * [Feature] Add cryptobox method to generate dkim keypairs
2306 * [Feature] Add fast hashes to lua cryptobox hash
2307 * [Feature] Add least passthrough results
2308 * [Feature] Allow oversign if exists mode
2309 * [Feature] Clickhouse: Modernise table initial schema
2310 * [Feature] Implement IUF interface for specific fast hashes
2311 * [Feature] Lua_util: Allow to obfuscate different fields
2312 * [Feature] Tune memory management in Rspamd and Lua
2313 * [Fix] Avoid buffer overflow when printing long lua strings
2314 * [Fix] Change the default oversigning headers to a more sane list
2315 * [Fix] Clickhouse: Do not store digest as it is not needed now
2316 * [Fix] Clickhouse: Fix lots of storage issues
2317 * [Fix] Clickhouse: Support custom actions
2318 * [Fix] Deny URLs where hostname is bogus
2319 * [Fix] Do not blacklist mail by SPF/DMARC for local/authed users
2320 * [Fix] Fix DoS caused by bug in glib
2321 * [Fix] Fix UCL parsing of the multiline strings
2322 * [Fix] Fix buffer overflow when printing small floats
2323 * [Fix] Fix init code for servers keypairs cache
2324 * [Fix] Fix issue with urls with no tld (e.g. IP)
2325 * [Fix] Fix memory in arc signing logic
2326 * [Fix] Fix memory leak in language detector during reloads
2327 * [Fix] Fix mixed case content type processing
2328 * [Fix] Fix processing of the ip urls in file
2329 * [Fix] Fix use after free
2330 * [Fix] HTML: Fix `size` attribute processing
2331 * [Fix] Hum, it seems that 99ff1c8 was not correct
2332 * [Fix] Lua_task: Fix task:get_from method
2333 * [Fix] Preserve fd when mapping file to scan
2334 * [Fix] Re-use milter_headers settings when doing arc signing
2335 * [Fix] Set dmarc force action as least action
2336 * [Fix] Switch to GMT
2337 * [Fix] allow PKCS7 signatures to be text/plain, too
2338 * [Project] Add initial version of the vault management tool
2339 * [Project] Add vault support for DKIM and ARC signing
2340 * [Project] Implement keys rotation in the vault
2341 * [Project] Improve dkim keys generation for vault
2342 * [Project] Improve keys creation in rspamadm vault
2343 * [Rework] Move lua_worker to a dedicated unit
2344 * [WebUI] Add URL fragments (#) support
2345 * [WebUI] Fix AJAX request URL
2346
2347 1.9.2: 16 Apr 2019
2348 * [Conf] Allow to load users plugins from plugins.d
2349 * [Conf] oversign openpgp and autocrypt headers
2350 * [Feature] Add SPF FFI library for Lua
2351 * [Feature] Add more verbosity for SPF caching
2352 * [Feature] Antivirus: Handle encrypted files specially
2353 * [Feature] Clickhouse: Slashing - add new fields to CH
2354 * [Feature] Dkim_signing: Add OpenDKIM like signing_table and key_table
2355 * [Feature] Dkim_signing: Allow to use new options as maps
2356 * [Feature] Import fpconv library
2357 * [Feature] Lua_maps: Allow static regexp and glob maps
2358 * [Feature] Parse ical files
2359 * [Feature] Rspamadm: Add dns_tool utility
2360 * [Feature] Store SPF records digests
2361 * [Feature] Use fpconv girsu2 implementation for printing floats
2362 * [Fix] Clickhouse: Use integer seconds when inserting rows
2363 * [Fix] Fix floating point printing
2364 * [Fix] Fix processing of embedded urls
2365 * [Fix] Lua_clickhouse: Fix CH errors processing
2366 * [Fix] Make spf digest stable
2367 * [Fix] Properly detect encrypted files in zip archives
2368 * [Fix] Slashing: Store times in GMT timezone in ClickHouse
2369 * [Rules] Add additional conditions to perform BTC checks
2370 * [Rules] Fix pay-to-hash addresses validation
2371
2372 1.9.1: 5 Apr 2019
2373 * [Conf] Add vendor groups for symbols
2374 * [Feature] Add `rspamadm template` command
2375 * [Feature] Allow to add messages from settings
2376 * [Feature] Allow unconnected DNS servers operations
2377 * [Feature] Check limits after being set, migrate to uint64
2378 * [Feature] Greylist: Allow to disable greylisting depending on symbols
2379 * [Feature] Improve lua binary strings output
2380 * [Feature] Mime_types: Implement user configurable extension filters
2381 * [Feature] Mime_types: When no extension defined, detect it by content
2382 * [Feature] Preprocess config files using jinja templates
2383 * [Feature] Replies: Filter replies sender to limit whitelisting to direct messages
2384 * [Feature] Treat all tags with HREF as a potential hyperlinks
2385 * [Feature] Validate BTC addresses in LEAKED_PASSWORD_SCAM
2386 * [Fix] Add crash safety for HTTP async routines
2387 * [Fix] Another fix for Redis sentinel
2388 * [Fix] Clickhouse: Fix table schema upload
2389 * [Fix] Core: Fix squeezed dependencies handling for virtual symbols
2390 * [Fix] Finally fix default parameters parsing in actions section
2391 * [Fix] Fix ES sending logic (restore from coroutines mess)
2392 * [Fix] Fix finishing script for clickhouse collection
2393 * [Fix] Fix priority for regexp symbols registriation
2394 * [Fix] Fix various issues found by PVS Studio
2395 * [Fix] Initialize lua debugging earlier
2396 * [Fix] Neural: Fix training
2397 * [Fix] Rework cached Redis logic to avoid sentinels breaking
2398 * [Fix] SURBL: Fix regression in surbl module
2399 * [Fix] Fix double signing in the milter
2400 * [Project] Add support of HTTP proxy in requests
2401 * [Rework] Change lua global variables registration
2402 * [Rework] Rework HTML content urls extraction
2403 * [Rework] Start rework of aliasing in Rspamd
2404 * [WebUI] Combine Scan and Learning into one tab
2405 * [WebUI] Fix symbol score input type
2406 * [WebUI] Show grayed out pie
2407 * [WebUI] Update Throughput summary values dynamically
2408
2409 1.9.0: 12 Mar 2019
2410 * [Conf] Add missing includes
2411 * [Conf] Move to options
2412 * [Conf] Rbl: DWL is actually special whitelist
2413 * [Conf] Relax some uribl rules
2414 * [Conf] Remove abuse.ch
2415 * [CritFix] Html: Entities are not valid within tag params values
2416 * [Feature] Add `rspamadm mime sign` tool
2417 * [Feature] Add configgraph utility
2418 * [Feature] Add dedicated ZW spaces detection for URLs
2419 * [Feature] Add flag to url object when visible part is url_like
2420 * [Feature] Add method task:lookup_words
2421 * [Feature] Add pyzor support (by crosenberg)
2422 * [Feature] Allow to add upstream watchers to Lua API
2423 * [Feature] Allow to set rewrite subject pattern from settings
2424 * [Feature] Better escaping of unicode
2425 * [Feature] Clickhouse: Allow to store subject in Clickhouse
2426 * [Feature] Core: Add QP encoding utility
2427 * [Feature] Core: Add libmagic detection for all parts
2428 * [Feature] Core: Add support for gzip archives
2429 * [Feature] Core: Allow to construct scan tasks from raw data
2430 * [Feature] Core: Detect charset in archived files
2431 * [Feature] Core: Ignore and mark invisible spaces
2432 * [Feature] Core: Normalise zero-width spaces in urls
2433 * [Feature] Core: Process data urls for images
2434 * [Feature] Core: Relax quoted-printable encoding
2435 * [Feature] Core: Support RFC2231 encoding in headers
2436 * [Feature] Core: Support telephone URLs
2437 * [Feature] Core: allow to emit soft reject on task timeout
2438 * [Feature] DCC: Add bulkness and reputation checks to dcc
2439 * [Feature] Elastic: Modernize plugin
2440 * [Feature] Export visible part of url to lua
2441 * [Feature] Fuzzy_storage: add preliminary support of rate limits
2442 * [Feature] HTML: Specially treat data urls in HTML
2443 * [Feature] Implement event watchers for upstreams
2444 * [Feature] Implement includes tracing in Lua
2445 * [Feature] Improve dkim part in configwizard
2446 * [Feature] Lua_scanners: Add VadeSecure engine support
2447 * [Feature] Lua_task: Add flexible method to get specific urls
2448 * [Feature] Mime_types: Add MIME_BAD_UNICODE rule
2449 * [Feature] Mime_types: Use detected content type as well
2450 * [Feature] Plugins: Add preliminary version of the external services plugin
2451 * [Feature] Query sentinel on master errors
2452 * [Feature] Regexp: Allow local lua functions in Rspamd regexp module
2453 * [Feature] Rspamadm: Allow to append footers to plain messages
2454 * [Feature] Rspamadm: Allow to rewrite headers in messages
2455 * [Feature] Selectors: Add `ipmask` processor
2456 * [Feature] Settings: Allow hostname match
2457 * [Feature] Settings: Allow local when selecting settings
2458 * [Feature] Settings: Allow multiple selectors
2459 * [Feature] Settings: Allow to inverse conditions
2460 * [Feature] Support User-Agent in HTTP requests
2461 * [Feature] Support ed25519 dkim keys generation
2462 * [Feature] Try to filter bad unicode types during normalisation
2463 * [Feature] external_services - oletools (olefy) support
2464 * [Feature] lua_scanners - icap protocol support
2465 * [Feature] lua_scanners - spamassassin spam scanner
2466 * [Fix] Add filter for absurdic URLs
2467 * [Fix] Add some more cases for Received header
2468 * [Fix] Allow to disable/enable composite symbols
2469 * [Fix] Arc: Use a separated list of headers for arc signing
2470 * [Fix] Archive: Final fixes for 7z archives
2471 * [Fix] Clickhouse: Fix database usage
2472 * [Fix] Controller: Make save stats timer persistent
2473 * [Fix] Core: Detect encrypted rarv5 archives
2474 * [Fix] Core: Don't detect language twice
2475 * [Fix] Core: Fix address rotation bug
2476 * [Fix] Core: Fix content calculations for message parts
2477 * [Fix] Core: Fix emails comments parsing and other issues
2478 * [Fix] Core: Fix etags support
2479 * [Fix] Core: Fix headers folding on the last token
2480 * [Fix] Core: Fix iso-8859-16 encoding
2481 * [Fix] Core: Fix log_urls flag (and encrypted logging)
2482 * [Fix] Core: Fix part length when dealing with boundaries
2483 * [Fix] Core: Fix parts distance calculations
2484 * [Fix] Core: Fix processing of NDNs of certain type
2485 * [Fix] Core: Implement logic to find some bad characters in URLs
2486 * [Fix] Core: treat nodes with ttl properly in lru cache
2487 * [Fix] Fix Content-Type parsing
2488 * [Fix] Fix HTTP headers signing case
2489 * [Fix] Fix control interface
2490 * [Fix] Fix deletion of the duplicate headers
2491 * [Fix] Fix emails filtering in emails module
2492 * [Fix] Fix greylisting log message and logic
2493 * [Fix] Fix issues with storing of the accepted addr in rspamd control
2494 * [Fix] Fix maps object update race condition
2495 * [Fix] Fix memor leaks and whitespace processing
2496 * [Fix] Fix processing of null bytes in headers
2497 * [Fix] Fix rcpt_mime and from_mime in user settings
2498 * [Fix] Fix rfc2047 decoding for CD headers
2499 * [Fix] Fix rfc2231 for Content-Disposition header
2500 * [Fix] Fix setting of the subject pattern in config
2501 * [Fix] Greylist: fix records checking
2502 * [Fix] HTML: Another HTML comments exception fix
2503 * [Fix] HTML: Another entities decoding logic fix
2504 * [Fix] HTML: Fix HTML comments with many dashes
2505 * [Fix] HTML: Fix entities in HTML attributes
2506 * [Fix] HTML: Fix some more SGML tags issues
2507 * [Fix] Ignore whitespaces at the end of value in DKIM records
2508 * [Fix] MID module: Fix DKIM domain matching
2509 * [Fix] Milter_headers: Fix remove_upstream_spam_flag and modernise config
2510 * [Fix] Mime_parser: Fix issue with parsing of the trailing garbadge
2511 * [Fix] Mime_parser: Fix parsing of mime parts without closing boundary
2512 * [Fix] Multimap: Fix operating with userdata
2513 * [Fix] Process orphaned `symbols` section
2514 * [Fix] Rdns: Fix multiple replies in fake replies
2515 * [Fix] Rework groups scores definitions
2516 * [Fix] Set proper element when reading data from Sentinel
2517 * [Fix] Set rspamd user to initialise supplementary groups on reload
2518 * [Fix] Settings: Fix selectors usage
2519 * [Fix] Sort data received from Sentinel to avoid constant replacing
2520 * [Fix] groups.conf - filename typo
2521 * [Fix] lua_scanner - oletools typos, logging
2522 * [Fix] lua_scanners - actions and symbol_fail
2523 * [Fix] lua_scanners - fix luacheck
2524 * [Fix] lua_scanners - kaspersky - response with fname
2525 * [Fix] lua_scanners - savapi redis prefix
2526 * [Fix] tests - antivirus - fprot symbols
2527 * [Project] Add concept of flexible actions
2528 * [Project] Add heuristical from parser to received parser
2529 * [Project] Add new flags to clickhouse, redis and elastic exporters
2530 * [Project] Attach new received parser
2531 * [Project] Fallback to callbacks from coroutines
2532 * [Project] Implement keep-alive support in lua_http
2533 * [Project] Lua_udp: Implement fully functional client
2534 * [Project] Plug keepalive knobs into http connection handling
2535 * [Project] Rspamadm: Add `modify` tool
2536 * [Rework] Convert rspamd-server to a shared library
2537 * [Rework] Dcc: Rework DCC plugin
2538 * [Rework] Enable explicit coroutines symbols
2539 * [Rework] Rework telephone urls parsing logic
2540 * [Rework] Rewrite RBL module
2541 * [Rework] Settings: Rework settings check
2542 * [Rework] Slashing: Distinguish lualibdir, pluginsdir and sharedir
2543 * [Rework] Unify task_timeout
2544 * [Rework] Use VEX instructions in assembly, relocate
2545 * [WebUI] Notify user if uploaded data was not learned
2546 * [WebUI] Remove redundant condition
2547
2548 1.8.3: 03 Dec 2018
2549 * [CritFix] Make flags mutually exclusive for mime parts
2550 * [CritFix] Strictly deny unencoded bad utf8 sequences in headers
2551 * [Feature] Add Kaspersky antivirus support
2552 * [Feature] Add method to get dkim results
2553 * [Feature] Add more words regexp classes
2554 * [Feature] Allow to choose words format in `rspamadm mime`
2555 * [Feature] Allow to get all types of words from Lua
2556 * [Feature] Allow to get task flags in C expressions
2557 * [Feature] Allow to require encryption when accepting connections
2558 * [Feature] Ignore bogus whitespaces in the words
2559 * [Feature] Implement more strict configuration tests
2560 * [Feature] Improve SPF results in Authentication-Results
2561 * [Feature] Support ClickHouse database
2562 * [Fix] Add failsafety for utf8 regexps
2563 * [Fix] Do not trigger BROKEN_CONTENT_TYPE on innocent text parts
2564 * [Fix] Emit error if connection has been terminated with no stop pattern
2565 * [Fix] Fix boundaries checks in embedded messages
2566 * [Fix] Fix double free
2567 * [Fix] Perform policy downgrade on sample out, add tests
2568 * [Fix] Properly escape utf8 regexps in hyperscan mode
2569 * [Fix] Selectors - attachments args condition
2570 * [Fix] Some fixes for raw parts
2571 * [Fix] Treat learning errors as non-fatal
2572 * [Fix] Use tld when looking for DKIM domains
2573 * [Project] Words unicode structure rework
2574 * [Project] Add preliminary Redis Sentinel support
2575 * [Project] Improve Authentication-Results header
2576 * [Project] Rework DKIM checks results
2577 * [Project] Use more generalised API to produce meta words
2578
2579 1.8.2: 19 Nov 2018
2580 * [Conf] Add DWL support in the default configuration
2581 * [Conf] Disable rspamd_update by default (again)
2582 * [Conf] Fix configuration sample for ratelimit
2583 * [CritFix] Disable broken url tags by default
2584 * [CritFix] Fix \0 processing when doing RSA sign
2585 * [CritFix] Fix adding symbols to their primary groups
2586 * [Feature] Add `rspamadm cookie` utility
2587 * [Feature] Add specialised functions for generating encrypted cookies
2588 * [Feature] Add support of cookies in replies module
2589 * [Feature] Add support of words regexps
2590 * [Feature] Allow to add 3rd party clang plugins
2591 * [Feature] Allow to create lua regexps from glob or plain patterns
2592 * [Feature] Allow to set custom limits for upstream lists
2593 * [Feature] Detect orphaned parts and attach them to message
2594 * [Feature] Filter tokens in bayes
2595 * [Feature] Fold b= value when doing arc sealing
2596 * [Feature] Ignore cookies in the future and too old in the past
2597 * [Feature] Skip stop words in statistics
2598 * [Feature] Store stop words and allow to query them
2599 * [Feature] Support query arguments in controller's custom commands
2600 * [Feature] Tune upstream limits in Rspamd proxy
2601 * [Feature] Use different callback symbols for different uribls
2602 * [Feature] Write DKIM selector in dkim allow/reject symbols
2603 * [Fix] Add obs_fws state support to eoh state machine
2604 * [Fix] Add sanity check when applying mime boundaries heuristic
2605 * [Fix] Antivirus - virus names with 0 were recognized as tables
2606 * [Fix] Disable headernames in bayes temporarily
2607 * [Fix] Do not allow syntax errors in include files...
2608 * [Fix] Do not allow to merge an object with an array (or vice versa)
2609 * [Fix] Don't perform forged recipients check for missing recipients
2610 * [Fix] Fix DKIM based RBLs
2611 * [Fix] Fix actrie implementation (sync from upstream), fixed OOB read
2612 * [Fix] Fix explicit methods call in selectors
2613 * [Fix] Fix extraction of additional parts
2614 * [Fix] Fix finalization for internal plugins
2615 * [Fix] Fix override_defaults function
2616 * [Fix] Fix squeezed symbols when using settings
2617 * [Fix] Fix urls insertion in Clickhouse module
2618 * [Fix] Furhter fixes to ratelimits logic
2619 * [Fix] Ignore signatures when looking for boundaries
2620 * [Fix] Properly set learned count
2621 * [Fix] Really fix ratelimits configuration and work
2622 * [Fix] Remove ambigious format flag from printf
2623 * [Fix] Restore URLs exporting in ClickHouse plugin
2624 * [Fix] Rework bayes calculations...
2625 * [Fix] Switch from chi-square to naive for large Fisher value
2626 * [Fix] Treat normal password as enable password if there is no enable password
2627 * [Fix] Use proper syntax for making DNS requests
2628 * [Fix] Various fixes in embedded plugins
2629 * [Project] Change fuzzy check selection logic to lua_fuzzy library
2630 * [Project] Rework async events and symbols
2631 * [Project] Move all metatokens in Bayes to lua_stat from C
2632 * [WebUI] Add history rows per page control
2633
2634 1.8.1: 16 Oct 2018
2635 * [CritFix] Fix options insertion
2636 * [CritFix] Fix words decay one more time (affects long messages)
2637 * [CritFix] Increase default words_decay
2638 * [CritFix] Plug memory leak in redis pool
2639 * [Feature] Add `check_violation` feature to DKIM/ARC signing
2640 * [Feature] Add only unique elements to Clickhouse url arrays
2641 * [Feature] Allow `g+:` and `g-:` composite atoms
2642 * [Feature] Allow dkim domains check in surbl
2643 * [Feature] Allow maps with HTTP auth
2644 * [Feature] Allow to disable actions by users settings
2645 * [Feature] Extend whitelisting options
2646 * [Feature] Store url object in images
2647 * [Feature] Use verdict instead of the plain action in plugins
2648 * [Fix] Allow to call fstring append with NULL string
2649 * [Fix] DCC - luacheck
2650 * [Fix] Do not load torch on each rspamadm invocation
2651 * [Fix] Fix boundaries detection and rework stop words algorithm
2652 * [Fix] Fix dependencies for DNS_SIGNED symbol
2653 * [Fix] Fix errors when dealing with dynamic rates/bursts in Ratelimit
2654 * [Fix] Fix groups mess
2655 * [Fix] Fix groups mess
2656 * [Fix] Fix parsing address with comments
2657 * [Fix] Fix resolving in DMARC reports
2658 * [Fix] Fix various issues with parsing of the received headers
2659 * [Fix] Fix watchers issue in lua_tcp when doing no resolving
2660 * [Fix] Plug memory leak in language detector (affects reloads)
2661 * [Fix] Remove one letter stop words
2662 * [Fix] Slashing: backport chunk logic from libucl
2663 * [Fix] Stop libevent from using cached time in rspamadm
2664 * [Fix] Try to fix watchers chaining
2665 * [Fix] Various fixes in redis sync interface
2666 * [Fix] ip_score - respect check_authed and check_local settings from config
2667 * [Project] Rework passthrough actions
2668 * [Project] Clustering module
2669 * [Rework] Always create result for a task
2670 * [Rework] Completely rewrite DMARC checks logic
2671 * [Rework] Rework and fix whitelist plugin
2672 * [WebUI] Add symbols sorting buttons
2673 * [WebUI] Change symbols order without updating history
2674 * [WebUI] Colorize symbols
2675 * [WebUI] Do not display password form when secure_ip is set
2676 * [WebUI] Fix symbol description tooltips display
2677 * [WebUI] History: add sorting by symbol score value
2678
2679 1.8.0: 24 Sep 2018
2680 * [Feature] Add arguments schemas to processors and extractors
2681 * [Feature] Add functional selectors library
2682 * [Feature] Add generic selector to reputation module
2683 * [Feature] Add more ratelimits: by digest, by attachments data, by filenames
2684 * [Feature] Add preliminary stop words detection support
2685 * [Feature] Add pure Lua debugm function
2686 * [Feature] Add schema validation for Redis settings
2687 * [Feature] Add selectors combine function
2688 * [Feature] Add some recursion protection to lua logger
2689 * [Feature] Add support for Lua API tracing
2690 * [Feature] Allow to apply schema to arguments
2691 * [Feature] Allow to get dkim signing data directly from HTTP headers
2692 * [Feature] Allow to reuse existing authentication results
2693 * [Feature] Cache selectors results in re runtime
2694 * [Feature] Implement new text tokenizer based on libicu
2695 * [Feature] Integrate selectors framework to multimap
2696 * [Feature] Relax FORGED_RECIPIENTS
2697 * [Feature] Support (almost) all html entities
2698 * [Feature] Support adding and deletion of recipients in the milter block
2699 * [Feature] Support gathering HTTP body from fragments in lua_http
2700 * [Feature] Support multi flag in regexp and glob maps
2701 * [Feature] Support selectors in ratelimit module
2702 * [Feature] Support selectors in settings
2703 * [Feature] Use khash in HTML parser
2704 * [Feature] Use pure Lua debugm function
2705 * [Fix] Add fail-safety for destroying sessions
2706 * [Fix] Allow to add result-less fake DNS records
2707 * [Fix] Another try to fix race conditions on config unload
2708 * [Fix] Call Lua callback on DNS timeouts
2709 * [Fix] Deprecate task:inc_dns_req as it is redundant
2710 * [Fix] Do not allow events deletions on cleanup
2711 * [Fix] Do not try to process skipped messages
2712 * [Fix] Fix HTTP requests with no body
2713 * [Fix] Fix another cleanup race condition
2714 * [Fix] Fix bug in processing of pcre regexps
2715 * [Fix] Fix byte array allocation in the pool
2716 * [Fix] Fix crashes on task cleanup
2717 * [Fix] Fix dynamic buckets in ratelimits
2718 * [Fix] Fix endless loop when waiting for Rspamd to stop
2719 * [Fix] Fix lua_util.str_split in case of delimiters set
2720 * [Fix] Fix more issues with watching of async events
2721 * [Fix] Fix stop words detection and loading logic
2722 * [Fix] Fix various corner cases for language detection
2723 * [Fix] Fix watchers in lua_tcp
2724 * [Fix] Fix words decay algorithm
2725 * [Fix] Implement watchers replacement to handle nested calls
2726 * [Fix] Save faked code into fake dns record
2727 * [Fix] Show the proper frame when using lua_util.debugm
2728 * [Fix] Use fake dns records in tests
2729 * [Fix] Use unicode replacements for HTML entities
2730 * [Fix] fixed "cannot find dependency on symbol 1" issue when using replaced symbols in spamassassin rules
2731 * [Fix] partition_id is not available in old versions of CH
2732 * [Project] Add implicit conversion logic to selectors
2733 * [Project] Add initial support for selectors in regexps
2734 * [Project] Add method concept
2735 * [Project] Further changes in unicode operations
2736 * [Project] Implement Clickhouse migrations
2737 * [Project] Implement implicit conversions to userdata
2738 * [Project] Implement insert method
2739 * [Project] Implement selectors registration for regular expressions
2740 * [Project] Implement selectors support in re_cache
2741 * [Project] Improve language detector: cleanup unused files, categorize
2742 * [Project] Migrate CH data to a fat table
2743 * [Project] Rework selectors logic
2744 * [Project] Start Clickhouse utilities library
2745 * [Project] Start unicode rework
2746 * [Project] coroutine threaded model for API calls: thread pool
2747 * [Rework] Move phishtank to a DNS based service
2748 * [Rework] Rework Clickhouse plugin to use the new API
2749 * [Rework] Rework language detector
2750 * [Rework] Rework utf content processing in text parts
2751 * [WebUI] Add progress bar for AJAX requests
2752 * [WebUI] Avoid errors table reinitialization
2753 * [WebUI] Avoid history table reinitialization
2754 * [WebUI] Avoid throughput summary table reinitialization
2755 * [WebUI] Destroy summary table on disconnect
2756 * [WebUI] Fix "auth" request URL
2757 * [WebUI] Fix disabling and hiding controls on page reload
2758 * [WebUI] Fix maps loading from neighbours
2759 * [WebUI] Fix symbols sorting by score
2760 * [WebUI] Fix tables destroying
2761 * [WebUI] Fix throughput data consolidation
2762 * [WebUI] Fix upload buttons disabling
2763 * [WebUI] Notify user on module loading failure
2764 * [WebUI] Update FooTable 3.1.4 -> 3.1.6
2765
2766 1.7.9: 01 Aug 2018
2767 * [CritFix] Fix caseless comparison of equal length strings
2768 * [Feature] Add HTTP basic auth support to elastic and clickhouse plugins
2769 * [Feature] Add SPF selector to reputation
2770 * [Feature] Add support of the fallback backends for HTTP maps
2771 * [Feature] Allow to print full mime structure when extracting mime data
2772 * [Feature] Allow to split symbols in reputation plugin
2773 * [Feature] Check attachments only on AV scanners in attachments_only mode
2774 * [Feature] Disable all SSL checks if ssl_no_verify flag is set
2775 * [Feature] Implement parsing of scoped IPv6 addresses
2776 * [Feature] Improve `rspamc counters` output
2777 * [Fix] Add sanity checks when expanding SPF macros
2778 * [Fix] Allow to parse SA rules with no spaces around =~ (dirty hack)
2779 * [Fix] Avoid one extra byte writing
2780 * [Fix] Deal with direct hash table
2781 * [Fix] Detect empty text part as text, not HTML
2782 * [Fix] Do not reduce map watch timeout for mixed http/file maps
2783 * [Fix] Fix HTML part detection heuristic
2784 * [Fix] Fix double free in redirectors cleanup
2785 * [Fix] Fix legacy history handling in the controller
2786 * [Fix] Fix messages insertion
2787 * [Fix] Fix sending string method
2788 * [Fix] Fix statconver command line arguments
2789 * [Fix] Fixed argument checking for being null
2790 * [Fix] Fixed issues reported by luacheck
2791 * [Fix] Freeze updates queue when do actual storage update
2792 * [Fix] HTTP map hash is per-backend and not per-map
2793 * [Fix] Plug memory leak in fuzzy updates
2794 * [Fix] Prefer 'MTA-Name' when producing authentication results
2795 * [Fix] Replace bad unicode sequences instead of stopping on them
2796 * [Fix] Set classifier version on learning
2797 * [Project] Reworked ratelimits
2798 * [Project] Apply topological sorting for symbols in Rspamd
2799 * [Project] Remove global contexts from C modules
2800 * [Project] Move performance critical hash tables to khash
2801 * [WebUI] Avoid unused indexes
2802 * [WebUI] Do not execute `on_success` callback
2803 * [WebUI] Fix history reset for "All SERVERS" (#2346)
2804 * [WebUI] Fix query URL for selected server
2805 * [WebUI] Fix symbols display in legacy history,
2806 * [WebUI] Hide symbols order selector for legacy history
2807 * [WebUI] Refactor query functions into one
2808 * [WebUI] Remove previously-attached event handlers
2809 * [WebUI] Save symbols to the selected server
2810 * [WebUI] Unify arguments of query functions
2811 * [WebUI] Use common query functions to get graph data
2812 * [WebUI] Use common query functions to save symbols
2813
2814 1.7.8: 12 Jul 2018
2815 * [Feature] Add more extended statistics about fuzzy updates
2816 * [Feature] Add more non-conformant Received headers support
2817 * [Feature] Add preliminary function to get fuzzy hashes from text in Lua
2818 * [Feature] Allow to configure AV module rejection message
2819 * [Feature] Implement fuzzy hashes extraction in mime tool
2820 * [Feature] Improve WHITE_ON_WHITE rule
2821 * [Feature] Improve integer -> string conversion
2822 * [Feature] Reuse maps in multimap module more aggressively
2823 * [Fix] Avoid race condition in skip map as pool lifetime is not enough
2824 * [Fix] Eliminate all specific C plugins pools
2825 * [Fix] Fix DKIM check rule if DNS is unavailable
2826 * [Fix] Fix build where ucontext is defined in ucontext.h
2827 * [Fix] Fix crash in base url handling
2828 * [Fix] Fix descriptors leak in sqlite3 locking code
2829 * [Fix] Fix messages quarantine
2830 * [Fix] Fix padded numbers printing
2831 * [Fix] Fix race condition on maps reinit
2832 * [Fix] Fix regexp functions when no data is passed
2833 * [Fix] Fix specific urls extraction
2834 * [Fix] Fix styles propagation
2835 * [Fix] Improve resetting of the limit buckets
2836 * [Fix] Initialize sqlite3 properly
2837 * [Fix] Work with broken resolvers in resolv.conf
2838 * [Project] Implement HTTP maps caching
2839 * [Project] Refresh fuzzy hashes when matched
2840 * [Project] Add logic to deduplicate fuzzy updates queue
2841 * [WebUI] Add missed declarations
2842 * [WebUI] Avoid using "undefined" property
2843 * [WebUI] Do not accept passwords containing control characters
2844 * [WebUI] Do not redeclare variables
2845 * [WebUI] Enable strict mode,
2846 * [WebUI] Fix variable assignment
2847 * [WebUI] Initialize variables at declaration
2848 * [WebUI] Remove duplicated path from RequireJS config
2849 * [WebUI] Remove unused block
2850 * [WebUI] Remove unused variable
2851 * [WebUI] Remove unused variables
2852 * [WebUI] Use self-explanatory notation
2853 * [WebUI] Use type-safe equality operators
2854
2855 1.7.7: 02 Jul 2018
2856 * [CritFix] Check NM part of pubkey to match it with rotating keypairs
2857 * [CritFix] Do not overwrite PID of the main process
2858 * [CritFix] Fix maps after reload
2859 * [CritFix] Fix maps race conditions on reload
2860 * [CritFix] Fix shmem leak in encrypting proxy mode
2861 * [Feature] Add a concept of ignored symbols to avoid race conditions
2862 * [Feature] Add ability to print bayes tokens in rspamadm mime
2863 * [Feature] Add method to get statistical tokens in Lua API
2864 * [Feature] Add preliminary mime stat command
2865 * [Feature] Add rspamadm mime tool
2866 * [Feature] Add urls extraction tool
2867 * [Feature] Address ZeroFont exploit
2868 * [Feature] Allow rspamadm mime to process multiple files
2869 * [Feature] Allow to extract words in `rspamadm mime`
2870 * [Feature] Allow to print mime part data
2871 * [Feature] Allow to show HTML structure on extraction
2872 * [Feature] Distinguish IP failures from connection failures
2873 * [Feature] Improve output for mime command
2874 * [Feature] Improve styles propagation
2875 * [Feature] Main process crash will now cleanup all children
2876 * [Feature] Preload file and static maps in main process
2877 * [Feature] Print stack trace on crash
2878 * [Feature] Process font size in HTML parser
2879 * [Feature] Propagate content length of invisible tags
2880 * [Feature] Read ordinary file maps in chunks to be more safe on rewrites
2881 * [Feature] Support base tag in HTML
2882 * [Feature] Support more size suffixes when parsing HTML styles
2883 * [Feature] Support opacity style
2884 * [Fix] Another fix for nested composites
2885 * [Fix] Fill nm id in keypairs cache code
2886 * [Fix] Fix colors alpha channel handling
2887 * [Fix] Fix destruction logic
2888 * [Fix] Fix double free
2889 * [Fix] Fix maps preload logic
2890 * [Fix] Fix nested composites process
2891 * [Fix] Fix proxying of Exim connections
2892 * [Fix] Fix reload crash
2893 * [Fix] Fix rspamadm -l command
2894 * [Fix] Update ed25519 signing schema
2895 * [WebUI] Stop using "const" declaration
2896 * [WebUI] Update RequireJS to 2.3.5
2897
2898 1.7.6: 15 Jun 2018
2899 * [CritFix] Fix multiple neural networks support
2900 * [Feature] Add decryption function to keypair command
2901 * [Feature] Add gzip compression for HTTP requests in elastic module
2902 * [Feature] Add gzip methods to lua util
2903 * [Feature] Add maps based on Top Level Domains
2904 * [Feature] Add pubkey checks for dkim_signing
2905 * [Feature] Add support of fake DNS records
2906 * [Feature] Add tool to encrypt files
2907 * [Feature] Allow to add symbols using settings directly
2908 * [Feature] Allow to match private and public keys for DKIM signatures
2909 * [Feature] Allow to set task flags via settings
2910 * [Feature] Allow to specify fake DNS address from the config
2911 * [Feature] Implement signatures verification using rspamadm keypair
2912 * [Feature] Implement signing using `rspamadm keypair`
2913 * [Feature] Improve error reporting for DKIM key access issues
2914 * [Feature] Provide $HOSTNAME variable in UCL
2915 * [Feature] Rework levenshtein distance computation
2916 * [Feature] Split message parsing and processing
2917 * [Feature] Support ED25519 DKIM signatures
2918 * [Feature] Support encrypted configs in UCL
2919 * [Feature] Suppress duplicate warning on very large radix tries
2920 * [Feature] Use OSB to combine header names
2921 * [Fix] Cleanup maps data on shutdown
2922 * [Fix] Fix '~' behaviour in composites
2923 * [Fix] Fix HTTP maps updates
2924 * [Fix] Fix NIST signatures
2925 * [Fix] Fix RFC822 comments when processing a mime address
2926 * [Fix] Fix double free
2927 * [Fix] Fix dynamic settings application
2928 * [Fix] Fix for CommuniGate Pro maillist
2929 * [Fix] Fix keypair creation method to actually create keypair...
2930 * [Fix] Fix matching patterns with no paths
2931 * [Fix] Fix memory leak in parsing comments
2932 * [Fix] Fix parsing of urls with numeric password
2933 * [Fix] Fix plugins intialisation in configwizard
2934 * [Fix] Fix potential crash on reload
2935 * [Fix] Fix potential race condition for a finished HTTP connections
2936 * [Fix] Fix race-condition leak on processes reload
2937 * [Fix] Fix signing in openssl mode
2938 * [Fix] Free language detector structures
2939 * [Fix] Relax alignment requirements
2940 * [Fix] Send DMARC reports compressed
2941 * [Fix] Try to fix leak in dmarc module
2942 * [Fix] Try to plug memory leak in metric exporter
2943 * [Project] Convert rspamadm subcommands to Lua
2944 * [WebUI] Display smtp sender/recipient in history
2945 * [WebUI] Fix elements disabling in "Symbols" tab
2946 * [WebUI] Limit recipients list in history column to 3
2947 * [WebUI] Match envelope and mime addresses following in arbitrary order
2948 * [WebUI] Update column header
2949 * [WebUI] Wrap addresses in history
2950
2951 1.7.5: 18 May 2018
2952 * [Conf] Add MSBL proposed return codes
2953 * [Conf] Add additional groups for policies
2954 * [CritFix] Do not use volatile Lua strings as UCL keys
2955 * [Feature] Add ability to add fuzzy hashes to headers
2956 * [Feature] Add function to extract most meaningful urls
2957 * [Feature] Add rule to block mixed text and encrypted parts
2958 * [Feature] Allow multiple groups for symbols
2959 * [Feature] Allow to disable lua squeezing logic
2960 * [Feature] Allow to get multipart children in Lua
2961 * [Feature] Allow to insert multiple headers from milter headers
2962 * [Feature] Allow to print scores in subject and further extensions
2963 * [Feature] Be more error-prone in squeezed rules
2964 * [Feature] Support multiple return codes in emails module
2965 * [Feature] Use EMA for calculating averages
2966 * [Feature] Use common jit cache for all regexps
2967 * [Feature] support for CommuniGate Pro self-generated messages
2968 * [Fix] Allow to have multiple values for headers as arrays
2969 * [Fix] Do not open sockets for disabled workers
2970 * [Fix] Fix AuthservId
2971 * [Fix] Fix base64 folding in Lua API
2972 * [Fix] Fix build on non-x86 platforms
2973 * [Fix] Fix cached maps logic
2974 * [Fix] Fix compatibility with old maps query logic
2975 * [Fix] Fix crash if skip_map is used
2976 * [Fix] Fix importing static maps from UCL
2977 * [Fix] Fix parsing of unix sockets
2978 * [Fix] Fix raw_mime regexp on HTML part with no text content
2979 * [Fix] Fix tables logging
2980 * [Fix] Fix vertical tab handling in libucl
2981 * [Fix] Try to fix frequency counters
2982 * [Fix] Use better sharding for ip_score
2983 * [Fix] Use multiple results from SURBL DNS reply
2984 * [Fix] When doing AV scan select a different server for retransmit
2985
2986 1.7.4: 01 May 2018
2987 * [Conf] Major stock config updates:
2988 - Workers are now specified in a new format worker "type" { ... }
2989 - Enable fuzzy worker to simplify local fuzzy storages configuration
2990 - Bind all workers to localhost by default to avoid security flaws
2991 * [Conf] Make more sane fuzzy_check default settings
2992 * [CritFix] Fix ucl escape for bad symbols
2993 * [Feature] Add failure symbol for AV module
2994 * [Feature] Add lazy expiration mode for new classifier schema
2995 * [Feature] Add preliminary version of maps stats plugin
2996 * [Feature] Allow to block fuzzy requests from specific networks
2997 * [Feature] Allow to change `expire` of live statistics
2998 * [Feature] Distinguish AV failure from clean result
2999 * [Feature] Further improvements of language detector by using khash
3000 * [Feature] Further optimization of the lang_detection
3001 * [Feature] Implement cluster-aware bayes expiry
3002 * [Feature] Implement exclude patterns in rspamc
3003 * [Feature] Implement glob maps in addition to regexp maps
3004 * [Feature] Implement map statistics function for lua API
3005 * [Feature] Implement stop symbols for Clickhouse collection
3006 * [Feature] Support recipients separated by commas
3007 * [Feature] Try harder to upload scripts to the Redis server
3008 * [Feature] Upgrade t1ha distribution
3009 * [Feature] use_domain_sign_inbound
3010 * [Feature] Use scores from maps if `symbols_set` is not defined
3011 * [Fix] Add resolving version of radix map helper
3012 * [Fix] Check URL before adding implicit prefix
3013 * [Fix] Do not check pid/state when using PRNG
3014 * [Fix] Fix CentOS logrotate script for systemd
3015 * [Fix] Fix slash + dot in urls
3016 * [Fix] Fix systemd version of the logrotate script
3017 * [Fix] Propagate key when import implicit array from Lua
3018 * [Fix] Strip spaces from map keys and values
3019 * [Fix] Try to fix a specific case when processing milter protocol
3020 * [Fix] Try to fix crash when a tcp connection cannot be set
3021 * [Fix] Typo use_domain_local --> use_domain_sign_local
3022 * [Fix] Various fixes to once_received module
3023 * [Project] Store hits counters for map elements
3024
3025 1.7.3: 10 Apr 2018
3026 * [CritFix] Plug bad memory leak in protocol reply
3027 * [Feature] Add avx2 codec for base64
3028 * [Feature] Add method to receive all URL flags from Lua API
3029 * [Feature] Allow to fold headers on stop characters
3030 * [Feature] Allow to set lua_cpath from options
3031 * [Feature] Allow to specify custom rejection message in milter
3032 * [Feature] Deal with unnormalised Unicode obfuscation
3033 * [Feature] Do not detect language twice for relative parts
3034 * [Feature] Implement oversigning feature
3035 * [Feature] Implement silent logging level to minimize noise in logs
3036 * [Feature] Improve URL_IN_SUBJECT rule
3037 * [Feature] Use hashing to reduce redis attack surface
3038 * [Fix] Add oversigning for the most important headers
3039 * [Fix] add 'rewrite subject' to History dropdown
3040 * [Fix] Another fix in folding algorithm
3041 * [Fix] Do not call multimap addr for parts of addr if filter is presented
3042 * [Fix] Do not clean hostname on generic reset
3043 * [Fix] Do not create pid file in no-fork mode
3044 * [Fix] Fix fold_after case to preserve multiple spaces
3045 * [Fix] Fix folding and folding tests
3046 * [Fix] Fix hostname usage in milter mode
3047 * [Fix] Fix lua RSA verify and its tests
3048 * [Fix] Fix metadata exporter send_mail backend (#2124)
3049 * [Fix] Fix processing of '\v' in libucl
3050 * [Fix] Fix shemaless URLs detection
3051 * [Fix] Fix support of multiple headers in sign_header
3052 * [Fix] Fix usage of util.parse_mail_address
3053 * [Fix] Fix weights of dynamic squeezed rules
3054 * [Fix] Leak from bucket before checking the burst
3055 * [Fix] Stop using own localtime as DST could be messy in many cases
3056 * [Fix] Treat unnormalised URLs as obscured
3057 * [Rework] Restore leaky bucket model in ratelimit plugin
3058 * [WebUI] Add messages total to throughput summary
3059 * [WebUI] Add symbols order selector to history
3060 * [WebUI] Config: Load list on demand
3061 * [WebUI] Fix modalBody for maps that appear more than once
3062 * [WebUI] History: Fix Tooltips on paging, filtering and sorting
3063 * [WebUI] Remove a previously-attached event handler
3064 * [WebUI] Update D3 to v5.0.0 and jQuery to v3.3.1
3065
3066 1.7.2: 23 Mar 2018
3067 * [Feature] Store emails in Clickhouse
3068 * [Feature] Support single quotes in config
3069 * [Feature] Use templates when publishing CH schema
3070 * [Feature] Improve Docker image
3071 * [Fix] Add rounding when printing a lot of FP variables
3072 * [Fix] Allow to disable certain actions by assigning null to them
3073 * [Fix] Disable results caching
3074 * [Fix] Fix disabling of squeezed symbols
3075 * [Fix] Fix scan time set
3076 * [Fix] Rework logic of actions setting
3077 * [Fix] Try to fix various Lua stack issues
3078 * [WebUI] Add link tag for favicon.ico
3079 * [WebUI] Display hostname:port/path in the page title
3080
3081 1.7.1: 20 Mar 2018
3082 * [CritFix] Fix lowercase comparison
3083 * [CritFix] Timezone defines seconds WEST UTC not East
3084 * [Feature] Add filename to log format
3085 * [Feature] Add lua rules squeezing
3086 * [Feature] Add related symbols analysis to rspamd_stats
3087 * [Feature] Remove upstream `X-Spam: Yes` header by default
3088 * [Feature] rspamd_stats: Output progress info on STDERR
3089 * [Feature] Whitelist for emails module
3090 * [Fix] Do not allow dependencies on self
3091 * [Fix] Do not cache metric result
3092 * [Fix] Do not trust all issuers as a client certificate
3093 * [Fix] Fix dependencies in lua squeeze
3094 * [Fix] Fix enabling/disabling squeezed rules
3095 * [Fix] Fix enabling/disabling symbols
3096 * [Fix] Fix external dependencies
3097 * [Fix] Fix processing of a single compressed file
3098 * [Fix] Fix some typos
3099 * [Fix] Fix various modules in case of empty message
3100 * [Fix] Handle callbacks that returns table of options
3101 * [Fix] Improve cached action interaction
3102 * [Fix] Make dynamic conf more NaN aware
3103 * [Fix] Never hide actions from WebUI `configuration` tab
3104 * [Project] Implementation of Lua rules squeezing
3105
3106 1.7.0: 12 Mar 2018
3107 * [Conf] Add bayes_expiry as explicit module
3108 * [Conf] Adjust names and weights for neural network plugin
3109 * [Conf] Change updates url
3110 * [Conf] Default statistics is stored in Redis now
3111 * [Conf] Disable fann_redis module by default
3112 * [Conf] Fix default elastic configuration
3113 * [Conf] Fix double quote position
3114 * [Conf] Massive config rework for new structure of symbols and scores
3115 * [Conf] Rename Rambler BLs as they are now Rspamd's ones
3116 * [Conf] Use dedicated rspamd.com subdomains
3117 * [Conf] Use more data from rspamd.com fuzzy storage
3118 * [CritFix] Add sanity guards for badly broken HTML
3119 * [CritFix] Another errors path handling fix
3120 * [CritFix] Another portion of tokenization fixes
3121 * [CritFix] Do not send reject messages after set reply
3122 * [CritFix] Fix ARC chain verification
3123 * [CritFix] Fix crash in milter errors handler
3124 * [CritFix] Fix memory leak in spf caching logic
3125 * [CritFix] Fix milter commands pipelining
3126 * [CritFix] Fix newlines detection
3127 * [CritFix] Fix semicolons parsing in the content type
3128 * [CritFix] Plug memory leak in zstd protocol compression
3129 * [Feature] Add ability to match score in force_actions module
3130 * [Feature] Add aes-rng PRF to libottery
3131 * [Feature] Add 'composites' debug module
3132 * [Feature] Add concept of experimental modules
3133 * [Feature] Add DKIM trace symbol
3134 * [Feature] Add EBL to the default config
3135 * [Feature] Add expected ip check for emails plugin
3136 * [Feature] Add framework to manage Redis scripts
3137 * [Feature] Add framing for the new reputation generic plugin
3138 * [Feature] Add function to show plugins stat
3139 * [Feature] Add gzip compression support for clickhouse module
3140 * [Feature] Add gzip compression support for rspamd controller
3141 * [Feature] Add gzip support when sending lua http requests
3142 * [Feature] Add json output for rspamd_stats
3143 * [Feature] Add method to do a synchronous Redis connection
3144 * [Feature] Add method to get all content-type attributes in Lua
3145 * [Feature] Add `-m` flag to configdump to show modules states
3146 * [Feature] Add mime types to extensions map
3147 * [Feature] Add more features to rescore utility
3148 * [Feature] Add more gtube like patterns to test other spam actions
3149 * [Feature] Add more metafunctions, improve logging
3150 * [Feature] Add more text attributes
3151 * [Feature] Add new configwizard command to rspamadm
3152 * [Feature] Add new tooling for stats conversation
3153 * [Feature] Add old groups migration tool
3154 * [Feature] Add plugins state variable
3155 * [Feature] Add preliminary ecdsa keys support in DKIM
3156 * [Feature] Add preliminary support of idempotent symbols
3157 * [Feature] Add Redis server wizard
3158 * [Feature] Add routine to convert old style stats to a new one
3159 * [Feature] Add some sanity checks for actions and controller
3160 * [Feature] Add statistic convertation module to configwizard
3161 * [Feature] Add sugestions logic to mempool allocator
3162 * [Feature] Add support of config transform in Lua
3163 * [Feature] Add timeout to rspamc when doing corpus test
3164 * [Feature] Add tooling to convert bayes schemas
3165 * [Feature] Add torch conditional to configuration
3166 * [Feature] Add torch-decisiontree package
3167 * [Feature] Add torch-optim contrib package
3168 * [Feature] Add TTL autodetection
3169 * [Feature] Add urls reputation to the reputation framework
3170 * [Feature] Allow floating and negative values in expressions limits
3171 * [Feature] Allow multiple CTs in full extensions map
3172 * [Feature] Allow multiple fann rules
3173 * [Feature] Allow randomly select User-Agent from a list
3174 * [Feature] Allow rspamadm commands to export methods in Lua
3175 * [Feature] Allow rule specific min_bytes in fuzzy check
3176 * [Feature] Allow to adjust symbols scores from Lua
3177 * [Feature] Allow to attach stat signature to messages
3178 * [Feature] Allow to change SMTP from via milter headers
3179 * [Feature] Allow to configure monitored
3180 * [Feature] Allow to create directories in Lua API
3181 * [Feature] Allow to disable torch and skip train samples for ANN
3182 * [Feature] Allow to discard messages dynamically
3183 * [Feature] Allow to enable/disable languages from the detector
3184 * [Feature] Allow to generate DKIM keys from rspamadm API
3185 * [Feature] Allow to get CPU flags from Lua
3186 * [Feature] Allow to have high precision timestamps in logs
3187 * [Feature] Allow to insert headers into specific position
3188 * [Feature] Allow to limit redirector requests per task
3189 * [Feature] Allow to load and use dynamic ANNs with torch
3190 * [Feature] Allow to quarantine rejected messages using milter interface
3191 * [Feature] Allow to receive signing keys from mempool vars
3192 * [Feature] Allow to reserve elements in libucl
3193 * [Feature] Allow to reuse signal handlers chains
3194 * [Feature] Allow to set custom mempool variables from settings
3195 * [Feature] Allow to set headers from settings
3196 * [Feature] Allow to set Settings-Id for all connections
3197 * [Feature] Allow to skip real action and add a header instead
3198 * [Feature] Allow to skip specific hashes in fuzzy storage
3199 * [Feature] Allow to spawn asynchronous processes from Lua
3200 * [Feature] Allow to specify number of threads for ANN learning
3201 * [Feature] Allow to use global lua maps in settings
3202 * [Feature] Allow to use postfilters in composites
3203 * [Feature] Allow to verify signatures from HTTP headers in maps
3204 * [Feature] Antivirus: ordered pattern matches
3205 * [Feature] Authentication-Results: support hiding usernames
3206 * [Feature] Automatically create tables in clickhouse
3207 * [Feature] Catch next-to-last bad extension
3208 * [Feature] Check cached maps more frequently
3209 * [Feature] Check groups sanity
3210 * [Feature] Deal with obscured URLs with @ symbols
3211 * [Feature] Enhance task:store_in_file method
3212 * [Feature] Export password encryption routines to Redis
3213 * [Feature] Filter nan and inf when adding scores
3214 * [Feature] Finalize 7zip files support
3215 * [Feature] Further improvements in language detection
3216 * [Feature] Further improvements in language detection algorithm
3217 * [Feature] Generic key name expansion for Redis keys
3218 * [Feature] Hash whitelist for fuzzy_check
3219 * [Feature] Implement bayes signatures storage
3220 * [Feature] Implement buckets for Redis backend
3221 * [Feature] Implement DKIM reputation adjustments
3222 * [Feature] Implement forked workers children monitoring
3223 * [Feature] Implement headers flags in mime parser
3224 * [Feature] Implement l1/l2 regularization against the current weights
3225 * [Feature] Implement manual ANN train mode
3226 * [Feature] Implement per-user ANN support
3227 * [Feature] Implement torch based ANN learning
3228 * [Feature] Implement upstreams logic for clickhouse exporter
3229 * [Feature] Import torch to Rspamd...
3230 * [Feature] Improve allocation policy when interacting with Lua
3231 * [Feature] Improve Lua/C interaction in history_redis
3232 * [Feature] Improve multiple fuzzy results combining
3233 * [Feature] Improve parsing of DKIM keys: parse algorithm
3234 * [Feature] Improve subprocesses termination handle
3235 * [Feature] Improve symbol type parsing in Lua API
3236 * [Feature] Metadata Exporter: e-Mail Alerts: support multiple recipients; alerting senders/recipients/users (#1600)
3237 * [Feature] Milter headers: support adding/removing arbitrary headers from config
3238 * [Feature] More metatokens
3239 * [Feature] Multimap: checking of symbol options
3240 * [Feature] Multimap: template URL filter
3241 * [Feature] New bayes expiry plugin
3242 * [Feature] Periodically save rspamd stats to disk
3243 * [Feature] Preliminary import of the elasticsearch module
3244 * [Feature] Ratelimit: allow full addresses in whitelisted_rcpts
3245 * [Feature] Ratelimit: support fetching limits from Redis
3246 * [Feature] RBL: received: filtering by position & flags
3247 * [Feature] Read global maps for lua
3248 * [Feature] Redis settings: support checking multiple keys
3249 * [Feature] Rework fann plugin to be a normal post-filter
3250 * [Feature] Rework logging configuration for rspamadm case
3251 * [Feature] Rework short hashes generation to avoid FP
3252 * [Feature] Save real ucl types when exporting to Lua
3253 * [Feature] Set TCP_NODELAY for milter sockets
3254 * [Feature] Setup DKIM signing from configwizard
3255 * [Feature] Skip certain symbols from ANN classify
3256 * [Feature] Store plugins state
3257 * [Feature] Support etag for HTTP maps
3258 * [Feature] Support Expires header when using HTTP maps
3259 * [Feature] Support sending given header multiple times in lua_http
3260 * [Feature] Support sha512 in DKIM signatures
3261 * [Feature] Try to detect HTML messages better
3262 * [Feature] Use array instead of queue to reduce memory fragmentation
3263 * [Feature] Use controller port by default when connecting to local IP
3264 * [Feature] Use rdtsc where possible
3265 * [Fix] Actively load skip hashes map in fuzzy storage
3266 * [Fix] Add another workaround to display history properly
3267 * [Fix] Add definition for old glib compatibility method
3268 * [Fix] Add missing rspamadm control options to help
3269 * [Fix] Add workaround for IPv6 in sendmail
3270 * [Fix] Add workaround for system with non-XSI compatible tzset
3271 * [Fix] Allow oversigning in DKIM signatures
3272 * [Fix] Allow to check negative scores in force_actions
3273 * [Fix] Allow to have negative actions limits
3274 * [Fix] Allow to set any layers number for fann rules
3275 * [Fix] Another fix for rdtcs
3276 * [Fix] Another fix to lua xmlrpc
3277 * [Fix] Another try to deal with #1998
3278 * [Fix] Another try to fix #1998
3279 * [Fix] Another try to fix threading in torch
3280 * [Fix] Apply language detection when adding fuzzy hashes
3281 * [Fix] ARC: Fix Lua 5.3 compatibility; timestamp should be integer
3282 * [Fix] Authentication Results: Fix SPF smtp.mail_from
3283 * [Fix] Auth-Results: Multiple DKIM signatures
3284 * [Fix] Avoid changing content-transfer-encoding header's value
3285 * [Fix] Better handling of the legacy protocol
3286 * [Fix] Check decoded headers sanity (e.g. by excluding \0)
3287 * [Fix] Check for magic when checking for an archive
3288 * [Fix] Cleanup mess with groups
3289 * [Fix] Clickhouse: Insertion in the symbols table
3290 * [Fix] Crash in URL processing
3291 * [Fix] Deal with another case when processing exceptions
3292 * [Fix] Deal with deeply nested messages more aggressively
3293 * [Fix] Deal with nan and inf encoding in json/ucl
3294 * [Fix] Deal with non-key arguments in lua_redis.exec_script
3295 * [Fix] Deal with unknown weight
3296 * [Fix] Deal with URLs with no slashes after protocol
3297 * [Fix] Deal with URLs wrapped in [] in text parts
3298 * [Fix] Deal with zero scores symbols
3299 * [Fix] Default monitoring domain for surbl plugin
3300 * [Fix] Delay upstream re-resolving when one upstream is defined
3301 * [Fix] Detection of maillist optimized and fixed
3302 * [Fix] DKIM signing: allow for auth_only to be false
3303 * [Fix] DMARC: require report_settings for sending reports only
3304 * [Fix] Do not allow garbadge when checking url domain
3305 * [Fix] Do not cache SPF records with PTR elements
3306 * [Fix] Do not constantly re-resolve failed upstreams with a single element
3307 * [Fix] Do not crash if no words defined
3308 * [Fix] Do not crash on empty subtype
3309 * [Fix] Do not expose spamtrap messages to SMTP reply
3310 * [Fix] Do not fail rbl plugin when there are no received or emails
3311 * [Fix] Do not ignore short words
3312 * [Fix] Do not include idempotent/nostat symbols to checksum
3313 * [Fix] Do not override groups when converting metrics
3314 * [Fix] Do not override unix socket group when group comes before owner
3315 * [Fix] Do not skip the last character
3316 * [Fix] Do not spawn too many workers by default
3317 * [Fix] Do not stop monitored on dns errors
3318 * [Fix] Do not stop parsing headers on bad IP header
3319 * [Fix] Do not strip last character in the last word
3320 * [Fix] Do not treat script content as text
3321 * [Fix] Do not try to connect to non-supported addresses
3322 * [Fix] Do not try to dereference last character
3323 * [Fix] Do not try to sign unknown domains
3324 * [Fix] Don't use whitelist/greylist maps as regexp, but as map
3325 * [Fix] Erase unknown HTML entities
3326 * [Fix] Exim Received header protocol parsing
3327 * [Fix] First load selector_map and path_map. And only return false when domain not found if try_fallback is false
3328 * [Fix] Fix a lot of FP in chartable in mixed languages
3329 * [Fix] Fix ANN checks
3330 * [Fix] Fix ANN loading logic
3331 * [Fix] Fix another tokenization issue
3332 * [Fix] Fix autolearn parameters reading
3333 * [Fix] Fix bad archive characters stripping
3334 * [Fix] Fix bad extension check
3335 * [Fix] Fix bayes schema conversion
3336 * [Fix] Fix blacklists and DMARC in whitelist
3337 * [Fix] Fix brain-damaged torch build system
3338 * [Fix] Fix build on FreeBSD
3339 * [Fix] Fix clickhouse exporter
3340 * [Fix] Fix clickhouse schema
3341 * [Fix] Fix comparision
3342 * [Fix] Fix composites processing
3343 * [Fix] Fix connecting to a unix socket in rspamadm statconvert
3344 * [Fix] Fix couple of warnings
3345 * [Fix] Fix crashes in the rspamd_control path
3346 * [Fix] Fix deletion from hash
3347 * [Fix] Fix DKIM forgeries via multiple headers
3348 * [Fix] FIx dynamic conf plugin
3349 * [Fix] Fix emails detection
3350 * [Fix] Fix empty headers simple canonicalization
3351 * [Fix] Fix empty threshold check in greylisting module
3352 * [Fix] Fix encrypted legacy reply in fuzzy storage
3353 * [Fix] Fix enormous scores for R_WHITE_ON_WHITE
3354 * [Fix] Fix exceptions list in surbl
3355 * [Fix] Fix *_EXCESS_BASE64 rules
3356 * [Fix] Fix expire rounding
3357 * [Fix] Fix extra hits in PCRE mode for regular expressions
3358 * [Fix] Fix format strings
3359 * [Fix] Fix get_content method
3360 * [Fix] Fix groups override when defining symbols
3361 * [Fix] Fix learned count in new schema
3362 * [Fix] Fix learn errors propagation
3363 * [Fix] Fix loading of per-user redis backend for statistics
3364 * [Fix] Fix logging buffer corruption in case of repeated messages
3365 * [Fix] Fix lua cached elements invalidation
3366 * [Fix] Fix merging of the implicit arrays
3367 * [Fix] Fix mime_types scoring
3368 * [Fix] Fix multiple headers in DKIM headers list
3369 * [Fix] Fix null callee case in clang plugin
3370 * [Fix] Fix obscured url in format user@@example.com
3371 * [Fix] Fix parsing of the per-user script
3372 * [Fix] Fix priorities in rspamd_update, disable rules execution
3373 * [Fix] Fix processing of closed tags
3374 * [Fix] Fix processing of idempotent rules when autolearn fails
3375 * [Fix] Fix processing of multipart parts with no headers
3376 * [Fix] Fix processing of skip-hashes in fuzzy storage
3377 * [Fix] Fix PTR processing in SPF
3378 * [Fix] Fix pushing country to clickhouse asn table
3379 * [Fix] Fix random forests module
3380 * [Fix] Fix real IP parsing for some strange Exim received
3381 * [Fix] Fix Redis timeout setup
3382 * [Fix] Fix reload crash when hyperscan is enabled
3383 * [Fix] Fix reusing of redis connection after exec
3384 * [Fix] Fix sanity checks on macro value
3385 * [Fix] Fix setting of path and cpath for Lua
3386 * [Fix] Fix setting of signals when spawning a thread
3387 * [Fix] Fix text splitting: stack overflow (too many captures)
3388 * [Fix] Fix ticks processing
3389 * [Fix] Fix upstream addrs updating
3390 * [Fix] Fix urls/emails distinguishing found in queries
3391 * [Fix] Fix user settings check
3392 * [Fix] Fix variable increment
3393 * [Fix] Fix various issues in stat_convert
3394 * [Fix] F-PROT Antivirus infection string for all known occurences
3395 * [Fix] F-PROT Antivirus: only check return code to determine infection
3396 * [Fix] Further fixes around floating point expressions
3397 * [Fix] Further fixes to ANN module
3398 * [Fix] Further fixes to rescore tool
3399 * [Fix] Further fixes to support ES 6
3400 * [Fix] Further tokenization fixes
3401 * [Fix] Greylisting set phase is not idempotent
3402 * [Fix] Handle proxy copy errors
3403 * [Fix] Header checks: Fix get_raw_header method
3404 * [Fix] Header checks: REPLYTO_UNPARSEABLE rule
3405 * [Fix] Kill spawned processes on termination
3406 * [Fix] Load skip map from all processes as shared cache is unavailable
3407 * [Fix] Lowercase HTTP headers to make them searchable from Lua
3408 * [Fix] Lowercase words
3409 * [Fix] Lua_http: freeing
3410 * [Fix] Lua: lpeg to be loaded with rspamd_lua_add_preload, to avoid "rspamd_config_read: rcl parse error: cannot init lua file […] module 'lpeg' not found"
3411 * [Fix] Map absence is not an error
3412 * [Fix] Metadata exporter: check IP sanity
3413 * [Fix] Milter headers: custom headers: removing headers
3414 * [Fix] Milter headers: skip_local / skip_authenticated settings
3415 * [Fix] Milter headers: X-Spamd-Result header if X-Virus ran first
3416 * [Fix] mime_types: fix next-to-last extension length check
3417 * [Fix] More hacks to deal with old configs
3418 * [Fix] Move composites second pass to the dedicated stage
3419 * [Fix] Multimap: received: filtering of artificial header
3420 * [Fix] Multiple fixes in torch based ANN plugins
3421 * [Fix] Once more (#1879) fix bad extension check
3422 * [Fix] Optimize rspamd_fstring_t reallocations
3423 * [Fix] options.local_networks setting
3424 * [Fix] Parse HREF urls without explicit prefix
3425 * [Fix] Plan new event on HTTP errors
3426 * [Fix] Plug another possible memory leak
3427 * [Fix] Plug memory leak
3428 * [Fix] Plug memory leak in lua_tcp
3429 * [Fix] Plug memory leak when setting email addresses from Lua
3430 * [Fix] Propagate learn/stat errors more precisely
3431 * [Fix] Ratelimit: fix whitelisted_rcpts matching
3432 * [Fix] Ratelimit: lowercase email addresses
3433 * [Fix] RBL: received: deal with missing data (#1965)
3434 * [Fix] Rebalance and slightly rework MX check plugin
3435 * [Fix] Redis key expansion: EVAL: deal with strings
3436 * [Fix] Redis script loading in DMARC; URL tags; URL reputation
3437 * [Fix] Reject invalid bh for DKIM signatures earlier
3438 * [Fix] Relax pem signature detection
3439 * [Fix] Relax unicode properties requirements for chartable module
3440 * [Fix] Remove extra noise from dkim and arc signing
3441 * [Fix] Remove hop-by-hop headers in proxy
3442 * [Fix] Remove incorrect method `task:set_metric_subject`
3443 * [Fix] Replace space like characters in headers with plain space
3444 * [Fix] Restore old style ratelimits support
3445 * [Fix] Rework elasticsearch plugin
3446 * [Fix] Rewriting subjects via force actions module
3447 * [Fix] RPM postinstall
3448 * [Fix] Sanitize IP in history redis
3449 * [Fix] Select the correct signature when doing simple canon
3450 * [Fix] Set CLOEXEC flag on files opened
3451 * [Fix] Setting check_local / check_authed in plugins (#1954)
3452 * [Fix] Settings: avoid checking invalid IP (#1981)
3453 * [Fix] Settings: header: deal with multiple settings (#1988)
3454 * [Fix] Skip checks if both extensions are not bad
3455 * [Fix] Skip nostat tokens when get number of tokens
3456 * [Fix] Some more fixes towards emails detection
3457 * [Fix] SpamAssassin: Fail check_freemail_header if regexp didn't match
3458 * [Fix] Stop using of g_slice...
3459 * [Fix] Switch rspamadm logging to message level
3460 * [Fix] Symbol 'FANNR_SPAM' has its score defined..
3461 * [Fix] Table parameter for rspamd_config:add_doc()
3462 * [Fix] Treat 'rewrite subject' as spam action
3463 * [Fix] Try harder in passing IPv6 addresses
3464 * [Fix] Try harder to find rfc822 notifications
3465 * [Fix] Try harder to find urls
3466 * [Fix] Use decoded values when parsing mime addresses
3467 * [Fix] Use full URL when making an HTTP request
3468 * [Fix] Use greylisting threshold in greylisting module
3469 * [Fix] Use n_words attribute from ngramms
3470 * [Fix] Use raw urls when sending requests to redirector
3471 * [Fix] Use the right boolean operator on error check
3472 * [Fix] Use weight from map for fuzzy scoring
3473 * [Fix] Various fixes to elastic plugin
3474 * [Fix] Various fixes to fann_redis instantiation
3475 * [Fix] Various improvements in language detection
3476 * [Fix] Virus infection string for F-PROT Antivirus
3477 * [Fix] Virus infetction string for F-PROT Antivirus
3478 * [Fix] WebUI: use relative path for savemap (#1943)
3479 * [Fix] WHITE_ON_WHITE: Ensure score is matched to part that fired the rule
3480 * [Fix] Write configuration changes as UCL config
3481 * [Project] Add detection logic for words
3482 * [Project] Add fast debug logging infrastructure
3483 * [Project] Add more flags to languages
3484 * [Project] Add n-gramms data files
3485 * [Project] Add ngramms frequencies detector
3486 * [Project] Add random words selection logic
3487 * [Project] Add unigramms to language detection as well
3488 * [Project] Convert all C modules to fast debug infrastructure
3489 * [Project] Detect some languages based on unicode script
3490 * [Project] Enable fast debug lookup for some modules
3491 * [Project] Enable language detector init in scanner workers
3492 * [Project] Further improvements to language detector
3493 * [Project] Implement logic of ngramms application
3494 * [Project] Improve weighting in lang_detection
3495 * [Project] Initialize language detector
3496 * [Project] Preliminary version of ngramms based language detector
3497 * [Project] Preliminary version of the new stat_convert
3498 * [Project] Remove old language detector
3499 * [Project] Rework language detection ngramms structure
3500 * [Project] Start language detection project
3501 * [Project] Start rework of language detection to improve quality
3502 * [Project] Use fast debug logging check
3503 * [Rework] Add frame for new reputation based IP score module
3504 * [Rework] Continue stat_convert rework task
3505 * [Rework] Implement new version of fuzzy replies
3506 * [Rework] Improve readability of xmlrpc API
3507 * [Rework] Kill metrics!11
3508 * [Rework] Ratelimit module
3509 * [Rework] Rename fann_redis to neural plugin
3510 * [Rework] Reorganize mime_types module
3511 * [Rework] Rework rescore utility
3512 * [Rework] Rewrite model and learning logic for rescore
3513 * [Rework] Run post-loads when all initialization is completed
3514 * [Rework] Simplify lua path initialization
3515 * [Rework] Start major stat_convert rework
3516 * [Rework] Start mempool fragmentation reduce project
3517 * [Rework] Start moving of fann redis to torch
3518 * [Rework] Stop embedding rspamadm scripts into C
3519 * [Rework] Use floating point arithmetics in Rspamd expressions
3520 * [Rework] Use frequencies distribution in language detector
3521 * [Rules] Penalise R_BAD_CTE_7BIT for utf8 messages
3522 * [WebUI] Compact graph selectors
3523 * [WebUI] Escape strings inside HTML in history
3524 * [WebUI] Fix message count in throughput summary (#1724)
3525 * [WebUI] Fix NaNs display on Throughput graph
3526 * [WebUI] Migrate widgets to D3 v4
3527 * [WebUI] Restore passwordless login support (#2003)
3528 * [WebUI] Show symbol descriptions as tooltips in history
3529 * [WebUI] Stop using commas in pie chart tooltips
3530 * [WebUI] Update D3 and jQuery
3531 * [WebUI] Update D3Evolution 1.0.0 -> 1.1.0
3532
3533 1.6.6: 16 Feb 2018
3534 * [CritFix] Add sanity guards for badly broken HTML
3535 * [CritFix] Another errors path handling fix
3536 * [CritFix] Fix ARC chain verification
3537 * [CritFix] Fix crash in milter errors handler
3538 * [Feature] Allow to insert headers into specific position
3539 * [Feature] Allow to receive signing keys from mempool vars
3540 * [Feature] Authentication-Results: support hiding usernames
3541 * [Fix] Another try to deal with #1998
3542 * [Fix] Another try to fix #1998
3543 * [Fix] Better handling of the legacy protocol
3544 * [Fix] Check decoded headers sanity (e.g. by excluding \0)
3545 * [Fix] Deal with nan and inf encoding in json/ucl
3546 * [Fix] Deal with URLs wrapped in [] in text parts
3547 * [Fix] DKIM signing: allow for auth_only to be false
3548 * [Fix] Do not crash on empty subtype
3549 * [Fix] Do not fail rbl plugin when there are no received or emails
3550 * [Fix] Do not skip the last character
3551 * [Fix] Do not try to dereference last character
3552 * [Fix] Do not try to sign unknown domains
3553 * [Fix] Exim Received header protocol parsing
3554 * [Fix] First load selector_map and path_map. And only return false when domain not found if try_fallback is false
3555 * [Fix] Fix bad archive characters stripping
3556 * [Fix] Fix comparision
3557 * [Fix] Fix connecting to a unix socket in rspamadm statconvert
3558 * [Fix] Fix empty headers simple canonicalization
3559 * [Fix] Fix extra hits in PCRE mode for regular expressions
3560 * [Fix] Fix parsing of the per-user script
3561 * [Fix] Fix processing of skip-hashes in fuzzy storage
3562 * [Fix] Fix Redis timeout setup
3563 * [Fix] Fix sanity checks on macro value
3564 * [Fix] Fix text splitting: stack overflow (too many captures)
3565 * [Fix] Fix urls/emails distinguishing found in queries
3566 * [Fix] F-PROT Antivirus: only check return code to determine infection
3567 * [Fix] Metadata exporter: check IP sanity
3568 * [Fix] Multimap: received: filtering of artificial header
3569 * [Fix] Plan new event on HTTP errors
3570 * [Fix] Plug another possible memory leak
3571 * [Fix] Remove hop-by-hop headers in proxy
3572 * [Fix] Sanitize IP in history redis
3573 * [Fix] Setting check_local / check_authed in plugins (#1954)
3574 * [Fix] Settings: avoid checking invalid IP (#1981)
3575 * [Fix] Try harder in passing IPv6 addresses
3576 * [Fix] WebUI: use relative path for savemap (#1943)
3577 * [WebUI] Fix message count in throughput summary (#1724)
3578 * [WebUI] Fix NaNs display on Throughput graph
3579 * [WebUI] Restore passwordless login support (#2003)
3580
3581 1.6.5: 22 Oct 2017
3582 * [CritFix] Another portion of tokenization fixes
3583 * [CritFix] Fix memory leak in spf caching logic
3584 * [CritFix] Fix milter commands pipelining
3585 * [CritFix] Fix newlines detection
3586 * [Feature] Filter nan and inf when adding scores
3587 * [Feature] Implement headers flags in mime parser
3588 * [Feature] Support Expires header when using HTTP maps
3589 * [Fix] Actively load skip hashes map in fuzzy storage
3590 * [Fix] Add workaround for IPv6 in sendmail
3591 * [Fix] Authentication Results: Fix SPF smtp.mail_from
3592 * [Fix] Check for magic when checking for an archive
3593 * [Fix] Deal with another case when processing exceptions
3594 * [Fix] Deal with URLs with no slashes after protocol
3595 * [Fix] Do not allow garbadge when checking url domain
3596 * [Fix] Do not ignore short words
3597 * [Fix] Do not strip last character in the last word
3598 * [Fix] Do not treat script content as text
3599 * [Fix] Erase unknown HTML entities
3600 * [Fix] Fix another tokenization issue
3601 * [Fix] Fix DKIM forgeries via multiple headers
3602 * [Fix] Fix emails detection
3603 * [Fix] Fix empty threshold check in greylisting module
3604 * [Fix] Fix enormous scores for R_WHITE_ON_WHITE
3605 * [Fix] Fix loading of per-user redis backend for statistics
3606 * [Fix] Fix multiple headers in DKIM headers list
3607 * [Fix] Fix obscured url in format user@@example.com
3608 * [Fix] Further tokenization fixes
3609 * [Fix] Load skip map from all processes as shared cache is unavailable
3610 * [Fix] Lowercase words
3611 * [Fix] Milter headers: skip_local / skip_authenticated settings
3612 * [Fix] Milter headers: X-Spamd-Result header if X-Virus ran first
3613 * [Fix] Ratelimit: fix whitelisted_rcpts matching
3614 * [Fix] Some more fixes towards emails detection
3615 * [Fix] SpamAssassin: Fail check_freemail_header if regexp didn't match
3616 * [Fix] Use greylisting threshold in greylisting module
3617
3618 1.6.4: 10 Sep 2017
3619 * [Feature] Add method to get all content-type attributes in Lua
3620 * [Feature] Add some sanity checks for actions and controller
3621 * [Feature] Allow randomly select User-Agent from a list
3622 * [Feature] Deal with obscured URLs with @ symbols
3623 * [Feature] Milter headers: support adding/removing arbitrary headers from config
3624 * [Fix] Add another workaround to display history properly
3625 * [Fix] Add missing rspamadm control options to help
3626 * [Fix] Auth-Results: Multiple DKIM signatures
3627 * [Fix] Crash in URL processing
3628 * [Fix] Default monitoring domain for surbl plugin
3629 * [Fix] Detection of maillist optimized and fixed
3630 * [Fix] Do not cache SPF records with PTR elements
3631 * [Fix] Fix blacklists and DMARC in whitelist
3632 * [Fix] Fix exceptions list in surbl
3633 * [Fix] Fix processing of closed tags
3634 * [Fix] Fix PTR processing in SPF
3635 * [Fix] Lowercase HTTP headers to make them searchable from Lua
3636 * [Fix] options.local_networks setting
3637 * [Fix] Ratelimit: lowercase email addresses
3638 * [Fix] Rebalance and slightly rework MX check plugin
3639 * [Fix] Redis script loading in DMARC; URL tags; URL reputation
3640 * [Fix] Reject invalid bh for DKIM signatures earlier
3641 * [Fix] Remove incorrect method `task:set_metric_subject`
3642 * [Fix] Rewriting subjects via force actions module
3643 * [Fix] RPM postinstall
3644 * [Fix] Treat 'rewrite subject' as spam action
3645 * [Fix] Try harder to find urls
3646 * [Fix] Use full URL when making an HTTP request
3647 * [Fix] Use raw urls when sending requests to redirector
3648 * [Fix] Use weight from map for fuzzy scoring
3649 * [Rules] Penalise R_BAD_CTE_7BIT for utf8 messages
3650
3651 1.6.3: 26 Jul 2017
3652 * [CritFix] Fix semicolons parsing in the content type
3653 * [Feature] Add EBL to the default config
3654 * [Feature] Allow to configure monitored
3655 * [Feature] Allow to skip specific hashes in fuzzy storage
3656 * [Feature] Multimap: checking of symbol options
3657 * [Feature] Redis settings: support checking multiple keys
3658 * [Fix] ARC: Fix Lua 5.3 compatibility; timestamp should be integer
3659 * [Fix] Avoid changing content-transfer-encoding header's value
3660 * [Fix] Don't use whitelist/greylist maps as regexp, but as map
3661 * [Fix] Fix get_content method
3662 * [Fix] Header checks: Fix get_raw_header method
3663 * [Fix] Header checks: REPLYTO_UNPARSEABLE rule
3664 * [Fix] Lua_http: freeing
3665 * [Fix] Milter headers: custom headers: removing headers
3666 * [Fix] Parse HREF urls without explicit prefix
3667 * [Fix] WHITE_ON_WHITE: Ensure score is matched to part that fired the rule
3668 * [WebUI] Escape strings inside HTML in history
3669
3670 1.6.2: 08 Jul 2017
3671 * [Conf] Remove Rambler email bl for now
3672 * [Conf] Switch RAMBLER_URIBL to a locally managed source
3673 * [CritFix] Switch from ragel to C for Content-Type parsing
3674 * [Feature] Add `-e` option for lua_repl
3675 * [Feature] Add per-domain emails normalisation rules
3676 * [Feature] Add sessions cache to debug dangling sessions
3677 * [Feature] Add short_text_direct_hash for fuzzy check module
3678 * [Feature] Add text_part:get_stats function
3679 * [Feature] Allow to add custom processing script for surbl
3680 * [Feature] Allow to check reply-to email
3681 * [Feature] Allow to customize spam header, remove existing spam headers
3682 * [Feature] Allow to disable specific workers in the config
3683 * [Feature] Allow to discard messages instead of rejection
3684 * [Feature] Allow to specify custom delimiter in emails plugin
3685 * [Feature] Allow to specify custom User-Agent for rspamc
3686 * [Feature] Allow to store symbols data in Clickhouse
3687 * [Feature] Allow to use HTTPS when connecting to Clickhouse
3688 * [Feature] Enable sessions cache tracking for milter connections
3689 * [Feature] Implement per-line mode in lua_repl (like `perl -p`)
3690 * [Feature] Implement rdns-curve plugin based on rspamd cryptobox
3691 * [Feature] Improve maps cached data lifetime
3692 * [Feature] Improve maps checking frequency
3693 * [Feature] Improve monitored timeouts logic
3694 * [Feature] milter_headers: add `extended_headers_rcpt` option
3695 * [Feature] Milter headers: Add X-Spam-Flag to rmilter-compatibility headers
3696 * [Feature] Milter headers: remove-header routine
3697 * [Feature] Multimap: received filters for extracting TLDs from hostnames
3698 * [Feature] Normalize email aliases in emails module
3699 * [Feature] Re-add rambler email bl (as hashed list)
3700 * [Feature] Reload file maps more frequently
3701 * [Feature] Rework newlines strip parser one more time
3702 * [Feature] Skip updates for messages scanned via controller
3703 * [Feature] Split long DKIM public keys
3704 * [Feature] Store more data when stripping newlines
3705 * [Feature] Support SPF macros transformations
3706 * [Feature] Support suppressing DMARC reports for some domains
3707 * [Fix] Add missing `break` statement
3708 * [Fix] Allow modifiers in SPF macros
3709 * [Fix] DKIM sign tools: edge-cases around use_esld
3710 * [Fix] Do not cache SPF records with macros
3711 * [Fix] Do not overwrite score when setting pre-action
3712 * [Fix] Fix comparison logic
3713 * [Fix] Fix DKIM base64 folding for milter flagged messages
3714 * [Fix] Fix emails module configuration
3715 * [Fix] Fix folding for arc headers when milter interface is used
3716 * [Fix] Fix gmail dots removal
3717 * [Fix] Fix rspamc detection in greylist module
3718 * [Fix] Fix some more issues with HTTP maps
3719 * [Fix] Milter sessions can live forever
3720 * [Fix] Normalize fuzzy probability better
3721 * [Fix] Plug memory leak
3722 * [Fix] RBL: Fixed hashed email address lookups
3723 * [Fix] Try to deal with brain-damaged milter behaviour
3724 * [Fix] Use `\n` to fold headers for milter
3725 * [Rework] Allow to use custom callback for monitored checks
3726 * [Rework] Further steps towards one process monitoring
3727 * [Rework] Send health checks from a single worker
3728 * [WebUI] Round-up throughput summary values
3729
3730 1.6.1: 14 Jun 2017
3731 * [Fix] Allow to init resolver without rspamd_config
3732 * [Fix] Do not crash when resolver failed to initialize
3733 * [Fix] Fix abstract context layout
3734 * [Fix] Fix CGP helper reply parsing
3735 * [Fix] Fix crashes when socket write errors occur
3736 * [Fix] Fix parsing IPv6 nameservers in resolv.conf
3737 * [Fix] Milter: Don't defer on "greylist" action
3738
3739 1.6.0: 12 Jun 2017
3740 * [Conf] Add rspamd_proxy to the default configuration set
3741 * [Conf] Add sample arc module config
3742 * [Conf] Do away with systemd specifics completely
3743 * [Conf] Increase min_bytes to avoid FP
3744 * [Conf] Remove ratelimits from default configuration
3745 * [CritFix] Fix accepting on IPv6 sockets
3746 * [CritFix] Fix corruption when multiple fuzzy are defined
3747 * [CritFix] Fix learn condition in fuzzy check
3748 * [CritFix] Fix memory leak in fuzzy check
3749 * [CritFix] Fix memory leak in maps scheduling
3750 * [CritFix] Paese the last character in DKIM signature correctly
3751 * [CritFix] Zero fill sockaddr_un
3752 * [Feature] Add ability to add doc strings by example
3753 * [Feature] Add API to verify DKIM (and ARC) signatures
3754 * [Feature] Add compression/decompression to proxy
3755 * [Feature] Add count to url structure
3756 * [Feature] Add initial support of the new protocol reply
3757 * [Feature] Add Lua plugin spamtrap
3758 * [Feature] Add `monitored_address` for rbls
3759 * [Feature] Add new schema for bayes tokens
3760 * [Feature] Add preliminary ARC support to dkim code
3761 * [Feature] Add preliminary support of ARC signing
3762 * [Feature] Add rules to detect bad 8bit characters in From and To
3763 * [Feature] Add scanning support for milter protocol
3764 * [Feature] Add support for bidirectional symbols in rspamd_stats
3765 * [Feature] Add support for static maps
3766 * [Feature] Add support of maps with multiple regexps matches
3767 * [Feature] Add `text_multiplier` param
3768 * [Feature] Add the preliminary ARC plugin
3769 * [Feature] Add top redirector targets rank
3770 * [Feature] Allow async events to be registered from LUA rules
3771 * [Feature] Allow storing bayes tokens in Redis
3772 * [Feature] Allow to exclude specific domains from mx check
3773 * [Feature] Allow to have a stack of watcher finalisers
3774 * [Feature] Allow to pass hostname to `-i` flag in Rspamc
3775 * [Feature] Allow to set custom user agent in url redirector
3776 * [Feature] Allow to use custom callback when parsing resolv.conf
3777 * [Feature] Allow to use domain from authenticated user
3778 * [Feature] Bayes expiry plugin
3779 * [Feature] Check dkim sign keys for modifications
3780 * [Feature] DKIM signing: sign_networks/local address specific use_domain settings
3781 * [Feature] DMARC: Support excluding domains from sampling
3782 * [Feature] Expire processing items for URL redirector aggressively
3783 * [Feature] Fix surbl monitored for IP lists, add `monitored_domain` option
3784 * [Feature] Implement caching for dkim body hashes
3785 * [Feature] Implement milter protocol scan reply
3786 * [Feature] Improve omograph phishing detection
3787 * [Feature] Initial support of self-scan in Rspamd proxy
3788 * [Feature] Keep track of headers in milter interface
3789 * [Feature] Milter headers: better controls for local/authenticated
3790 * [Feature] Multimap: email:domain:tld filter
3791 * [Feature] Preliminary DMARC reporting implementation
3792 * [Feature] Reuse stemmers in the cache
3793 * [Feature] Rework confighelp to load Lua plugins
3794 * [Feature] Rework hfilter to use hyperscan if possible
3795 * [Feature] Rework lua RSA API
3796 * [Feature] Rmilter_headers: approximate rmilter's extended_spam_headers
3797 * [Feature] Start integration of milter support in proxy
3798 * [Feature] Store average words length and short words count
3799 * [Feature] Store hash of headers order and names
3800 * [Feature] Support MTA name header
3801 * [Feature] Support multiple types of dkim signing in Lua
3802 * [Feature] Support numeric arguments for Redis requests
3803 * [Feature] Use headers hash in bayes metatokens
3804 * [Feature] Use normal resolv.conf rules of rotation in Rspamd
3805 * [Feature] Use version 2 proto for checking messages
3806 * [Fix] Allow to follow symlinks when safe
3807 * [Fix] Append MX name for authentication results as required
3808 * [Fix] Change default text multiplier from 0.5 to 2.0
3809 * [Fix] Check min_bytes for images as well
3810 * [Fix] Deal with 7bit charsets properly
3811 * [Fix] Deal with 8bit characters in email addresses
3812 * [Fix] Deal with unpaired <a> tags
3813 * [Fix] Detect confighelp in plugins initialisation
3814 * [Fix] Disable certain checks for utf spoof detection
3815 * [Fix] DKIM Signing: avoid nil index when From header is missing
3816 * [Fix] Do not add exact hashes from different parts
3817 * [Fix] Do not check DMARC if SPF or DKIM were not checked
3818 * [Fix] Do not check URLs that are resolved to be redirected
3819 * [Fix] Do not set bayes probability if we don't use it
3820 * [Fix] Do not stop on illegal unicode points - replace them
3821 * [Fix] Fix another race condition in arc checks
3822 * [Fix] Fix arc count logic
3823 * [Fix] Fix ARC signing
3824 * [Fix] Fix brain-damaged spamc protocol for now
3825 * [Fix] Fix calling for peak functions
3826 * [Fix] Fix couple of issues in FORWARDED rule
3827 * [Fix] Fix CTE propagation from parent containers to children parts
3828 * [Fix] Fix errors processing in the controller
3829 * [Fix] Fix format string in milter
3830 * [Fix] Fix issues in SPF macros parsing
3831 * [Fix] Fix logging format string
3832 * [Fix] Fix logic of cached passwords check
3833 * [Fix] Fix lowercasing of stemmed words
3834 * [Fix] Fix LRU elements removal
3835 * [Fix] Fix memory leak when accepting from unix sockets
3836 * [Fix] Fix milter connections persistence
3837 * [Fix] Fix objects merging in UCL
3838 * [Fix] Fix order of operations to avoid race condition
3839 * [Fix] Fix parsing of long regexp types
3840 * [Fix] Fix passing data to log helper when many symbols defined
3841 * [Fix] Fix pools management for milter session
3842 * [Fix] Fix processing of the watchers
3843 * [Fix] Fix queue id macro in milter
3844 * [Fix] Fix R_BAD_CTE_7BIT rule
3845 * [Fix] Fix Redis timeout set
3846 * [Fix] Fix REPLYTO_UNPARSEABLE rule
3847 * [Fix] Fix setting of email address
3848 * [Fix] Fix some more issues about duplicated fuzzy requests
3849 * [Fix] Fix spamc support in rspamd proxy
3850 * [Fix] Fix syntax error in spamtrap plugin
3851 * [Fix] Fix url counts for href urls
3852 * [Fix] Fix url handling in the protocol
3853 * [Fix] Multimap: Received IP filters with Redis
3854 * [Fix] Oops, fix d9d0fa5e86db2f4470d34395a233b450478b2f60
3855 * [Fix] Parse rgb[a](x,x,x[,x]) css colors
3856 * [Fix] Phishing: strict_domains
3857 * [Fix] Reduce maps aggressiveness
3858 * [Fix] Reresolve upstreams even if there is a single server there
3859 * [Fix] Rspamadm grep: Disable Lua patterns in string search by default
3860 * [Fix] Skip text parts when checking binary parts in fuzzy check
3861 * [Fix] Support v2 checks in controller
3862 * [Fix] Treat empty address as valid
3863 * [Fix] Try harder to detect CTE
3864 * [Fix] Try to deal with v4 mapped to v6 addresses on accept
3865 * [Fix] Use dkim signing callback properly
3866 * [Fix] Use non-volatile memory for storing data
3867 * [Fix] Use static maps instead of ugly hack for radix_from_config
3868 * [Fix] Use the same pool for related sessions
3869 * [Rework] Continue modularisation for lua library
3870 * [Rework] Initial milter protocol support
3871 * [Rework] Make log pipes worker agnostic, add scanners API
3872 * [Rework] Move authentication results generation to a separate routine
3873 * [Rework] Move common DKIM functions to a separate lua module
3874 * [Rework] Move global functions to a separate directory
3875 * [Rework] Prepare dkim module for ARC checks
3876 * [Rework] Propagate ucl variables from the command line
3877 * [Rework] Remove multiple metrics support from Rspamd
3878 * [Rework] Stop using name 'rmilter' for the modern protocol
3879 * [Rework] Use LFU algorithm in LRU cache
3880 * [Rules] Fix received TLS rules
3881 * [Rules] Improve URL_COUNT_ODD rule
3882 * [WebUI] Fix add header filter in history
3883 * [WebUI] Use modern protocol for checking messages
3884
3885 1.5.9:
3886 * [Conf] Increase min_bytes to avoid FP
3887 * [Conf] Remove ratelimits from default configuration
3888 * [CritFix] Fix accepting on IPv6 sockets
3889 * [CritFix] Zero fill sockaddr_un
3890 * [Feature] Add `text_multiplier` param
3891 * [Fix] Check min_bytes for images as well
3892 * [Fix] Do not add exact hashes from different parts
3893 * [Fix] Fix memory leak when accepting from unix sockets
3894 * [Fix] Fix some more issues about duplicated fuzzy requests
3895 * [Fix] Phishing: strict_domains
3896 * [Fix] Skip text parts when checking binary parts in fuzzy check
3897 * [Minor] Add the same duplicates protection for all fuzzy hashes types
3898 * [Minor] Fix braces
3899 * [Minor] Fix test
3900 * [Minor] SPOOF_DISPLAY_NAME: Use all SMTP/MIME recipients
3901 * [Minor] Validate assumed spoofed display name domains to contain a dot
3902
3903
3904 1.5.8:
3905 * [CritFix] Fix memory leak in fuzzy check
3906 * [CritFix] Fix memory leak in maps scheduling
3907 * [Feature] Multimap: email:domain:tld filter
3908 * [Fix] DKIM Signing: avoid nil index when From header is missing
3909 * [Fix] Do not set bayes probability if we don't use it
3910 * [Fix] Do not stop on illegal unicode points - replace them
3911 * [Fix] Fix brain-damaged spamc protocol for now
3912 * [Fix] Fix Redis timeout set
3913 * [Fix] Fix spamc support in rspamd proxy
3914 * [Fix] Multimap: Received IP filters with Redis
3915 * [Fix] Parse rgb[a](x,x,x[,x]) css colors
3916 * [Fix] Reresolve upstreams even if there is a single server there
3917 * [Fix] Treat empty address as valid
3918 * [Fix] Try harder to detect CTE
3919 * [Fix] Try to deal with v4 mapped to v6 addresses on accept
3920 * [Minor] Add `wsf` and `hta` bad archive extensions
3921 * [Minor] Fix configuration option
3922 * [Minor] Fix result parsing for SAVAPI
3923 * [Minor] Further logging improvements
3924 * [Minor] Improve logging of errors
3925 * [Minor] Prevent MID_CONTAINS_FROM from firing on empty address
3926 * [Minor] Reduce digit->number transmission penalty
3927 * [Minor] Relax CTYPE_MISSING_DISPOSITION rule
3928
3929
3930 1.5.7:
3931 * [CritFix] Fix corruption when multiple fuzzy are defined
3932 * [CritFix] Fix learn condition in fuzzy check
3933 * [Feature] Add rules to detect bad 8bit characters in From and To
3934 * [Feature] DKIM signing: sign_networks/local address specific use_domain settings
3935 * [Feature] Support numeric arguments for Redis requests
3936 * [Fix] Deal with 8bit characters in email addresses
3937 * [Fix] Fix couple of issues in FORWARDED rule
3938 * [Fix] Fix passing data to log helper when many symbols defined
3939 * [Fix] Fix R_BAD_CTE_7BIT rule
3940 * [Fix] Fix REPLYTO_UNPARSEABLE rule
3941 * [Fix] Fix setting of email address
3942 * [Fix] Rspamadm grep: Disable Lua patterns in string search by default
3943 * [Minor] Add Lua 5.3 workaround
3944 * [Minor] Add lua methods to detect if a part has 8bit characters
3945 * [Minor] Allow session-less lua dns requests
3946 * [Minor] Allow to append greylist end time to message reported
3947 * [Minor] Avoid `nil` table
3948 * [Minor] Disable dkim_signing if redis is specified but not configured
3949 * [Minor] Fix build with pcre2
3950 * [Minor] Fix rule
3951 * [Minor] Fix warnings
3952 * [Minor] Format floating point number
3953 * [Minor] Push email flags to the lua API
3954 * [Minor] Silence some warnings
3955 * [Minor] Silence warning
3956 * [Minor] Try all hostname regexps to find the most significant one
3957 * [WebUI] Fix add header filter in history
3958
3959 1.5.6:
3960 * [Feature] Add unigramms support in bayes
3961 * [Feature] Allow configurable sign headers for DKIM
3962 * [Feature] Allow to add unigramm metatokens from Lua
3963 * [Feature] DKIM Signing: envelope match exception for local IPs
3964 * [Feature] UCL: register parser variables from Lua
3965 * [Fix] Always try to adjust filename
3966 * [Fix] Do extra copy to ensure that original content is never touched
3967 * [Fix] Fix SPOOF_REPLYTO rule
3968 * [Fix] Ignore Rmilter added Received
3969 * [Fix] More fixes for hashed email dnsbls
3970 * [Fix] Plug memory leak in chartable module
3971 * [WebUI] Display multiple alerts at once
3972
3973
3974 1.5.5:
3975 * [CritFix] Fix classifier learning with Redis backend
3976 * [CritFix] Fix issue when parsing encoded rfc822/messages
3977 * [Feature] Add escaped version of lua_ucl import
3978 * [Feature] Add task:headers_foreach function
3979 * [Feature] Allow to process filenames from content type
3980 * [Feature] Allow to query hashed emails
3981 * [Feature] Ignore bayes with mostly metatokens or with too few text
3982 * [Feature] Probabilistically skip metatokens
3983 * [Feature] Retrieve all virus names from SAVAPI
3984 * [Feature] Rework classifiers lua metatokens
3985 * [Feature] Store headers order
3986 * [Feature] Store text tokens inside bayes tokens
3987 * [Feature] Use cached shingles keys
3988 * [Fix] Add missing score normalisation for HFILTER_URL_ONLY
3989 * [Fix] Avoid lookup in absent hash
3990 * [Fix] Check return values from Lua functions called from C
3991 * [Fix] Do not count sending and loading time in rspamc
3992 * [Fix] Escape json strings for controller rejplies from Lua
3993 * [Fix] Fix archive scans for savapi
3994 * [Fix] Fix domain_only emails RBL
3995 * [Fix] Fix ip_score map configuration
3996 * [Fix] Fix JSON output for history_redis
3997 * [Fix] Fix one character length substrings search
3998 * [Fix] Fix parsing of non-RFC compatible Exim received
3999 * [Fix] Fix parsing of options for workers with the same type
4000 * [Fix] Fix processing of small tokens vectors
4001 * [Fix] Fix rfc2047 tokenization
4002 * [Fix] Fix typo
4003 * [Fix] More fixes for inplace decoding
4004 * [Fix] Try to avoid modifications of the original data
4005 * [Fix] URL redirector: Fix call to is_redirector
4006 * [Rework] Set token data as uint64_t instead of chars array
4007 * [WebUI] Check if neighbours' history backend versions match
4008 * [WebUI] Disable phrase connectors replacement in history filtering
4009 * [WebUI] Disable phrase connectors replacement in symbols filtering
4010 * [WebUI] Do not hide messages with bad subject, just replace it with '???'
4011 * [WebUI] Fix error message
4012 * [WebUI] Fix history v2 display
4013 * [WebUI] Fix legacy history
4014 * [WebUI] history: break To address lists on commas
4015 * [WebUI] Increase default timeout to 20 seconds
4016 * [WebUI] Save some history table space
4017
4018 1.5.4:
4019 * [Conf] Add history_redis default configuration
4020 * [Feature] Add spoofed rules
4021 * [Feature] Add URL_IN_SUBJECT rule
4022 * [Feature] Allow to get task's subject
4023 * [Feature] Allow to specify maximum number of shots for symbols
4024 * [Feature] Distinguish URLs found in Subject
4025 * [Feature] Memoize LPEG grammars
4026 * [Feature] Parse else parts in SA rules
4027 * [Feature] Process subject for mixed characters
4028 * [Feature] Resolve url chains in url_redirector module
4029 * [Feature] Stat greylisted messages as greylisted not soft-rejected
4030 * [Feature] Support checking for redirector in Lua SURBL
4031 * [Feature] Support tag_exists SA function
4032 * [Feature] Work with broken rfc2047 tokens
4033 * [Fix] Check all watcher's dependencies
4034 * [Fix] Do not compile hyperscan with no SSSE3 support
4035 * [Fix] Do not crash if cannot decode qp encoded part
4036 * [Fix] Fix dependencies of DKIM when multiple signatures are found
4037 * [Fix] Fix lists in whitelist plugin
4038 * [Fix] Fix one-shot symbols weight calculations
4039 * [Fix] Fix options and shots match
4040 * [Fix] Fix order of symbol options
4041 * [Fix] Fix parsing of dot at the end of the address
4042 * [Fix] Fix parsing of lua table arguments
4043 * [Fix] Fix processing of subject words
4044 * [Fix] Fix string split memoization
4045 * [Fix] Fix templates grammar usage
4046 * [Fix] Fix various issues related to Lua stack manipulation
4047 * [Fix] Force actions: Use postfilter if we have honor_action / require_action
4048 * [Fix] Further fixes to avoid PHISHING FP
4049 * [Fix] Preserve order of options in symbols
4050 * [Fix] Rspamadm grep: deal with unusually-formatted logs
4051 * [Fix] Use hostname suffix when dealing with history
4052 * [Rework] Remove outdated SA rules
4053 * [WebUI] Add flexible columns
4054 * [WebUI] Add footable
4055 * [WebUI] Add sender, recipients and subject columns
4056 * [WebUI] Allow message-id break
4057 * [WebUI] Fix history clustering
4058 * [WebUI] Fix history display
4059 * [WebUI] Fix sorting
4060 * [WebUI] Humanize sizes
4061 * [WebUI] Initial move towards footable
4062 * [WebUI] Remove datatables
4063 * [WebUI] Replace `.values` method with `.map`
4064 * [WebUI] Rework v2 symbols display
4065 * [WebUI] Try to normalize frequencies
4066 * [WebUI] Unbreak WebUI
4067 * [WebUI] Use Footable to draw Throughput summary table
4068
4069 1.5.3:
4070 * [Conf] Add composite for hacked wordpress phishing
4071 * [CritFix] Fix base64 decoding when there are unparseable characters
4072 * [Feature] Additional symbol metadata in metadata exporter
4073 * [Feature] Add method to get protocol reply from Lua
4074 * [Feature] Add symbols when tagged rcpt/sender are normalised
4075 * [Feature] Add task:get_symbols_all() function
4076 * [Feature] Allow multiple formats of DKIM signing key
4077 * [Feature] Allow to cache and use flexible protocol reply
4078 * [Feature] Allow to set one_shot flag from register_symbol
4079 * [Feature] Allow to skip certain types of hashes when learning fuzzy
4080 * [Feature] Cache and insert scan time into the protocol
4081 * [Feature] Detect newlines in rspamc --mime
4082 * [Feature] DKIM signing: support use of maps
4083 * [Feature] Greylist: Support excluding low-scoring messages from greylisting
4084 * [Feature] Implement lua history in controller
4085 * [Feature] Implement redis history querying
4086 * [Feature] Preliminary implementation of redis history plugin
4087 * [Feature] Support using request headers in settings
4088 * [Fix] Change default template to deal with non-ASCII characters
4089 * [Fix] Deal with lists of maps in whitelist module
4090 * [Fix] DKIM signing: use domain-specific signing key
4091 * [Fix] Do not reallocate completed zstd buffer
4092 * [Fix] Do not use local_addrs in proxy
4093 * [Fix] Fix crash when resolver is undefined
4094 * [Fix] Fix double free when closing lua_tcp connections
4095 * [Fix] Fix for lua 5.3
4096 * [Fix] Fix freeing of arrays iterators
4097 * [Fix] Fix issue with task:get_symbol and symbols with no metric
4098 * [Fix] Fix log line duplication in `rspamadm grep`
4099 * [Fix] Fix memory corruption on termination
4100 * [Fix] Fix out-of-bound access in base64 decode
4101 * [Fix] Fix ratelimit + greylisting
4102 * [Fix] Fix subject rewriting
4103 * [Fix] Fix task:set_recipients function
4104 * [Fix] Fix URI_COUNT_ODD rule
4105 * [Fix] Follow the traditional symbols conventions in RCPT_COUNT rule
4106 * [Fix] Greylist: Suppress greylist action for whitelisted hosts too
4107 * [Fix] Metadata exporter: use rule-specific settings for emails
4108 * [Fix] Properly set missing fields in exporter
4109 * [Fix] Proxy: max_retries option
4110 * [Fix] RCPT_COUNT fixes
4111 * [Fix] Rework HAS_X_PRIO rule to match symbols conventions
4112 * [Fix] Update issues in ac-trie
4113 * [Fix] Use optimised base64 decoding in DKIM
4114 * [WebUI] Add preliminary v2 history parser
4115 * [WebUI] Allow different history parsers
4116 * [WebUI] Display symbols
4117 * [WebUI] Rework history v2 function
4118
4119 1.5.2:
4120 * [Conf] Add default config for spamassasssin plugin
4121 * [Conf] Add default configuration for antivirus module
4122 * [Conf] Add dkim signing docs
4123 * [Conf] Add mx_check default config
4124 * [Conf] Add replies config
4125 * [Conf] Add trie default config
4126 * [Feature] Add heuristic to find text parts in files
4127 * [Feature] Add rule to detect broken content type
4128 * [Feature] Allow to extract CTE in Lua API
4129 * [Feature] Allow to set from address for a lua_task
4130 * [Feature] Allow to set recipients of a task from Lua
4131 * [Feature] Enchance text_part:get_content method
4132 * [Feature] Remove + aliases from emails
4133 * [Feature] Support rmilter block and dkim signature in CGP helper
4134 * [Feature] Support running event loop from Lua
4135 * [Fix] Antivirus: use scanner-specific redis prefix
4136 * [Fix] Couple of fixes for DKIM signing module
4137 * [Fix] Distinguish missing and broken mandatory headers
4138 * [Fix] Do more heuristical detection for missing CTE
4139 * [Fix] Do not resort cache on each check
4140 * [Fix] Fix CGP escaping
4141 * [Fix] Fix MISSING_MIME_VERSION rule for plain messages
4142 * [Fix] Fix parsing of cte in expressions
4143 * [Fix] Fix partial matches in rspamadm grep
4144 * [Fix] Fix setting class on style field
4145 * [WebUI] Auto-switch Throughput units to `msg/min` for very low rate
4146 * [WebUI] Update D3Evolution to 0.0.2
4147
4148 1.5.1:
4149 * [CritFix] Fix processing of stop_patterns with `\0` character
4150 * [CritFix] Fix setting of raw key for signing
4151 * [Fix] Fix lua exports from plugins during reload
4152 * [Fix] Fix prefilters action scores
4153 * [Fix] Fix symbols processing order
4154 * [Minor] Help cmake find gthread
4155 * [Minor] Some cmake fixes
4156
4157 1.5.0:
4158 * [Conf] Add configurations for asn, clickhouse and dcc
4159 * [Conf] Add default config for url redirector plugin
4160 * [Conf] Add the default config for greylist module
4161 * [Conf] Allow to edit all local maps from WebUI by default
4162 * [CritFix] Deal with absent headers in DKIM
4163 * [CritFix] Do not trust remote shingles count
4164 * [CritFix] Fix bad memory leak in TLS certificates validation
4165 * [CritFix] Fix critical memory issues with radix maps
4166 * [CritFix] Fix descriptors leak on reload
4167 * [CritFix] Fix headers selection in DKIM verification
4168 * [CritFix] Fix parsing of boundaries that end with `--`
4169 * [CritFix] Repair PTR_ARRAY_FOREACH macro
4170 * [Feature] Add CORS support to the controller
4171 * [Feature] Add FROM_NAME_EXCESS_SPACE rule
4172 * [Feature] Add REPLYTO_EMAIL_HAS_TITLE rule
4173 * [Feature] Add `caseless_hash` method to `lua_util`
4174 * [Feature] Add `rip` keyword to ratelimit module
4175 * [Feature] Add a simple benchmark for content type parsing
4176 * [Feature] Add boundaries parsing in content type
4177 * [Feature] Add charset detection for text parts
4178 * [Feature] Add content disposition parser
4179 * [Feature] Add fallback if too many updates are failing
4180 * [Feature] Add function to convert struct tm to time using timezone
4181 * [Feature] Add function to normalize HTTP paths
4182 * [Feature] Add fuzzy collection plugin
4183 * [Feature] Add fuzzy logic for images
4184 * [Feature] Add gmime parser to mime_tool
4185 * [Feature] Add heuristic to detect broken messages
4186 * [Feature] Add heuristic to find displayed URLs
4187 * [Feature] Add heuristic to process broken email addresses
4188 * [Feature] Add images normalization
4189 * [Feature] Add mechanism for disabling composites (Fixes #1270)
4190 * [Feature] Add method to create regexp from a glob pattern
4191 * [Feature] Add mime encoding manipulation routines
4192 * [Feature] Add mime tool to explore messages
4193 * [Feature] Add more meta tokens from received headers
4194 * [Feature] Add neighbours option to support Rspamd cluster in WebUI
4195 * [Feature] Add new function to parse mime addresses
4196 * [Feature] Add new methods for lua_tcp
4197 * [Feature] Add own headers decoding routine
4198 * [Feature] Add own routine to generate a message id
4199 * [Feature] Add parser for SMTP date
4200 * [Feature] Add per-task lua cache to reuse 'heavy' objects
4201 * [Feature] Add plugins list path in WebUI
4202 * [Feature] Add preliminary multipart support
4203 * [Feature] Add preliminary version of DKIM signing module
4204 * [Feature] Add profiling support in client output
4205 * [Feature] Add rfc2047 grammar
4206 * [Feature] Add rfc2047 variant for QP decoding
4207 * [Feature] Add rmilter_headers module (Fixes #1227)
4208 * [Feature] Add sse42 version of base64 decoding
4209 * [Feature] Add ssse3 and avx2 base64 decoders
4210 * [Feature] Add support of libgd
4211 * [Feature] Add the preliminary version of redirects resolver in Lua
4212 * [Feature] Add ucl_object_iterate_full function
4213 * [Feature] Add url encoding function
4214 * [Feature] Allow SOA requests in lua dns
4215 * [Feature] Allow custom parse types in lua ucl
4216 * [Feature] Allow plugins to register webui handlers
4217 * [Feature] Allow to add options explicitly to symbols
4218 * [Feature] Allow to call a callback when symbol frequency is on peak
4219 * [Feature] Allow to call redirector script from SURBL
4220 * [Feature] Allow to create variable length dkim keys
4221 * [Feature] Allow to have module specific options for Redis in plugins
4222 * [Feature] Allow to pass sign key directly from Lua
4223 * [Feature] Allow to register configuration docs from Lua API
4224 * [Feature] Allow to return options as a table
4225 * [Feature] Allow to set peak callbacks from Lua
4226 * [Feature] Allow to specify custom method for a message
4227 * [Feature] Allow to store dkim keys in Redis
4228 * [Feature] Allow to store messages in files
4229 * [Feature] Apply DCT using AAN for fuzzy signature
4230 * [Feature] Avira SAVAPI support
4231 * [Feature] Cache and simplify DCT and jpeg decode
4232 * [Feature] Cache libicu converters
4233 * [Feature] Detect URLs with suspicious omographs
4234 * [Feature] Do not increase score for duplicate options
4235 * [Feature] Do not trust CTE, check base64 and qp strictly
4236 * [Feature] Dynamic reputation in URL reputation plugin
4237 * [Feature] Extend redis lock when learning spawned
4238 * [Feature] Filter non-utf chars from all decoded headers
4239 * [Feature] Fix phishing detection for IDNA urls
4240 * [Feature] Ignore bad symbols on base64 decoding
4241 * [Feature] Ignore too wide elements in SPF
4242 * [Feature] Implement fuzzy collection mode
4243 * [Feature] Implement helo maps in multimap
4244 * [Feature] Implement human readable buckets configuration
4245 * [Feature] Implement min-hash shingles for DCT data from images
4246 * [Feature] Implement new algorithm for fuzzy hashes of images
4247 * [Feature] Implement new unicode normalizer
4248 * [Feature] Implement quoted printable decoding
4249 * [Feature] Implement received headers flags
4250 * [Feature] Implement rspamdgrep tool
4251 * [Feature] Implement sane checksum for config file
4252 * [Feature] Implement url tags concept
4253 * [Feature] Improve detection of omographs using libicu
4254 * [Feature] Improve url redirector module
4255 * [Feature] Multimap: Received header processing
4256 * [Feature] Multiple improvements in the maps
4257 * [Feature] New URL filters in multimap
4258 * [Feature] Plugin to force actions on selected symbols
4259 * [Feature] RBL module: support hashing for emails and helo RBL
4260 * [Feature] Reuse URL tags in SURBL module
4261 * [Feature] Rework RRD ds count, add conversion path
4262 * [Feature] Rework surbl module to avoid extra redirector calls
4263 * [Feature] Send config id to the WebUI
4264 * [Feature] Simplify HTTPCrypt client support
4265 * [Feature] Skip processing for large images
4266 * [Feature] Start collection only mode implementation for fuzzy storage
4267 * [Feature] Start import of the optimized base64 decode
4268 * [Feature] Store all received headers in lua
4269 * [Feature] Store relational order of all headers in a message
4270 * [Feature] Support DKIM signing in Lua plugins
4271 * [Feature] Support HTTPCrypt client in lua_http
4272 * [Feature] Support setting SMTP message in multimap
4273 * [Feature] Support setting metric subject from Lua
4274 * [Feature] Support setting subject in force actions module
4275 * [Feature] Treat v6 mapped addresses as v4 addresses
4276 * [Feature] URL reputation plugin
4277 * [Feature] Use Redis instead of memcached in URLs redirector
4278 * [Feature] Use Rspamd rfc2047 decoder instead of gmime one
4279 * [Feature] Use a different normalization for fuzzy images
4280 * [Feature] Use normalized images in fuzzy hashes
4281 * [Feature] Use own code for parsing of date
4282 * [Feature] Use shingles for images fuzzying
4283 * [Feature] Use t1ha for hashes, allow inlining
4284 * [Feature] Use t1ha instead of metrohash and xxhash32
4285 * [Feature] Various new features in metadata exporter module
4286 * [Feature] rmilter_headers: authentication-results (#78)
4287 * [Fix] Add additional check to mark redis connection inactive
4288 * [Fix] Add packed attribute for protocol structure
4289 * [Fix] Adopt OMOGRAPH_URL rule
4290 * [Fix] Allow static maps
4291 * [Fix] Allow to disable classifiers checks using settings and conditions
4292 * [Fix] Another try to fix 0 length maps
4293 * [Fix] Another try to fix corruption during maps reload
4294 * [Fix] Another try to fix descriptors leak
4295 * [Fix] Another try to fix reload and logger
4296 * [Fix] Antivirus module: register virtual symbols for patterns
4297 * [Fix] Avoid extensive reallocs
4298 * [Fix] Avoid mempool leak in SA plugin on reload
4299 * [Fix] Avoid race condition on saving cache and reload
4300 * [Fix] Avoid reusing g_error (Fixes #1262)
4301 * [Fix] Break pool connection on fatal redis errors
4302 * [Fix] Check for NaN properly
4303 * [Fix] Couple of fixes for date parsing
4304 * [Fix] Date header timezone adjustments (#1279)
4305 * [Fix] Deal with EOF properly
4306 * [Fix] Decode filename in content disposition
4307 * [Fix] Disable fuzzy images by default
4308 * [Fix] Disable zero-copy mode for text parts to avoid crashes
4309 * [Fix] Do not destroy session when not all finish scripts are done
4310 * [Fix] Do not greyscale images
4311 * [Fix] Do not leave parent-less workers processes on fatal errors
4312 * [Fix] Do not lowercase Content-Disposition to perform decoding
4313 * [Fix] Do not penalize characters just after numeric prefix
4314 * [Fix] Do not refork workers that are intended to die
4315 * [Fix] Do not set pre-result and update records for no `Queue-ID` messages
4316 * [Fix] Do not skip post-filters when pre-filters have set some results
4317 * [Fix] Do not stop symbols planning if async events are pending
4318 * [Fix] Do not try to set keys for unencrypted requests in proxy
4319 * [Fix] Encode URLs according to rfc3986
4320 * [Fix] Encode URLs before sending them to the protocol
4321 * [Fix] Filter bad characters from message id
4322 * [Fix] Fix CTE detection heuristic
4323 * [Fix] Fix Content-Type in HTTP requests
4324 * [Fix] Fix IDN eslds phishing checks
4325 * [Fix] Fix adding maps from config in Lua
4326 * [Fix] Fix another reload memory issue
4327 * [Fix] Fix argument returned on redis backend errors
4328 * [Fix] Fix assertion in graph handling
4329 * [Fix] Fix body trie matching
4330 * [Fix] Fix build
4331 * [Fix] Fix byte array expansion during toutf8 conversion
4332 * [Fix] Fix charset normalisation
4333 * [Fix] Fix checking of DKIM bodies that needs just `\n` to be added
4334 * [Fix] Fix couple of cornercases with email addresses
4335 * [Fix] Fix couple of issues
4336 * [Fix] Fix dependencies tracking for callback symbols
4337 * [Fix] Fix detection of jpeg size
4338 * [Fix] Fix errors handling in fuzzy backend initialization
4339 * [Fix] Fix fuzzy hashes count
4340 * [Fix] Fix globbing and convert lists to arrays in fuzzy_check
4341 * [Fix] Fix heuristical CTE detection for QP encoding
4342 * [Fix] Fix ignoring of bad text parts
4343 * [Fix] Fix indexes in array access, interleave loop
4344 * [Fix] Fix int64 -> double conversion
4345 * [Fix] Fix invalid memory access on reload
4346 * [Fix] Fix issues with empty updates
4347 * [Fix] Fix issues with quoted-printable encoding
4348 * [Fix] Fix keys names
4349 * [Fix] Fix lots of issues in mime parser code
4350 * [Fix] Fix lua maps load
4351 * [Fix] Fix macro name
4352 * [Fix] Fix mas group score calculations
4353 * [Fix] Fix matching of the same patterns from different tries
4354 * [Fix] Fix memory corruprtion and leak
4355 * [Fix] Fix memory leak in HTTP maps
4356 * [Fix] Fix memory leak in expression destroying
4357 * [Fix] Fix memory leak in parsing of mime names
4358 * [Fix] Fix memory leak in safe ucl iterators
4359 * [Fix] Fix memory leak on reload in plugins
4360 * [Fix] Fix modules reconfigure on reload
4361 * [Fix] Fix monitored setup fro URLBLs with IP addresses
4362 * [Fix] Fix name of var
4363 * [Fix] Fix new rrd updates
4364 * [Fix] Fix out of bounds access
4365 * [Fix] Fix parsing messages with no body
4366 * [Fix] Fix parsing of '=' character in headers
4367 * [Fix] Fix parsing of messages with no content type
4368 * [Fix] Fix plugins callbacks in webui
4369 * [Fix] Fix possible memory corruption in redis pool
4370 * [Fix] Fix probability calculations for fuzzy redis backend
4371 * [Fix] Fix processing errors in lua_tcp
4372 * [Fix] Fix processing of emails with name only
4373 * [Fix] Fix processing of non-multipart messages
4374 * [Fix] Fix processing of parts with no valid content type
4375 * [Fix] Fix race condition in SIGUSR2 handler
4376 * [Fix] Fix redis options parsing when no redis servers are defined
4377 * [Fix] Fix reload and hyperscan ready event
4378 * [Fix] Fix reload memory issue
4379 * [Fix] Fix rra_ptr conversion
4380 * [Fix] Fix rrd file conversion
4381 * [Fix] Fix setting of content-type attributes
4382 * [Fix] Fix signing headers creation in DKIM
4383 * [Fix] Fix stddev calculations
4384 * [Fix] Fix surbl plugin to work with composite maps
4385 * [Fix] Fix timezones parsing
4386 * [Fix] Fix tokens usage
4387 * [Fix] Fix urls and emails hashes
4388 * [Fix] Fix usage of unsafe ucl iterators
4389 * [Fix] Fix work with broken utf8 tokens
4390 * [Fix] Fix writing of user to roll history
4391 * [Fix] Forgotten worker
4392 * [Fix] Further memory leaks fixes
4393 * [Fix] Ignore lua metatokens in bayes for now
4394 * [Fix] Improve OMOGRAPH_URL rule
4395 * [Fix] Lua IP from string should be invalid if parsing failed
4396 * [Fix] Miltiple fixes to new lua_tcp, add debugging
4397 * [Fix] More fixes for iterators cleanup
4398 * [Fix] More fixes to logger initialization
4399 * [Fix] More heuristic fixes for phishing detection
4400 * [Fix] More leaks eliminated
4401 * [Fix] More leaks...
4402 * [Fix] More random fixes for reload...
4403 * [Fix] Multimap: Fixes for email filters
4404 * [Fix] Multiple fixes for fann module
4405 * [Fix] Multiple memory corruption fixes
4406 * [Fix] Normalize path in HTTP router
4407 * [Fix] Plug memory leak
4408 * [Fix] Plug memory leak in adding radix trees
4409 * [Fix] Plug memory leak in configuration parser
4410 * [Fix] Plug memory leak in expressions parsing during reload
4411 * [Fix] Plug memory leak in learning fuzzy storage
4412 * [Fix] Plug memory leak in lua_tcp
4413 * [Fix] Plug reload leaks
4414 * [Fix] Plug termination memory leaks
4415 * [Fix] Really increase lock lifetime
4416 * [Fix] Replies module: fix symbol weight
4417 * [Fix] Restore content type params related functions
4418 * [Fix] Set task's subject from mime subject
4419 * [Fix] Sigh, one more reload leak
4420 * [Fix] Simplify images shingles
4421 * [Fix] Some more memory issues are fixed
4422 * [Fix] Stop hardcoding of lua in C
4423 * [Fix] Stop processing of bad parts as text parts
4424 * [Fix] Strictly filter bad characters when emittin json
4425 * [Fix] Strings returned from lua are ephemeral
4426 * [Fix] Support unix sockets for lua redis
4427 * [Fix] Try to fix issues with reloading config
4428 * [Fix] Try to fix race condition in redis_pool
4429 * [Fix] Use checksum to avoid intersection between different ANNs
4430 * [Fix] Use rspamd hashes in embedded ucl
4431 * [Fix] Use sane default rewrite subject (*** SPAM *** %s)
4432 * [Fix] Various collection mode fixes
4433 * [Fix] Various fixes to mime parser
4434 * [Fix] Various reload leak fixing
4435 * [Fix] Whitelist certain extensions from archive checks
4436 * [Rework] Add preliminary implementation of the mime parser
4437 * [Rework] Adopt code for the new options
4438 * [Rework] Change logger setup interface
4439 * [Rework] Composite configuration (#1270)
4440 * [Rework] Finally remove gmime dependency from Rspamd
4441 * [Rework] Further fixes to symbols frequencies
4442 * [Rework] Implement content type parser for mime
4443 * [Rework] Kill all InternetAddressList usages
4444 * [Rework] Multiple fixes for symbols cache statistics
4445 * [Rework] Refactor struct names
4446 * [Rework] Rework images fuzzy hashes algorithm
4447 * [Rework] Rework lua_tcp to allow TCP dialog
4448 * [Rework] Start massive rework to get rid of gmime
4449 * [Rework] Start new approach for multiparts parsing
4450 * [Rework] Start rework of mime addresses
4451 * [Rework] Start rework of symbols cache updates
4452 * [Rework] Start switching to libicu
4453 * [Rework] Use a special structure for stats tokens
4454 * [Rework] Use hash tables for symbols options
4455 * [Rework] Use libicu instead of iconv for conversions
4456 * [Rework] Use new scheme to parse mime parts
4457 * [WebUI] Add Access-Control-Allow-Origin for cluster management
4458 * [WebUI] Add Throughput graph autorefreshing (#820)
4459 * [WebUI] Add Visibility.js library
4460 * [WebUI] Add basic cluster support to Throughput tab
4461 * [WebUI] Add graph legend entries for new DSes
4462 * [WebUI] Add graph tab
4463 * [WebUI] Add neighbours RRD data consolidation
4464 * [WebUI] Add preliminary save symbols clustering
4465 * [WebUI] Add server selector to navbar
4466 * [WebUI] Add soft reject to auth stats
4467 * [WebUI] Add summary to the Throughput tab
4468 * [WebUI] Allow to save maps on the cluster
4469 * [WebUI] Avoid extra graph redraw and alerts glitching
4470 * [WebUI] Be more generous with AJAX timeout
4471 * [WebUI] Disable error ring loading in `read only` mode
4472 * [WebUI] Enclose table header cells with `tr`s
4473 * [WebUI] Finish interface rework
4474 * [WebUI] Fix RRD summary pie chart position
4475 * [WebUI] Fix `All SERVERS` graph fot just one available server
4476 * [WebUI] Fix case when no cluster is defined
4477 * [WebUI] Fix compatibility with non-ES6 compliant browsers
4478 * [WebUI] Fix config ID
4479 * [WebUI] Fix configuration page partially
4480 * [WebUI] Fix disabled state
4481 * [WebUI] Fix graph dataset selector initialization
4482 * [WebUI] Fix graph selectors state resetting
4483 * [WebUI] Fix mouse events on throughput summary table area
4484 * [WebUI] Fix multiple JS issues
4485 * [WebUI] Fix pie chart displaying
4486 * [WebUI] Fix read only
4487 * [WebUI] Fix read only2
4488 * [WebUI] Fix retarded datatables
4489 * [WebUI] Fix soft reject in pie chart
4490 * [WebUI] Fix stat widgets timers multiplication on `Refresh` click
4491 * [WebUI] Fix symbols config
4492 * [WebUI] Fix various errors with login form
4493 * [WebUI] Further fixes
4494 * [WebUI] Hide learning tab in read-only mode
4495 * [WebUI] Initial clusters support
4496 * [WebUI] Make legend entry colours more contrast
4497 * [WebUI] Move configuration tab to a separate module
4498 * [WebUI] Move history tab
4499 * [WebUI] Move symbols config as well
4500 * [WebUI] New sec to time function
4501 * [WebUI] Prevent multiple clicks on `Refresh`
4502 * [WebUI] RRD summary: Hide inner labels of tiny pie sectors
4503 * [WebUI] RRD summary: Respect undefined values
4504 * [WebUI] Reduce font size of graph's legend
4505 * [WebUI] Remove orphaned font duplicates
4506 * [WebUI] Remove unused code
4507 * [WebUI] Replace spinner with animated glyphicon
4508 * [WebUI] Reset refresh timer on server switching
4509 * [WebUI] Rework interface to use requirejs
4510 * [WebUI] Rework neighbours query function
4511 * [WebUI] Separate attributes by space
4512 * [WebUI] Set focus to password field (#1230)
4513 * [WebUI] Simplify neighbours table populating
4514 * [WebUI] Start rework of modules
4515 * [WebUI] Stop stats refreshing if the page is hidden
4516 * [WebUI] Turn d3pie's stuff into a reusable function,
4517 * [WebUI] Unify send data functions
4518 * [WebUI] Update D3Evolution to 0.0.1
4519 * [WebUI] Update d3.js
4520 * [WebUI] Update datatables to work with the requirejs
4521 * [WebUI] Use unified tab click event handler,
4522 * [WebUI] clusters for the chart
4523 * [WebUI] fix uptime
4524
4525 1.4.2:
4526 * [CritFix] Deal with absent headers in DKIM
4527 * [CritFix] Do not trust remote shingles count
4528 * [CritFix] Fix headers selection in DKIM verification
4529 * [Feature] Add EXT_CSS rule
4530 * [Feature] Add toggle for disabling SURBLs
4531 * [Feature] Extend redis lock when learning spawned
4532 * [Feature] Parse <link> HTML tags
4533 * [Fix] Avoid reusing g_error (Fixes #1262)
4534 * [Fix] Do not reset loaded ANN when learning is requested
4535 * [Fix] Fix another issue with external deps in SA
4536 * [Fix] Fix body trie matching
4537 * [Fix] Fix checking of DKIM bodies that needs just `\n` to be added
4538 * [Fix] Fix fuzzy hashes count
4539 * [Fix] Fix keys names
4540 * [Fix] Fix length calculations for url encoded urls
4541 * [Fix] Fix matching of the same patterns from different tries
4542 * [Fix] Fix name of var
4543 * [Fix] Fix parsing of URLs with spaces and other bad chars
4544 * [Fix] Fix probability calculations for fuzzy redis backend
4545 * [Fix] Fix signing headers creation in DKIM
4546 * [Fix] Plug memory leak
4547 * [Fix] Really fix chained SA dependencies
4548 * [Fix] Really increase lock lifetime
4549 * [Fix] Use checksum to avoid intersection between different ANNs
4550 * [Fix] Use rspamd hashes in embedded ucl
4551 * [Fix] Yet another change for testing external deps
4552
4553 1.4.1:
4554 * [Feature] ASN support in Clickhouse module
4555 * [Feature] Add clickhouse plugin
4556 * [Feature] Add generic tool to add universal maps for lua modules
4557 * [Feature] Add logger.debugm to debug lua modules
4558 * [Feature] Allow to register metrics symbols using register_symbol
4559 * [Feature] Allow to specify prefix for fann_redis
4560 * [Feature] Clickhouse: support different masks for IPv4/IPv6
4561 * [Feature] Support forcing action in antivirus plugin
4562 * [Fix] Add handling of regexp maps
4563 * [Fix] Allow backslashes in http urls
4564 * [Fix] Avoid mapping of empty files
4565 * [Fix] Do not load tld file to speed up rspamadm
4566 * [Fix] Do not resolve numeric IP addresses due to ipv6 insanity
4567 * [Fix] Filter incorrect training data
4568 * [Fix] Fix Fuzzyconvert tool when password or DB is given
4569 * [Fix] Fix build with custom glib/gmime
4570 * [Fix] Fix converting of learn count from sqlite to redis
4571 * [Fix] Fix crashes with invalid received and task:set_from_ip
4572 * [Fix] Fix external dependencies for SA module
4573 * [Fix] Fix fann_redis when number of scores has been changed
4574 * [Fix] Fix hyperscan usage for non compatible platforms
4575 * [Fix] Fix loading of maps from UCL objects
4576 * [Fix] Fix memory leak for task-less redis requests
4577 * [Fix] Fix mid module with new maps syntax
4578 * [Fix] Fix parsing of URLs with username
4579 * [Fix] Fix re cache initialisation
4580 * [Fix] Fix replacements to sanitize '%' character
4581 * [Fix] Fix set and regexp like static maps
4582 * [Fix] Fix some issues in redis settings
4583 * [Fix] Fix static IP maps
4584 * [Fix] Fix total learns counter for redis stats
4585 * [Fix] Fix usage of config during reload
4586 * [Fix] Fix various warnings and issues
4587 * [Fix] Invalidate ANN if training data is incorrect
4588 * [Fix] Miltiple fixes to fann_redis module
4589 * [Fix] More fixes for URLs with backslashes
4590 * [Fix] Properly get options for ip_score module
4591 * [Fix] Relax requirements for Received as gmail cannot RFC
4592 * [Fix] Remove or fix hyperscan incompatible regexps
4593 * [Fix] Settings: correctly read redis config
4594 * [Rework] Rework lua logger interface slightly
4595 * [Rework] Use new maps add function
4596
4597 1.4.0:
4598 * [CritFix] Add guards for inactive redis connections
4599 * [CritFix] Another fix for proxying files using rspamd_proxy
4600 * [CritFix] Cleanup inactive redis connections
4601 * [CritFix] Do not sometimes try to exec posfilters before classification
4602 * [CritFix] Fix application of IPv6 mask
4603 * [CritFix] Fix chunked encoding when reading messages
4604 * [CritFix] Fix file mode for rspamd_proxy
4605 * [CritFix] Fix hyperscan compilation on regexp change
4606 * [CritFix] Fix issue with finding of end of lines pointers
4607 * [CritFix] Fix iteration over headers array (introduced in 1.4)
4608 * [CritFix] Fix processing of learned tokens count for redis backend
4609 * [CritFix] Fix race condition in checking of cached maps
4610 * [CritFix] Fix workers scripts by sharing workers configs
4611 * [CritFix] Introduce raw content to text parts
4612 * [CritFix] Plug memory leak and potential memory corruption
4613 * [Feature] Adaptive ratelimits
4614 * [Feature] Add ASN -> rbldnsd script for asn.rspamd.com
4615 * [Feature] Add DMARC_NA symbol
4616 * [Feature] Add F-Prot support to antivirus module
4617 * [Feature] Add HTTP backend to metadata exporter
4618 * [Feature] Add Lua API module for monitored objects
4619 * [Feature] Add R_DKIM_NA / R_SPF_NA / AUTH_NA symbols
4620 * [Feature] Add R_DKIM_PERMFAIL symbol
4621 * [Feature] Add R_SPF_PERMFAIL symbol
4622 * [Feature] Add Sophos antivirus support
4623 * [Feature] Add ZSTD compression to Lua API
4624 * [Feature] Add `mid` Lua module
4625 * [Feature] Add `one_param` flag for metric symbols
4626 * [Feature] Add a generic lua classifier
4627 * [Feature] Add a very basic interface to access workers data from on_load
4628 * [Feature] Add ability to delete a hash by its data to fuzzy_check plugin
4629 * [Feature] Add ability to enable/disable symbols via dynamic_conf
4630 * [Feature] Add ability to lookup settings by key
4631 * [Feature] Add common way to disable Lua modules
4632 * [Feature] Add compression support to rspamd client
4633 * [Feature] Add condition to do antiviral check
4634 * [Feature] Add configuration for lua classifiers
4635 * [Feature] Add configuration knobs for the errors circular buffer
4636 * [Feature] Add decompression support in rspamd client
4637 * [Feature] Add errors exporter to the controller
4638 * [Feature] Add expected value for monitored DNS resources
4639 * [Feature] Add exporter from error ringbuf to ucl
4640 * [Feature] Add extended version for fann creation function
4641 * [Feature] Add ffi friendly version of process_regexp function
4642 * [Feature] Add frequency and time display to webui
4643 * [Feature] Add fuzzy_delhash command to rspamc client
4644 * [Feature] Add implementation of redis connections pool
4645 * [Feature] Add latency and offline time monitoring
4646 * [Feature] Add learning support for lua classifiers
4647 * [Feature] Add max-size and timeout options to CGP helper
4648 * [Feature] Add method to enable/disable symbols in config
4649 * [Feature] Add methods to get metric's actions and symbols from Lua
4650 * [Feature] Add mmap support to lua_text
4651 * [Feature] Add monitored object for surbl plugin
4652 * [Feature] Add more exceptions to surbl whitelist
4653 * [Feature] Add more meta-tokens to bayes
4654 * [Feature] Add neural net classifier to fann_scores module
4655 * [Feature] Add neural net serialization/deserialization
4656 * [Feature] Add new dynamic conf module
4657 * [Feature] Add periodic events support for lua_config
4658 * [Feature] Add plugin to check MX'es for the sender's domain
4659 * [Feature] Add preliminary monitored module
4660 * [Feature] Add preliminary support of dynamic conf updates in Redis
4661 * [Feature] Add preliminary version of clamav plugin
4662 * [Feature] Add redis cache to asn module
4663 * [Feature] Add replies compression
4664 * [Feature] Add spamhaus DROP dnsbl
4665 * [Feature] Add support for dictionary in client compression
4666 * [Feature] Add support for fuzzy learn and unlearn from lua
4667 * [Feature] Add support for input encryption
4668 * [Feature] Add support of min_learns to neural net classifier
4669 * [Feature] Add termination callbacks for workers
4670 * [Feature] Add user-agent for rspamc
4671 * [Feature] Add utility to perform classifier tests
4672 * [Feature] Add zstd compression library
4673 * [Feature] Allow HTTPS requests in lua_http
4674 * [Feature] Allow conditions for pre and postfilters
4675 * [Feature] Allow custom functions for ratelimits
4676 * [Feature] Allow for excluding messages from AV scanning based on size
4677 * [Feature] Allow for getting worker stats from Lua
4678 * [Feature] Allow getting task UID from Lua
4679 * [Feature] Allow parsing of mailbox messages from the commandline
4680 * [Feature] Allow plugins to publish their lua API via rspamd_plugins
4681 * [Feature] Allow to compare other systems with Rspamd
4682 * [Feature] Allow to execute Lua scripts by controller
4683 * [Feature] Allow to have a function to set custom greylist message
4684 * [Feature] Allow to iterate over multiple tags
4685 * [Feature] Allow to pass extra data from plugins to log helper
4686 * [Feature] Allow to plan new periodics at different time
4687 * [Feature] Allow to reset hashes
4688 * [Feature] Allow to run rspamadm lua just as a lua interpreter
4689 * [Feature] Allow to store settings in redis
4690 * [Feature] Allow to update dynamic conf in Redis
4691 * [Feature] Allow to use dictionaries for compression
4692 * [Feature] Allow to use md5, sha1, sha256, sha384 and sha512 hashes in Lua
4693 * [Feature] Allow whitelisting by IP for greylisting plugin
4694 * [Feature] Antivirus: Support whitelists & pattern-matching sig names
4695 * [Feature] Backport pack/unpack routines from Lua 5.3
4696 * [Feature] Check settings with equal priopities in alphabetical order
4697 * [Feature] Compress neural net in redis
4698 * [Feature] Consider more tags when doing WHITE_ON_WHITE rule
4699 * [Feature] Descriptive options for DMARC failure symbols
4700 * [Feature] Descriptive options for RBL symbols
4701 * [Feature] Enable configuration for monitored objects
4702 * [Feature] Execute on_load scripts with ev_base ready
4703 * [Feature] Fann scores now uses metadata from a message
4704 * [Feature] Implement FANN threaded learning
4705 * [Feature] Implement classifying for lua classifiers
4706 * [Feature] Implement finish scripts for worker processes
4707 * [Feature] Implement monitoring for DNS resources
4708 * [Feature] Implement real priorities for pre and post filters
4709 * [Feature] Insert two symbols: FANN_HAM and FANN_SPAM instead of one
4710 * [Feature] Module to push metadata/messages to redis pubsub
4711 * [Feature] Monitor RBL records
4712 * [Feature] Move fann_classifier to a separate plugin
4713 * [Feature] Normalize all ANN inputs
4714 * [Feature] Preliminary version of metric exporter module
4715 * [Feature] Preserve decompression context between tasks
4716 * [Feature] Ratelimit: Support dynamic bucket size/leak rate
4717 * [Feature] Relax FORGED_RECIPIENTS: allow senders to BCC themselves
4718 * [Feature] Remove symbols weights on composites processing
4719 * [Feature] Return symbol scores when getting resulting symbols
4720 * [Feature] Rework lua tcp module
4721 * [Feature] Rule to detect some obvious X-PHP-Originating-Script forgeries
4722 * [Feature] Rule to identify some X-PHP-Script forgeries
4723 * [Feature] Rules for scoring Google Message-ID fixes
4724 * [Feature] Send hashes values to reply
4725 * [Feature] Set expire for dmarc reports
4726 * [Feature] Stop using cymru zone as it is unstable
4727 * [Feature] Stop using of GLists for headers, improve performance
4728 * [Feature] Store `for` in task:get_received_headers
4729 * [Feature] Store `for` part in received headers
4730 * [Feature] Store enabled flag for webui session
4731 * [Feature] Store error messages in ring buffer
4732 * [Feature] Support compressed maps
4733 * [Feature] Support excluding selected users from ratelimits
4734 * [Feature] Support looking up NS records in lua_dns
4735 * [Feature] Support modern style SURBL configuration
4736 * [Feature] Support multiple hashes in delhash path
4737 * [Feature] Support new messages in rspamc
4738 * [Feature] Support requests without reads in lua_tcp
4739 * [Feature] Support setting task message from Lua
4740 * [Feature] Track visibility of HTML elements
4741 * [Feature] Try to add CRLF when checking DKIM
4742 * [Feature] Try to guess line endings when folding headers
4743 * [Feature] Try to improve normalization function for bayes
4744 * [Feature] Use FFI to optimize SA module
4745 * [Feature] Use length based arguments for redis, allow lua_text as arg
4746 * [Feature] Use more layers for fann and another normalization
4747 * [Feature] User-defined ratelimits
4748 * [Feature] Utility to convert fuzzy storage from sqlite to redis
4749 * [Feature] Yield DMARC_DNSFAIL on lookup failure
4750 * [Fix] Adopt fuzzy storage for flexible backends
4751 * [Fix] Allow plain IP addresses in Rspamd maps
4752 * [Fix] Another fix for brain-damaged hiredis
4753 * [Fix] Another fix for rdns write errors
4754 * [Fix] Another fix for rdns_make_request_full invocation
4755 * [Fix] Another fix in DKIM canonicalization
4756 * [Fix] Another memory leak plugged
4757 * [Fix] Another try to deal with posix idiotizm
4758 * [Fix] Another try to fix RDNS events processing logic
4759 * [Fix] Avoid double frees in HEAD requests
4760 * [Fix] Avoid extra symbols for RBLs
4761 * [Fix] Banish table.maxn from Lua parts
4762 * [Fix] Check for socket error before connection in lua_tcp
4763 * [Fix] Correctly propagate redis timeouts to Lua
4764 * [Fix] Do not add extra newline in MIME mode
4765 * [Fix] Do not be cheated by system hiredis
4766 * [Fix] Do not classify when a message has not enough tokens
4767 * [Fix] Do not crash on redis errors
4768 * [Fix] Do not distinguish NXDOMAIN and NOREC for monitored
4769 * [Fix] Do not replan retransmits if merely one server is defined
4770 * [Fix] Do not use headers to calculate messages digests
4771 * [Fix] Don't force action in replies module for authenticated users/local networks
4772 * [Fix] Explicitly ban default passwords in webui
4773 * [Fix] Finally fix ambiguity between parsed and resolved spf elts
4774 * [Fix] Fix 'decoded' value in task:get_header_full()
4775 * [Fix] Fix DKIM calculations
4776 * [Fix] Fix DKIM signing for messages with no newline at the end
4777 * [Fix] Fix DNS request in monitored
4778 * [Fix] Fix DNS write errors processing
4779 * [Fix] Fix HTTP methods other than GET and POST
4780 * [Fix] Fix PERMFAIL for v6/v4 ambiguities
4781 * [Fix] Fix absurdic scores for HFILTER_URL_ONLY
4782 * [Fix] Fix actions in rolling history
4783 * [Fix] Fix actrie patterns
4784 * [Fix] Fix applying of lua dynamic confg
4785 * [Fix] Fix autolearning errors and redis cache
4786 * [Fix] Fix bayes learn_condition
4787 * [Fix] Fix build with the recent OpenSSL
4788 * [Fix] Fix caching and compressed maps
4789 * [Fix] Fix check plain text part
4790 * [Fix] Fix crash on OpenBSD in `url_email_start`
4791 * [Fix] Fix double free in SPF
4792 * [Fix] Fix extraction of shingles from redis fuzzy storage
4793 * [Fix] Fix false sharing for symbols in the cache
4794 * [Fix] Fix float usage in util:get_time
4795 * [Fix] Fix folding algorithm to deal with empty tokens
4796 * [Fix] Fix format string
4797 * [Fix] Fix format string usage in controller errors handling
4798 * [Fix] Fix handling of '\0' in lua_tcp
4799 * [Fix] Fix handling of HTTP HEAD methods
4800 * [Fix] Fix hash creation
4801 * [Fix] Fix hiredis stupidity
4802 * [Fix] Fix implicit settings module settingsup
4803 * [Fix] Fix interaction with lua GC to avoid craches
4804 * [Fix] Fix ip_score module registration
4805 * [Fix] Fix issue with empty messages and dkim
4806 * [Fix] Fix issues with CGP helper
4807 * [Fix] Fix issues with the recent SPF changes
4808 * [Fix] Fix key name to load ANN correctly
4809 * [Fix] Fix lua tcp module by saving `do_read` in callback data
4810 * [Fix] Fix memory leak in client when using compression
4811 * [Fix] Fix min_learns option
4812 * [Fix] Fix on_finish scripts and async handlers
4813 * [Fix] Fix options for SPF dnsfail symbol
4814 * [Fix] Fix parsing includes and redirects in SPF
4815 * [Fix] Fix parsing of lua comments with empty lines
4816 * [Fix] Fix parsing of unquoted HTML attributes
4817 * [Fix] Fix periodic events and redis
4818 * [Fix] Fix processing of fuzzy learns from Lua
4819 * [Fix] Fix processing of redirect in SPF includes
4820 * [Fix] Fix processing of symbols when reject limit is reached
4821 * [Fix] Fix refcounts when map is specified by IP
4822 * [Fix] Fix rspamd{session} class in Lua API
4823 * [Fix] Fix setting ratelimit key for 'ip' bucket
4824 * [Fix] Fix some cases of TLD urls detector
4825 * [Fix] Fix statconvert tool
4826 * [Fix] Fix stats for backend-less classifiers
4827 * [Fix] Fix training script for fann_redis
4828 * [Fix] Fix variable in ann module
4829 * [Fix] Fix various errors in lua dynamic conf plugin
4830 * [Fix] Forget old ANN when max_usages is reached to avoid overtrain
4831 * [Fix] Further canonicalization fixes
4832 * [Fix] Further fixes for fann_redis prefixes
4833 * [Fix] Handle failures for inactive pooled connections
4834 * [Fix] Improve multimap info message
4835 * [Fix] More fixes in ANN loading
4836 * [Fix] More fixes to fann_redis
4837 * [Fix] More issues in fann_redis
4838 * [Fix] More spaces fix in DKIM signature
4839 * [Fix] Multiple fixes to asn script, add IPv6 support
4840 * [Fix] Multiple issues in fann_redis
4841 * [Fix] No greylist rejected messages
4842 * [Fix] One more attempt to fix lua_redis
4843 * [Fix] One more check for readdir...
4844 * [Fix] Params should be treated as a hash
4845 * [Fix] Plug memory leak in regexp desctructor
4846 * [Fix] Process headers only once
4847 * [Fix] Properly handle nil values in ratelimit plugin
4848 * [Fix] Really fix redis shingles check
4849 * [Fix] Remove fann with incorrect layers count
4850 * [Fix] Remove mentions of deleted include
4851 * [Fix] Remove some incompatible functions
4852 * [Fix] Settings: fix `authenticated` parameter (#886)
4853 * [Fix] Skip MX check for authenticated users and local networks
4854 * [Fix] Slightly fix ANN routines
4855 * [Fix] Stop caching records with DNS failures
4856 * [Fix] Treat all errors in redis_pool as fatal errors for a connection
4857 * [Fix] Try avoid false-positives in HEADER_FORGED_MDN rule
4858 * [Fix] Try to avoid race condition when using rrd
4859 * [Fix] Try to reload redis scripts if they are missing
4860 * [Fix] Unbreak once_received skipping for local networks
4861 * [Fix] Unlock ANN on error
4862 * [Fix] Use memmove for overlapping regions
4863 * [Fix] Use real size instead of displayed for core limits
4864 * [Fix] Use the correct macro to get the size of control
4865 * [Fix] Various fixes for errors ringbuffer
4866 * [Fix] Yield R_SPF_DNSFAIL if lookup of included record fails
4867 * [Fix] mid: fix map initialization
4868 * [Fix] mid: handle incorrect rgexps in the map
4869 * [Rework] Add extract training data function to fann_redis
4870 * [Rework] Add preliminary train tests
4871 * [Rework] Add redis storage feature to fann_redis
4872 * [Rework] Adopt fuzzy storage for abstract backend
4873 * [Rework] Adopt plugins
4874 * [Rework] First reiteration on fann scores
4875 * [Rework] Implement loading/invalidating
4876 * [Rework] Make lua_redis task agnostic
4877 * [Rework] Make rspamd protocol messages useful
4878 * [Rework] Massive removal of legacy code
4879 * [Rework] More cleanup actions
4880 * [Rework] Remove legacy code never used for classifiers
4881 * [Rework] Remove outdated and unused lua_session module
4882 * [Rework] Reorganize fuzzy backend structure
4883 * [Rework] Reorganize the internal backend structure
4884 * [Rework] Restore old fann_scores, move common parts
4885 * [Rework] Rework and simplify rbl plugin
4886 * [Rework] Rework parsing of DMARC records
4887
4888 1.3.4:
4889 * [Feature] ASN module; support matching ASN/country in multimap
4890 * [Feature] Add SPF method in spf return result
4891 * [Feature] Add Yandex and Mail.ru forwarding rules
4892 * [Feature] Add mempool maps in multimap
4893 * [Feature] Add rule for identifying mail sent by eval()'d PHP code
4894 * [Feature] Add support of stub DNSSEC resolver to rdns
4895 * [Feature] Add task:get_digest method
4896 * [Feature] Allow for more fine-grained scoring for ip_score
4897 * [Feature] Allow to get digest of a mime part from lua
4898 * [Feature] Allow to print message digest in logs
4899 * [Feature] Fold DKIM-Signature header
4900 * [Feature] Implement encrypted logs
4901 * [Feature] Log URLs encrypted if we have log encryption pubkey
4902 * [Feature] Pass authenticated bit to lua
4903 * [Feature] Read redis backend statistics configuration from global section
4904 * [Feature] Show the exact value matched for multima symbols
4905 * [Feature] Store task checksum
4906 * [Fix] Avoid setting limits when required elements are missing
4907 * [Fix] DMARC: Fix alignment checking for subdomains
4908 * [Fix] DMARC: deal with missing and spurious spaces
4909 * [Fix] Defer insertion of results in ip_score to avoid skewing stats
4910 * [Fix] Disable DMARC for local/authorized mail
4911 * [Fix] Fix handling of proxied headers in controller
4912 * [Fix] Fix hex printing of strings
4913 * [Fix] Fix issue with spaces in maps
4914 * [Fix] Fix parsing of forwarded IP
4915 * [Fix] Fix reload in some plugins and workers
4916 * [Fix] Fix reloading on SIGHUP
4917 * [Fix] Fix some border cases for DKIM canonicalization
4918 * [Fix] Fix url maps
4919 * [Fix] Make dnssec configurable option disabled by default for now
4920 * [Fix] rspamadm statconvert: force db to be a string
4921 * [Fix] rspamadm statconvert: use db/password for learn cache
4922 * [Rework] Rework flags in rspamd logger
4923
4924 1.3.3:
4925 * [CritFix] Check hyperscan cache sanity before loading
4926 * [CritFix] Fix setting of fuzzy keys (completely breaks fuzzy storage)
4927 * [Feature] Add SARBL (sarbl.org) uribl
4928 * [Feature] Add `--search-pattern` option to rspamd_stats
4929 * [Feature] Add some sanity check for very long from/to log elements
4930 * [Feature] Allow to create hashes from string in a single step
4931 * [Feature] Fix order of pre and postfilters
4932 * [Feature] Improve lua URLs API
4933 * [Feature] Improve message about fuzzy rules
4934 * [Feature] Pre-calculate blake2 digest for all parts
4935 * [Feature] Print radix duplicate keys as IP addresses
4936 * [Feature] Simple mechanism for disabling RBLs in local.d/rbl.conf
4937 * [Feature] Use faster hash function for fuzzy storage
4938 * [Feature] rspamd_stats: support log directory reading
4939 * [Fix] Add sanity check for url filters
4940 * [Fix] Do not show rmilter section as a fake metric in rspamc
4941 * [Fix] Fix URL filters
4942 * [Fix] Fix a stupid mistake in util.strequal_caseless
4943 * [Fix] Fix blake2b hash of the string "rspamd"
4944 * [Fix] Fix filename maps filter
4945 * [Fix] Fix finding tld in util.get_tld
4946 * [Fix] Fix multimap content filters
4947 * [Fix] Fix returning boolean from Lua
4948 * [Fix] Fix returning of REDIS_NIL
4949 * [Fix] Try to deal with multiple workers terminated
4950 * [Fix] Use forced DNS request when calling for lua_http
4951 * [Rework] Rework multimap filters, add redis maps
4952
4953 1.3.2:
4954 * [Feature] Add a special symbol for SPF DNS errors: R_SPF_DNSFAIL
4955 * [Feature] Add correlations report in fuzzy stats
4956 * [Feature] Add experimental CGP integration
4957 * [Feature] Add method to get urls length in a text part
4958 * [Feature] Add new methods to lua_html to access HTML tags
4959 * [Feature] Allow all types of symbols to be added via __newindex method
4960 * [Feature] Allow to create settings for authenticated users
4961 * [Feature] Allow to get block content for HTML tags
4962 * [Feature] Improve DNS failures when dealing with SPF
4963 * [Feature] Properly implement R_WHITE_ON_WHITE rule
4964 * [Feature] Remove old ugly rules
4965 * [Feature] Rspamc can now add dkim signature in mime mode
4966 * [Feature] Store content length for HTML tags
4967 * [Feature] Support reacher set of HTML colors
4968 * [Feature] Try to avoid FP for low contrast fonts detection
4969 * [Fix] Add missing HTML colors
4970 * [Fix] Add spaces to dkim signature to allow folding
4971 * [Fix] Avoid returning NaN as score on scan
4972 * [Fix] Decode entitles in href parts
4973 * [Fix] Do not cache SPF records with DNS errors
4974 * [Fix] Do not crash on cyclic depends
4975 * [Fix] Do not insert HELO/HOSTNAME unknown when they are not passed
4976 * [Fix] Do not set absent hostname to "unknown"
4977 * [Fix] Do not stress redis with KEYS command (#791)
4978 * [Fix] Fix DMARC_BAD_POLICY symbol
4979 * [Fix] Fix HFILTER_URL module
4980 * [Fix] Fix HFILTER_URL_ONELINE rule
4981 * [Fix] Fix buffering in CGP integration
4982 * [Fix] Fix colors propagation from parent nodes
4983 * [Fix] Fix confusing OpenSSL API usage of i2d_RSAPublicKey
4984 * [Fix] Fix dependencies id sanity check
4985 * [Fix] Fix folding for semicolon separated tokens
4986 * [Fix] Fix largest possible TLD behaviour
4987 * [Fix] Fix last token folding
4988 * [Fix] Fix length calculations in white on white rule
4989 * [Fix] Fix multiple request headers structure
4990 * [Fix] Fix multiple values headers freeing
4991 * [Fix] Fix parsing of background color
4992 * [Fix] Fix printing from field in log_urls
4993 * [Fix] Fix processing of last element of DMARC policies
4994 * [Fix] Further fixes for HTML colors
4995 * [Fix] Further fixes for multiple values headers
4996 * [Fix] Further fixes for white on white rule
4997 * [Fix] Further fixes in HTML tags parsing
4998 * [Fix] Ignore content type/subtype case
4999 * [Fix] Increase score of R_WHITE_ON_WHITE
5000 * [Fix] Parse CGP envelope data
5001 * [Fix] Propagate colors in HTML
5002 * [Fix] Restore multiple values headers in protocol
5003 * [Fix] Restore multiple values in headers processing
5004 * [Fix] Some more changes to tag's content length calculations
5005 * [Fix] Some more fixes for low contrast fonts detector
5006 * [Fix] SpamAssassin plugin: support check_freemail_header('EnvelopeFrom', [..])
5007 * [Fix] Trigger HTML_SHORT_LINK_IMG on any external image
5008 * [Fix] rspamd_stats: remove deprecated defined(@array)
5009
5010 1.3.1:
5011 * [CritFix] Fix catena passwords validation
5012 * [CritFix] Fix crash when the first received is faked
5013 * [Feature] Add DMARC_BAD_POLICY symbol when DMARC policy was invalid
5014 * [Feature] Allow for matching hostnames in multimap (#773)
5015 * [Feature] Allow for setting action based on DMARC disposition
5016 * [Feature] Allow limiting of the inbound message size
5017 * [Feature] Allow maps with multiple symbols and scores
5018 * [Feature] Allow regexps in the emails maps
5019 * [Feature] Allow to register metric symbols from multimap
5020 * [Feature] Allow to reset redis tokens instead of appendig values
5021 * [Feature] Allow to store strings in radix maps
5022 * [Feature] Check UTF validity when there are utf regexps in a map
5023 * [Feature] Correctly work when there is no hard reject action
5024 * [Feature] Implement dependencies for maps
5025 * [Fix] Another effort to unbreak sqlite locking
5026 * [Fix] Avoid crash when closing mmapped file
5027 * [Fix] Do not break history on NaN in required score
5028 * [Fix] Ensure that hyperscan cache written is written properly
5029 * [Fix] Filter NaN from scores in history
5030 * [Fix] Fix DNSBL maps
5031 * [Fix] Fix another locking issue in sqlite
5032 * [Fix] Fix another locking issue with mapped files
5033 * [Fix] Fix deadlock in mmaped file stats
5034 * [Fix] Fix dependencies in multimap plugin
5035 * [Fix] Fix emails module configuration
5036 * [Fix] Fix greylist plugin (#755)
5037 * [Fix] Fix greylisting plugin variable usage
5038 * [Fix] Fix installed permissions for rspamd_stats
5039 * [Fix] Fix locking in mmapped statistics
5040 * [Fix] Fix paths in tests
5041 * [Fix] Fix prefilter mode for multimap
5042 * [Fix] Forgot to commit leftover changes
5043 * [Fix] Really fix local.d includes
5044 * [Fix] Restore selective greylisting behaviour
5045 * [Fix] Set max size on per connection basis
5046 * [Fix] Use temporary storage for hyperscan cache
5047 * [Rework] Remove systemd socket activation
5048
5049 1.3.0:
5050 * [CritFix] Fix SA rawbody processing - exclude top part
5051 * [CritFix] Fix decoding of UTF HTML entitles
5052 * [CritFix] Fix encrypted fuzzy requests
5053 * [CritFix] Fix leak of shared memory fds and files
5054 * [CritFix] Fix levenshtein distance calculations
5055 * [CritFix] Fix mime headers processing
5056 * [CritFix] Fix parsing of URLs in texts
5057 * [CritFix] Fix parsing of missing classes
5058 * [CritFix] Fix redis structure by adding {NULL, NULL} member
5059 * [CritFix] Fix some more URL detector issues
5060 * [CritFix] Fix systemd sockets activation
5061 * [CritFix] Fix unencrypted passwords processing in the controller
5062 * [CritFix] Fix writing CDPs to the database
5063 * [CritFix] Fix writing of encrypted HTTP requests
5064 * [CritFix] Plug memory leak in dkim module
5065 * [CritFix] Plug memory leak in headers getting code
5066 * [CritFix] Pre-filters and post-filters were completely broken
5067 * [CritFix] Properly support SA body regexps
5068 * [CritFix] Really skip filters in case of pre-result set
5069 * [CritFix] Restore the intended pre-filters behaviour
5070 * [Rework] Adopt new maps code
5071 * [Rework] Compile ragel sources when building rspamd
5072 * [Rework] Finish rework for the rest of places that use HTTP
5073 * [Rework] Fix DKIM headers canonicalization
5074 * [Rework] Fix lua maps API
5075 * [Rework] Import linenoise for line editing
5076 * [Rework] Include config structure to all rcl handlers
5077 * [Rework] Make chartable module useful
5078 * [Rework] Move http internal structures to a private header
5079 * [Rework] Partly fix controller
5080 * [Rework] Remove dedicated images list
5081 * [Rework] Rename http proxy to rspamd proxy
5082 * [Rework] Rename mime parts structures
5083 * [Rework] Rework HTTP code
5084 * [Rework] Rework exceptions and newlines processing
5085 * [Rework] Rework pre and postfilters system
5086 * [Rework] Separate method to close backend connections
5087 * [Rework] Start the complete maps rework
5088 * [Rework] Use dynamically generated ragel C sources
5089 * [Feature] Add 'blacklist' and 'strict' modes for whitelists
5090 * [Feature] Add 'symbols_enabled' and 'groups_enabled' to settings
5091 * [Feature] Add ESMTPSA received type
5092 * [Feature] Add a simple script to evaluate rspamd rules in the logs
5093 * [Feature] Add a simple tool to generate DKIM keys
5094 * [Feature] Add a trivial heuristic for codepages
5095 * [Feature] Add and use mumhash for non-crypto hashing
5096 * [Feature] Add better method to check lua userdata types
5097 * [Feature] Add better zip files search algorithm
5098 * [Feature] Add catena PBKDF function
5099 * [Feature] Add configuration knobs for in and out parser scripts
5100 * [Feature] Add content filtering support to multimap
5101 * [Feature] Add different timeouts for proxy connections
5102 * [Feature] Add dot commands for lua REPL:
5103 * [Feature] Add execution of lua global functions script
5104 * [Feature] Add function for pretty printing of inet addresses
5105 * [Feature] Add function to convert fstring_t to c string
5106 * [Feature] Add function to create temporary shared memory mapping
5107 * [Feature] Add function to generate random hex string
5108 * [Feature] Add generic fucnction to parse IP maps
5109 * [Feature] Add initial version of HTTP lua repl
5110 * [Feature] Add learn condition to the default configuration
5111 * [Feature] Add learn conditions for classifiers
5112 * [Feature] Add limit for dkim signatures to be checked
5113 * [Feature] Add locking routines for lua_util
5114 * [Feature] Add lua API for getting info from archives
5115 * [Feature] Add lua utility to decode URL encoding
5116 * [Feature] Add method to copy message from http connection
5117 * [Feature] Add mirrors feature
5118 * [Feature] Add more algorithms for shingles generation
5119 * [Feature] Add more domains to redirectors list
5120 * [Feature] Add more encodingsto cryptobox hash API
5121 * [Feature] Add more file utilities to lua_util
5122 * [Feature] Add more functions to extract data from text parts
5123 * [Feature] Add more methods to get headers from a task
5124 * [Feature] Add more methods to init http message body
5125 * [Feature] Add more options for redis config parsing function
5126 * [Feature] Add new representation of email address
5127 * [Feature] Add new symbols to filter bad extensions in messages
5128 * [Feature] Add new utility methods to mimepart object
5129 * [Feature] Add openphish support to rspamd phishing module
5130 * [Feature] Add parsers for SMTP address in ragel
5131 * [Feature] Add parsing of mirror hosts for fuzzy storage
5132 * [Feature] Add parsing scripts for master connection as well
5133 * [Feature] Add preliminary greylist plugin
5134 * [Feature] Add preliminary phishtank support
5135 * [Feature] Add preliminary rarv5 support
5136 * [Feature] Add preliminary version of ssl toolbox
5137 * [Feature] Add protection against open files limit and accepting sockets
5138 * [Feature] Add rar v4 support
5139 * [Feature] Add reading scripts for master connection
5140 * [Feature] Add replies plugin
5141 * [Feature] Add results parsing code
5142 * [Feature] Add routines to compare and check pubkeys
5143 * [Feature] Add simpler versions of refcounts
5144 * [Feature] Add some time manipulation functions for lua APi
5145 * [Feature] Add support for non-standard BATV signatures
5146 * [Feature] Add support of address with at-domain list
5147 * [Feature] Add support to search archives by magic
5148 * [Feature] Add task:get_rawbody method
5149 * [Feature] Add test to check shared memory support sanity
5150 * [Feature] Add the initial version of LUA repl to rspamadm
5151 * [Feature] Add throughput graph for RRD backend to WebUI
5152 * [Feature] Add universal function to make a proper redis request
5153 * [Feature] Add universal function to parse redis servers for plugins
5154 * [Feature] Add util.unlink function
5155 * [Feature] Add utility function to return random number from 0 to 1
5156 * [Feature] Add utility method to convert ftok to C string
5157 * [Feature] Add utility to map shared memory segments
5158 * [Feature] Add versions to fuzzy storage
5159 * [Feature] Add workaround for legacy clients in rspamd proxy
5160 * [Feature] Add workaround for systems without sane shmem support
5161 * [Feature] Add xoroshiro+ fast rng for non-crypto purposes
5162 * [Feature] Adopt plugins for new maps API
5163 * [Feature] Allow SPF to be checked for empty tasks
5164 * [Feature] Allow binary patterns in lua_trie
5165 * [Feature] Allow catena encrypted passwords in controller
5166 * [Feature] Allow client ip match in the settings
5167 * [Feature] Allow easy adding and overriding of fuzzy rules
5168 * [Feature] Allow empty tasks to be processed
5169 * [Feature] Allow hostnames in IP maps
5170 * [Feature] Allow https maps
5171 * [Feature] Allow multiple PBKDF types in `rspamadm pw`
5172 * [Feature] Allow named fuzzy rules
5173 * [Feature] Allow non zero terminated patterns in multipattern
5174 * [Feature] Allow partial hash updates
5175 * [Feature] Allow pipelining for redis.make_request
5176 * [Feature] Allow sending empty requests using client
5177 * [Feature] Allow setting fuzzy flag by symbol not by value
5178 * [Feature] Allow setting scores and actions from lua
5179 * [Feature] Allow shared memory simple http client
5180 * [Feature] Allow static lua files in any parts of rspamd sources
5181 * [Feature] Allow to change flag from fuzzy learn condition
5182 * [Feature] Allow to check rspamd_text using maps
5183 * [Feature] Allow to disable composite rules from settings
5184 * [Feature] Allow to disable some modules from common redis setup
5185 * [Feature] Allow to extract ucl_object from lua using common API
5186 * [Feature] Allow to get settings and settings id hash from lua_task
5187 * [Feature] Allow to have specific settings for mirrored traffic
5188 * [Feature] Allow to open message from a shared memory segment
5189 * [Feature] Allow to parse pubkeys from the rcl config
5190 * [Feature] Allow to pass extradata from rspamd to rmilter
5191 * [Feature] Allow to query storage about number of fuzzy hashes stored
5192 * [Feature] Allow to read logs without symbols scores
5193 * [Feature] Allow to read password from console for rspamc
5194 * [Feature] Allow to set ciphers and CA paths in config
5195 * [Feature] Allow to skip some initialization phases to speed up rspamadm
5196 * [Feature] Allow underscore separated names in settings
5197 * [Feature] Allow versioning for sqlite databases
5198 * [Feature] Always allow to terminate rspamd
5199 * [Feature] Better deal with backend errors
5200 * [Feature] Better lua_redis logging
5201 * [Feature] Configure CA path and ciphers
5202 * [Feature] Create a dedicated parser to strip newlines
5203 * [Feature] Deduplicate the same urls in multimap module
5204 * [Feature] Distinguish luajit from lua
5205 * [Feature] Do not print garbadge in --compact output
5206 * [Feature] Dynamically detect if a CPU is incompatible with hyperscan
5207 * [Feature] Enable forced resolving for some lua plugins
5208 * [Feature] Enable rrd by default
5209 * [Feature] Enable workaround for exim
5210 * [Feature] Fix task functions to work without rspamd_config
5211 * [Feature] Further improvements to chartable module
5212 * [Feature] Further micro-optimizations for hashing and shingles
5213 * [Feature] Further relax parser
5214 * [Feature] Humanize numbers in stats widgets
5215 * [Feature] Implement HTTPS client
5216 * [Feature] Implement SSL support in http client
5217 * [Feature] Implement body rules for the trie plugin
5218 * [Feature] Implement braced regexp quantifiers
5219 * [Feature] Implement compare scripts for mirrors results
5220 * [Feature] Implement compare scripts setup
5221 * [Feature] Implement composites policies
5222 * [Feature] Implement conditional learning for classifiers
5223 * [Feature] Implement constructing of map from UCL
5224 * [Feature] Implement dkim signing in dkim check plugin
5225 * [Feature] Implement fuzzy storage updates
5226 * [Feature] Implement fuzzy updates push protocol
5227 * [Feature] Implement https maps
5228 * [Feature] Implement inter-process maps caching
5229 * [Feature] Implement mapping of remote flags to local flags
5230 * [Feature] Implement mirroring in rspamd proxy
5231 * [Feature] Implement multi-flags fuzzy replies
5232 * [Feature] Implement multiple-sources fuzzy storage
5233 * [Feature] Implement order of pre/post filters
5234 * [Feature] Implement partial deleting for multi-flags
5235 * [Feature] Implement pipelining for redis async interface
5236 * [Feature] Implement ragel parser for received headers
5237 * [Feature] Implement reading of messages to shared memory
5238 * [Feature] Implement refcount for messages
5239 * [Feature] Implement retransmits for master connection
5240 * [Feature] Implement zero-copy mode for HTTP reading
5241 * [Feature] Improve SPF domain detection logic
5242 * [Feature] Improve config:register_symbol function
5243 * [Feature] Improve error report for type mismatch in lua
5244 * [Feature] Improve fstrings API
5245 * [Feature] Improve getting SMTP data from lua_task
5246 * [Feature] Improve levenshtein distance function
5247 * [Feature] Improve logging in proxy and add refcounts
5248 * [Feature] Improve logging lua types
5249 * [Feature] Improve master/slave logging
5250 * [Feature] Improve phishing plugin
5251 * [Feature] Improve phishtank and openphish support
5252 * [Feature] Improve ragel build target
5253 * [Feature] Improve statistics script
5254 * [Feature] Initialize ssl library to use SSL connections
5255 * [Feature] Interpolate points sent to webui
5256 * [Feature] Limit logging of elements that could have too many items
5257 * [Feature] Lock ANN file when loading
5258 * [Feature] New abstract hashing API in cryptobox
5259 * [Feature] Normalize quoted addresses
5260 * [Feature] Now cryptobox lua API accepts rspamd text as input
5261 * [Feature] Optimize alignment to speed up hashing
5262 * [Feature] Parse received date and ESMTPA proto
5263 * [Feature] Parse received timestamp
5264 * [Feature] Pass settings id to log helper
5265 * [Feature] Pass settings id to lua script from log helper
5266 * [Feature] Perform files expansion on proxying
5267 * [Feature] Preliminary implementation of fuzzy master/slave updates
5268 * [Feature] Print userdata using tostring if possible
5269 * [Feature] Propagate HTTP result string when using proxy
5270 * [Feature] Properly implement unweighted round-robin algorithm
5271 * [Feature] Reduce number of timers queries
5272 * [Feature] Rework and improve fuzzy storage
5273 * [Feature] Rework dns resolving API for lua, add 'forced' option
5274 * [Feature] Rework fann module to understand settings
5275 * [Feature] Rework listening system to allow multiple socket types per worker
5276 * [Feature] Rework ratelimit module to set expiration
5277 * [Feature] Save bayes probability in memory pool var
5278 * [Feature] Save settings id hash for convenience
5279 * [Feature] Search for SSL_set_tlsext_host_name support
5280 * [Feature] Send DKIM signature to protocol reply
5281 * [Feature] Show DKIM signature in rspamc client
5282 * [Feature] Show symbols description in scan output
5283 * [Feature] Sign message merely after DKIM check
5284 * [Feature] Simplify machines by assuming that headers are unfolded
5285 * [Feature] Sort symbols when displaying them in log
5286 * [Feature] Split main connection from mirrored connections
5287 * [Feature] Start moving to the new email address structure
5288 * [Feature] Store HTTP headers in a hash table
5289 * [Feature] Store more information about compressed files
5290 * [Feature] Store raw headers value to use them in DKIM
5291 * [Feature] Store text parts content with newlines stripped
5292 * [Feature] Support DKIM signing
5293 * [Feature] Support EXIF jpeg images
5294 * [Feature] Support archive files list extraction
5295 * [Feature] Support archives when matching patterns in multimap
5296 * [Feature] Support premium/academic feed for openphish
5297 * [Feature] Support rspamd_updates via https
5298 * [Feature] Supprort FQDNs in phishing module maps
5299 * [Feature] Try to read on fuzzy timeout to avoid fake timeouts
5300 * [Feature] Try to select the optimal possible function for input
5301 * [Feature] Unescape and unquote smtp addresses
5302 * [Feature] Update fuzzy timestamp when adding value
5303 * [Feature] Update mumhash
5304 * [Feature] Use -flto if possible when optimizations are enabled
5305 * [Feature] Use extended map types in lua map, unify code
5306 * [Feature] Use file lock in logger to avoid deadlocks
5307 * [Feature] Use generic global string split function
5308 * [Feature] Use metrohash as well
5309 * [Feature] Use mumhash by default for incremental hashing
5310 * [Feature] Use mumhash for words hashing
5311 * [Feature] Use new ip parsing API
5312 * [Feature] Use new maps API for local addrs
5313 * [Feature] Use new ragel parser in message parsing code
5314 * [Feature] Use new received parser instead of old one
5315 * [Feature] Use new redis API in DMARC plugin
5316 * [Feature] Use new redis API in greylist plugin
5317 * [Feature] Use new redis API in ip_score plugin
5318 * [Feature] Use new redis API in ratelimit plugin
5319 * [Feature] Use new redis API in replies plugin
5320 * [Feature] Use new version of register_symbol in rspamd plugins
5321 * [Feature] Use offset when passing shm to deal with encrypted requests
5322 * [Feature] Use one pass to remove newlines and store their positions
5323 * [Feature] Use rspamd specific type checks for userdata
5324 * [Feature] Use shared memory storage for http maps
5325 * [Feature] Use universal redis definitions in rspamd plugins
5326 * [Feature] Various improvements in greylist module
5327 * [Feature] Wait for sqlite if locked when switching to WAL mode
5328 * [Fix] Add filenames sanity filtering for mime types
5329 * [Fix] Add guards for empty parts
5330 * [Fix] Add missing types
5331 * [Fix] Add more priority for config file symbols registered from UCL
5332 * [Fix] Add sanity checks when compiling regexp maps
5333 * [Fix] Add spaces instead of newlines to the normalized content
5334 * [Fix] Add workaround for ancient openssl
5335 * [Fix] Add workaround for gmime CTE stupidity
5336 * [Fix] Add workaround for hex digits
5337 * [Fix] Adjust MISSING_MIMEOLE score
5338 * [Fix] Adjust body/body_buf when stealing encrypted message
5339 * [Fix] Adopt lua task API for the new email addresses structure
5340 * [Fix] Allow for disabling DMARC reporting when Redis is configured
5341 * [Fix] Always register openphish and phishtank virtual symbols
5342 * [Fix] Always use shmem on linux
5343 * [Fix] Another change of newlines policy
5344 * [Fix] Another d3evolution update
5345 * [Fix] Another fix for exim workaround
5346 * [Fix] Another fix for legacy clients
5347 * [Fix] Another fix for maps scheduling
5348 * [Fix] Another fix for marking upstreams inactive
5349 * [Fix] Another fix for postfilters
5350 * [Fix] Another fix for redis timeouts
5351 * [Fix] Avoid `table.getn` method as it has been removed in lua 5.3
5352 * [Fix] Avoid double hashing for images
5353 * [Fix] Avoid linking with actrie if hyperscan is enabled
5354 * [Fix] Check copy result when sending message to mirrors
5355 * [Fix] Cleanup message when assiging body
5356 * [Fix] Cleanup stack from global vars
5357 * [Fix] Correctly parse query type
5358 * [Fix] Disable all symbols if enable_groups is found in settings
5359 * [Fix] Disable fts as it is completely broken in bloody linux
5360 * [Fix] Disable multiple autolearn checks
5361 * [Fix] Disallow updates by default
5362 * [Fix] Do not abort when cannot load a map
5363 * [Fix] Do not check recursion for non-DNS SPF record types
5364 * [Fix] Do not delete uninitialized events
5365 * [Fix] Do not die if shmem_mkstemp fails
5366 * [Fix] Do not die when no metrics defined
5367 * [Fix] Do not even try pcre in case of regexp maps
5368 * [Fix] Do not greylist messages if redis has failed somehow
5369 * [Fix] Do not greylist on rejection
5370 * [Fix] Do not leave temporary maps cached
5371 * [Fix] Do not output meaningless errors
5372 * [Fix] Do not send NaN in json
5373 * [Fix] Don't mix hyperscan and pcre processing within a same task
5374 * [Fix] Finally rework and simplify redis backend for statistics
5375 * [Fix] Fix Exim shutdown patch
5376 * [Fix] Fix JIT compilation for PCRE2 expressions
5377 * [Fix] Fix JIT usage for PCRE2
5378 * [Fix] Fix REPL output
5379 * [Fix] Fix SMTP address parsing machine
5380 * [Fix] Fix UTF8 mode in PCRE2
5381 * [Fix] Fix a stupid misprint in word 'phishing'
5382 * [Fix] Fix accepting the first update when local idx is -1
5383 * [Fix] Fix adding maps from ucl
5384 * [Fix] Fix adding upstream to an active queue
5385 * [Fix] Fix and rescore R_PARTS_DIFFER logic
5386 * [Fix] Fix body rules in SA plugin
5387 * [Fix] Fix body start position
5388 * [Fix] Fix border case in urls detector
5389 * [Fix] Fix border cases for incremental hashing
5390 * [Fix] Fix caseless uthash application
5391 * [Fix] Fix chartable issue with starting digits
5392 * [Fix] Fix client_ip in users settings
5393 * [Fix] Fix compilation issue
5394 * [Fix] Fix conditional learning
5395 * [Fix] Fix crash on empty maps
5396 * [Fix] Fix creating of URLs from LUA
5397 * [Fix] Fix creating of temporary shmem segment
5398 * [Fix] Fix creation of mmapped statfiles
5399 * [Fix] Fix descriptors leak on shmem detaching
5400 * [Fix] Fix detaching of shared memory segments
5401 * [Fix] Fix detection of URLs in text parts
5402 * [Fix] Fix directories processing for rspamc
5403 * [Fix] Fix displaying of rewrite subject in WebUI
5404 * [Fix] Fix dkim private keys operations
5405 * [Fix] Fix dkim signing
5406 * [Fix] Fix dynamic scoring of subject symbols
5407 * [Fix] Fix email address build
5408 * [Fix] Fix encrypted proxy requests
5409 * [Fix] Fix errors counting in upstreams
5410 * [Fix] Fix errors handling in the proxy
5411 * [Fix] Fix event bases for IO events
5412 * [Fix] Fix events handling when scheduling map wacth
5413 * [Fix] Fix fann rewrite
5414 * [Fix] Fix files fallback for shmem transfer
5415 * [Fix] Fix fuzzy adding in webui
5416 * [Fix] Fix fuzzy storage encrypted mirroring
5417 * [Fix] Fix fuzzy storage sync replies
5418 * [Fix] Fix handling of the same words
5419 * [Fix] Fix inserting values to the sources list
5420 * [Fix] Fix ipv6 mask application
5421 * [Fix] Fix issue with missing recipients
5422 * [Fix] Fix issues with multiple returns from lua
5423 * [Fix] Fix learning for non-existent backend
5424 * [Fix] Fix legacy clients support in proxy
5425 * [Fix] Fix length calculations for shared memory segments
5426 * [Fix] Fix listening on UDP sockets
5427 * [Fix] Fix loading of file maps
5428 * [Fix] Fix long regexp flags (e.g. {sa_body})
5429 * [Fix] Fix lua compare function init
5430 * [Fix] Fix maps descriptions
5431 * [Fix] Fix maps locking
5432 * [Fix] Fix max_train setup in ANN module
5433 * [Fix] Fix memory corruption
5434 * [Fix] Fix memory leak in unsigned maps reading
5435 * [Fix] Fix misprints for lto usage
5436 * [Fix] Fix more issues with scripts processing
5437 * [Fix] Fix next-to-last extension length check
5438 * [Fix] Fix openssl initialization
5439 * [Fix] Fix order of arguments
5440 * [Fix] Fix order of initialization
5441 * [Fix] Fix parser
5442 * [Fix] Fix parsing of binary tries
5443 * [Fix] Fix parsing of braced IPv6 addresses
5444 * [Fix] Fix parsing of nested braces in SMTP comments
5445 * [Fix] Fix parsing of rarv5 archives
5446 * [Fix] Fix periodic scheduling when a map is not modified
5447 * [Fix] Fix possible FP in TRACKER_ID rule
5448 * [Fix] Fix post-filters processing
5449 * [Fix] Fix potential NULL dereference
5450 * [Fix] Fix processing of <br> and <hr> tags
5451 * [Fix] Fix processing of addresses in protocol
5452 * [Fix] Fix processing of messages without received headers
5453 * [Fix] Fix proxying issue for unconnected sessions
5454 * [Fix] Fix proxying of the encrypted messages
5455 * [Fix] Fix race condition with shared memory by refcounts
5456 * [Fix] Fix ratelimit initialization
5457 * [Fix] Fix redis set request in replies plugin
5458 * [Fix] Fix redis timeout events handling
5459 * [Fix] Fix redis timeouts processing logic
5460 * [Fix] Fix refcounts in lua_redis
5461 * [Fix] Fix results checking if no master connection is active
5462 * [Fix] Fix return value for couple of lua functions
5463 * [Fix] Fix round-robin selection when upstreams have no weight
5464 * [Fix] Fix rows calculation in graph
5465 * [Fix] Fix rspamd_redis_make_request syntax in replies plugin
5466 * [Fix] Fix scheduling of locked map events
5467 * [Fix] Fix scores detection
5468 * [Fix] Fix searching for newline positions
5469 * [Fix] Fix secure_ip setting in controller
5470 * [Fix] Fix sending data to graph command
5471 * [Fix] Fix setting of score for parts differ
5472 * [Fix] Fix setting of the lua top
5473 * [Fix] Fix setting path for lua
5474 * [Fix] Fix setting path for phishtank
5475 * [Fix] Fix settings application
5476 * [Fix] Fix shm_open call as described in POSIX
5477 * [Fix] Fix size of length in fuzzy mirror wire protocol
5478 * [Fix] Fix smtp grammar issues
5479 * [Fix] Fix some issues with redis API
5480 * [Fix] Fix some issues with retries in the proxy
5481 * [Fix] Fix stack growing
5482 * [Fix] Fix start of body detection in DKIM
5483 * [Fix] Fix state on timeout
5484 * [Fix] Fix stats script
5485 * [Fix] Fix substring search when there are '\0' in strings
5486 * [Fix] Fix symbol name for spf soft fail
5487 * [Fix] Fix symbol type's check
5488 * [Fix] Fix symbols registration and execution
5489 * [Fix] Fix the case of multiple values keys
5490 * [Fix] Fix the default symbol names according to metric
5491 * [Fix] Fix timeout setup on learning
5492 * [Fix] Fix timeouts in redis cache processing
5493 * [Fix] Fix timeouts processing in lua_redis
5494 * [Fix] Fix upstreams interaction for rspamd proxy
5495 * [Fix] Fix usage of rdns reply structure
5496 * [Fix] Fix varargs loop
5497 * [Fix] Fix whitelists and blacklists in SA rules
5498 * [Fix] Fix write servers setup for redis
5499 * [Fix] Fix writing of HTTP messages
5500 * [Fix] Force rspamd to upgrade fuzzy db on opening
5501 * [Fix] Free the correct pointer
5502 * [Fix] Further fixes for lto and static linking
5503 * [Fix] Further fixes for surbl extensions map
5504 * [Fix] Further fixes in maps code
5505 * [Fix] Further improvements to error messages in fuzzy check
5506 * [Fix] Further tweaks to redis garbadge collection
5507 * [Fix] Groups are now case insensitive
5508 * [Fix] Handle log pipe read errors
5509 * [Fix] Handle nested dependencies in SpamAssassin plugin
5510 * [Fix] Implement new automata to skip empty lines for dkim signing
5511 * [Fix] Improve error messages on fuzzy add
5512 * [Fix] Improve lua redis handling
5513 * [Fix] Improve phishing module logging
5514 * [Fix] Improve printing of fuzzy errors
5515 * [Fix] Improve rrd diagnostic errors
5516 * [Fix] Improve strcase hash used in uthash
5517 * [Fix] Include fuzzy key to distinguish storages with different keys
5518 * [Fix] Include slave cluster name into http request
5519 * [Fix] Include some more information about archives
5520 * [Fix] Indicate upstream error on timeout
5521 * [Fix] Initialize hash tables array to avoid crashes
5522 * [Fix] Initialize parser scripts properly
5523 * [Fix] Initialize vars to avoid warnings
5524 * [Fix] Inverse logic for saving ANN
5525 * [Fix] Link lpeg to rspamd lua library
5526 * [Fix] Make extension checks case-insensitive
5527 * [Fix] Mark expired hashes as not found and not as zero flag
5528 * [Fix] Match archive name as well
5529 * [Fix] More and more fixes to redis states
5530 * [Fix] More fixes about shared memory in proxy
5531 * [Fix] More fixes for redis refcounts
5532 * [Fix] More fixes to end of headers detection
5533 * [Fix] More fixes to events logic
5534 * [Fix] More fixes to multi-flag fuzzy storage
5535 * [Fix] More fixes to parts distance calculations
5536 * [Fix] More guards for redis free
5537 * [Fix] One more fix in redis destructor
5538 * [Fix] One more try to fix redis
5539 * [Fix] PIE is required for static build
5540 * [Fix] Partial fix for mmap'd statistics tests
5541 * [Fix] Plug memory leak in proxy
5542 * [Fix] Properly detect end of headers position
5543 * [Fix] Properly init and free session structures
5544 * [Fix] Reduce PRECEDENCE_BULK rule weight
5545 * [Fix] Reduce the default thresholds for learning
5546 * [Fix] Remove Type=forking from systemd unit file (#709)
5547 * [Fix] Remove bad FANN file to save computational resources
5548 * [Fix] Remove event before closing of fd to avoid race conditions
5549 * [Fix] Remove parsing of 'from' variable in redis backend
5550 * [Fix] Remove some bad domains from whitelists
5551 * [Fix] Repair optional dependencies
5552 * [Fix] Reset master connection when retransmitting scan request
5553 * [Fix] Restore ONCE_RECEIVED symbol
5554 * [Fix] Restore compatibility with old lua API behaviour
5555 * [Fix] Restore redis runtime state
5556 * [Fix] Reverse options when received
5557 * [Fix] Send updates to mirrors only if we have some changes
5558 * [Fix] Set host attribute properly when making HTTP request from lua
5559 * [Fix] Set terminated state before calling of async free
5560 * [Fix] Simplify MISSING_MIMEOLE rule
5561 * [Fix] Simplify state machine by ignoring multiple spaces
5562 * [Fix] Skip setting RPATH for static builds
5563 * [Fix] Slightly reduce weights of rules with high FP rate
5564 * [Fix] Some fixes to libmagic initialization
5565 * [Fix] Some more fixes to ratelimit plugin
5566 * [Fix] Strip '\r\n' properly
5567 * [Fix] Switch hashes to mumhash
5568 * [Fix] Treat NaN values properly in graph command
5569 * [Fix] Try to avoid FP when checking for phished URLs
5570 * [Fix] Try to avoid recursive events deletions
5571 * [Fix] Try to fix false positive URL detections in text parts
5572 * [Fix] Try to fix issue in redis stats backend when task is closed
5573 * [Fix] Try to fix proxying of stupid spamc protocol to HTTP mirrors
5574 * [Fix] Try to fix redis crashes
5575 * [Fix] Try to fix upstreams with one element
5576 * [Fix] Try to handle multiline history in a more sane way
5577 * [Fix] Unbreak build on gcc < 4.9
5578 * [Fix] Update RPM spec/sources (#700)
5579 * [Fix] Update d3evolution version
5580 * [Fix] Update mumhash implementation
5581 * [Fix] Use custom error function for pre and post filters
5582 * [Fix] Use new postfilters and prefilters API in the plugins
5583 * [Fix] Use non-blocking mode for systemd sockets
5584 * [Fix] Use shared memory merely for local backends in the proxy
5585 * [Fix] Use watchers for spf plugin
5586 * [Fix] Varioud fixes to the maps code
5587
5588 1.2.8:
5589 * Another fix for exim workaround (#637)
5590 * Fix unencrypted passwords processing in the controller
5591 * Fix setting path for lua (#652)
5592 * Fix usage of rdns reply structure (#654)
5593 * Use file lock in logger to avoid deadlocks
5594 * Add `application/octet-stream` mime type for `pdf` extension (by @moisseev)
5595 * Implement new automata to skip empty lines for dkim signing (#651)
5596 * Fix parsing of missing classes
5597 * Clarify some rspamc arguments (by @fatalbanana)
5598 * Correct suppress spelling
5599
5600 1.2.7:
5601 * Slightly reduce weights of rules with high FP rate
5602 * Add workround for rspamd-1.3
5603 * Fix possible FP in TRACKER_ID rule
5604 * Simplify MISSING_MIMEOLE rule
5605 * Add workaround for gmime CTE stupidity
5606 * Fix mime headers processing
5607 * Fix false positive URL detections in text parts
5608 * Fix Exim shutdown patch
5609 * Enable workaround for exim mailbox format
5610 * Backport shingles static test
5611 * Fix levenshtein distance calculations
5612 * Fix max_train setup in ANN module
5613 * Fix redis structure by adding {NULL, NULL} member
5614 * Fix build with unmodified LibreSSL opensslv.h
5615 * Repair optional dependencies
5616 * Really skip filters in case of pre-result set
5617 * Restore the intended pre-filters behaviour
5618 * Fix ipv6 mask application
5619
5620 1.2.6:
5621 * Fix parsing of URLs in texts
5622 * Fix creating of URLs from LUA
5623 * Fix some more URL detector issues
5624 * Fix unit tests
5625 * Fix JIT compilation for PCRE2 expressions
5626 * Fix JIT usage for PCRE2
5627 * Fix UTF8 mode in PCRE2
5628 * Add workaround for pre-historic compilers (#605)
5629 * Fix and rescore R_PARTS_DIFFER logic
5630 * Properly set lua paths for tests
5631 * Fix SA rawbody processing - exclude top part
5632 * Store text parts content with newlines stripped
5633 * Properly support SA body regexps
5634 * Fix body rules in SA plugin
5635 * Fix setting of score for parts differ
5636 * More fixes to parts distance calculations
5637 - Use hashed words instead of full words for speed
5638 - Improve levenstein distance calculations and penalise replaces
5639 - Always return number from 0 to 1
5640 - Use g_malloc instead of alloca
5641 * Fix percents output in R_PARTS_DIFFER
5642 * Plug memory leak in dkim module
5643 * Plug minor memory leak in regexps creation
5644
5645 1.2.5:
5646 * Plug an important memory leak in headers getting code
5647 * Remove some bad domains from whitelists
5648
5649 1.2.4:
5650 * Implement new multipattern matcher that uses hyperscan if possible
5651 * Use mutlipattern for lua_trie code
5652 * Add utility methods for multipattern
5653 * Use multipattern in url matcher
5654 * Add escape functions for hyperscan
5655 * Allow to optimize lua -> C transition by flattening table args
5656 * Optimize hot paths in SA plugin
5657 * Optimize rspamd_re_cache_type_from_string
5658 * Allow empty tries
5659 * Fix extraction of URLs from Subject
5660 * Allow to have different flags for different patterns in multipattern
5661 * Add common directory for hyperscan cache to config
5662 * Implement caching for hyperscan multipattern
5663 * Attach domain part to `R_SUSPICIOUS_URL` (by @moisseev)
5664 * Allow multipattern scans to be nested for the case of hyperscan
5665 * Simplify SURBL redirector search code and avoid ac_trie
5666 * Add two way substring search algorithm
5667 * Avoid acism usage to find gtube pattern
5668 * Fix processing of empty headers
5669 * Allow to disable pthread mutexes on broken platforms
5670 * Make web interface not send password in query strings (#585) by @fatalbanana
5671 * Add maximum delay to ratelimit module
5672 * Backport fix for empty files inclusion from libucl
5673 * Fix settings id setup
5674 * Add min_learns option to classifiers
5675 * Use more clever to utf8 conversion strategy
5676 * Fix disabling of virtual symbols in the settings
5677 * Rework settings to work properly in metric-less configuration
5678 * Set the default limit for classifier
5679 * Fix ttl based expiration from LRU cache
5680 * Rework DKIM module to use OpenSSL for digests
5681 * Fix mailto urls parsing with hyperscan
5682 * Do not set obscured flag for urls starting with spaces
5683 * Fix crash on redis learn
5684 * Fix ratelimit ctime setting
5685
5686 1.2.3:
5687 * New DCC module (by @smfreegard)
5688 * Rework whitelist module:
5689 - Now we check different elements for different checks
5690 - MIME from for DMARC
5691 - DKIM signature domain for DKIM
5692 - SMTP from or HELO for SPF
5693 * Fix regexps results combination (*critical*)
5694 * Fix issue with expressions processing (*critical*)
5695 * Optimize strlcpy for aligned input
5696 * Add support of half-closed connection in lua_tcp
5697 * Allow to print compact json in client
5698 * Save required score in history (#581)
5699 * Allow to attach file descriptors to control commands
5700 * Allow to send descriptors from workers to main
5701 * Allow to attach fd when broadcasting to workers
5702 * Implement log pipe feature for rspamd logs analysis
5703 * Add `log_helper` worker
5704 * Add `URIBL_SBL_CSS` (by @smfreegard)
5705 * Add worker scripts functionality
5706 * Add on load hooks for rspamd_config
5707 * Add lua scripts for log_helper worker
5708 * Add generic maillist detector (#584)
5709 * Implement FANN autolearn using log_helper worker
5710 * Rework metrics configuration to allow includes
5711 * Change default value of forced removal in composite rules
5712 * Allow to use assembly version of blake2b on x86 cpu
5713 * Use less precise (but faster) clock if possible
5714 * Insert redirected URL to the urls list
5715 * Allow to get and set callback data for rspamd symbols
5716 * Add binary heap implementation
5717 * Use binary heap for expire algorithms in the hash
5718 * Use `least frequent used` expiration strategy
5719 * Allow to get mime headers from a task
5720 * Add support for mime headers in `regexp` module
5721 * Update Exim patches (by @fatalbanana)
5722 * Allow building rspamd with jemalloc
5723 * Save multipart boundaries
5724 * SA plugin changes:
5725 - Properly handle MIME headers
5726 - Fix eval:check_for_missing_to_header rule
5727 - Implement SA compatible body regexps
5728 - Use sabody rules in SA plugin
5729 * LUA API changes:
5730 - Add util.get_ticks function
5731 - Add util.stat function
5732 - Add task:get_symbols_numeric method
5733 - Add method to get number of symbols in the cache
5734 - Add lua methods to get redirected urls
5735 - Allow to get callbacks for lua symbols
5736 - Add config:set_symbol_callback function
5737
5738 1.2.2:
5739 * Use HTTP Content-Type on non mime input if possible
5740 * Save log level when compressing log messages
5741 * Further rework of composite rules (add '^' prefix)
5742 * Add tracking for rspamd expressions
5743 * Store actions limits in metric result
5744 * Fix parsing of include/redirect with many records in SPF
5745 * Add method to disable symbols execution in the cache
5746 * Allow to disable checks from settings
5747 * Allow to select settings by id in HTTP query
5748 * Find URLs with '\r' and '\n' inside href attribute
5749 * Implement vectored mode for hyperscan (experimental)
5750 * Improve client connection errors diagnostics
5751 * Allow to edit new files with signtool
5752 * Improve hashes performance on 32 bit platforms
5753 * Fix sorting of limits
5754 * Remove slow and unused rules `INVALID_EXIM_RECEIVED*`
5755 * Add expression:process_traced lua method
5756 * Allow tables in task:insert_result
5757 * Save trace for SA metas
5758 * Do not parse broken TLD parts in URLs
5759 * Investigate many border cases in URLs parser
5760
5761 1.2.1:
5762 * Add list support to `mime types` module configuration (by @moisseev)
5763 * Allow symbols params to be printed in logs
5764 * Fix `MIME_BAD_ATTACHMENT` false positives for MDN/DSN
5765 * Fix crashes on arm32
5766 * Do not classify message if some class is missing
5767 * Fix cryptobox cleanup
5768 * Remove multipart/report from bad mime types (#569)
5769 * Improve logging for fuzzy hashes
5770 * Show map URLs in webui
5771 * Sort symbols in webui
5772
5773 1.2.0:
5774 * New dynamic updates plugin
5775 * Regular expressions map support
5776 * Faster radix trie algorithm
5777 * Faster siphash for AVX2 supporing CPUs (used in fuzzy hashes)
5778 * PCRE2 support
5779 * Allow quoted and slashed keys in map
5780 * Add proper support of DNS resolvers balancing (#552)
5781 * Rework includes and configuration system for better local changes support
5782 * New keypairs framework for signing and encryption
5783 * Added support for dynamic modules and workers
5784 * Allow to dump configuration with help comments
5785 * Rework once_received module
5786 - Fix priority for `good_hosts`
5787 - If a good host has been found do not add once_received symbols
5788 - Fix priorities for strict once_received
5789 - Add ability to whitelist IP addresses
5790 * Implement support of signed maps for HTTP and file maps
5791 * Add command to sync fuzzy storage (#533)
5792 * Rework system of symbols and actions registration
5793 It is possible now to use priorities when adding symbols to metrics and
5794 override scores for symbols with lower priority with the scores with
5795 high priority.
5796 * Add auth support and db selection for redis stats
5797 * Improve composite rules application
5798 * Add ignore_received option
5799 * Fix critical issue with inconsistent resorting
5800 * Fix `all` in spf redirects
5801 * Add punycoded versions for IDN domains (#554)
5802 * Improve sorting order for symbols cache
5803 * Add lockless logging for processes management
5804 * Allow to specify flags for metric symbols
5805 * Load images height and width from style attribute (#538)
5806 * Override DNS requests limits for SPF and DKIM
5807 * Fix resetting symbols to their default values in WebUI
5808 * Improve configuration agility for redis stats
5809 * Allow to set db and password for redis in stat_convert
5810 * Import the latest libucl
5811 * LUA API changes:
5812 - Add rspamd_version function to LUA API
5813 - Add lua_cryptobox module
5814 - Add lua_map module
5815 - Add task:set_metric_action lua API method
5816 - Fix race condition in lua_tcp module
5817 - Fix a lot of issues in lua_redis module
5818 - Rework and abstract lua maps API
5819 - Add util.strlen_utf8 lua function
5820 - Add lua functions for caseless comparison
5821 - Allow optional symbols registration
5822 - Add config:add_map table form method, add regexp maps
5823 - Add task:has_urls method
5824 - Add task:has_flag method
5825 - Add html tags methods to lua_html
5826 - Add task:get_dns_req
5827 * Plugins changes:
5828 - Add support for WLBLEval SA plugin
5829 - Use caseless comparison in SA and DMARC plugins
5830 - Allow SA plugin to set scores for rspamd symbols
5831 - Add regexp maps support to multimap
5832 - Allow filenames match in multimap
5833 - Add more filters for the existing map types
5834 - Fix html images rules to reduce FP rates
5835 * New rules:
5836 - LONG_SUBJ - too long subject
5837 - MIME_BAD_ATTACHMENT - bad attachment type
5838 - RDNS_NONE - no reverse DNS record for sender's IP
5839 - Fix MISSING_MIMEOLE rule for modern OE
5840 * Many other bugfixes, memory leaks plugs thanks to:
5841 - Coverity scan
5842 - New gcc-6 warnings
5843 - valgrind manual iterations
5844 * Documentation improvements:
5845 - FAQ list: https://rspamd.com/doc/faq.html
5846 - Reworked quick start guide
5847 - Added documentation for all active modules
5848 * Other changes:
5849 - Dropped Ubuntu Vivid support
5850 - Added Ubuntu Xenial support
5851 - Rework build system for rspamd and rmilter
5852
5853 1.1.4:
5854 * Print traceback on lua errors in lua config
5855 * Fix leaks in lua error paths
5856 * Improve 'R_EMPTY_IMAGE' rule
5857 * Fix metas memoization in SA plugin
5858 * Properly set `flag` in fuzzy replies
5859 * Fix arguments order
5860 * Fix issue with out-of-boundary reading
5861 * Fix issues found by coverity
5862 * Same result checking error found by coverity
5863 * Fix varargs processing (found by coverity)
5864 * Fix error in printing hex
5865 * Reduce weights for some hfilter patterns
5866 * Add aliases for task:get_from_ip:
5867 - task:get_addr
5868 - task:get_from_addr
5869 - task:get_ip
5870 * Rework once_received module
5871 - Fix priority for `good_hosts`
5872 - If a good host has been found do not add once_received symbols
5873 - Fix priorities for strict once_received
5874 - Add ability to whitelist IP addresses
5875 * Fix `MISSING_MIMEOLE` rule for modern OE
5876 * Treat meta tags as embedded tags (#501)
5877
5878 1.1.3:
5879 * Fix DSN rules when SMTP from is unavailable
5880 * Fix statconvert routine to avoid lua module usage
5881 * Set a sane quark for configtest to avoid NULL to be printed in logs
5882 * Support c11 if available
5883 * Fix parsing of ip:port strings
5884 * Add more diagnostic for lua subr errors
5885 * Fix task:set_from_ip lua method
5886 * Add basic routines for digital signatures
5887 * Add tool for digital signatures
5888 * Add plain open file API method for atomic open
5889 * Fix parsing nested braces inside logger vars
5890 * Pre filters now actually skip processing
5891 * Add pre-filter mode for multimap
5892 * Switch to apache 2 license
5893
5894 1.1.2:
5895 * Fix stat_cache closing
5896 * Add checkpoints to sqlite3 learn cache
5897 * Do not recompile lua generated headers all the time
5898 * Increase number of messages learned
5899 * Fix issues with dual stack and hfilter
5900 * Disable MID checks for hfilter by default
5901 * Fix cache definitions in multiple classifier and no type
5902 * Don't crash if learn cache failed to initialize
5903 * Fix googlegroups support in maillist plugin
5904 * Rework flags LUA API:
5905 - Allow to check for a specific flag
5906 - Add `learn_spam`, `learn_ham` and `broken_headers` flags
5907 - Unify internal functions
5908 * Add `BROKEN_HEADERS` rule
5909 * Add support for forged confirmation headers (by @AdUser)
5910 * Allow `any`, `mime` and `smtp` for get_from/get_recipients
5911 * Add mime types checking plugin
5912 * Add rule to detect spammers attempts to cheat mime parsing
5913 * Rework parsing of IP addresses in configuration (better IPv6 support)
5914 * Add `util.parse_mail_address` function to LUA API
5915 * Add lua sqlite3 module
5916 * Implement synchronous redis call
5917 * Ratelimit: avoid possible indexing of nil value (Fixes #498) (by @fatalbanana)
5918 * Add stat_convert command to convert stats tokens from sqlite3 to redis
5919 * Implement redis advanced lua api with pipelining
5920 * Fix memory leak on redis stat (#500)
5921 * Fix user/language learn count in sqlite statistics (#496) (by @fatalbanana)
5922 * Fix build with custom pcre
5923 * Fix fuzzy relearning (#498)
5924 * Improve planning of asynchronous tasks
5925 * Show slow rules in log
5926 * Add warning for slow regexps
5927 * Add base32 decode/encode routines to lua util
5928 * Allow converting of learn cache from sqlite to redis
5929 * Add methods to check if a messages has from/rcpts
5930 * Improve and fix multimap plugin:
5931 - Restore 'header' maps
5932 - Add filters for headers
5933 - Add 'email:addr', 'email:user', 'email:domain' and 'email:name' filters
5934 - Add generic regexp filters
5935 * Disable reload command in rc scripts
5936 * Improve runtime CPU dispatcher for libcryptobox
5937 * Add preliminary support of digital signatures via ed25519
5938 * Add detection for RDRAND support
5939 * Print configuration of crypto on start
5940 * A in SPF presumes AAAA lookup as well
5941
5942 1.1.1:
5943 * Fix duplicated XBL symbol
5944 * Reduce log severity for ratelimit missing servers
5945 * Fix XBL composite to avoid duplicate symbols
5946 * Reduce weight of URL_ONLY rule due to FP rate
5947 * Disable fuzzy hashes from the metadata for now
5948 * Fix processing of empty messages (#486)
5949 * Always treat DNS timeouts as temporary fail for SPF
5950 * Fix issue with SPF double IP stack (#483)
5951 * Use X-Forwarded-For when checking secure_ip (#488)
5952 * Fix hash calculation for sqlite stats
5953 * Fix memory corruption on punycode
5954 * Fix strings allocation in punycode
5955 * Fix error message (#491)
5956
5957 1.1.0:
5958 * Incompatible change: sqlite3 and per_user behaviour:
5959 Now both redis and sqlite3 follows the common principles for per-user
5960 statistics:
5961 1) If per-user statistics is enabled check per-user tokens ONLY
5962 2) If per-user statistics is not enabled then check common tokens ONLY
5963 If you need old behaviour, then you'd need to use separate classifier
5964 for per-user statistics.
5965 * Implement redis statistics backend and cache
5966 * Implement autolearning for statistics
5967 * Reworked statistics architecture from scratch
5968 * Add hyperscan (https://github.com/01org/hyperscan) engine for regular
5969 expressions:
5970 - add lazy loader for hyperscan databases
5971 - rework regexp cache to have joint pcre/hyperscan scanning
5972 - implement hyperscan pre-filter support
5973 - add compilation guards for bad expressions
5974 - implement `rspamadm control recompile` command
5975 - implement hyperscan cache monitoring
5976 - slides: <https://highsecure.ru/rspamd-hyperscan.pdf>
5977 * Implement flexible task logging
5978 * Rework fuzzy worker:
5979 - it is now possible to run multiple fuzzy workers;
5980 - implement lazy writing as sqlite3 is bad at concurrent writing;
5981 - add retries for simple sql commands in fuzzy backend;
5982 - use fine-grained transactions for fuzzy;
5983 - implement new multi-pubkeys mode;
5984 - allow encrypted only storages;
5985 - rework statistics for fuzzy;
5986 - add `rspamadm control fuzzystat` command for extended statistics;
5987 - implement human readable output for the previous command;
5988 - add condition script for learning fuzzy storage;
5989 * Various fixes to SPF:
5990 - fix `redirect` records;
5991 - fix domains when parsing mx/ptr/a records in includes/redirects;
5992 - fix issues with multiple addresses in SPF records;
5993 - ignore SPF results in case of DNS failure;
5994 - adjust TTL of records when resolving subelements of SPF records;
5995 - always select `v=spf1` line if it is available
5996 - do not cache records with DNS failure in subrequests;
5997 - ignore records with temporary fails during subrequests resolving;
5998 - fix `RDNS_RC_NOREC` support;
5999 * Add clang plugin for static analysis:
6000 - implement static checks for `rspamd_printf` format strings;
6001 * Add 'allow_raw_input' option for non-mime messages
6002 * Recognize types using libmagic
6003 * Fix parsing of IPv6 received headers
6004 * Add new interface of communication between workers in rspamd
6005 * Add support for named socketpairs
6006 * Don't write URLs by default as it is too verbose
6007 * Set status for HTTP replies
6008 * Try load `rspamd.conf.override`
6009 * Implement words decaying for text parts to limit many checks
6010 * Improve support of SA rules and plugins:
6011 - add check_for_shifted_date and check_for_missing_to_header eval rules;
6012 - add 'check_relays_unparseable' support;
6013 - add `check_for_mime('mime_attachement')` function;
6014 - use new re_cache interface for all SA rules;
6015 - add support for `Mail::SpamAssassin::Plugin::MIMEHeader`;
6016 - add support of 'special' SA headers to `exists` function;
6017 - fix issue when SA metas contain other metas;
6018 - fix freemail rules;
6019 * Many fixes to the URL parser
6020 * Match any newline character in regexps
6021 * Fix resolving of upstreams and detection of poor IPv6 configurations
6022 * Parse upstreams selection algorithm from the configuration line
6023 * Add `reresolve` command to the control interface
6024 * Generate fuzzy hashes from task metadata (URLs and headers)
6025 * Add method to check if IP is local and `local_addrs` option
6026 * Implement forced timeout for delayed filters
6027 * Disable fast path of pcre-jit as it seems to be broken
6028 * Bayes fixes:
6029 - new normalizer function;
6030 - really use weights of tokens from the OSB algorithm;
6031 - restore multiple classifiers support;
6032 * Rules changes:
6033 - add `R_SUSPICIOUS_URL` rule that detects obfuscated URL's;
6034 - improve empty image rule;
6035 - rework `FORGED_RECIPIENTS` rule;
6036 - reduce weight of `SUSPICIOUS_RECIPS`;
6037 - fix `*_NORESOLVE_MX` symbols in hfilter;
6038 - add `SUBJ_ALL_CAPS` rule with support of UTF8
6039 - add spamhaus SBL to uribl
6040 - fix `SUSPICIOUS_RECIPS` and `SORTED_RECIPS` rules
6041 - remove `R_TO_SEEMS_AUTO` as it generates a lot of FP;
6042 - add new Message-ID regexp for Thunderbird (by @moisseev);
6043 * Plugins changes:
6044 - allow ratelimit plugin to set symbol instead of pre-result
6045 - support IP DNS black lists for URIBL (e.g spamhaus SBL);
6046 - drop deprecated SURBL bits (by @fatalbanana)
6047 - rename `JP_SURBL_MULTI` to `ABUSE_SURBL` (by @fatalbanana)
6048 - add `SURBL_BLOCKED` (by @fatalbanana)
6049 - add `CR_SURBL`
6050 - SURBL: allow fallthrough to default symbol (by @fatalbanana)
6051 - Settings: fix IP match (by @fatalbanana)
6052 - SURBL: add missing symbols to metric (by @fatalbanana)
6053 - allow processing images urls for SURBL
6054 - unconditionally disable SPF for authenticated users and local networks
6055 * Rework ratelimit plugin
6056 - switch to `rates` instead of old and stupid strings to setup;
6057 - check if a bucket is zero and disable the corresponding limits'
6058 - turn off all buckets by default;
6059 - check either `rcpt` or `user` buckets, not all together'
6060 - document new `rates` and `symbol` options;
6061 - inform user about what buckets are used in the configuration;
6062 * Add neural network **experimental** plugin
6063 * Add a sample script to learn neural network from rspamd logs
6064 * Add documentation strings support to rspamd:
6065 - add strings for the main configuration options;
6066 - document workers options;
6067 - add internal plugin options;
6068 - create `rspamadm confighelp` routine;
6069 - implement human readable output for the previous command;
6070 - add subtree search support;
6071 - add keyword search support;
6072 * Documentation improvements, tutorials section, statistics description
6073 * Many other minor and major bugfixes not noted here
6074
6075 1.0.11:
6076 * Fix spf redirects
6077 * Fix domains when parsing mx/ptr/a records in includes/redirects
6078 * Fix unfolded base64 encoding
6079 * Fix GError use-after-free
6080 * Do not rewrite the original url when using redirector
6081 * Fix parsing of fragment in urls
6082 * Fix processing of HTML tags
6083 * Improve empty image rule
6084 * Avoid long double type
6085 * Fix tokens weights in OSB algorithm
6086 * Improve debugging for bayes
6087
6088 1.0.10:
6089 * Fix settings application (#416)
6090 * Fix another issue with fixed strings
6091 * Fix hash function invocation
6092 * Use the proper string for make_dns_request in lua_http
6093 * Fix scan time output
6094 * Update webui:
6095 - fix labels for greylisting
6096 - fix dimension of scan time
6097
6098 1.0.9:
6099 * Emergency fix in keyed blake2 to fix fuzzy hashes and encrypted password
6100 * Support passwords longer than 64 symbols
6101
6102 1.0.8:
6103 * Add function to traverse AST atoms
6104 * Allow dependencies on rspamd symbols for SA metas
6105 * Fix memory corruption when timeout is removed in fuzzy check
6106 * Fix encrypted fuzzy add processing
6107 * Avoid use-after-free in controller session destructor
6108 * Use session pool instead of task pool in fuzzy check
6109 * Fix assembly in i386 mode (#413, #412)
6110
6111 1.0.7:
6112 * Plugged memory leaks in internet address object & html parser
6113 * Fixed static build
6114 * Fixed multiple sigchld processing
6115 * Fixed deletion of signal events after event processing loop
6116 * Fixed build on ARM (#404 - reported by @Gottox)
6117 * Fixed setting the default mask for SPF.
6118 * Fixed sanitisation of HTTP query values
6119 * Fixed parsing of the last header in encrypted HTTP messages
6120 * Additions and fixes for test suite & benchmarks
6121 * Added openssl aes-256-gcm support to libcryptobox & HTTP server
6122 * Implemented support for starting multiple HTTP servers
6123 * Implemented batch accept in HTTP server
6124 * Added module to get data from HTTP headers (#285 - reported by @msimerson)
6125 * Added `rspamadm control` command
6126 * Added ability to sort counters output.
6127 * Added ability to specify custom headers for rspamc client
6128 * Fix architecture detection
6129 * Converted history storage to the UCL format
6130 * Allow flexible number of rows in history
6131 * Fix action badges in WebUI
6132 * Add universal cryptobox hash API
6133 * Migrated to the optimized blake2b implementation adopted from Andrew Moon
6134 * Allow explicit loading of specific modules
6135 * Always load settings module
6136 * Allow to add symbols from settings
6137 * Fix double free in the controller fuzzy learn command
6138 * Avoid endless loop when cannot open sqlite db
6139 * Updated libucl
6140
6141 1.0.6:
6142 * Fix build on i386
6143 * Update CentOS7 service file patch (by @fatalbanana)
6144 * Fix path to rspamadm in Debian init script (by @fatalbanana)
6145 * Fix broken '_SC_GETPW_R_SIZE_MAX' on FreeBSD
6146 * Fix portability issues
6147 * Use cryptobox chacha for libottery
6148 * Better support of 32 bit builds
6149 * Fix header name tokens setup
6150 * Fix levenstein distance method for words
6151 * Add workaround for old libevent (#400)
6152 * Fix microseconds in termination timer
6153 * Fix some more issues with fixed strings
6154 * Explicitly test CPU instructions even after CPUID call
6155 * Do not check out of boundary memory
6156 * Do not output broken emails
6157 * Fix unknown symbols registration
6158 * Handle SIGILL using longjmp
6159 * Block signals when exiting event loop
6160 * Fix incorrect allocation size
6161 * Slightly optimize alignment
6162 * Restore rspamd -t for compatibility
6163 * Add more sanity checks for emails
6164
6165 1.0.5:
6166 * Add rspamd control interface:
6167 - support `stat` command to get runtime stats of rspamd workers
6168 - support `reload` command to reload runtime elements (e.g. sqlite3 databases)
6169 * Rework curve25519 library for modular design:
6170 - add Sandy2x implementation by Tung Chou
6171 - fix CPU detection for variables loading assembly
6172 - add testing for curve25519 ECDH
6173 * New fixed strings library
6174 * Add `R_SUSPICIOUS_IMAGES` rule
6175 * Enable mmap in sqlite3
6176 * Use new strings in the HTTP code
6177 * Improve google perftools invocation
6178 * Improve performance profiling in http test
6179 * Reorganize includes to reduce namespace pollution
6180 * Allow specific sections printing in configdump command
6181 * Rework workers signals handlers to be chained if needed
6182 * Update socketpair utility function
6183 * Add control_path option for rspamd control protocol
6184 * Fix ownership when listening on UNIX sockets
6185 * Rework signals processing in main
6186 * Remove extra tools from rspamd (they live in rspamadm now)
6187 * Remove global rspamd_main
6188 * Add global timeout for the overall task processing (8 seconds by default)
6189 * Sanitize NULL values for fuzzy backend
6190 * Store NM between encrypt/decrypt
6191 * Add textpart:get_words_count method
6192 * Fix generic DNS request in lua
6193 * Tune hfilter weights
6194 * Add support of IPv6 in hfilter
6195 * Fix parsing of HTTP headers with IP addresses
6196 * Sync with the recent libucl
6197 * Various minor bugfixes
6198
6199 1.0.4:
6200 * Add configdump routine to rspamadm
6201 * Implement retransmits for fuzzy_check plugin
6202 * Fix events processing for learning anf checking fuzzy hashes
6203 * Avoid dependency on unneeded and uncompatible glib include
6204 * Add `historyreset` command to the controller
6205 * Fix loading of tokenizer config from dump (#389)
6206 * Add sorting hints for the history
6207 * Allow custom lua scripts for users/languages extraction (#388)
6208 * Do not add FORGED_RECIPIENTS when 'To' is missing (#387)
6209 * Do not add R_UNDISC_RCPT when 'To' is missing (#387)
6210 * Add encryption to fuzzy check plugin
6211 * Add encryption for fuzzy storage
6212 * Add new epoch for encrypted fuzzy request
6213 * Add encryption for `rspamd.com` storage
6214 * Remove gmime processing for LDA mode as it is deadly broken
6215 * Add routine to find end of headers position in mime messages
6216 * Fix LDA headers folding
6217 * Init libraries in rspamc client as well to avoid locale issues
6218 * Avoid collision with locally installed includes
6219 * Allocate and free memory with the same allocator in rspamadm (#385)
6220 * Preserve expired fuzzy hashes counter
6221 * Improvements in webui:
6222 - Add favicon.ico
6223 - Rework history table
6224 - Fix sorting for the history
6225 - Migrate to bootstrap 3 and jquery 2
6226 - Fix css bugs
6227 - Add glyphicons
6228 - Add reset history
6229 - Improve history buttons
6230 - Redraw graph to avoid display issues
6231 - Webui is now MIT licensed to match licensing policy of rspamd
6232
6233 1.0.3:
6234 * Fix piechart clean slice (#380)
6235 * Fix controller crashes when GString is reallocated (#381)
6236 * Correctly set locale before start
6237 * Set C locale for numeric values
6238 * Add rspamadm routine:
6239 - add `pw` command to manage passwords
6240 - add `help` command for displaying help
6241 - add `configtest` command to check configuration files
6242 - add `keypair` command for generating encryption keys
6243 - add `fuzzy_merge` routine to merge fuzzy sqlite databases
6244 - add a simple manual page for rspamadm
6245 * Allow metric registration for composite expressions
6246 * Add strict mode for configtest
6247 * Add logger counters
6248 * Save and show learned messages count (#383)
6249 * Add `no_stat` flag
6250 * Add `task:set_flag` and `task:get_flags` (#382)
6251 * Enable foreign keys in sqlite3
6252 * Remove orphaned shingles from fuzzy storage
6253 * Optimize synchronization steps for fuzzy storage
6254 * Allow delayed conditions registration
6255 * Add lua API for conditions registering
6256
6257 1.0.2:
6258 * Fix critical bug in webui that prevents password from being sent
6259 * Rework webui view:
6260 - Switch to d3.js for graphs
6261 - Improve piechart look
6262 - Rework colors for piechart
6263 - Fix layout for symbols
6264 - Fix refresh button
6265 * Add descriptions for whitelist maps
6266 * Fix build on arm (#379)
6267 * Fix issue with the last element in the radix trie
6268 * Add more tests for radix trie algorithm
6269 * Allow to extract URLs from query strings of other URLs (#361)
6270 * Initialize rrd fields before writing to file
6271 * Fix double free if no password has been specified
6272
6273 1.0.1:
6274 * Add writing to rrd from the controller
6275 * Fixed lots of bugs in rrd code
6276 * Adopt new DNS API in hfilter plugin (by @AlexeySa)
6277 * Allow only one controller process to manage rrd file
6278 * Set event base for fuzzy calls
6279 * Improve fuzzy IO errors logging
6280 * Add rra extraction function to rrd library
6281 * Add graph handler to the controller
6282 * Cache correct passwords to avoid too high CPU usage when working with webui
6283 * Controller sockets are owned by router do not export them to task
6284 * Optimize logging by skipping hash table search if it's empty
6285 * Fix loading issue with broken statfiles
6286 * Print assertions from glib to rspamd logger
6287 * Load legacy `lua/rspamd.local.lua`
6288 * Update webui with some fixes to learning and scanning
6289
6290 1.0.0:
6291 * Rework symbols processing:
6292 - Improve sorting logic for symbols
6293 - Organize processing into multiple stages
6294 - Added asynchronous watchers for symbols
6295 - Added ability to organize dependencies between symbols
6296 * Fixed URL redirector:
6297 - Use optimized POE loop
6298 - Organize dependencies
6299 - Fix startup
6300 * New sqlite3 backend:
6301 - Allow to have per-languages and per-user statistics
6302 - Allow sqlite3 to be used as statistics backend
6303 * Store tokenizer configuration within statfiles
6304 * Improve bayes statistics:
6305 - Use headers and images metainformation in bayes
6306 - Suggest using of pre-processed tokens for statistics
6307 - Fix tokens normalization for OSB algorithm
6308 * Rewrite url parsing:
6309 - Fix numerous issues with url extraction and normalization
6310 - Fix mailto urls
6311 * Fix settings plugin to allow custom actions scores
6312 * Improve rbl plugin
6313 * Allow capturing patterns in rspamd lua regexp library
6314 * Add GTUBE support
6315 * Fix spamc legacy support
6316 * Add DKIM support to RBL module
6317 * Fix issues with multiple DKIM signatures
6318 * Fix issue if rspamd cannot create statfiles (#331)
6319 * Rework parts and task structure:
6320 - Now text_parts, parts and received are arrays
6321 - Pre-allocate arrays with some reasonable defaults
6322 - Use arrays instead of lists in plugins and checks
6323 - Remove unused fields from task structure
6324 - Rework mime_foreach callback function
6325 - Remove deprecated scan_milliseconds field
6326 * Add ip_score plugin support (not enabled by default):
6327 - Can check for asn/country and network using DNS lookups
6328 - Can store and load reputation from redis server
6329 * Improve PARTS_DIFFER rule to count merely different words
6330 * New HTML parser:
6331 - Parses HTML parts using a set of state machines
6332 - Extracts useful data and exports it to lua functions:
6333 + Styles
6334 + Images
6335 + URLs
6336 + Colors
6337 + Structure elements
6338 - Added HTML rules for some checks
6339 * New version of LUA DNS API
6340 * Table versions of many functions in LUA API
6341 * Improve rspamc client:
6342 - Print execution time
6343 - Allow executing of external commands and passing output to them
6344 - Allow mime output mode when rspamc alters message according to rspamd
6345 checks and send it to an external command or stdout
6346 * Allow scanning of local files using HTTP requests
6347 * Rework configuration system:
6348 - Rules are now moved from the $CONFDIR to $RULESDIR to avoid ambiguity
6349 - All modules configurations are now split in $CONFDIR/modules.d/* to
6350 simplify upgrades
6351 - Move hfilter to plugins
6352 - Allow plugins and rules to define default scores to simplify metrics
6353 setup
6354 - Include overrides for all modules to honor local/automatic parameters
6355 - Tune scores for many modules
6356 * Rework and enable DMARC plugin
6357 * Add whitelist plugin for SPF/DKIM/DMARC based whitelisting
6358 * Add some common domains to whitelists shipped with rspamd
6359 * Rework logging:
6360 - Now each log entry supports module name and a `tag`. Tag is used to
6361 identify unique objects (such as tasks) when checking log files
6362 - It is possible to turn on debugging for the specific modules
6363 - Systemd logging is fixed
6364 * Improve spamassassin plugin.
6365 - Now headers are matched more like SA
6366 - Improve support of Message-ID
6367 - Add support of ToCc header type
6368 - Fix :addr and :name in headers regexps
6369 * Resurrect rrd support code
6370 * Save controller stats between restarts
6371 * Fixed tonns of bugs
6372 * Added tonns of minor improvements and features
6373 * Added more unit tests
6374 * Create functional tests framework
6375 * Added documentation for missing modules
6376 * Added rpm/deb repositories and scripts
6377 * Updated WebUI and libucl externals
6378
6379 0.9.10:
6380 * Do not dereference null pointer on learning.
6381 * Fix some extreme cases in BAYES.
6382 * Add a workaround to avoid bad HTML messages breaking.
6383 * Build with -O2 flags by default.
6384 * Add constraints to limit DNS requests count per task.
6385 * Add workaround for SURBL DNS flood.
6386 * Set error if rspamd cannot learn anything.
6387
6388 0.9.9:
6389 * Don't use RWL_SPAMHAUS_WL (unknown result) for whitelisting (by @fatalbanana)
6390 * Import updated public suffix list (by @fatalbanana)
6391 * Remove debug message
6392 * Fix settings (by @fatalbanana)
6393 * Remove duplicated symbol registration
6394 * Use WAL for fuzzy storage
6395 * RBL fixes (by @fatalbanana):
6396 - silence errors;
6397 - yield unknown results from RBLs;
6398 - fix scoring for DNSWL;
6399 - fix use of RBL name as symbol;
6400 - ignore RBL names that would not be yielded;
6401 * Support captures in regular expressions
6402 * Add captures support to lua_regexp
6403 * Support dist on FreeBSD and Darwin
6404 * Add RCVD_IN_DNSWL_NONE as whitelisting exclusion (by @fatalbanana)
6405 * Multiple fixes to URL detection:
6406 - support port definition;
6407 - fix query and path recognition;
6408 - fix parsing of multiple slashes in URL;
6409 - fix parsing query just after port;
6410 - fix path field in `url:to_table` method;
6411 - improve support of IP based URLs.
6412 * Set ignore_whitelists = true for RECEIVED_SPAMHAUS_XBL (by @fatalbanana)
6413 * Add GTUBE support
6414 * Ignore User header in SA mode
6415
6416 0.9.8:
6417 * Fix critical bug in bayes classifier (#305)
6418 * Fix critical bug in RBL module (by @fatalbanana)
6419 * Fix and rework settings plugin.
6420 * Fix get_all_opts for a case of non-iterable options.
6421 * Use tld for redirector's matching.
6422
6423 0.9.7:
6424 * Add whitelist_exception setting to RBL module (by @fatalbanana)
6425 * Don't use RWL_MAILSPIKE_POSSIBLE or DNSWL_BLOCKED for whitelisting (by
6426 @fatalbanana)
6427 * Fix extreme cases in bayes classifier.
6428 * Fix parsing of urls with '?' at the end of hostname.
6429 * Update interface.
6430 * Fix number of issues with webui interaction.
6431 * Fix saving maps.
6432 * Allow user@ and @domain matches in multimap.
6433 * Fix issues with bounces From processing.
6434 * Fix abs/fabs misuse.
6435 * Fix builds on suse and arch linux distributions.
6436
6437 0.9.6:
6438 * Fix memory leak if mime cannot be parsed.
6439 * Fix dkim cache expiration.
6440 * Fix issues with redirector HTTP response.
6441 * Fix abnormal connection closing with certains messages with a high score
6442 (issue #296)
6443 * Fix redirector installation.
6444 * Use specific POE loop for some systems.
6445 * Fix number of issues in URL redirector.
6446 * Fix selecting URLs for sending to redirector.
6447
6448 0.9.5:
6449 * Avoid double free when extending HTTP message.
6450 * Fix double free if multiple classifiers are defined.
6451 * Fix misprint in spamassassin plugin.
6452 * Fix cpuid invocation on i386.
6453 * Fix ownership issues for zero-copy decode.
6454 * Allow __len metamethod on rspamd{text}.
6455 * Add base64 decoding lua utility.
6456 * Fix build on FreeBSD
6457 * Skip spaces at the beginning of mime messages.
6458 * DBL_ABUSE_REDIR should not have significant weight.
6459 * Allow to split by lua_regexp rspamd{text} objects.
6460 * Allow to specify custom stop pattern for lua_tcp.
6461
6462 0.9.4:
6463 * Fix critical bugs in tokenization algorithm
6464 * Write unit tests for tokenization
6465 * Add documentation for lua_tcp
6466 * Switch off legacy tokenization by default.
6467 * Fix critical bugs in words normalization
6468 * Add lua bindings to tokenizer.
6469 * Implement storing of HTTP headers inside task
6470 * Add lua API to accerss HTTP headers data
6471 * Implemented base64 encoding suitable for MIME
6472 * Use caseless hash and equal functions for HTTP request headers.
6473 * Improve debian architectures support (by @dottedmag)
6474
6475 0.9.3:
6476 * Revert incorrect regexp change that broke the default rules
6477 * Fix lua_tcp module
6478
6479 0.9.2:
6480 * Fix error on spawning unique workers.
6481 * Add preliminary version of generic LUA TCP requests API.
6482 * Use lua 5.1 if luajit is not available (Arm64, PowerPC, s390x etc)
6483 * Fix fuzzy mime strings with only type.
6484 * Improve thunderbird sanity checks.
6485 * Fix critical bug on matching regular expressions.
6486 * Make hiredis optional dependency.
6487 * Fix multiple bugs in daemon reloading
6488
6489 0.9.1:
6490 * Restore utf8 validation for regular expressions to avoid crashes
6491 * Fix symbols displaying in the interface
6492 * Add symbol groups to the interface
6493 * Fix maps ID parsing in the controller
6494 * Add multimap and regexp modules documentation
6495 * Backport fixes from libucl
6496 * Fix debian package (by @dottedmag)
6497 * Rework XXH32 invocations
6498
6499 0.9.0:
6500 * Add support of the fast and secure protocol level encryption:
6501 - curve25519 is used for key exchange;
6502 - chacha20/poly1305 cryptobox construction for bulk encryption;
6503 - zero latency overhead;
6504 - encrypting and balancing HTTP proxy worker
6505 * Rework expressions and create new expressions library:
6506 - aggressive optimizations based on the abstract syntax tree;
6507 - abstract expressions support (regular expressions, functions, lua modules
6508 composites and so on)
6509 - New comparison and '+' operators support
6510 - New greedy algorithm to minimize execution time of expressions and
6511 all symbols
6512 - Dynamic expressions benchmark and reoptimizations
6513 * Many improvements to the LUA API:
6514 - reworked logger module allowing to do pretty print of the most of lua
6515 types (including tables and userdata classes)
6516 - reworked lua redis and lua HTTP to support more features
6517 - added opaque type for passing large text chunks without copying
6518 - new regexp module with many auxiliary functions (e.g. `re:split`)
6519 * LuaJIT is now the default requirement for rspamd allowing to speed up lua
6520 execution by a large margin (however, plain lua is still supported)
6521 * New plugins:
6522 - spamassassin rules plugin that allows to load and re-use the most of
6523 SA rules natively
6524 - DMARC plugin that evaluates SPF and DKIM policies to the domain policies
6525 - many old plugins has been reworked to implement new features and improve
6526 stability
6527 * New aho-corasic trie implementation from @mischasan that allows to load and
6528 use hundreds of thousands of patterns with no influence on load
6529 * Support of PCRE JIT and PCRE JIT fast path modes that significantly improves
6530 the performance of regular expressions if supported by PCRE
6531 * New URLs parser and extractor:
6532 - removed legacy code that was useless for url finding
6533 - reworked algorithms of URL parsing for more precise and accurate results
6534 - added top-level-domains tree from http://publicsuffix.org
6535 - improved emails parsing
6536 - removed many phishing false positives due to TLD tree check
6537 * New statistics infrastructure:
6538 - created a separate layer of statistic library
6539 - improved OSB-Bayes by re-weighting tokens according to the original
6540 academic paper and `crm114` implementation, which reduced false positives
6541 rate significantly
6542 - created learn cache to avoid double learning of statistics and providing
6543 an efficient way to re-learn class for a message
6544 - created abstract layers for different statistics backends
6545 - implemented new tokenization algorithms with fast or secure (siphash)
6546 hashes to generate statistics features
6547 * Reworked utf8 tokenization that previously corrupted all UTF8 words (minor
6548 incompatibility with old fuzzy hashes with utf-8 symbols)
6549 * SPF module has been completely rewritten to support complex cases of
6550 `include` and `redirect` within SPF records
6551 * DKIM module now supports multiple signatures
6552 * Controller passwords can now be stored encrypted by `PBKDF2-HMAC` in the
6553 configuration file
6554 * Many hand-written HTTP clients has been replaced with the common rspamd
6555 http module
6556 * New test framework:
6557 - import lua `telescope` test framework
6558 - add unit tests for many rspamd modules and routines
6559 - create a unit test for each possible bug found
6560 - use luajit ffi for testing C code
6561 - added preliminary support of functional testing by creating tasks from lua
6562 * Randomize hash seed to avoid certain hash tables vulnerabilities
6563 * Documentation improvements:
6564 - added documentation for the vast majority of rspamd modules
6565 - added documentation for rspamd protocol
6566 - added documentation for the most of rspamd LUA extensions
6567 * Fixed tonns of bugs and memory leaks
6568 * Added tonns of minor features
6569
6570 0.8.3:
6571 * Various critical fixes in distribution (by @dottedmag and @fatalbanana)
6572 * Fixed bugs in url detector to parse certain patterns
6573 * Add default host and helo for a client
6574 * Some sanity checks for tokenizer and classifier
6575 * Reiterate on systemd support
6576 * Fix missing symbol registration
6577 * Add support of spamc compatible output
6578 * Filter double-dots in rbl.lua validate_dns (by @fatalbanana)
6579 * Update ucl submodule due to critical bugfix
6580
6581 0.8.2:
6582 * Create fuzzy db if it does not exist
6583 * Fix: Centos init script: configtest() (by @AlexeySa)
6584 * Enable one_shot for RECEIVED_SPAMHAUS_XBL - Fixes #102 (by @fatalbanana)
6585 * Update Exim patch (by @fatalbanana)
6586 * Fix processing of unix sockets.
6587 * Allow applying settings to authenticated users (by @fatalbanana)
6588 * Make settings priorities work as documented (by @fatalbanana)
6589 * Fix race condition in symbols planner
6590 * Add DNSWL_BLOCKED symbol (by @fatalbanana)
6591 * Make Exim pass usernames to rspamd (by @fatalbanana)
6592 * Update RBL module (by @fatalbanana):
6593 - fix indentation;
6594 - collapse loops;
6595 - avoid calling for un-needed information;
6596 - allow disabling RBLs for authenticated users
6597 * once_received.lua: Fix indentation & add exclusion for authenticated users (by @fatalbanana)
6598 * hfilter.lua: Add exclusion for authenticated users (by @AlexeySa)
6599 * Updates to hfilter rules (by @AlexeySa)
6600 * Set empty <> user or addr for msgs without FROM (by @eneq123)
6601 * Fix: attempt to index field '?' (a nil value) (by @eneq123)
6602 * Fix: if not exist Date-header (by @AlexeySa)
6603 * Add task:get_content() method.
6604 * rbl.lua: Ignore private IP space (by @fatalbanana)
6605 * Allow to check radix maps from lua by rspamd{ip}
6606 * Make local exclusions configurable per-RBL (by @fatalbanana)
6607 * Add rspamd_config:radix_from_config() (by @fatalbanana)
6608 * Support emails dnsbl in rbl (by @fatalbanana)
6609 * Complete rework of url extraction logic
6610 * Allow customizations for unix sockets. (fixes #182)
6611 * Set lua path according to rspamd settings.
6612 * Import lua-functional for plugins stuff.
6613 * Completely rewrite multimap plugin in functional style.
6614 * Fix FORGED_MUA_THUNDERBIRD_MSGID (fixes #186)
6615 * Check IPv6 addresses at dnswl.org and Spamhaus whitelist (by @fatalbanana)
6616 * Add lowercase utility for utf8 strings.
6617 * Various fixes to build system
6618 * Updated debian configuration infrastructure (by @dottedmag)
6619
6620 0.8.1:
6621 * Add sqlite and perl as dependencies for RPM/Debian packages (by @fatalbanana)
6622 * Remove whitelist.lua from RPM file list (by @fatalbanana)
6623 * Make Exim pass hostnames to rspamd (by @fatalbanana)
6624 * Fix building on Fedora (by @fatalbanana)
6625 * Add toggle for disabling installation of systemd units on Linux (by @fatalbanana)
6626 * Fix double format rounding that caused output corruption (reported by @fatalbanana)
6627 * Revert broken change for destructors ordering that led to memory corruption
6628 * Do not reset symbols case of settings if parsed from lua (reported by @andrejzverev)
6629 * Fix build on SunOS (by @wiedi)
6630 * Fix multiple crashes on broken DKIM DNS records
6631 * Fix critical issue with composites weights removing
6632 * Fix memory corruption in composites processing code
6633 * Ignore non-SPF TXT records when parsing SPF includes
6634
6635 0.8.0:
6636 * New fuzzy check logic:
6637 - use shingles algorithm for fuzzy matching
6638 - use blake2 instead of md5 for larger output space
6639 - combine fuzzy and strict matching
6640 - allow to organize private storages by means of keys
6641 - preserve compatibility with previous versions
6642 * New fuzzy storage:
6643 - use sqlite instead of own memory based hash tables
6644 - rework commands interface
6645 - add conversion from the old format
6646 - add fuzzy match by shignles
6647 - support old rspamd versions
6648 * Add lemmatizing for words used in fuzzy hashes that allows to improve match
6649 quality by using of the first forms of all words
6650 * Rework language detection
6651 * Fix several critical bugs, memory leaks and deadlocks:
6652 - memory leak in HTML nodes parsing
6653 - deadlock in logger code
6654 - deadlock in signals processing
6655 - crashes in fuzzy_storage
6656 - crashes in tokenizers if the input was empty
6657 * Import new libucl with several bugfixes and improvements
6658 * Support listening on ipv6 addresses only
6659 * Fix macro expansion in SPF module
6660 * Several bugfixes in DKIM module
6661 * Add load headers support for mime parts to the lua API
6662 * Add documentation for:
6663 - workers in general
6664 - fuzzy_storage worker
6665 - fuzzy_check plugin
6666 - mimepart and textpart lua API modules
6667
6668 0.7.6:
6669 * Apply boundary fix for dkim simple canonization
6670 * Fix ping command
6671 * Return nil if header was not found in lua_task
6672 * Fix hang in upstreams revive logic
6673 * Decode entitles when normalizing HTML parts
6674 * Fix logic of finding URLs in HTML parts
6675 * Do not include \0 into length of text when performing conversion to utf8
6676 * Fix raw vs parsed reperesentations
6677 Raw parts are now:
6678 - decoded b64/qp, but *NOT* converted to utf-8
6679 Processed parts are now:
6680 - converted to UTF-8
6681 - normalized if needed (e.g. HTML tags are stripped)
6682 * Rework DKIM canonization to line based
6683 * Fix fuzzy hashes adding
6684 * Use more specific hash function for fuzzy
6685 * Fix leaking of iconv descriptors
6686 * Fix PTR resolving in lua resolver
6687 * Rework spf module.
6688 - Copy data to memory pool as cached record might be destroyed causing
6689 freed memory being passed to the protocol output (use after free)
6690 - Allow SPF_NEUTRAL policy to be handled separately
6691 - Add R_SPF_NEUTRAL to the default config
6692 * Rework `register_symbols` function
6693 * Allow to disable components of hfilter
6694
6695 0.7.5:
6696 * Fix owner when creating folder /run/rspamd (by @sfirmery)
6697 * Fix IP validity checks
6698 * Decode URLs obtained from HTML tags
6699 * Fix crash with unweighted upstreams
6700 * Stop processing headers in parts
6701 * Set sockaddr.sa_family properly when connectig to upstreams
6702 * Fix reload issues in surbl and fuzzy_check (reported by @citrin)
6703 * Fix timeouts in redirector
6704 * Improve lua errors reporting
6705 * Fix lua closures processing in libucl
6706 * Rework calling of lua functions from regexp module
6707 * Choose raw regexp for raw headers
6708 * Rework conversion to utf since glib one is broken
6709 * Ignore SGML style tags in html
6710 * Fix old bug with non-capturing https urls
6711 * Fix memory corruption on fuzzy reload (reported by @citrin)
6712 * Fix percents display in rspamc
6713 * Fix buffer update for DKIM
6714 * Do not validate utf for raw headers
6715
6716 0.7.4:
6717 * Fix build under *BSD
6718 * Detect HAN unicode script
6719 * Implement language detection heuristic for text parts
6720 * Fix time output in history
6721 * Improve piechart coloring
6722 * Fix \r\n conversion in DKIM module (reported by @citrin)
6723 * Try to detect systems with no IPv6 support
6724 * Fix multiple/single values in use settings (reported by @citrin)
6725 * Rework IP addresses in upstreams:
6726 - Select ipv4/unix addresses if they exist and use ipv6 for ipv6 only
6727 upstreams (since the support of ipv6 is poor in many OSes and
6728 environments)
6729 - Free IP list on upstream destruction
6730 - Add test cases for addresses selection
6731 - Allow adding of free form IP addresses to upstreams
6732 * Fix endianness in lua_radix search (reported by @citrin)
6733 * Soft shutdown should also set wanna_die flag (reported by @citrin)
6734 * Stop use-after-free in event loop termination
6735 * Fix processing of very short messages in DKIM (reported by @citrin)
6736 * Detect systems without shared mutexes
6737 * Fix issues with PTR and MX elements in SPF parser (reported by @citrin)
6738
6739 0.7.3:
6740 * New upstreams code:
6741 - simplify upstreams API;
6742 - unify strings parsing in upstreams definition;
6743 - add configuration options for the upstreams;
6744 - for failed upstreams re-resolve their addresses;
6745 - use all resolved addresses for an upstream (round-robin);
6746 - implement stable hashing and use it by default for upstreams;
6747 - add unit test for upstreams module.
6748 * Rework signals processing in all rspamd workers:
6749 - signals are now processed in the event loop;
6750 - implement the most common signal handlers for all workers;
6751 - add callbacks for workers specific signal handlers
6752 * Fix critical issue with fuzzy storage:
6753 Fuzzy stroage could not save any hashes on termination due to bugged
6754 signals handling
6755 * Fix roll history IP storage
6756 * Rework ipv4/ipv6 handling in parsing addresses:
6757 - turn off support of IPV6_V6ONLY socket option;
6758 - create ipv6 socket prior to ipv4 one to handle systems with v6/v4
6759 sockets enabled (Linux)
6760 * Remove CBL as it's wholly included in Spamhaus XBL (by @fatalbanana)
6761 * Remove nszones.com fake RBL (by @citrin)
6762 * Fix upstreams interaction for fuzzy_check
6763 * Verify spf PTR records (reported by @citrin)
6764 * Fix spf MX records parsing
6765 * Add compatibility for old libevent (by @yellowman)
6766 * Sync bugfixes from libucl
6767
6768 0.7.2:
6769 * Convert all maps to the compressed radix trie
6770 * Allow IPv6 addresses in IP maps
6771 * Remove dynamic items support from symbols cache
6772 * Allow hex encoded output of strings
6773 * Fix bug with control connections count
6774 * Process fuzzy weight correctly (reported by @fatalbanana)
6775 * Remove extra reference retain of http connection on error
6776 * Remove deprecated options from the default config
6777 * Add `one_shot` attr to metric's symbols
6778 * Doc: add documentation for metrics
6779 * Add Upstart job to debian packaging (by @CameronNemo)
6780 * Config: improve SURBL symbols descriptions (by @citrin)
6781 * Config: reflect SURBL changes (by @citrin):
6782 - Outblaze removed, malware moved to separate list:
6783 http://www.surbl.org/news/internal/MW-malware-sublist-added-to-multi
6784 * Fix C modules initialization on restart
6785 * Treat single IP as a single IP in radix lists (reported by @citrin)
6786 * Do not touch file and core limits if not asked explicitly (reported by @citrin)
6787 * Improve logging for fuzzy errors
6788 * Block SIGPIPE for HTTP writing
6789 * Doc: update manual pages
6790 * Fix HTTP connection termination
6791 * Reduce default number of parallel requests to 8
6792 * Sync with libucl include features
6793
6794 0.7.1:
6795 * Fix typo in stat output.
6796 * Fix issues with includes crossing with the system includes
6797 * Restore testing framework
6798 * Add radix trie test suite
6799 * Implement new path-compressed radix trie.
6800 - The performance benefit over the old algorithm is about 1.5 times.
6801 - Memory usage is significantly lower as well.
6802 - Now radix trie can accept any IPv4/IPv6 values
6803 * Various improvements to the memory pools code
6804 * Fix writing reply to a client when no filters are defined
6805 * Write base32 encoded fuzzy
6806 * Fix 'soft reject' action
6807 * Fix rspamd reload and modules reconfiguration
6808 * Fix subject rewriting for the default subject
6809 * Fix states for processing task and pre-filters
6810 * Fix issues with connection closing
6811 * Fix crashes in rdns
6812 * Fix ratelimit pre-filter
6813 * Update exim patch.
6814 - Update to the recent exim version
6815 - Strip extra leading src/ from the patch
6816 - Remove sendfile since it was broken
6817 - Fix rspamd spam report for exim
6818 * Improve documentation
6819
6820 0.7.0:
6821 * Use HTTP protocol for all operatiosn
6822 * Webui worker is now removed and controller works as webui
6823 * Allow to serve static files via controller by option `static_dir`
6824 * Rspamd interface is now a part of rspamd
6825 * Rspamc client has been rewritten to use HTTP and non-blocking mode
6826 allowing to start multiple operations simultaneously (see `-n` option)
6827 * Lua API was completely reworked to satisfy modern standards of LUA:
6828 * Module `lua-message` was removed
6829 * Reduced number of superglobals registered by rspamd
6830 * Many functions has been redesigned
6831 * Symbols registration is now more convenient
6832 * Users settings has been rewritten as lua plugin
6833 * Reworked headers system as gmime's based one misses many headers and is
6834 very slow to get headers values
6835 * Reorganized code and removed embedded jannsson by using UCL for all json
6836 parsing
6837 * Migrated to `librdns` for DNS resolving that improves concurrency for
6838 DNS requests significantly
6839 * Fixed tonns of bugs in MIME processing
6840 * Improved metrcis and default symbol's weights
6841 * Added new RBL's
6842 * Fixed a number of issues in the modules
6843 * Removed several memory leaks found
6844 * Fix unicode processing
6845 * Fix fuzzy checking for unicode parts
6846 * Significantly improve documentation and especially LUA API docs
6847 * See migration notes at https://rspamd.com/doc/migration.html
6848
6849 0.6.8:
6850 * Controller now listen for localhost and not for 127.0.0.1 by default
6851 * Allow FCrDNS-style RBL lookups (by @fatalbanana)
6852 * Reduce threshold for parts_differ function.
6853 * Fix hostname lookup for rdns rbl (by @AlexeySa)
6854 * Fix HFILTER_URL_ONELINE to reduce false positive rate.
6855 * Fix whitelist module.
6856 * Allow override system predefined settings without touching system ones
6857 by .try_include macro (by @andrejzverev)
6858 * Check for [ip.address]-style HELO and suppress lookups. (by
6859 @fatalbanana)
6860 * Optimize hfilter (by @AlexeySa)
6861 * Fix issue with random numbers generator in dns.
6862 * Use more clever time values to setup entropy.
6863 * Synced with the recent libucl.
6864
6865 0.6.7:
6866 * Use ChaCha20 for DNS generator (more secure DNS id)
6867 * Unknown symbols now has zero weight and not 1.0
6868 * Fix fuzzy hashes expire time
6869 * Fix critical issue in statfiles on FreeBSD 9 (and some other platforms)
6870 * Add .include_map macro to ucl parser
6871 * Update libucl
6872 * Fix headers end detection for DKIM module
6873 * Fix a bug in received headers parser
6874 * Validate IP addresses before pushing them to lua
6875 * Start new documentation project
6876 * Fixed tonns of other minor bugs
6877 * Start to prepare for 0.7 with HTTP protocol and new settings
6878
6879 0.6.6:
6880 * Removed issue with BUFSIZ limitation in the controller output
6881 * Simplify logging symbols escaping
6882 * Adjusted weights for several rules
6883 * Improve spamhaus rbl support
6884 * Removed PBL for received headers checks
6885 * Added hfilter module that performs various HELO and IP checks.
6886 * Rspamd can now be reloaded by HUP signal
6887 * Fuzzy storage should expire hashes properly
6888 * Build system has been reworked for better supportof pkg-config
6889 * Various minor bugfixes
6890
6891 0.6.5:
6892 * Fixed critical bug in DNS resolver, introduced in 0.6.4
6893 * Improved multimap and rbl plugins to skip
6894 * Add dns_sockets option for tuning sockets per server in DNS resolver
6895 * Improved packages for rspamd
6896
6897 0.6.4:
6898 * Added io channels for DNS request to balance load and reduce id
6899 collisions chance
6900 * Fixed a bug in SPF filter that may cause core dump in specific
6901 circumstances
6902 * FIxed default config for rbl module
6903 * It is possible to get a list of rspamc commands with their descriptions
6904 * Added SORBS bl to the default config
6905 * 2tld file for surbl module has been significantly extended
6906 * Perl modules has been removed from the code.
6907 * Fixed an issue in libucl when parsing macros
6908
6909 0.6.3:
6910 * Fixed issues with DNS:
6911 - labels decompression algorithm was fixed;
6912 - added resolve_mx to lua API;
6913 - fixed modules that use DNS.
6914 * Lua modules once_received and emails reworked for new resolver API and UCL.
6915 * Debian package was polished.
6916 * Fixed a bug in fuzzy_check module that prevents correct processing messages
6917 without valid parts.
6918
6919 0.6.2:
6920 * Fuzzy check module has been reworked:
6921 - now fuzzy_check operates with a group of rules, that define which
6922 servers sre to be checked;
6923 - it is possible to specify read_only groups to avoid learning errors;
6924 - turn fuzzy_check to one_shot mode permanently;
6925 - fuzzy_check module configuration is now incompatible with the previous
6926 versions.
6927 * Imported bugfixes from libucl.
6928 * Fixed whitelist plugin.
6929 * Fixed statfiles resizing.
6930 * Improved logging initialization order.
6931 * Fixed race condition in the controller worker.
6932
6933 0.6.1:
6934 * Critical bugfixes:
6935 - fixed build system;
6936 - fixed in_class setting in bayes learning;
6937
6938 0.6.0:
6939 * Use UCL instead xml for configuration (https://github.com/vstakhov/libucl)
6940 * Fix statistics module normalization
6941 * Rework the many modules for the new configuration:
6942 - surbl has incompatible configuration;
6943 - fuzzy_check has incompatible configuration;
6944 - multimap has now new configuration;
6945 - received_rbl is removed and replaced by rbl module.
6946 * Removed deprecated options:
6947 - statfile_pool_size;
6948 - action and required/reject score for a metric.
6949 * Simplify build system and unify configuration for all platforms.
6950 * Improved URL detector (reduced false positive rate).
6951 * Lua 5.2 is now the default and fully supported version.
6952 * Tons of bugfixes and minor improvements.
6953
6954 0.5.6:
6955 * Fix bug with counters incrementing in rolling history
6956 * Detect expl and exp2l as some systems do not have it
6957 * Support input streams without Content-Length
6958 * Implement counters output via rspamc and controller interface
6959 * Fix bug with udp sockets in fuzzy storage
6960
6961 0.5.5:
6962 * New bayes normalizator based on inverse chi-square function
6963 * Various fixes to fuzzy storage
6964 * Allow update fuzzy storage only from specific IP addresses
6965 * Better support of IPv6 and address selection algorithms
6966 * Add CentOS spec file
6967
6968 0.5.4:
6969 * Fixed issues with diff algorithm
6970 * Added support of RRD statistics
6971 * Add webui worker for interface interaction
6972 * Fix a lot of issues with dynamic conf
6973 * Fix critical memory leak in settings code
6974 * Improve stability of the system
6975
6976 0.5.3:
6977 * Added dynamic options
6978 * Added advanced metaclassfication
6979 * Added RESTfull API for controller
6980 * Improved hashing algorithms
6981 * Various fixes for rspamc client:
6982 - allow interacting with unix sockets
6983 - librspamdclient major cleanup
6984 - bayes is now default classifier
6985 0.5.2:
6986 * Added lua bindings for:
6987 - basic mime parts, that allows checkign attachements for example;
6988 - DNS resolver;
6989 * Existing lua bindings now works without task object allowing to use them
6990 in custom code.
6991 * Threads system was reworked to avoid global lua interpreter lock.
6992 * DKIM module now converts all line endings to CRLF how opendkim does.
6993 * URL detector is now more accurate for text parts.
6994 * Several critical bugs and memory leaks were fixed.
6995
6996 0.5.1:
6997 * Added lua worker type to handle network connections in lua.
6998 * Added lua bindings for async_session, IO dispatcher, memory_pool, and
6999 worker.
7000 * Composites can now uses other composites in expressions.
7001 * Fixes for debian package and for FreeBSD >= 9.1
7002 * Add support of gmime-2.6 if gmime-2.4 is not found.
7003 * Improve url detection and phishing detection.
7004 * Add lua mime_part library to get an access to all message part
7005 attributes (like filename, length, type).
7006
7007 0.5.0:
7008 * Added SMTP lightweight balancing proxy with XCLIENT support.
7009 * Added lua bindings for upstreams objects and API.
7010 * New pre-filters are implemented to support initial checking for messages.
7011 * Added ratelimit plugin that uses redis protocol to store data.
7012 * Added ipv6 support to spf and some other modules.
7013 * Unbreak spf plugin.
7014 * Allow options with the same name be threated as list.
7015 * DKIM plugin an parsing code was added.
7016 * Separate build system to put logic in several shared libraries.
7017 * Many bugfixes.
7018
7019 0.3.2:
7020 * Add error handling for regexps
7021 * Fix quit command in controller interface
7022 * Write symbols weights to rspamc output
7023 * Improve logic of selecting rspamc version
7024 * Do not try to parse broken DNS replies
7025 * Add 'raw' flag to FROM_EXCESS_BASE64 rule (requested by citrin)
7026 * Output message id in rspamc reply
7027 * Fix inserting composite symbol
7028 * Fix output of log line
7029 * Document composites
7030 * Add logging for fuzzy checks
7031 * Add logging for learning
7032 * Improve logic of learning messages - do not learn more than specific threshold
7033 * Fix inserting results for symbols that were incorrectly (for example more than 1 time) defined in config file
7034 * Do not output control characters if output is not terminal
7035 * Fix some logic errors in learning
7036 * Consider lua plugins errors as fatal configuration errors
7037 * Fix writing message id during fuzzy_add command
7038 * Display weight of symbols correctly
7039 * Fixes to winnow learning
7040 * One more try to improve accuracy of winnow algorithm
7041 * Add bayesian classifier (initial version)
7042 * Remove normalizer as it is winnow specific thing, so all statistic algorithms now returns value from 0 to 1
7043 * Some fixes to fuzzy hashes expiration:
7044 * Fix assertion while look up value in NULL hash (found by cirtin)
7045 * Fix normalization for systems that have not tanhl function
7046 * Ignore rfc822 group addresses
7047 * Move images library to core rspamd
7048 * Add lua api to access images properties
7049 * Add post filters to lua API - filters that would be called after all message's processing
7050 * Add ability to check for specified symbol in task results from lua
7051 * Add ability to check for metric's results from lua
7052 * Add ability to learn specified statfile form lua
7053 * Add ability to extract filename and size of images from lua
7054 * Fix assertion while extracting internet address
7055 * Fix races in fuzzy storage
7056 * Make spf parser case insensitive
7057 * Add ability to check hashes of selected mime types
7058 * Add ability to set minimum size in bytes for mime types
7059 * Add ability to set minimum dimensions for images
7060 * Assume all text/* content types as text/plain
7061 * Fix getting data wrapper for gmime24
7062 * Many fixes to statfile synchronization system
7063 * Fixed statfile pool initialization and synchronization with disk
7064 * Prepare 0.3.2
7065 * Fix Mail::Rspamd::Config for new rspamd features
7066 * Use Mail::Rspamd::Config in rspamc client
7067 * Write user's name to rspamd log
7068 * Prepare rspamd build infrastructure for creating rpm and deb packages
7069 * Fix depends
7070 * Add start script for linux systems
7071 * Fix shared usage of statfiles
7072 * Add invalidation of statfiles in case of learning, so now statfiles
7073 * This should fix shared usage of statfile pool by several processes
7074 * Fix misprint (reported by az)
7075 * Fix stupid error when all checks can be done in a single pass
7076 * New trie based url scanner (based on libcamel)
7077 * Small fixes to rspamd perl client
7078 * Write fuzzy hashes info to log
7079 * Add trie interface to lua api
7080 * Explain sample config and cleanup it
7081
7082 0.3.1:
7083 * Add modules documentation
7084 * Continue implementing smtp proxy
7085 * Implement new learning system, now rspamd should be much more intelligent while learning messages
7086 * Convert statistic sums to use long double for counters
7087 * Use hyperbolic tangent for internal normalizer
7088 * In classify normalize result after comparing, not before
7089 * New symbols sorter
7090 * Fix strict aliasing while compiling with optimization
7091 * Fix tanhl detection for platforms that have not implementation of it
7092 * Remove several compile warnings
7093 * Add experimental support of dynamic rules to regexp module
7094 * Document views configuration
7095 * Several fixes to documentation
7096 * Add more logic for dynamic rules
7097 * Add documentation for dynamic rules
7098 * Add ability to make negations in networks in dynamic rules
7099 * Clean up cache items correctly
7100 * Implement basic SMTP dialog:
7101 * Implement interaction with smtp upstream (with support of XCLIENT)
7102 * Check messages received via smtp proxy
7103 * Add support for sendfile in io dispatcher
7104 * Fix issues with compatibility of worker_task and smtp proxy
7105 * Proxy DATA command
7106 * Fix SMTP
7107 * Change metric logic
7108 * Completely remove lex/yacc readers for config
7109 * Make common sense of metric/action and symbols
7110 * Sync changes with all plugins
7111 * Incorrectly removed in previous commit
7112 * Fix misprint (by Andrej Zverev)
7113 * announce the "password" keyword in usage list
7114 * Implement initial version of greylisting triplets storage
7115 * Fix issues with smtp worker
7116 * Fix QUIT command in SMTP worker
7117 * Some fixes about new metrics system (may be incomplete)
7118 * Get weights of symbol from default metric for symbols cache
7119 * Fix setting task->from/task->rctp in smtp client
7120 * Copy from and rcpt correctly
7121 * Some performance improvements to IO dispatcher (do not drain the whole buffer after a single line readed)
7122 * Fix smtp data input
7123 * Fix misprint
7124 * Add limit of maximum allowed smtp session errors
7125 * New logic of SURBL module:
7126 * Use system mkstemp(3) on systems where it is available as glib implementation
7127 * Try to fix memmove issues in io dispatcher
7128 * Remove debug from SURBL module
7129 * Rewrite buffered input for line policy (again)
7130 * Fix issue with links that are ip addresses in numeric form in surbl
7131 * On Darwin use BSD style sendfile definition
7132 * Reorganize platform specific knobs in CMakeLists
7133 * Use gettimeofday on systems that have not clock_getres
7134 * Use ftime for dns trans id generation on systems without clock_getres
7135 * Darwin sendfile(2) support
7136 * TIMEDB->TIMEB
7137 * More to previous commit
7138 * Pass env from main() arguments instead of platform specific global environ
7139 * Fix compatibility issues
7140 * Fix -lintl detection
7141 * Init some variables to avoid problems
7142 * Remove garbadge (gnome terminal sucks)
7143 * Add more information about why we drop smtp connection
7144 * Fix mkstemp call
7145 * Send to upstream QUIT command at the end of session
7146 * Check return value of each rspamd_dispatcher_write as in case of write errors sessions can be destroyed early
7147 * Fix states in smtp dialog
7148 * Use rspamd_snprintf instead of libc one
7149 * Fix URLS command
7150 * Fix reconfigure process of surbl module
7151 * Fix destroying smtp session (unmap memory and do not delete pool early)
7152 * Delete pool after using its variables
7153 * Delay timer must be registered in async session to correctly handle connection termination
7154 * Register dns requests in session too
7155 * Make session before registering events
7156 * Remove events in handlers
7157 * Add ability to set filters for smtp worker for each smtp stage
7158 * Add very initial version of DNS resolver (many things to be done)
7159 * Announce weights and sync
7160 * Fix few typo
7161 * Understand short names of facility in logging config
7162 * Add ability to make whitelist for spf checks
7163 * Misprint != -> ==
7164 * Handle lua tag in way that it is not required to write additional text:
7165 * Strip all starting whitespace symbols from xml texts
7166 * Fix stupid bug in calculating buffer length while reading file maps
7167 * Add resolv.conf parsing into dns.c
7168 * Fix microseconds<->milliseconds conversions
7169 * Take callback argument in Mail::Rspamd::Client for processing files and directories
7170 * Print results if rspamc is called for a directory
7171 * Fix stupid error with surbl module reconfig (another one, blame me)
7172 * Do not show duplicate urls in url header
7173 * Fix detection of numeric urls (reported by citrin)
7174 * Write real time of message's scan to log (not only virtual)
7175 * Fix chartable module in utf mode
7176 * Fix parsing of some broken urls
7177 * Add ability to test regexp with 'T' flag
7178 * Write more code for DNS resolver:
7179 * Make DNS resolver working
7180 * Many improvements to rspamd test suite: now it CAN be used for testing rspamd functionality
7181 * Write DNS resolver tests
7182 * Fix issues with memory_pool mutexes and with creating of statfiles
7183 * Forgotten in previous commit
7184 * Add support for parsing SPF and SRV records
7185 * Fix PTR parsing
7186 * Add tests
7187 * Make SURBL module to use rspamd dns module
7188 * Several fixes to DNS logic
7189 * Remove evdns and use only rspamd resolver
7190 * Very hard to detect problem with race among error in socket and destroying task while we are writing to socket and go through a hash table
7191 * Fix resolving in smtp module
7192 * Init events before configuring resolver in smtp worker
7193 * Set resolver inside task
7194 * Fix reload signal (reported by citrin)
7195 * Some improvements to redirector
7196 * Call has_forked method to inform POE about fork
7197 * Fix lua DNS code
7198 * Decompress labels in DNS packets more strictly
7199 * Fix some problems with TXT records
7200 * Try to fix removing of DNS events
7201 * Do not insert unparsed RR's into reply
7202 * Calling callbacks may cause destroying session from which we are calling callback so we MUST call callback as the latest action
7203 * Fix check_smtp_data function
7204 * Add ability to make views by recipient
7205 * Add ability to set metric's action from config file
7206 * Fix bug with writing garbadge if message has no urls or no messages
7207 * Fix bug with incorrect behaviour of compare_parts_distance function
7208 * Add ability to assign several actions to one metric
7209 * Report action in rspamc protocol
7210 * Mail::Rspamd::Client and rspamc can now understand Action header too
7211 * Write action to log as well
7212 * Make valgrind happy about comparing symbols
7213 * Add more debug to comparing parts distance function
7214 * Write action even if message has no symbols
7215 * Make improvements to HTML entities decoder: now it replaces entities with common characters and
7216 * Add -d option to force debug output
7217 * Assume 7bit as default transfer encoding
7218 * Do not overwrite lua plugins and configs if they already exists in target directory
7219 * Improve logging
7220 * Write queue id to log
7221 * Remove test messages from cmake
7222 * Reopen log file by USR1 signal
7223 * Add reopenlog method to FreeBSD rc script
7224 * Adopt foreach for cmake 2.6
7225 * Fix to rc script
7226 * Do not try to resolve names with several dots in a row
7227 * Fix surbl request formatting for ip addresses
7228 * Handle cases of broken requests
7229 * Fix problems with parsing compressed names
7230 * Fix TXT records parsing
7231 * Fix expanding spf macros that may fail in rare cases
7232 * Fix another error with early task destroying
7233 * Handle empty from header
7234 * Improve reopenlog command in rc script
7235 * Strip trailing whitespace characters in Mail::Rspamd::Client
7236 * Use ungreedy match to strip trailing whitespaces
7237 * Stupid error in calculation compressed label length
7238 * Some optimizations to client library
7239 * Do not compare empty parts
7240 * Empty and non-empty parts are always different
7241 * Save in regexp cache the whole regexp with header name (if exists) and with flags
7242 * Add rspamd_log variable to lua plugins to access logging functions
7243 * Each part in rspamd task now can have parent part
7244 * Check for parts distance only for multipart/alternative subparts
7245 * Do not check attachements even if they are text (but attached as file)
7246 * Do not die if write (2) returned ENOSPACE while doing logging, turn on throttling mode instead (1 write try in a second)
7247 * Add ability to turn on debug for specific symbols
7248 * Add ability to configure dns timeouts and dns retransmits in config file
7249 * More debug
7250 * Fix extracting arguments in lua logger interface
7251 * Turn off debug_ip during reload if it was disabled by new config
7252 * Improve lua logging
7253 * Pre-init symbols cache when rereading config
7254 * Fix lua representing of invalid ip (nil, not 255.255.255.255)
7255 * Fix R_TO_SEEMS_AUTO rule (by citrin)
7256 * Add multimap lua plugin
7257 * Fix some multimap issues
7258 * Try to save images hashes to fuzzy storage to stop some annoying spammers
7259 * Allocate some more bytes for read buffer to avoid incorrect behavoiur
7260 * Add ability to check dns black lists by multimap module
7261 * Add multimap documentation
7262 * Fix labels parsing
7263 * Another try to save regexps in cache correctly
7264 * Improve test logs for regexps
7265 * Fix parsing txt records to avoid reading of uninitialized data
7266 * Fix error with writing symbols cache file
7267 * Fix error while working in utf mode when raw regexps was not created properly
7268 * Do not add extra byte while converting text to utf
7269 * Add error handling for regexps