Published on 2019-05-13 00:00:00

Humio 1.5.10

New Bloom Filters

Version

Type

Release Date

End of Support

Upgrades From

Data Migration

Config. Changes

1.5.10

Archive

2019-05-13

2020-03-14

1.5.8

No

Yes

JAR Checksum

Value

MD5

1b828fd0d80aa3c80aa9f1d4bba0dbd6

SHA1

998c039c894acdbe30d83efa414428ab77de2d7e

SHA256

b18d7b1844f4482f0e1aa8afe7e67ad1bf06e8bb5f40faebe9179c49dc72a412

SHA512

cb3efdf806231d2f3d71d378054e7513eed3bd73ccb445159f8232da4df14bae1f1165bde27d5536554f178dbcde3973d2d64e2f33271247e734cc3d6b88fd3f

TGZ Checksum

Value

MD5

1b828fd0d80aa3c80aa9f1d4bba0dbd6

SHA1

998c039c894acdbe30d83efa414428ab77de2d7e

SHA256

b18d7b1844f4482f0e1aa8afe7e67ad1bf06e8bb5f40faebe9179c49dc72a412

SHA512

cb3efdf806231d2f3d71d378054e7513eed3bd73ccb445159f8232da4df14bae1f1165bde27d5536554f178dbcde3973d2d64e2f33271247e734cc3d6b88fd3f

Summary

New bloom filters, but please upgrade to 1.5.11 to avoid known problems in this build.

Change Log

  • New experimental bloom filters that speed up searching for constant strings such as UUIDs and IP-addresses; the longer the search string, the bigger the speedup. The bloom filters also help regular expression searching, including case insensitive ones.

  • MUST be enabled with BLOOMFILTER_ENABLED=true (Note! defaults to false in this release, which makes searches skip events they should not).

  • When enabled, this will write files along with the segment files with prefix bloom5h1., which add approximately 5% storage overhead.

  • The bloom filter files will be generated as part of digest work, and also generated for “old” segment files when Humio is otherwise idle. Thus, when the feature is initially enabled, it will be visible that the CPU load is higher for a period of time.

  • It is safe to just delete any bloom5h1. files while the system is running, or in case the feature needs to be disabled.