Humio Server 1.38.0 Stable (2022-03-15)

VersionTypeRelease DateEnd of SupportUpgrades FromData MigrationConfig. Changes
1.38.0Stable2022-03-152023-03-151.26.0NoYes
JAR ChecksumValue
MD583afa7f6d2c55efbb88387474efd1264
SHA15587c3365fcfb22e1a45ea96b9503497b705125e
SHA256357591952ed12d0d9f93b084cff4b0ff6848d7a464071ff27edee9f921e23174
SHA5127a88658b07d69f6a2fe151da8fe94ebfe0a1259ffa48c45df6154dcce4f6453fac8f78087cefdf869fb6322fa4e31a01f830d9db998293ebeabb0f2c8e3e5cfb
JAR ChecksumValue
humio-core-devcff83e3a3ea8c455040ca31d4e8071a0f1c80be894fdde4cad768e69e1c449e5
humio-dev9cd0f6a91b150bb51f9407451bd70c40dc49f730f76840e061a6570008d88453
kafka-devd960ac292f781baa54c1388f4bbc94c77c1ae06b94a082a214777844f1435120
zookeeper-devb2ab322170bfab4d221f6f5e4a4cca5751b2d97bcf75d451de4d24a00c775206

Humio can now poll and ingest data from the Falcon platform's Falcon Data Replicator(FDR) service. This feature can be used as an alternative to the standalone fdr2humio project. See the Ingesting FDR Data for more information.

Improvements, new features and functionality

  • UI Changes

    • Added a quick-fix to convert non-ASCII quotes to ASCII quotes in the search field.

    • When changing focus inside a dialog with the keyboard, the focus will no longer move outside the dialog while it is open.

    • Visually hidden clipboard field is now hidden for assistive technologies/keyboard users.

    • Hover information in the search field is shown despite an overlapping warning.

    • The bar and pie charts now support holding the SHIFT key to display unformatted numeric values.

    • First row entry in the statistics table on the repo page is now a table header and added hidden content to the empty table header in the new view page.

    • On the time, bar and pie charts you can hold the ALT/OPTION key to display long legend titles.

    • Added a quick-fix for unknown escape sequences in the search field.

    • Reworked the hover message layout and changed the hover information on text (in the search field).

    • The search page now has focus states on the Language Syntax, Event List Widget and Save As buttons.

    • The Cluster Nodes table has been redesigned to allow for easier overview and copying the version-number.

    • Better accessibility for queries panel. You can now tab to focus individual queries, and open a details panel. From here you can also access all actions in the details panel by tabbing.

    • Minor UX improvements (ie. accessibility) on the queries panel.

    • Added a warning for unknown escape sequences in the search field.

    • When using the table visualisation in dark mode, empty table cells are now clearly discernible.

    • Pop-ups and drop-downs will now close automatically when focus leaves them.

    • Hover over parameter names and arguments in the search field now includes the default value.

  • GraphQL API

    • Fixed a bug in the response from calling the installPackageFromZip graphql mutation. Previously the response type exposed a deprecated clientmutationid that could not be selected. Also now if form fields are missing they are properly reported in the response.

    • The PERMISSION_MODEL_MODE config option has been removed. All graphql related schema has also been removed.

    • Deprecates the ReadContents view action, in favor of ReadEvents. This also means ReadEvents has been undeprecated, as we have slightly changed how we consider read rights, and want the action names to match this.

  • Configuration

    • Reduce default value of INGESTQUEUE_COMPRESSION_LEVEL, the ingest queue compression level from 1 to 0. This reduces time spent compressing before inserting into the ingest queue by roughly 4x at the expense of a 10-20% increase in size required in Kafka for the ingest queue topic.

    • Added config IP_FILTER_RDNS for specifying what IP addresses can be queried using the rdns query function.

    • Added the config CORS_ALLOWED_ORIGINS a comma separated list for CORS allowed origins, default allows all origins.

    • Added new config NATIVE_FALLOCATE_SUPPORT (default true) to allow turning off the use of fallocate and ftruncate internally.

    • Added new config NATIVE_FADVICE_SUPPORT (default true) to allow turning off the use of fadvice internally.

    • When Kafka topic configuration is managed by Humio (default true) set max.message.bytes on the topics to the value of Config TOPIC_MAX_MESSAGE_BYTES, default is 8388608 (8 MB). Minimum value is 2 MB.

    • The Property inter.broker.protocol.version in kafka.properties now defaults to 2.4 if not specified. Users upgrading Kafka can either set inter.broker.protocol.version manually in kafka.properties, or pass DEFAULT_INTER_BROKER_PROTOCOL_VERSION as an environment variable to Docker when launching the container. Please follow Kafka's upgrade guidelines when upgrading a Kafka cluster to avoid data loss https://kafka.apache.org/documentation/#upgrade_3_1_0.

    • Added config IP_FILTER_RDNS_SERVER for specifying what DNS servers can be allowed in the rdns query function.

    • Fixed a bug where TLS_KEYSTORE_TYPE and TLS_TRUSTSTORE_TYPE would only recognize lower-case values.

    • Added config RDNS_DEFAULT_SERVER for specifying what DNS server is the default for the rdns query function.

    • Added new settings for how uploads to bucket storage are validated. In the case that validation with etags are not available, content length can be used instead.

  • Other

    • Improved the performance of deletes from global.

    • Fixed an issue where negated functions could lose their negation.

    • Fixed an issue where queries with tail() would behave in an unexpected manner when an event is focused.

    • Improved performance of FDRJob.

    • Added tombstoning to uploaded files, which helps with avoiding data loss.

    • Fixed an issue where users could be shown in-development feature on the client when running a local installation of Humio.

    • Fixed an issue where top(max) could throw an exception when given values large enough to be represented as positive infinity.

    • Warn at startup if CORES > AvailableProcessorCount as seen by the JVM.

    • Fixed an issue with epoch and offsets not always being stripped from segments.

    • Fixed a bug where the Add Column button on the Fields panel would do nothing

    • Fixed an issue where percentile() would crash on inputs larger than ~1.76e308.

    • For HTTP Event Collector (HEC) the input field sourcetype is now also stored in @sourcetype.

    • Fixed several issues where users could add invalid query filters via the Add filter context button after selecting text in the Event List.

    • LSP warnings don't crash queries any more.

    • Added a new system-level permission that allows changing usernames of users.

    • Improved off-heap memory handling. Humio now typically uses only 1 GB on systems with 32 vCPUs, down from typically 16 GB. This leaves more memory for other processes and page cache for data.

    • Fixed an issue where queries of the form #someTagField != someValue ... would sometimes produce incorrect results.

    • Fixed an issue where tail() could produce results inconsistent with other query functions, when used in a live query.

    • During Digest startup, abort fetching segments from other nodes if the assigned partition set changes while fetching.

    • Fixed a bug where providing a bad view/repository name when blocking queries would block the query in all views and repositories.

    • Published new versions of the Humio Kafka Docker containers for Kafka 3.1.0.

    • Do not run the Global snapshot consistency check on stateless ingest nodes.

    • Previously a package could be updated with another package with the same name and version, but with different content. This is no longer allowed, and any attempt do so will be rejected and fail.

    • During identity provider configuration, it's possible to fetch SAML configuration from an endpoint.

    • Fixed an ingest bug where under some circumstances we would reverse the order of events in a batch.

    • Fixed a compatibility issue with LogStash 7.16+ and 8.0.0 when using the Elasticsearch output plugin.

    • Ensure only a cluster leader that still holds cluster leadership can force digesters to release partition leadership. This could cause spurious reboots in clusters where leadership was under contention.

    • Upgrades the Kafka client to 3.1.0 from 2.8.1. 3.1.0 enables the idempotent producer by default, which implies acks=all. Clusters that set acks to a different number via EXTRA_KAFKA_CONFIGS_FILE should update their config to also specify enable.idempotence=false

    • Fixed a bug where the package marketplace would redirect to unsupported package versions on older Humio instances.

    • Allow cluster managers access to settings for personal sandboxes and to block and kill queries in them.

    • Ensure a digester can only acquire or release partition leadership if no other digester has leadership of that partition. This could cause spurious reboots if digester leadership became contended.

    • Fixed an issue where live queries would sometimes double-count parts of the historic data.

    • Fixed a bug in the Sankey chart such that it now updates on updated query results.

    • Fixed a compatibility issue with FileBeat 8.0.0.