Humio Server 1.37.0 Preview (2022-02-14)

VersionTypeRelease DateEnd of SupportUpgrades FromData MigrationConfig. Changes
JAR ChecksumValue
Docker ImageSHA256 Checksum

Humio can now poll and ingest data from the Falcon platform's Falcon Data Replicator (FDR) service. This feature can be used as an alternative to the standalone fdr2humio project. See the Ingesting FDR Data for more information.

Improvements, new features and functionality

  • UI Changes

    • Visually hidden clipboard field is now hidden for assistive technologies/keyboard users.

    • Added a quick-fix for unknown escape sequences in the search field.

    • First row entry in the statistics table on the repo page is now a table header and added hidden content to the empty table header in the new view page.

    • Added a quick-fix to convert non-ASCII quotes to ASCII quotes in the search field.

    • When changing focus inside a dialog with the keyboard, the focus will no longer move outside the dialog while it is open.

    • The bar and pie charts now support holding the SHIFT key to display unformatted numeric values.

    • Reworked the hover message layout and changed the hover information on text (in the search field).

    • Added a warning for unknown escape sequences in the search field.

    • The Cluster Nodes table has been redesigned to allow for easier overview and copying the version-number.

    • Hover over parameter names and arguments in the search field now includes the default value.

    • Hover information in the search field is shown despite an overlapping warning.

    • When using the table visualisation in dark mode, empty table cells are now clearly discernible.

    • The search page now has focus states on the Language Syntax, Event List Widget and Save As buttons.

    • Pop-ups and drop-downs will now close automatically when focus leaves them.

    • On the time, bar and pie charts you can hold the ALT/OPTION key to display long legend titles.

    • Minor UX improvements (ie. accessibility) on the queries panel.

    • Better accessibility for queries panel. You can now tab to focus individual queries, and open a details panel. From here you can also access all actions in the details panel by tabbing.

  • GraphQL API

    • Deprecates the ReadContents view action, in favor of ReadEvents. This also means ReadEvents has been undeprecated, as we have slightly changed how we consider read rights, and want the action names to match this.

    • Fixed a bug in the response from calling the installPackageFromZip graphql mutation. Previously the response type exposed a deprecated clientmutationid that could not be selected. Also now if form fields are missing they are properly reported in the response.

  • Configuration

    • When Kafka topic configuration is managed by Humio (default true) set max.message.bytes on the topics to the value of Config TOPIC_MAX_MESSAGE_BYTES, default is 8388608 (8 MB). Minimum value is 2 MB.

    • Added config RDNS_DEFAULT_SERVER for specifying what DNS server is the default for the rdns() query function.

    • Added the config CORS_ALLOWED_ORIGINS a comma separated list for CORS allowed origins, default allows all origins.

    • Added new settings for how uploads to bucket storage are validated. In the case that validation with etags are not available, content length can be used instead.

    • Reduce default value of INGESTQUEUE_COMPRESSION_LEVEL, the ingest queue compression level from 1 to 0. This reduces time spent compressing before inserting into the ingest queue by roughly 4x at the expense of a 10-20% increase in size required in Kafka for the ingest queue topic.

    • Added config IP_FILTER_RDNS_SERVER for specifying what DNS servers can be allowed in the rdns() query function.

    • The PERMISSION_MODEL_MODE configuration option has been removed. All graphql related schema has also been removed.

    • Added config IP_FILTER_RDNS for specifying what IP addresses can be queried using the rdns() query function.

    • The Property in now defaults to 2.4 if not specified. Users upgrading Kafka can either set manually in, or pass DEFAULT_INTER_BROKER_PROTOCOL_VERSION as an environment variable to Docker when launching the container. Please follow Kafka's upgrade guidelines when upgrading a Kafka cluster to avoid data loss

    • Fixed a bug where TLS_KEYSTORE_TYPE and TLS_TRUSTSTORE_TYPE would only recognize lower-case values.

  • Other

    • Ensure a digester can only acquire or release partition leadership if no other digester has leadership of that partition. This could cause spurious reboots if digester leadership became contended.

    • Ensure only a cluster leader that still holds cluster leadership can force digesters to release partition leadership. This could cause spurious reboots in clusters where leadership was under contention.

    • Added tombstoning to uploaded files, which helps with avoiding data loss.

    • Upgrades the Kafka client to 3.1.0 from 2.8.1. 3.1.0 enables the idempotent producer by default, which implies acks=all. Clusters that set acks to a different number via EXTRA_KAFKA_CONFIGS_FILE should update their config to also specify enable.idempotence=false

    • Published new versions of the Humio Kafka Docker containers for Kafka 3.1.0.

    • Allow cluster managers access to settings for personal sandboxes and to block and kill queries in them.

    • Improve the performance of deletes from global.

    • During Digest startup, abort fetching segments from other nodes if the assigned partition set changes while fetching.

    • Do not run the Global snapshot consistency check on stateless ingest nodes.

    • During identity provider configuration, it's possible to fetch SAML configuration from an endpoint.

Bug Fixes

  • UI Changes

    • Fixed a bug where providing a bad view/repository name when blocking queries would block the query in all views and repositories.

    • Fixed an issue where live queries would sometimes double-count parts of the historic data.

    • Fixed an issue where queries of the form #someTagField != someValue ... would sometimes produce incorrect results.

    • Fixed an issue where percentile() would crash on inputs larger than ~1.76e308.

    • Fixes an issue with epoch and offsets not always being stripped from segments.

    • Fixed an issue where queries with tail() would behave in an unexpected manner when an event is focused.

    • For HTTP Event Collector (HEC) the input field sourcetype is now also stored in @sourcetype.

    • Fixed a bug in the Sankey chart such that it now updates on updated query results.

    • Fixed an issue where tail() could produce results inconsistent with other query functions, when used in a live query.

    • Fixed a compatibility issue with FileBeat 8.0.0.

    • Previously a package could be updated with another package with the same name and version, but with different content. This is no longer allowed, and any attempt do so will be rejected and fail.

    • Warn at startup if CORES > AvailableProcessorCount as seen by the JVM.

    • Fixed several issues where users could add invalid query filters via the Add filter context button after selecting text in the Event List.

    • Fixed a compatibility issue with LogStash 7.16+ and 8.0.0 when using the Elasticsearch output plugin.

    • Fixed a bug where the Add Column button on the Fields panel would do nothing

    • LSP warnings don't crash queries any more.

    • Fixed a bug where the Package Marketplace would redirect to unsupported package versions on older Humio instances.

    • Fixed an issue where negated functions could lose their negation.

    • Fixed an issue where top(max) could throw an exception when given values large enough to be represented as positive infinity.