Full Release Notes Index
This section contains a single page with all release notes on the same page.
Humio Server 1.50.0 Stable (2022-08-02)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.50.0 | Stable | 2022-08-02 | 2023-08-02 | 1.30.0 | No | No |
Bug fixes and an updated dependency, released to cloud only.
Improvements, new features and functionality
Summary
Streaming queries that fail to validate now return a message of why validation failed.
Added validation to the 'field' and 'key parameters of the 'join' function, so empty lists will be rejected with a meaningful error message.
Improved the phrasing of the warning shown when groupBy exceeds the max or default limit.
Added validation to the 'field' parameter of the 'top' function, so empty lists will be rejected with a meaningful error message.
Fixed an issue where query auto-completion sometimes wouldn't show the documentation for the suggested functions.
Added validation to the 'field' parameter of the 'kvParse' function, so empty lists will be rejected with a meaningful error message.
Humio now logs digest partition assignments regularly. The logs can be found using the query "class=*DigestLeadershipLoggerJob*".
UI Changes
When editing an email action in the UI and adding multiple recipients, it is now possible to add a space after the comma in the comma-separated list of recipients.
The design of the timeselector has been updated, and it now features an "Apply" button on the dashboard page
Adds an icon and a hint to a disabled side navigation menu item that tells the user the reason for it being disabled.
Dashboards and Widgets
Dashboards can now be configured to not update after the initial search has completed. This mode is mainly meant to be used when a dashboard is interactive and not for wall-mounted monitors that should update continually. The feature can be accessed from the Dashboard Property panel when a dashboard is put in edit-mode.
GraphQL API
The GQL API mutation `updateDashboard` has been updated to take a new argument `updateFrequency` which can currently only be `NEVER` or `REALTIME`, which correspond respectively to "dashboard where queries are never updated after first completion" and "dashboard where query results are updated indefinitely.
Documentation
All documentation links have been updated after the documentation site has been restructured. Please contact support, if you experience any broken links.
Other
Added a new action type that creates a CSV file from the query result and uploads it to Humio to be used with the
match()
query function. See Upload File
Bug Fixes
Summary
Fix the `assets` GraphQL query in organizations with views that are not 1-to-1 linked
Fixed an issue where event forwarding still showed as beta
Fix performance issue for users with access to many views
Fixed an issue where query auto-completion would sometimes delete existing parentheses.
Fix an issue that could rarely cause exceptions to be thrown from Segments.originalBytesWritten, causing noise in the log.
Fixed an issue where JSON parsing on ingest and in the query language was inefficient for large JSON objects.
Fix an issue causing Humio to create a large number of temporary directories in the data directory.
Fixed an issue where validation of "+/- Infinity" as integer arguments would crash
Functions
Fixed an issue where `join()` would not produce the correct results when `mode=left` was set.
Humio Server 1.49.1 Stable (2022-07-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.49.1 | Stable | 2022-07-26 | 2023-07-26 | 1.30.0 | No | No |
Bug fixes and an updated dependency, released to cloud only.
Deprecation
These items have been deprecated and may be removed in a future release:
The deprecated REST API for parsers has been removed
Improvements, new features and functionality
Summary
The Save As... button is now always displayed on the Search Page
Make BucketStorageUploadJob only log at info level rather than error if a segment upload fails because the segment has been removed from the host. This can happen if node X tries to upload a segment, but node Y beats it to the punch. Node X may then choose to remove its copy before the upload completes.
The 'groupBy' function now accepts 'max' as value for the 'limit' parameter, which sets the limit to the largest allowed value (as configured by the dynamic configuration 'GroupMaxLimit')
Parser installation will now be ignored when installing a package into a system repository.
Java in the docker images no longer has the `cap_net_bind_service` capability and thus Humio cannot bind directly to privileged ports when running as a non-root user.
Fixed a bug where an alert with name longer than 50 characters could not be edited.
Fix an unhandled IO exception from TempDirUsageJob. The consequence of the uncaught exception was only noise in the error log.
Bug Fixes
Summary
Fixed an issue where strings like Nana and Information could be interpreted as NaN (not-a-number) and infinity, respectively.
Fix a bug that could cause a NumberFormatException to be thrown from ZookeeperStatsClient.
Revised some of the error messages and warnings regarding `join` and `selfJoin`.
Fixed an issue where some warnings would show twice.
Humio Server 1.49.0 Not Released (2022-07-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.49.0 | Not Released | 2022-07-26 | 2023-07-26 | 1.30.0 | No | No |
Not released.
Humio Server 1.48.1 Stable (2022-07-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.48.1 | Stable | 2022-07-19 | 2023-07-19 | 1.30.0 | No | No |
Bug fixes and an updated dependency, released to cloud only.
Deprecation
These items have been deprecated and may be removed in a future release:
Remove the following feature flags and their usage: EnterpriseLogin, OidcDynamicIdpProviders, UsagePage, RequestToActivity, CommunityNewDemoData.
Deprecated "enabledFeatures" query. Use new "featureFlags" query instead.
Improvements, new features and functionality
Summary
Add flag whether a feature is experimental.
Added detection and handling of all queries being blocked during Humio upgrades
Include the requester in logs from QuerySessions when a live query is restarted or cancelled
All feature flags now contains a textual description about what features are hidden behind the flag.
The Live checkbox is now no longer checked automatically when changing the value of the time window in the time selector
UI Changes
Updated styling on the log in pages
Add missing accessibility features to the login page.
GraphQL API
Expose a new GraphQL type with feature flag descriptions and whether they are experimental.
Bug Fixes
Summary
Fixes the placement of a confirmation dialog when attempting to change retention
Fix response entities not being discarded in error cases for the "proxyqueryjobs" endpoint, which could cause warnings in the log.
When viewing the events behind e.g. a time chart, the events will now only display with the `@timestamp` and `@rawstring` columns.
UI Changes
The theme toggle on a shared dashboard was moved to the header panel and no longer overlaps with any widgets.
Humio Server 1.48.0 Not Released (2022-07-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.48.0 | Not Released | 2022-07-19 | 2023-07-19 | 1.30.0 | No | No |
Not released.
Humio Server 1.47.1 Stable (2022-07-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.47.1 | Stable | 2022-07-12 | 2023-07-12 | 1.30.0 | No | No |
Bug fixes and an updated dependency, released to cloud only.
Improvements, new features and functionality
Summary
The referrer meta tag for humio has been changed from no-referrer to same-origin.
Table widgets will now break lines for newline characters in columns.
Fix a bug that could cause Humio to spuriously log errors warning about segments not being merged for datasources doing backfilling.
Introduced new dynamic configuration 'JoinRowLimit'. It can be set using graphQL. 'JoinRowLimit' can be used as an alternative to the environment variable 'MAX_JOIN_LIMIT'. If the 'JoinRowLimit' is set, then its value will be used instead of 'MAX_JOIN_LIMIT'. If it is not set, then 'MAX_JOIN_LIMIT' will be used.
Introduced new dynamic configuration 'LiveQueryMemoryLimit'. It can be set using graphQL. 'LiveQueryMemoryLimit' determines how much memory in bytes a live query can consume during its execution. For non-live queries, their memory limit is determined by the 'QueryMemoryLimit', which is 100MB by default. By default 'LiveQueryMemoryLimit' the same value as 'QueryMemoryLimit'.
All users will not have access to the audit log or search all view by default anymore. Access can be granted with permissions.
Introduced new dynamic configuration 'QueryMemoryLimit'. It can be set using graphQL. 'QueryMemoryLimit' determines how much memory in bytes a static query can consume during its execution. 'QueryMemoryLimit' replaces the environment variable 'MAX_MEMORY_FOR_REDUCE', so if you have changed the value of 'MAX_MEMORY_FOR_REDUCE', please use 'QueryMemoryLimit' now instead. 'QueryMemoryLimit' defaults to 100MB. See also 'LiveQueryMemoryLimit' for live queries.
Added a new dynamic configuration
GroupDefaultLimit
which sets the default value for the 'limit' parameter ofgroupBy()
,selfJoin()
and some other functions. Previously the environment variableMAX_STATE_LIMIT
was used to determine the default value. This can be done through GraphQL.GroupDefaultLimit
has a default value of either 20000 or the value of the configGroupMaxLimit
, whichever is smallest. 'GroupDefaultLimit' cannot be larger thanGroupMaxLimit
. If you've changed the value ofMAX_STATE_LIMIT
, we recommend that you also changeGroupDefaultLimit
andGroupMaxLimit
to the same value for a seamless upgrade.Introduced new dynamic configuration 'StateRowLimit'. It can be set using graphQL. 'StateRowLimit' can be used as an alternative to the environment variable 'MAX_STATE_LIMIT'. If 'StateRowLimit' is set, then its value will be used instead of 'MAX_STATE_LIMIT'. If it is not set, then 'MAX_STATE_LIMIT' will be used.
Introduced new dynamic configuration 'GroupMaxLimit'. It can be set using graphQL. The 'GroupMaxLimit' sets the maximum value of the 'limit' parameter for groupBy. Previously, this parameter was bounded by 'MAX_STATE_SIZE', so if you have made any modifications to 'MAX_STATE_SIZE', please set 'GroupMaxLimit' to the same value for a seamless upgrade. The default value of 'GroupMaxLimit' is 200000.
Added a new dynamic config flag 'QueryResultRowCountLimit' that globally limits how many results (events) a query can return. The default value is either 100000 or the value of the flag 'StateRowLimit', whichever is largest. This flag can be set by administrators through graphQL.
UI Changes
Applied stylistic changes for the Inspector Panel used in Widget Editor.
If Humio fails to start because the cluster is being upgraded a dedicated message will show when launching the UI.
GraphQL API
Added preview fields isClusterBeingUpdated and minimumNodeVersion to the GraphQL Cluster object type.
Configuration
Support for KMS on S3 bucket for Bucket Storage. Specify full ARN of the key. The key_id is persisted in the internal BucketEntity so that a later change of the ID of the key to use for uploads will make Humio still refer the old keyID when downloading files uploaded using the previous key. Setting a new value for the target key results in a fresh internal bucket entity to track which files used kms and which did not. For simplicity it is recommended to not mix KMS and non-KMS configs on the same S3 bucket.
New configuration variable
S3_STORAGE_KMS_KEY_ARN
that specifies the KMS key to use.New configuration variable
S3_STORAGE_2_KMS_KEY_ARN
for 2nd bucket key.New configuration variable
S3_RECOVER_FROM_KMS_KEY_ARN
for recovery bucket key.
FDR polling is now turned on by default. Whether FDR polling should be turned on or off on a node can be configured using the
ENABLE_FDR_POLLING_ON_NODE
config variable.New configurations
BUCKET_STORAGE_SSE_COMPATIBLE
that makes bucket storage not verify checksums of raw objects after uploading to an S3. This option is turned on automatically is KMS is enabled (seeS3_STORAGE_KMS_KEY_ARN
) but is available directly here for use with other S3 compatible providers where verfying even content length does not work.Mini segments usually get merged if their event timestamps span more than
MAX_HOURS_SEGMENT_OPEN
. Mini segments created as part of backfilling did not follow this rule, but will now get merged if their ingest timestamps span more thanMAX_HOURS_SEGMENT_OPEN
.
Other
Compute next set of Prometheus metrics only in a single thread concurrently. If more requests arrive, then the next request gets the previous response.
The audit log system repository on cloud has been replaced with a view, so that dashboards etc. can be created on top of audit log data.
Improved performance of validation of keys in tags.
Bug Fixes
Summary
Fix type in "Unregisters node" text on cluster admin UI.
Functions
Fixed a bug where using
eval
as an argument to a function would result in a confusing error message.
Humio Server 1.47.0 Not Released (2022-07-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.47.0 | Not Released | 2022-07-12 | 2023-07-12 | 1.30.0 | No | No |
Not released.
Humio Server 1.46.0 Stable (2022-07-05)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.46.0 | Stable | 2022-07-05 | 2023-07-05 | 1.30.0 | No | No |
Bug fixes and an updated dependency, released to cloud only.
Improvements, new features and functionality
Summary
When unregistering a node from a cluster, return a validation error if it is still alive. Hosts should be shut down before attempting to remove them from the cluster. This validation can be skipped using the same accept-data-loss parameter that also disables other validations for the unregistration endpoint.
UI Changes
New styling of errors on search and dashboard pages.
In lists of users, with user avatars containing user initials, the current user would sometimes appear to have an opening parenthesis as their last initial.
Dashboards and Widgets
Introducing the Heat Map Widget that visualizes aggregated data as a colorised grid.
Sorting of Pie Chart Widget categories, descending by value. Categories grouped as
Others
will always be last.Better handling of dashboard connections issues during restarts and upgrades
Added empty states for all widget types that will be rendered when there are no results.
GraphQL API
Improved error messaging of GraphQL queries and mutations for alerts, scheduled searches and actions in cases where a given repository or view cannot be found.
Other
Remove remains of default groups and roles. The concept was replaced with UserRoles.
Fix a bug causing Humio's digest coordinator to allow nodes to take over digest without catching up to the current leader. This could cause the new leader to replay more data from Kafka than necessary.
Make a number of improvements to the digest partition coordinator. The coordinator now tries harder to avoid assigning digest to nodes that are not caught up on fetching segments from the other nodes. It also does a better job unassigning digest from dead nodes in edge cases.
Bug Fixes
UI Changes
The widget legend column width is now based on the custom series title (if specified) instead of the original series name.
Intermediate network issues are not reported immediately as an error in the UI.
Configuration
Fixed a bug that could result in merging small ("undersized") segments even if the resulting segment would then have a wider than desired time span. The goal it to not produce segments that span more than the 10% of the retention setting for time for the repository. If no time-based retention is configured on the repository, then 3 times the value of configuration variable
MAX_HOURS_SEGMENT_OPEN
is applied as limit. For default settings that results in 72 hours.
Functions
Fixed a bug where the
writeJson()
function would write any field starting with a case-insensitiveinf
orinfinity
prefix as a null value in the resulting JSON.
Other
FDR Ingest will no longer fail on events that are larger than the maximum allowed event size. Instead, such messages will be truncated.
Upgrade Kafka to 3.2.0 in the docker images, and in the Humio dependencies.
Humio Server 1.45.0 Stable (2022-06-28)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.45.0 | Stable | 2022-06-28 | 2023-06-28 | 1.30.0 | No | No |
Bug fixes and an updated dependency, released to cloud only.
Improvements, new features and functionality
Dashboards and Widgets
The Pie Chart Widget now uses the first column for the series as a fall back option.
The Bar Chart Widget now works with bucket query results.
Default background color is now
Auto
.Introduced the text color configuration option.
Configuration
Adds a new metric for measuring the merge latency, which is defined as the latency between the last minisegment being written in a sequence with the same merge target, and those minisegments being merged. The metric name is
segment-merge-latency-ms
.Adds a new logger job that logs the age of an unmerged miniSegment if the age exceeds the threshold set by the env variable
MINI_SEGMENT_MAX_MERGE_DELAY_MS_BEFORE_WARNING
. The default value ofMINI_SEGMENT_MAX_MERGE_DELAY_MS_BEFORE_WARNING
is 2 xMAX_HOURS_SEGMENT_OPEN
. MAX_HOURS_SEGMENT_OPEN defaults to 24 hours. The error log produced looks like:Oldest unmerged miniSegment is older than the threshold thresholdMs={value} miniSegmentAgeMs={value} segment={value}
.
Other
Bump the version of the Monaco code editor.
Added a log message with the maximum state size seen by the live part of live queries.
Bug Fixes
UI Changes
Websocket connections are now kept open when transitioning pages, and are used more efficiently for syntax highlighting.
Fix the dropdown menus closing too early on the home page.
Dashboards and Widgets
The Time Chart Widget regression line is no longer affected by the interpolation setting.
Other
Fix a bug causing digesters to continue digesting even if the local disk is full. The digester will now pause digesting and error log if this occurs.
Some errors messages wrongly pointed to the beginning of the query.
Bump woodstox to address SNYK-JAVA-COMFASTERXMLWOODSTOX-2928754.
Make streaming queries search segments newest-to-oldest rather than oldest-to-newest. Streaming queries do not ensure the order of exported events anyway, and searching newest-to-oldest is more efficient.
Humio Server 1.44.0 Stable (2022-06-21)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.44.0 | Stable | 2022-06-21 | 2023-06-21 | 1.30.0 | No | No |
Bug fixes and an updated dependency, released to cloud only.
Deprecation
These items have been deprecated and may be removed in a future release:
The deprecated REST API for actions has been removed, except for the endpoint for testing an action.
Improvements, new features and functionality
UI Changes
Improved keyboard accessibility for creating repositories and views.
The toggle switch is now tabbable and can be accessed using the keyboard.
Dashboards and Widgets
The Y-axis can now start at smaller values than 1 for logarithmic scales, when the data contain small enough values.
It now has an
Auto
setting for the Input Data Format property, see Wide or Long Input Format for details.Now works with bucket query results.
The dashboards page now displays the current cluster status.
Missing buckets are now shown as gaps on the sparkline.
Isolated data points are now visualised as dots on the sparkline.
The
Normalize
option for the World Map Widget has been replaced by a third magnitude mode namedNone
, which results in fixed size and opacity for all marks.
GraphQL API
Introduced new dynamic configuration flag
join-row-limit
. It can be set using graphQL. The flag can be used as an alternative to the environment variableMAX_JOIN_LIMIT
. If thejoin-row-limit
flag is set, then its value will be used instead ofMAX_JOIN_LIMIT
. If it is not set, thenMAX_JOIN_LIMIT
will be used.Introduced new dynamic configuration flags
query-memory-limit
. It can be set using graphQL. The flag replaces the environment variableMAX_MEMORY_FOR_REDUCE
, so if you have changed the value ofMAX_MEMORY_FOR_REDUCE
, please usequery-memory-limit
now instead.query-memory-limit
defaults to the maximum signed integer value.Introduced new dynamic configuration flag
state-row-limit
. It can be set using graphQL. The flag can be used as an alternative to the environment variableMAX_STATE_LIMIT
. Ifstate-row-limit
is set, then its value will be used instead ofMAX_STATE_LIMIT
. If it is not set, thenMAX_STATE_LIMIT
will be used.
Configuration
Default value of configuration variable
S3_ARCHIVING_WORKERCOUNT
raised from1
to(vCPU/4)
.Added a new environment variable
GROUPBY_DEFAULT_LIMIT
which sets the default value for thelimit
parameter ofgroupBy()
. SeegroupBy()
documentation for details.Added a link to humio-activity repository for debugging IDP configurations to the page for setting up the same.
Log Collector
The Log Collector download page has been enabled for on-prem deployments.
Other
Adds a logger job for cluster management stats it log the stats every 2 minutes, which makes them searchable in Humio.
The logs belong to the class
c.h.c.ClusterManagementStatsLoggerJob
, logs for all segments containsglobalSegmentStats
log about singular segments starts with segmentStats.Add warning when a multitenancy user is changing data retention on an unlimited repository.
Added a log of the approximate query result size before transmission to the frontend, captured by the
approximateResultBeforeSerialization
key.Adds a new metric for the temp disk usage. The metric name is
temp-disk-usage-bytes
and denotes how many bytes are used.Improved performance of NDJSON format in S3 Archiving.
Bug Fixes
Other
Fix a bug where changing a role for a user under a repository would trigger infinite network requests.
Fix an issue causing the event forwarding feature to incorrectly reject topic names that contained a dash
(-)
.Fixed a bug where multiline comments weren't always highlighted correctly.
Improve file path handling in DiskSpaceJob to eliminate edge cases where the job might not have been able to tell if a file was on primary or secondary storage.
If a segment is deleted or otherwise disappears from global while Humio is attempting to upload it to bucket storage, the upload will now be dropped with an info-level log, rather than requeued with an error log.
Update
org.json:json
to address a vulnerability that could cause stack overflows.Bump javax.el to address CVE-2021-28170.
Update Netty to address CVE-2022-24823.
Humio Server 1.42.1 Stable (2022-07-18)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.42.1 | Stable | 2022-07-18 | 2023-06-17 | 1.30.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 0d84ae2bac065c74f033b3f510812cf6 |
SHA1 | aa21f410e29c6189b56526c42d4414398544f3e3 |
SHA256 | 6b59d546a2f271d499b857b290f6c283b90282a5d9a213bc037652367f258c4d |
SHA512 | 688242a795f9526828841faabc34e59e048439a1c748842d0a0fdf8eb8dffa99ce2f5281fa1c067dbbbac3db0494af006f46d3917de4f85c73372d536a102d97 |
JAR Checksum | Value |
---|---|
humio-core-dev | 14ec97ed7bf950b0e0669627babebfb3e5ca67b38cc40d116254567ee4e9199d |
humio-dev | d83d0ea9247637ce91d2b84123659858624fe329583e1c6fe6900bd4eaa4acae |
kafka-dev | e9a4ee28381265a1b80071257996003a9bea0e29234a6394477d8859cb546e68 |
zookeeper-dev | b377e734d662fe80b4dbc6b355965694464e437a2e0855272b9652ac9225b050 |
Bug fixes and an updated dependency.
Improvements, new features and functionality
UI Changes
The Search Page.
button is now always displayed on the
Bug Fixes
Summary
Updated dependencies to woodstox to fix a vulnerability.
Other
Compute next set of Prometheus metrics only in a single thread concurrently. If more requests arrive, then the next request gets the previous response.
Humio Server 1.42.0 Stable (2022-06-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.42.0 | Stable | 2022-06-17 | 2023-06-17 | 1.30.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 6f0306d98c1f4931a083fe9211841ea1 |
SHA1 | afee8f0c7c705b0c6b54c5a3321cf7ed6bbfc6f2 |
SHA256 | 0167bd6ae46368db74434133b9881380fd6c389c9ea35ac5612d9a643366d3ac |
SHA512 | e66acd012641e19d6c8c7613a56302c66138902912eb3aaa2157fef4199b6e77b20367be49bd90f2b430573b6317bd7214600436edfaf52cbffc108c0c414fd6 |
JAR Checksum | Value |
---|---|
humio-core-dev | 958fc373d5cf0da75861981cbf6fb3cead3c41388480d72b4bb7ad85734bc0cd |
humio-dev | 37cb34cccd8e0b749308f96bc49cd67c92ca6af537e5c01cec0ecf4d26d2712f |
kafka-dev | aea9942f9b789b058984dc348fa91657c8be210ad9d6f85ed8e0fdd6f09e408d |
zookeeper-dev | d52cd8f48f55cf09db7426a746b536face085b8b919ed1cdc1ce57f7e74d450e |
Deprecation
These items have been deprecated and may be removed in a future release:
The local disk based backup feature described at Making Back-Ups is deprecated, and is planned for removal in September 2022. We have found that restoring backups using this feature is difficult in practice, it is not commonly used, and the backup/restore functionality is covered by the bucket storage feature as well. For these reasons, we are deprecating this feature in favour of bucket storage.
The
DELETE_BACKUP_AFTER_MILLIS
configuration parameter, which controls the delay between data being deleted in Humio and removed from backup, will be retained, since it controls a similar delay for bucket storage. Customers using local disk based backups should migrate to using bucket storage instead. Systems not wishing to use a cloud bucket storage solution can keep backup support by instead installing an on-prem S3- or GCS-compatible solution, such as MinIO.
Improvements, new features and functionality
UI Changes
Both the Scatter Chart and the Bar Chart widgets now support automatically adding/toggling axis and legend titles based on the mapped data.
The Format Panel is now available for changing the style of the data displayed in the Event list — see Changing the Data Display.
The Fields Panel now enables you to fetch fields beyond those from the last 200 events — see Adding and Removing Fields.
Dashboards and Widgets
The Single Value widget is now available. Construct a query which returns any single value, or use the
timeChart()
query function to create a Single Value widget instance with sparkline and trend indicator.The Gauge widget is being deprecated in favour of the Single Value widget. Configurations of the Gauge widget are compatible with the Single Value widget. This means that persisted configurations of the Gauge widget (url / dashboard widgets / saved queries / recent queries) are still valid, but are visualised using the Single Value widget instead.
Configuration
Improve the error message if Humio is configured to use bucket storage, but the credentials for the bucket are not configured.
The Feature Flag, CookieAuthServerSide, has been deprecated as cookie authentication is now enabled by default. Instead, the configuration field
ENABLE_BEARER_TOKEN_AUTHORIZATION
has been introduced.
Log Collector
The Humio Log Collector can now be downloaded from the Organizational Settings page, see the Log Collector Documentation for a complete list of the supported logs formats and operating systems.
Functions
ioc:lookup()
would sometimes give incorrect results when negated.worldmap()
will warn about licensing issues with IP database.worldmap()
accepts more magnitude functions, including percentile and anonymous functions.sankey()
now accepts more weight functions such as anonymous functions and percentile.
Other
Added the
fdr-message-count
metric, which contains the approximate number of messages on an FDR feed's SQS queue.Added the
fdr-invisible-message-count
metric, which contains the approximate number of invisible messages on an FDR feed's SQS queue.When cleaning up a deleted data space, don't error log if two nodes race to delete the data space metadata from global.
Fixed an issue where Humio's Zookeeper monitoring page would show X/0 followers in sync.
Improved error logging, when an FDR feed fails to download data from an S3 bucket. It now clearly states when a download failed because the S3 bucket is located in a different region than the SQS queue.
Ensured that errors during view tombstone removal are logged and don't prevent the RetentionJob from performing other cleanup tasks.
Logging to the humio-activity repository is now also done for events in sandbox repositories.
Fixed an issue that if download of IOCs took more than an hour, Humio would indefinitely start a new download every hour which would eventually fail.
Specifying a versionless packageId will load the newest version of that package.
Email actions can now add the result set as a
CSV
attachment.Fixed an underlying bug causing
addToExistingJob did not find the existing job
to be error logged unnecessarily. Humio may decide to fetch a segment from bucket storage for querying. If this decision is made right as the query is cancelled, Humio could log the message above. With this fix, Humio will instead skip downloading the segment, and not log the error.Fixed an issue where a scheduled search could trigger actions multiple times for the same time period if actions took a long time to finish.
Humio Server 1.40.0 Stable (2022-05-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.40.0 | Stable | 2022-05-12 | 2023-05-12 | 1.30.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 8a733e1201103eeef32e63b0bf4c8977 |
SHA1 | 5b217fb48f1b5684330ec70fc5d20d322b0a75f8 |
SHA256 | 8838d422459feb6a56d1f15578c581fec7983165635fb4e74f312c2cc4da8046 |
SHA512 | 94bb617a37475918313decc3bf56696890c90d3e3f91de78dccb9431fee0b1bba8d90f60f0d591f5acbea7c6e09c5cb57ddf95fba088a34efc92a0899ac4aef9 |
JAR Checksum | Value |
---|---|
humio-core-dev | 9326081840d3f852df54702c9d5e72ea492d49c55aab51ed83b1b234439c4ec7 |
humio-dev | 7c9b77b32fc84e31ecc57461ae3e8bfac9b584fb6fb3af0b909bd7e05903d0d8 |
kafka-dev | 344a06f56ada7ea9af2c7c5d146fa07f6fda87be750a7283e6f753189b42a0b5 |
zookeeper-dev | 42cdbca9d0ce73516a27beda618390a40db3e086580ce3d6ab2779c1952980ee |
1.40 REQUIRES minimum version 1.30.0 of Humio to start. Clusters
wishing to upgrade from older versions must upgrade to 1.30.0+
first. After running 1.40.0 or later, you cannot run versions
prior to 1.30.0. Breaking change: the
selfJoin()
query function was observed to
cause memory problems, so we have set a limit of .0.0 output
events (there was previously no bound). This limit can be
adjusted with the GraphQL mutation setDynamicConfig with config
flag SelfJoinLimit. A value of -1
returns
selfJoin
to its old, unbounded version.
Improvements, new features and functionality
UI Changes
It is now possible to test an FDR feed in the UI, which will test that Humio can connect to the SQS queue and the S3 bucket.
Events with JSON data can now be collapsed and expanded in the Json panel.
Syntax highlighting for XML, JSON and accesslog data now uses more distinguishable colors.
Improvements to the Sankey Diagram widget, it now has multiple style options; show/hide the y-axis, sorting type, label position, and colors plus labels for series.
Added style options to either truncate or show full legend labels in widgets.
Improvements to the Pie Chart widget, it now has a max series setting similar to the time chart widget.
Introducing the new Scatter Chart (previously known as XY):
It supports long data format (one field for the series name and one field for the y values) as well as wide format (one field per series value).
You can now visualize data in the Scatter chart when queried with the
timeChart()
,bucket()
andgroupBy()
functions, as well as thetable()
function like before.
The widget dropdown can now be navigated with the keyboard.
Keep empty lines in queries when exporting assets as templates or to packages.
The
@timestamp
column is now allowed to be moved amongst the other columns in the event list.When using a widget that is not compatible with the current data, the
button now works again.
Dashboards and Widgets
Improvements to the Bar Chart widget:
Added style options to name the x and y axis.
Added option for interpreting the resulting query data as either wide or long format data.
Added option to set a max label length for the x-axis, instead of the bottom padding option. With auto-padding and this style option, it is easier to fit the wanted information in the view.
It is now possible to configure bar charts to have a logarithmic y axis.
Introduced the stacked bar charts option.
It no longer has an artificial minimum height for bars, as this may distort at a glance interpretations of the chart.
It no longer has sorting by default, which means that the order will be identical to the query result. You can now sort the x axis of the bar chart by using the
sort()
query function, if sort by series in the style options is not set.It now has a max series setting similar to the time chart widget.
Improvements to the Time Chart Widget widget:
It now has an option to show the underlying data points, which makes it possible to inspect the behaviour of the different interpolation methods.
Trend lines can now be added in the chart.
Introducing the Single Value Widget widget. Construct a query which returns any single value, or use the
timeChart()
query function to create a Single Value widget instance with sparkline and trend indicator.
GraphQL API
Removed the following deprecated GraphQL fields:
UserSettings.settings
,UserSettings.isEventListOrderChangedMessageDismissed
, andUserSettings.isNewRepoHelpDismissed
.Added a new GraphQL mutation to rename views or repositories by id.
Marked experimental language features as preview in GraphQL API.
The GraphQL queries and mutations for FDR feeds are no longer in preview.
It is now possible to refer a parser by name when creating an ingest token or assigning a parser to an existing ingest token using the GraphQL API mutations
addIngestTokenV3
andassignParserToIngestTokenV2
. The old mutationsaddIngestTokenV2
andassignParserToIngestToken
have been deprecated.Added two new organization level permissions:
DeleteAllRepositories
andDeleteAllViews
that allow repository and view deletion, respectively, inside an organization.Added a GraphQL mutation
deleteSearchDomainById
that deletes views or repositories by ID.Removed the deprecated
clientMutationId
argument from the GraphQL mutationupdateSettings
.Changed permission token related GraphQL endpoints to use enumerations instead of strings.
It is now possible to refer a parser by name when creating or updating an ingest listener using the GraphQL API mutations
createIngestListenerV3
andupdateIngestListenerV3
. It is now also possible to change the repository on an ingest listener usingupdateIngestListenerV3
. The old mutationscreateIngestListenerV2
andupdateIngestListenerV2
have been deprecated.
Configuration
Using the dynamic configuration option
FdrEnable
, administrators can now turn FDR polling on/off on the entire cluster with a single update. Defaults tofalse
.The static configuration variable
ENABLE_FDR_POLLING_ON_NODE
is no longer supported, as its functionality has been replaced with the dynamic configurations listed above.Added a new configuration variable
BUCKET_STORAGE_TRUST_POLICY
for the dual-bucket use case. This setting configures which bucket is considered the "trusted" bucket when two buckets are configured, which impacts when Humio considers data to be safely replicated. Supported values arePrimary
for trusting the primary bucket,Secondary
for trusting the secondary bucket,TrustEither
for considering data safely replicated if it is in either bucket, andRequireBoth
for considering data safely replicated only if it is in both buckets. This config replaces theBUCKET_STORAGE_2_TRUSTED
configuration,true
in the old configuration equates toSecondary
in the new configuration. The default value of the new configuration isSecondary
.Using the dynamic configuration option
FdrMaxNodes
, administrators can put a cap on how many nodes should at most simultaneously poll data from the same FDR feed. Defaults to 5 nodes.Validate block CRCs before uploading segment files to bucket storage. Can be disabled by setting
VALIDATE_BLOCK_CRCS_BEFORE_UPLOAD
tofalse
.Using the dynamic configuration option
FdrExcludedNodes
, administrators can now exclude specific nodes from polling from FDR. Defaults to the empty list, so all nodes will be used for polling.Added a new config
NATIVE_FALLOCATE_SUPPORT
(defaulttrue
) to allow turning off the use offallocate
andftruncate
internally.Require that
{S3/GCS}_STORAGE
config must be set before{S3/GCS}_STORAGE_2
is set.Introduced dynamic configuration options for changing FDR polling behaviour at runtime. FDR polling is not enabled by default, so you should take care to set up these new configurations after upgrading, or you will risk that your FDR data isn't ingested into Humio before it is deleted from Falcon.
Amended how Humio chooses segments to download from bucket storage when prefetching. If
S3_STORAGE_PREFERRED_COPY_SOURCE
isfalse
, the prefetcher will only download segments that are not already on another host. Otherwise, it will download as many hosts as necessary to follow the configured replication factor. This should help avoid excessive bucket downloads when nodes in the cluster have lots of empty disk space.Added a new config
NATIVE_FADVICE_SUPPORT
(defaulttrue
) to allow turning off the use offadvice
internally.
Other
Adding and removing queries from the query blocklist is now audit logged as two separate audit log event types,
query-blocklist-add
andquery-blocklist-remove
, rather than the single event typeblocklist
.Added a new system-level permission allowing changing the user name of a user.
Create, update and delete operations on ingest listeners are now always audit logged. Previously, they were only logged when performed through the REST API. Also, the audit log format has been updated to be similar to the format of other assets. Look for events with the
type
field set toingestlistener.create
,ingestlistener.update
, andingestlistener.delete
.Renamed the Humio tarball distribution to
humio-1.39.0.tar.gz
instead ofhumio-release-1.39.0.tar.gz
. The file now contains a directory namedhumio-1.39.0
instead ofhumio-release-1.39.0
.The REST API for ingest listeners has been deprecated.
Fixed an ingest bug where, under some circumstances, we would reverse the order of events in a batch.
Fixed how relative time is displayed.
Fixed an issue that could cause the query scheduler to erroneously retry searching a bucketed segment.
Ingest listeners are now only stopped, not deleted, when a user deletes a repository. If the repository is restored, the ingest listener will be restarted automatically. When it is no longer possible to restore the repository, the ingest listener will be deleted.
Added a feature that allows deletion of repositories and views on cloud.
When calculating the starting offset in Kafka for digest, Humio will now trust that if a segment in global is listed as being in bucket storage, that segment is actually present in bucket storage. Humio no longer double checks by asking bucket storage directly.
Fixed a caching-related issue with
groupBy()
in live queries that would briefly cause inconsistent results.It is now possible to create a view with the same name as a deleted view.
Fixed an issue where query cancellation could in rare cases cause the query scheduler to throw exceptions.
Fixed an issue where Filebeat 8.1 would not be compatible unless
output.elasticsearch.allow_older_versions
was set totrue
.When logging Kafka consumer and producer metrics, Humio will now log repeated metrics like
records-lag-max
once per partition, with the partition specified in thepartition
field.Fixed an issue where
OrganizationStatsUpdaterJob
would repeatedly post the errorcom.humio.entities.organization.OrganizationSingleModeNotSupported: Not supported when using organizations in single mode
when the cluster was configured for only one organization.Fixed an issue where
NetFlow
parsing would crash if it received an options data record.Added more visibility on organization limits when changing the retention settings on a repository.
Automatic system removals of queries expired from the blocklist are now audit logged as well.
Fixed an issue where audit logging of alerts, scheduled searches and actions residing on views would yield incomplete or missing audit logs.
Added support for restoring deleted repositories and views when using bucket storage. See Delete a Repository or View.
Fixed an issue where non-default log formats such as
log4j2-json-stdout.xml
that logs toSTDOUT
were not fully in control of their output stream, as log entries of levelERROR
were also printed directly tostderr
from within the code. The default log4j2 configuration now includes a Console appender that prints errors tostdout
, achieving the same result, while allowing the other formats to fully control their output stream.Fixed an issue where download of IOCs from another node in the cluster could start before the previous download had finished, resulting in too many open connections between nodes in the cluster.
Improved distribution onto partitions of tag combinations (datasources) that are affected by auto sharding, resulting in less collisions.
Webhook action has been updated to only allow the following HTTP verbs:
GET
,HEAD
,POST
,PUT
,PATCH
,DELETE
andOPTIONS
.Fixed an issue where some errors showed wrong positions in the search page query field.
Fixed duplicate
Change triggers and actions
entry in view permission token page.Added
humio-token-hashing.sh
to the Humio bin directory. This invokes a utility for generating root tokens.Added support in
fieldStats()
query function for skipping events. This is used by the UI, but only in situations where we know an approximate result is acceptable and where processing all events would be too costly.Fixed an ingest bug where sometimes we wouldn't turn event fields into tags if we fell back to using the key-value parser. Now we always turn fields into tags.
Improved the phrasing of some error messages.
Improved the flow of creating a blocked query.
When Humio detects multiple datasources for the same set of tags, it will not deduplicate them by selecting one source to keep and marking the others replaced.
Added a feature that allows regular users with delete permissions on cloud to rename views and repositories.
Made changes to Humio's tracking of bucket storage downloads. This should avoid some rare cases where downloads could get stuck.
Fixed an ingest bug where, when truncating an event with too many fields, we wouldn't count error fields, leading to the event still being larger than the maximum size.
Fixed an issue where an exception in rare cases could cause ingest requests to fail intermittently.
It is no longer possible to delete a parser that is used by an ingest listener. You must first assign another parser to the ingest listener.
Fixed a bug where accessing a
csv
file with records spanning multiple lines would fail with an exception.Fixed a race condition between nodes creating the merge result for the same target segment, and also transferring it among the nodes concurrently. If a query read the file during that race, an in-memory cache of the file header might hold contents that did not match the local file, resulting in
Broken segment
warnings in queries.Fixed an issue where Filebeat 8.0 would not be compatible unless
setup.ilm.enabled
was set tofalse
.Reduced the amount of time Humio will spend during shutdown waiting for in-progress data to flush to disk to 60 seconds from 150 seconds.
Humio will now periodically log node configs to the debug log, in addition to the existing log of config on node boot. These logs will come from
com.humio.jobs.ConfigLoggerJob
.If the query scheduler attempts to read a broken segment file, it may be able to fetch a new copy from bucket storage in some cases. Humio will now only allow this if it can be guaranteed that no events from the broken segment have been added to the query result. Otherwise the query will receive a warning.
It is now validated, that the parser supplied when creating or updating an ingest listener, exists.
Fixed an issue that could cause an exception to be thrown in the ingest code if digest assignment changed while a local segment file being written was still empty.
Updating alert labels using the
addAlertLabel
andremoveAlertLabel
mutations now requires theChangeTriggersAndActions
permission.Fixed an issue where the
set-replication-defaults config endpoint
could attempt to assign storage to nodes configured not to store segments.It is no longer possible to create ingest listeners on system repositories using the APIs. Previously, it was only prohibited in the UI.
Humio is now more strict during a Kafka reset to avoid global desyncs. Only one node will be allowed to boot on the new epoch, remaining nodes won't be allowed to use their snapshots, and will need to fetch a fresh global snapshot from that node.
Fixed a bug with UTF-8 serialization of 4-byte codepoints (emojis etc.).
Improved performance of formatting action messages, when the query result for an alert or scheduled search contains large events.
Fixed an ingest bug where if multiple types of errors occurred for an event we would only add error fields describing one of them. Now we always report all errors.
Fixed an issue where exceptions in FDR were not properly logged.
Fixed an issue that links in alerts from OpsGenie actions were not clickable.
Fixed bugs related to repository deletes.
Added
humio-decrypt-bucket-file.sh
to the Humio bin directory. This invokes a utility for decrypting files downloaded from bucket storage.Fixed an issue when using bucket storage alongside secondary storage, where Humio would download files to the secondary storage but register them as present in the primary. It will now download and register them as present on the secondary storage.
Fixed an ingest bug where we might discard
@timezone
and@error
fields in events with too many fields. Now we always retain those and only discard other fields.During ingest, if an event has too many fields we now sort the fields lexicographically and remove fields from the end. Before, there was no system to which fields were retained, it was effectively random.
Webhook action now includes the 'Message Body Template' for
PATCH
andDELETE
requests as well if it is not empty.It is no longer possible to use experimental functions in Alerts, Parsers, and Event Forwarding. They are now only available on the search page.
Fixed an issue that could cause creation of two datasources for the same tag set if messages with the same tags happened to arrive on different Kafka partitions.
The
findTimestamp()
function now supports date formats like23FEB2022
, that is date, literal month and year without any separators in between. Other formats still require separators between the parts.When shared dashboards are disabled or become inaccessible because of IP filters, they will now be completely unreachable, and any dashboards already open will show an informative error message.
Fixed an issue where the UI would not detect parameters in a query when using saved queries from a package.
Improved distribution of new autosharded datasources.
The query scheduler improperly handled regex limits being hit, it should result in a warning on the query. In some cases it was handled by retrying the segment read.
Humio Server 1.38.2 Stable (2022-06-13)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.38.2 | Stable | 2022-06-13 | 2023-03-15 | 1.26.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | c00de7af24633422654b3d16a764d753 |
SHA1 | 6c3043c27e5c7b3c7353f0f0e5e3e5b876319314 |
SHA256 | 6770856e5dcf19eee5384eecc40617fed15d92e2c2872ff7432f63bf43867c4a |
SHA512 | 7660d46ca1700336ce6fd2390e4b6de5b15963693499a6313513ff63ee9cedb6f99e1f595465ae3b1c420d0ba9b4626abe0ba81450f3bd7e92d528b0b1f51c6d |
JAR Checksum | Value |
---|---|
humio-core-dev | 4a9c5aa23b7842034e34dda4aaffcb12f6f23a8e1c2cf04933b44a8cdafbe74d |
humio-dev | 1290b8e98ae3553b092879867a433077a1eb7ff626c989d01d14f71218644072 |
kafka-dev | 04d14b84378ac9f6787af1b8477a0d2cbd6979da283bde177470d1af85a01637 |
zookeeper-dev | 46aa8bbcaa2c64cfa7afdb6e07df0783658b4983a6727ca6670989364e687477 |
Updated dependencies with security fixes and weakness.
Bug Fixes
Summary
Updated dependencies to fix vulnerabilities to CVE-2021-22573.
Updated java script dependencies to fix vulnerabilities.
Humio Server 1.38.1 Stable (2022-04-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.38.1 | Stable | 2022-04-27 | 2023-03-15 | 1.26.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | fcaf2c288bd1f7c0fbc63deca59aa53d |
SHA1 | aec8d78eb49ee4954f2e542f614c89595da0ec39 |
SHA256 | d31c13fcecfd380562faddb7ba4662484aa2254f1f0f54591241341870c7ae83 |
SHA512 | 98134b241d67029255018c24032897623e91a3f54627c53e1c801bd4528b9ea13ab48abe328f2b76f40048bf4cb7dd45480a9398f6bd8dea4edb5db1d296b3da |
JAR Checksum | Value |
---|---|
humio-core-dev | 7c1a2c853c4d7c348cfe948340a0f4101eb92a9ce365943897bf6c34cf393312 |
humio-dev | 2d33f1706e053414996c9ac5d3533a15b637d3b321ad91362ac1a2fb4e54d722 |
kafka-dev | e3fc06aca9f5df2e628fb6a2b78c39aaf1c1b682728eb74bbd87d018aa83b49a |
zookeeper-dev | 73746eff47c136fc01bf5898c4fecf43d459d3f103ccd29e10edf2ce7c79255d |
Updated dependencies with security fixes and weakness.
Bug Fixes
Summary
Use latest version of Java 1.13 on Docker image.
Updated java script dependencies to fix vulnerabilities.
Use latest version of Alpine on Docker image.
Updated dependencies to Jackson to fix a vulnerability.
Humio Server 1.38.0 Stable (2022-03-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.38.0 | Stable | 2022-03-15 | 2023-03-15 | 1.26.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 83afa7f6d2c55efbb88387474efd1264 |
SHA1 | 5587c3365fcfb22e1a45ea96b9503497b705125e |
SHA256 | 357591952ed12d0d9f93b084cff4b0ff6848d7a464071ff27edee9f921e23174 |
SHA512 | 7a88658b07d69f6a2fe151da8fe94ebfe0a1259ffa48c45df6154dcce4f6453fac8f78087cefdf869fb6322fa4e31a01f830d9db998293ebeabb0f2c8e3e5cfb |
Value | JAR Checksum |
---|---|
humio-core-dev | cff83e3a3ea8c455040ca31d4e8071a0f1c80be894fdde4cad768e69e1c449e5 |
humio-dev | 9cd0f6a91b150bb51f9407451bd70c40dc49f730f76840e061a6570008d88453 |
kafka-dev | d960ac292f781baa54c1388f4bbc94c77c1ae06b94a082a214777844f1435120 |
zookeeper-dev | b2ab322170bfab4d221f6f5e4a4cca5751b2d97bcf75d451de4d24a00c775206 |
Humio can now poll and ingest data from the Falcon platform's Falcon Data Replicator(FDR) service. This feature can be used as an alternative to the standalone fdr2humio project. See the Ingesting FDR Data for more information.
Improvements, new features and functionality
UI Changes
Added a quick-fix to convert non-ASCII quotes to ASCII quotes in the search field.
When changing focus inside a dialog with the keyboard, the focus will no longer move outside the dialog while it is open.
Visually hidden clipboard field is now hidden for assistive technologies/keyboard users.
Hover information in the search field is shown despite an overlapping warning.
The bar and pie charts now support holding the SHIFT key to display unformatted numeric values.
First row entry in the statistics table on the repo page is now a table header and added hidden content to the empty table header in the new view page.
On the time, bar and pie charts you can hold the
ALT
/OPTION
key to display long legend titles.Added a quick-fix for unknown escape sequences in the search field.
Reworked the hover message layout and changed the hover information on text (in the search field).
The search page now has focus states on the Language Syntax, Event List Widget and buttons.
The Cluster Nodes table has been redesigned to allow for easier overview and copying the version-number.
Better accessibility for queries panel. You can now tab to focus individual queries, and open a details panel. From here you can also access all actions in the details panel by tabbing.
Minor UX improvements (ie. accessibility) on the queries panel.
Added a warning for unknown escape sequences in the search field.
When using the table visualisation in dark mode, empty table cells are now clearly discernible.
Pop-ups and drop-downs will now close automatically when focus leaves them.
Hover over parameter names and arguments in the search field now includes the default value.
GraphQL API
Fixed a bug in the response from calling the installPackageFromZip graphql mutation. Previously the response type exposed a deprecated clientmutationid that could not be selected. Also now if form fields are missing they are properly reported in the response.
The PERMISSION_MODEL_MODE config option has been removed. All graphql related schema has also been removed.
Deprecates the ReadContents view action, in favor of ReadEvents. This also means ReadEvents has been undeprecated, as we have slightly changed how we consider read rights, and want the action names to match this.
Configuration
Reduce default value of
INGESTQUEUE_COMPRESSION_LEVEL
, the ingest queue compression level from 1 to 0. This reduces time spent compressing before inserting into the ingest queue by roughly 4x at the expense of a 10-20% increase in size required in Kafka for the ingest queue topic.Added config
IP_FILTER_RDNS
for specifying what IP addresses can be queried using therdns
query function.Added the config
CORS_ALLOWED_ORIGINS
a comma separated list for CORS allowed origins, default allows all origins.Added new config NATIVE_FALLOCATE_SUPPORT (default true) to allow turning off the use of fallocate and ftruncate internally.
Added new config NATIVE_FADVICE_SUPPORT (default true) to allow turning off the use of fadvice internally.
When Kafka topic configuration is managed by Humio (default true) set
max.message.bytes
on the topics to the value of ConfigTOPIC_MAX_MESSAGE_BYTES
, default is 8388608 (8 MB). Minimum value is 2 MB.The Property
inter.broker.protocol.version
inkafka.properties
now defaults to 2.4 if not specified. Users upgrading Kafka can either setinter.broker.protocol.version
manually inkafka.properties
, or passDEFAULT_INTER_BROKER_PROTOCOL_VERSION
as an environment variable to Docker when launching the container. Please follow Kafka's upgrade guidelines when upgrading a Kafka cluster to avoid data loss https://kafka.apache.org/documentation/#upgrade_3_1_0.Added config
IP_FILTER_RDNS_SERVER
for specifying what DNS servers can be allowed in therdns
query function.Fixed a bug where
TLS_KEYSTORE_TYPE
andTLS_TRUSTSTORE_TYPE
would only recognize lower-case values.Added config
RDNS_DEFAULT_SERVER
for specifying what DNS server is the default for therdns
query function.Added new settings for how uploads to bucket storage are validated. In the case that validation with etags are not available, content length can be used instead.
Other
Improved the performance of deletes from global.
Fixed an issue where negated functions could lose their negation.
Fixed an issue where queries with tail() would behave in an unexpected manner when an event is focused.
Improved performance of FDRJob.
Added tombstoning to uploaded files, which helps with avoiding data loss.
Fixed an issue where users could be shown in-development feature on the client when running a local installation of Humio.
Fixed an issue where top(max) could throw an exception when given values large enough to be represented as positive infinity.
Warn at startup if CORES > AvailableProcessorCount as seen by the JVM.
Fixed an issue with epoch and offsets not always being stripped from segments.
Fixed a bug where the
button on the Fields panel would do nothingFixed an issue where percentile() would crash on inputs larger than ~1.76e308.
For HTTP Event Collector (HEC) the input field sourcetype is now also stored in @sourcetype.
Fixed several issues where users could add invalid query filters via the
context button after selecting text in the Event List.LSP warnings don't crash queries any more.
Added a new system-level permission that allows changing usernames of users.
Improved off-heap memory handling. Humio now typically uses only 1 GB on systems with 32 vCPUs, down from typically 16 GB. This leaves more memory for other processes and page cache for data.
Fixed an issue where queries of the form #someTagField != someValue ... would sometimes produce incorrect results.
Fixed an issue where tail() could produce results inconsistent with other query functions, when used in a live query.
During Digest startup, abort fetching segments from other nodes if the assigned partition set changes while fetching.
Fixed a bug where providing a bad view/repository name when blocking queries would block the query in all views and repositories.
Published new versions of the Humio Kafka Docker containers for Kafka 3.1.0.
Do not run the Global snapshot consistency check on stateless ingest nodes.
Previously a package could be updated with another package with the same name and version, but with different content. This is no longer allowed, and any attempt do so will be rejected and fail.
During identity provider configuration, it's possible to fetch SAML configuration from an endpoint.
Fixed an ingest bug where under some circumstances we would reverse the order of events in a batch.
Fixed a compatibility issue with LogStash 7.16+ and 8.0.0 when using the Elasticsearch output plugin.
Ensure only a cluster leader that still holds cluster leadership can force digesters to release partition leadership. This could cause spurious reboots in clusters where leadership was under contention.
Upgrades the Kafka client to 3.1.0 from 2.8.1. 3.1.0 enables the idempotent producer by default, which implies acks=all. Clusters that set acks to a different number via
EXTRA_KAFKA_CONFIGS_FILE
should update their config to also specify enable.idempotence=falseFixed a bug where the package marketplace would redirect to unsupported package versions on older Humio instances.
Allow cluster managers access to settings for personal sandboxes and to block and kill queries in them.
Ensure a digester can only acquire or release partition leadership if no other digester has leadership of that partition. This could cause spurious reboots if digester leadership became contended.
Fixed an issue where live queries would sometimes double-count parts of the historic data.
Fixed a bug in the Sankey chart such that it now updates on updated query results.
Fixed a compatibility issue with FileBeat 8.0.0.
Humio Server 1.37.1 Preview (2022-02-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.37.1 | Preview | 2022-02-25 | 2022-03-15 | 1.26.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | e46117f38ef25afde602a458e5266b4b |
SHA1 | 3b0f5a30a7918a5f08ae8492bf855fadfc36fb90 |
SHA256 | 014420dfb22f8521a687eac1179c528afe0477fbb9284dc5381d9f91fd5329d1 |
SHA512 | ee13258be363f1b2103b864517ea4b9de9d6a78dcee0c4fcba95af2ea873dacebb298f6410f12cf68ecde3d17210256f85713ada7f5988726dc4440f5fbeee21 |
Value | JAR Checksum |
---|---|
humio-core-dev | e0de42791dd3e83c2aa9bea871cb6e7a62bf51c835de2142adfd51aa863625a3 |
humio-dev | e131f664f67e5ce98a397431b1f1a9d3c134d47dd24a24ed8ad76ae9e6d79eb0 |
kafka-dev | 9ab50e070047406cd6316fa2017d15ca24caa6e7a9b20ba741114b9cc1c3feec |
zookeeper-dev | 47aa1a18a57652f156406021dc61f8bb1042bc2bd23c89e715e14a8be4fb07f9 |
Minor fixes and improvements.
Improvements, new features and functionality
Other
Improved off-heap memory handling. Humio now typically uses only 1 GB on systems with 32 vCPUs, down from typically 16 GB. This leaves more memory for other processes and page cache for data.
Added a new system-level permission that allows changing usernames of users.
Improved performance of FDRJob.
Bug Fixes
Other
Fixed an issue where some queries using regex would use an unbounded regex engine.
Fixed an issue where users could be shown in-development feature on the client when running a local installation of Humio.
Fixed an issue where QueryFunctionValidator failed giving the error "scala.MatchError".
Humio Server 1.37.0 Preview (2022-02-14)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.37.0 | Preview | 2022-02-14 | 2023-02-14 | 1.26.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | f5c25eee6d9efb0ddf9d86ca74c84a3c |
SHA1 | 6026cc511279e9089bc49d8e5a0dd320e5397712 |
SHA256 | 097886ea8a6d2eece7980c46ba0b1002b7f7edf6d68109f91374b002a61e4975 |
SHA512 | 7c8fb7d2c53c5aab60ddf54250e47d41289cd9635005d3a765742298a20eb7f35426955a7388caf48fbc044747e917cfdd93003ce252c42358d947a504f73c29 |
JAR Checksum | Value |
---|---|
humio-core-dev | f43d4a206d9386d601798029df5c02d9b1e1b35bb6ae0f666aa6d8d36bcc60e3 |
humio-dev | c27d93d4fd87d253117b1442a7391ea3cd28366a960727482b27b58706211435 |
kafka-dev | 291d25337324ab70a3490f9b06ed2860215f37b84ced203b26cfa5d10877ce42 |
zookeeper-dev | 606ebc2ffcd28bc36d7d091ad649743f22de21b891f7a75c9048343e019372ef |
Humio can now poll and ingest data from the Falcon platform's Falcon Data Replicator(FDR) service. This feature can be used as an alternative to the standalone fdr2humio project. See the Ingesting FDR Data for more information.
Improvements, new features and functionality
UI Changes
Visually hidden clipboard field is now hidden for assistive technologies/keyboard users.
Added a quick-fix for unknown escape sequences in the search field.
Better accessibility for queries panel. You can now tab to focus individual queries, and open a details panel. From here you can also access all actions in the details panel by tabbing.
Pop-ups and drop-downs will now close automatically when focus leaves them.
When changing focus inside a dialog with the keyboard, the focus will no longer move outside the dialog while it is open.
The Cluster Nodes table has been redesigned to allow for easier overview and copying the version-number.
Added a warning for unknown escape sequences in the search field.
First row entry in the statistics table on the repo page is now a table header and added hidden content to the empty table header in the new view page.
When using the table visualisation in dark mode, empty table cells are now clearly discernible.
The bar and pie charts now support holding the SHIFT key to display unformatted numeric values.
Added a quick-fix to convert non-ASCII quotes to ASCII quotes in the search field.
The search page now has focus states on the Language Syntax, Event List Widget and buttons.
On the time, bar and pie charts you can hold the
ALT
/OPTION
key to display long legend titles.Hover information in the search field is shown despite an overlapping warning.
Minor UX improvements (ie. accessibility) on the queries panel.
Reworked the hover message layout and changed the hover information on text (in the search field).
Hover over parameter names and arguments in the search field now includes the default value.
GraphQL API
Deprecates the ReadContents view action, in favor of ReadEvents. This also means ReadEvents has been undeprecated, as we have slightly changed how we consider read rights, and want the action names to match this.
The PERMISSION_MODEL_MODE config option has been removed. All graphql related schema has also been removed.
Fixed a bug in the response from calling the installPackageFromZip graphql mutation. Previously the response type exposed a deprecated clientmutationid that could not be selected. Also now if form fields are missing they are properly reported in the response.
Configuration
The Property
inter.broker.protocol.version
inkafka.properties
now defaults to 2.4 if not specified. Users upgrading Kafka can either setinter.broker.protocol.version
manually inkafka.properties
, or passDEFAULT_INTER_BROKER_PROTOCOL_VERSION
as an environment variable to Docker when launching the container. Please follow Kafka's upgrade guidelines when upgrading a Kafka cluster to avoid data loss https://kafka.apache.org/documentation/#upgrade_3_1_0.Added config
IP_FILTER_RDNS_SERVER
for specifying what DNS servers can be allowed in therdns
query function.When Kafka topic configuration is managed by Humio (default true) set
max.message.bytes
on the topics to the value of ConfigTOPIC_MAX_MESSAGE_BYTES
, default is 8388608 (8 MB). Minimum value is 2 MB.Reduce default value of
INGESTQUEUE_COMPRESSION_LEVEL
, the ingest queue compression level from 1 to 0. This reduces time spent compressing before inserting into the ingest queue by roughly 4x at the expense of a 10-20% increase in size required in Kafka for the ingest queue topic.Added new settings for how uploads to bucket storage are validated. In the case that validation with etags are not available, content length can be used instead.
Added the config
CORS_ALLOWED_ORIGINS
a comma separated list for CORS allowed origins, default allows all origins.Added config
IP_FILTER_RDNS
for specifying what IP addresses can be queried using therdns
query function.Added config
RDNS_DEFAULT_SERVER
for specifying what DNS server is the default for therdns
query function.Fixed a bug where
TLS_KEYSTORE_TYPE
andTLS_TRUSTSTORE_TYPE
would only recognize lower-case values.
Other
Ensure a digester can only acquire or release partition leadership if no other digester has leadership of that partition. This could cause spurious reboots if digester leadership became contended.
Published new versions of the Humio Kafka Docker containers for Kafka 3.1.0.
Do not run the Global snapshot consistency check on stateless ingest nodes.
Ensure only a cluster leader that still holds cluster leadership can force digesters to release partition leadership. This could cause spurious reboots in clusters where leadership was under contention.
During Digest startup, abort fetching segments from other nodes if the assigned partition set changes while fetching.
Allow cluster managers access to settings for personal sandboxes and to block and kill queries in them.
Improve the performance of deletes from global.
Added tombstoning to uploaded files, which helps with avoiding data loss.
Upgrades the Kafka client to 3.1.0 from 2.8.1. 3.1.0 enables the idempotent producer by default, which implies acks=all. Clusters that set acks to a different number via
EXTRA_KAFKA_CONFIGS_FILE
should update their config to also specify enable.idempotence=falseDuring identity provider configuration, it's possible to fetch SAML configuration from an endpoint.
Bug Fixes
UI Changes
Fixed a compatibility issue with LogStash 7.16+ and 8.0.0 when using the Elasticsearch output plugin.
Fixed an issue where negated functions could lose their negation.
Fixed a bug where the package marketplace would redirect to unsupported package versions on older Humio instances.
Fixed a bug where providing a bad view/repository name when blocking queries would block the query in all views and repositories.
Fixed a bug in the Sankey chart such that it now updates on updated query results.
Fixed an issue where live queries would sometimes double-count parts of the historic data.
Fixed several issues where users could add invalid query filters via the
context button after selecting text in the Event List.Fixed an issue where top(max) could throw an exception when given values large enough to be represented as positive infinity.
Fixed an issue where percentile() would crash on inputs larger than ~1.76e308.
Fixed an issue where tail() could produce results inconsistent with other query functions, when used in a live query.
Warn at startup if CORES > AvailableProcessorCount as seen by the JVM.
For HTTP Event Collector (HEC) the input field sourcetype is now also stored in @sourcetype.
Previously a package could be updated with another package with the same name and version, but with different content. This is no longer allowed, and any attempt do so will be rejected and fail.
Fixed an issue where queries with tail() would behave in an unexpected manner when an event is focused.
Fixed a compatibility issue with FileBeat 8.0.0.
Fixed an issue where queries of the form #someTagField != someValue ... would sometimes produce incorrect results.
Fixes an issue with epoch and offsets not always being stripped from segments.
LSP warnings don't crash queries any more.
Fixed a bug where the
button on the Fields panel would do nothing
Humio Server 1.36.4 Stable (2022-06-13)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.36.4 | Stable | 2022-06-13 | 2023-01-31 | 1.26.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | ec11e6c40052ff89c3f7a2a2b1fddc95 |
SHA1 | fafb29f0c7fe9638ad0b136ae0e7d1402a750912 |
SHA256 | 3b8496c25ac0704d8e42f9261ec93877c7c9148f1f85d8bf0b5a6eaaf83e1820 |
SHA512 | 205f646e1a700d38c95916a69830ab2b4f14b7839d8eaefa61cbdaf4404759e3ed8f6b9279b0050008cdaacddad6222cb8a91f730753b84a1fc029e4a5207ab4 |
JAR Checksum | Value |
---|---|
humio-core-dev | 57ab8aaa9ce90575fd037da08f2be15df18286e74480594f08dd3c5ae81f39fa |
humio-dev | 5c7189dfae8441322eea8eddbd25962dfc7e68f26eae3c7516e5a46f5b6313f0 |
kafka-dev | 4a03a4e0cb9aab9a0c3f626c8b49daa64dafb54eafb8ae67298dd86b45624c33 |
zookeeper-dev | 24ba0f7cdcaca8d841dba4ba2cdc7348e82c6c44c1ffff5537ba13d066c7c180 |
Updated dependencies with security fixes and weakness.
Bug Fixes
Summary
Updated java script dependencies to fix vulnerabilities.
Updated dependencies to fix vulnerabilities to CVE-2021-22573.
Humio Server 1.36.3 Stable (2022-04-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.36.3 | Stable | 2022-04-27 | 2023-01-31 | 1.26.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 868ce151355a55e1793513eee4af54e2 |
SHA1 | a3e57e2fdbadcbfde4625d46084f25d84c5c2514 |
SHA256 | 59792217be1bf5d12ba47e1049df45778c6cefcabbc57d6f7126b5bc98f093c0 |
SHA512 | a93f931491b8c77050adde3c1aa983d3c949ad6708f8be932cfb901ea6e69a03cdd06a62394627f80e593afaa354f2f30edf596a23300f5c3b16faee80afb09c |
Value | JAR Checksum |
---|---|
humio-core-dev | 1f3a36d2f6a0d97bc9d4462072e3fafa2355c5bc8352e1bc47a526332c1ec01c |
humio-dev | be443af484a4131b93cdee2e7a5449fcfa8320a344d2f81f7b432dea89365a65 |
kafka-dev | ef6819d75f850b26a886b67e4e80f2d623eab268c4d2b4f85f7f47aa8daf9ecb |
zookeeper-dev | a0edb279463029310c1f43555045297f54882082a70753916394a38b56c3e5be |
Updated dependencies with security fixes and weakness.
Bug Fixes
Summary
Updated java script dependencies to fix vulnerabilities.
Use latest version of Alpine on Docker image.
Use latest version of Java 1.13 on Docker image.
Added new config NATIVE_FADVICE_SUPPORT (default true) to allow turning off the use of fadvice internally.
Added new config NATIVE_FALLOCATE_SUPPORT (default true) to allow turning off the use of fallocate and ftruncate internally.
Fix ingest bug where under some circumstances we would reverse the order of events in a batch.
Updated dependencies to Jackson to fix a vulnerability.
Humio Server 1.36.2 Stable (2022-03-01)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.36.2 | Stable | 2022-03-01 | 2023-01-31 | 1.26.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 4949fefd4012efb53b92595c364a4c7a |
SHA1 | 5350c5df3d0d43a5c08c2766003b28c959c912b1 |
SHA256 | 2fac7cb6e1216790893ec0759f697736a9ca2605313bcef53b7af54ee72257d5 |
SHA512 | 31fcdae45f52a263d5340b961a6e0feb98ea1fbb4ced0388216add576db9747995150112dee88d9ec3ea49cfc1367da1ca57bff13399d8d665fe9cdb80e9a1d8 |
Value | JAR Checksum |
---|---|
humio-core-dev | 7a3e262871585d8a43df8c4c4dbcf706327cade2f683ffaa9a543afccc3e8687 |
humio-dev | 4a80cd68778a6d5ccd734982c46e0355f0acf5c68ad564dd67cdb6e949750970 |
kafka-dev | 6e362a4827f9a41d37b19bdfa63f3cad7f77d2786f6b0366e410474de99113ce |
zookeeper-dev | deac05cfaa4762eaf079afa3063cf9271eff7080157d0e785a4c345d280f5d24 |
Performance and stability improvements.
Bug Fixes
Summary
Fixed a race condition between nodes creating the merge result for the same target segment, and also transferring it among the nodes concurrently. If a query read the file during that race condition, an in-memory cache of the file header might hold contents that did not match the local file, resulting in "Broken segment" warnings in queries.
Improved off-heap memory handling. Humio now typically uses only 1 GB on systems with 32 vCPUs, down from typically 16 GB. This leaves more memory for other processes and page cache for data.
Humio Server 1.36.1 Stable (2022-02-14)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.36.1 | Stable | 2022-02-14 | 2023-01-31 | 1.26.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 0aee460ed84a4acda917ce6cd61c433d |
SHA1 | 9ea746229c3f1f0f780d356b7ce4b6f6e1bbb78d |
SHA256 | 56a3a2e7ba88e1f5a019184a0d68e83f25b319d54e3aaee3eba4a37f0ef8950c |
SHA512 | aa3117230e866ae621c3f72e1517a9629f45520ea2fa00b6dc8c2ad3a6a1589ffbde36f38b3b1ec0ad927f89da4a9df7f3e6b59f1e844796553b5675608304e9 |
JAR Checksum | Value |
---|---|
humio-core-dev | ecfa5dd303d12725f754b4afabc44196ba37df739f04c30432401eb3149874ee |
humio-dev | 2671bacddfe88f34eaba196332b08659e79eab40c2ce26a0e6c2f7e58a78a213 |
kafka-dev | 0d50f27e33bf61f8b76f482fa7b2c4237227af7e429b1080e65daa877c65b457 |
zookeeper-dev | 62a511127a0eaa4ba0f5a29c421063d4c6822371ba6ee16e96ae1b930ca0e7ce |
Performance and stability improvements.
Bug Fixes
Summary
Reading hashfilter in chunks to avoid having huge off heap buffers.
Performance improvements of IngestPartitionCoordinator.
Improve the performance of deletes from global.
Downgrade to Java 1.13 on Docker image to fix rare cases of JVM crashes.
Humio Server 1.36.0 Stable (2022-01-31)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.36.0 | Stable | 2022-01-31 | 2023-01-31 | 1.26.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 87cdf81b183bf1a065596181b873d813 |
SHA1 | 8425487e7e3b566ed2eae42cac4cbb6010eb1825 |
SHA256 | 76af04b53a689411f4048e743e0491cb437b99503630a87cf5aba2eb0281231f |
SHA512 | 9dca89bf4097b1c4949c458b9010fff12edd25248c2f0f2e18835466e852d6c5fa6981c8763125b769c5a6673bd00a1a385bfb22f7241aeeadf9e826ef208c99 |
JAR Checksum | Value |
---|---|
humio-core-dev | 2641650964190056ac10ad0225b712c3a01d844bf2c5f517663187d45adf846c |
kafka-dev | 99e3a00c93308aa92a8363c65644748d6ace602c1c6e425dcfc32be12432dee7 |
zookeeper-dev | 45c911346e3b58501e1a1b264c178debd33edd692cd901dd9e87cbcd2f93e60a |
Beta: Bucket storage support for dual targets
Support for dual targets to allow using one as the preferred
download and the other to trust for durability. One example of
this is to save on cost (on traffic) by using a local bucket
implementation, such as
MinIO, in the local
datacenter as the preferred bucket storage target, while using a
remote Amazon S3
bucket as the trusted bucket for durability. If the local
MinIO bucket is lost (or just
not responding for a while) the Humio cluster still works using
the AWS S3 bucket with no
reconfiguration or restart required. Configuration of the second
bucket is via configuration entries similar to the existing
STORAGE
keys, but using the prefix
STORAGE_2
for the extra bucket.
When using dual targets, bucket storage backends may need
different proxy configurations for each backend - or not. The
new configuration
BUCKET_STORAGE_MULTIPLE_ENDPOINTS
(default
false
) controls whether the proxy
configuration in the environment is applied to all bucket
storage backends. When set to true
, each
bucket preserves the active proxy/endpoint configuration and a
change to those will trigger creation of a fresh internally
persisted bucket storage access configuration.
Improvements, new features and functionality
UI Changes
New feature to select text in the search page event list and include/exclude that in the search query.
Hovering over text within a query now shows the result of interpreting escape characters.
New dialogs for creation of parsers and dashboards.
Added ability to resize search page query field by dragging or fitting to query.
Time selector is now accessible by keyboard.
Allow more dialogs in the UI to be closed with the
Esc
key.Improved dark mode toggle button's accessibility.
Improved accessibility when choosing a theme.
Disable the option to creating a view if the user does not have Connect a view permission on any repository. This is more intuitive than getting an empty dropdown of repositories to choose from.
GraphQL API
Improved the error messages when the GraphQL queries
SearchDomain.alert
,SearchDomain.action
, andSearchDomain.savedQuery
do not find the entity with the given ID.
Configuration
Added INITIAL_FEATURE_FLAGS which lets you enable/disable feature flags on startup. For instance, setting INITIAL_FEATURE_FLAGS=+UserRoles,-UsagePage enables
UserRoles
and disablesUsagePage
.When using
ZOOKEEPER_URL_FOR_NODE_UUID
for assignment of node ID to Humio nodes, and value ofZOOKEEPER_PREFIX_FOR_NODE_UUID
(default/humio_autouuid
) does not match contents of localUUID
file, acquire a fresh nodeuuid
.Reduce default value of
INGESTQUEUE_COMPRESSION_LEVEL
, the ingest queue compression level from 1 to 0. This reduces time spent compressing before inserting into the ingest queue by roughly 4x at the expense of a 10-20% increase in size required in Kafka for the ingest queue topic.New configuration
BUCKET_STORAGE_MULTIPLE_ENDPOINTS
and many configurations usingSTORAGE_2
as prefix. See Bucket Storage.Added the config CORS_ALLOWED_ORIGINS a comma separated list for CORS allowed origins, default allows all origins.
Make
ZOOKEEPER_URL
optional. When not set, the zookeeper-status-logger job does not run, and the cluster administration page does not display information about a Zookeeper cluster.
Other
Improved caching of UI static assets.
Added option to specify an IP Filter for which addresses hostname verification should not be made.
Improved the default permissions on the group page by leaving their view expanded once the user cancels update.
Added a limit parameter to the
FieldStats
function. This parameter limits the number of fields to include in the result.Improved the error message when an ingest request times out.
Added granular IP Filter support for shared dashboards (BETA - API only).
Added warning logs when errors are rendered to browser during oAuth flows.
Remove caching of API calls to prevent caching of potential sensitive data.
Added exceptions to the Humio logs from
AlertJob
andScheduledSearchJob
.Improved usability of the groups page.
Added a job that scans segments which are waiting to be archived, this value is recorded in the metric:
s3-archiving-latency-max
.Added job which will periodically run a query and record how long it took. By default the query is
count()
.Added ability to override
max auto shard count
for a specific repository.Allow the same view name across organizations.
Added analytics on query language feature use to the audit-log under the fields
queryParserMetrics
.Allow the query scheduler to enqueue segments and
aux
files for download from bucket storage more regularly. This should ensure that queries fetching smallaux
files can more reliably keep the download job busy.Improved Humio's detection of Kafka resets. We now load the Kafka cluster id once on boot. If it changes after that, the node will crash.
Bug Fixes
UI Changes
Fixed an issue that repeatedly tried to restart live queries from a given user upon the deletion of the user.
Fixed a race condition that could cause Humio to delete more segments than expected when initializing a digester node.
Fixed an issue where the
SegmentMoverJob
could delete the local copy of a segment, if a pending download of the segment failed the CRC check. The job will now keep the downloaded file at a temporary path until the CRC check completes, to avoid deleting a local copy created by other jobs, e.g. by bucket downloads.Fixed a number of instability issues in the query scheduler. The scheduler should now more reliably ensure that each query either completes, or is cancelled.
Reenable a feature to make Humio delete local copies of bucketed segments, even if they are involved in a query.
Fixed an issue where the digest coordinator could consider a host to be alive if the coordinator hadn't seen any timestamps from that host.
Fixed an issue where choosing a UI theme would not get saved properly in the user's settings.
Fixed a race condition that could cause digesters to calculate two different offsets during startup when determining where to start consuming, and which partially written segments to discard, which could lead to data loss when partially written segments were replayed from Kafka.
Reenable a feature to make Humio fetch and check
hash
files from bucket storage before fetching the segments.Queries on views no longer restart when the ordering of the view's connections is changed.
Fixed a compatibility issue with Filebeat 7.16.0.
When interacting with the REST API for files, errors now have detailed error messages.
When starting ingest, Humio checks that the computed starting position in Kafka is below the Kafka end offset. Ensure that the end offset is requested after the starting position is computed, not before. This might prevent a very rare spurious boot failure.
When creating ingest and chatter topic, reduce desired max.message.bytes to what Kafka cluster allows, if that is lower than our desired values.
No longer allow requests to
/hec
to specify organizations by name. We now only accept IDs.Make writes to Kafka's chatter topic block in a similar manner as writes to global.
Errors on alerts are now cleared more granularly. Errors when starting the alert query are cleared as soon as the query is successfully started, errors from polling the query are cleared when the query is successfully polled, and errors from invoking actions are cleared when at least one action has been successfully triggered.
Code completion in the query editor now also works on the right hand side of
:=
.Fixed an issue where queries of the form #someTagField != someValue ... would sometimes produce incorrect results.
Errors on scheduled searches are now cleared more granularly. Errors when starting a query are cleared as soon as another query is successfully started, errors from polling a query are cleared when a query is successfully polled, and errors from invoking actions are cleared when at least one action has been successfully triggered.
Fixed an issue in the Export to file dialog on the search page. It is now possible to export fields with spaces.
Fixed an issue where the Humio query URLs sent by actions would land users on the search page in editing mode for the alert or scheduled search that had triggered. Now, they still land on the search page, but not in editing mode.
Fixed Humio always reading and discarding an already processed message from the ingest queue on boot.
The action message templates
{events_str}
and{query_result_summary}
always evaluate to the same string. To reflect this, the UI has been updated so that these templates are combined into the same item in the template overview for Email, Slack and Webhook actions.Fixed an issue where live queries would sometimes double-count parts of the historic data.
Reduce noise in the log when the bucket storage upload job attempts to upload a file that is deleted concurrently.
For HTTP Event Collector (HEC) the input field
sourcetype
is now also stored in@sourcetype
.From the alerts overview and the scheduled searches overview, it is now possible to clear the error status on an alert or a scheduled search.
Fixed an issue where, if a custom parser was overriding a built-in parser, then the custom parser could accidentally be overwritten by creating a new parser with the same name.
Removed a spurious warning log when requesting a non-existent
hash
file from S3.Fixed session() such that it works when events arrive out of time order.
Remove
script-src: unsafe-eval
from content security policy.When bootstrapping a new cluster, set the cluster version in global right away. Since nodes will not boot on a snapshot that doesn't specify a cluster version, it is important that this field exists in all snapshots.
Query partition tables updates are now rejected if written by a node that is no longer the cluster leader.
The
repository/.../query
endpoint now returns a status code of.0 (BadRequest)
when given an invalid query in some cases where previously it returned503 (ServiceUnavailable)
.The
AlertJob
andScheduledSearchJob
now only log validation errors from running the queries as warnings, previously, some of these were logged as errors.The query endpoint API now supports languageVersion for specifying Humio query language versions.
Fixed an issue where nodes could request partitions from the query partitioning table that were not present.
SAML and OIDC only - During signout, Humio background tabs will be redirected to a signout landing page instead of to the login page.
Fixed an issue where repeating queries could cause other queries to fail.
Fixed an issue where MaxMind databases would only update if a license was present at startup and not if it was added later.
Fixed an issue in the Table widget. It will no longer insert 0-values for missing fields in integer columns. Empty fields will be shown consistently, independent of the column data type.
Bumped the Humio Docker containers to Java 17. If you manually set any
--add-opens
flags in your JVM config, you should remove them. The container should set the right flags automatically.Fixed an issue where
top
would fail if the sum of the values exceeded 2^63-1. Exceeding sums are now pegged to 2^63-1.Humio now tries to avoid interrupting threads during shutdown, instead allowing them to finish their work. This should reduce log noise when shutting down.
Make Humio handle missing
aux
files a little faster when downloading segments from bucket storage.The
/hec
endpoint no longer responds toOPTIONS
requests saying it supportsGET
requests. It doesn't and never has.No longer allow organization- and system-level ingest tokens to ingest into sandbox and system repos.
Humio Server 1.35.0 Preview (2022-01-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.35.0 | Preview | 2022-01-17 | 2022-01-31 | 1.26.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 83b164ea22cbc8a347ee22a4e49d87fb |
SHA1 | cde673dc3026cf8455e980a7f1ffc17de2a92072 |
SHA256 | a43b1f86fe2f610eadaacfcff50264de578be56959125d24d27e51e1eacc403d |
SHA512 | a0897d2b8acb1ad888c1f0128bc46a9f3a425cc87adc40192ea3089533f247ce0ddff23971b1298d58cdb9f0e93f1bb24ae3392587de3a313fa4bbd89a32747b |
JAR Checksum | Value |
---|---|
humio-core-dev | 56193b2add6ece05561e058ffcd1706989b9633cb1da857b26582df7d7bf210a |
humio-dev | 2f6d1b42b5d2d519bd0152bf6e28952a8f5d9e711bfc6c8c50fb58d917d033f0 |
kafka-dev | 149bce1bfa2e9c3e8eb6ff3d8c9416fad058b392134cab5958bf405f2553d264 |
zookeeper-dev | 9393097554e28403372ef38f87eab200292a41f75d8d38a8d102f926e7919eae |
Beta: Bucket storage support for dual targets
Support for dual targets to allow using one as the preferred
download and the other to trust for durability. One example of
this is to save on cost (on traffic) by using a local bucket
implementation, such as
MinIO, in the local
datacenter as the preferred bucket storage target, while using a
remote Amazon S3
bucket as the trusted bucket for durability. If the local
MinIO bucket is lost (or just
not responding for a while) the Humio cluster still works using
the AWS S3 bucket with no
reconfiguration or restart required. Configuration of the second
bucket is via configuration entries similar to the existing
STORAGE
keys, but using the prefix
STORAGE_2
for the extra bucket.
When using dual targets, bucket storage backends may need
different proxy configurations for each backend - or not. The
new configuration
BUCKET_STORAGE_MULTIPLE_ENDPOINTS
(default
false
) controls whether the proxy
configuration in the environment is applied to all bucket
storage backends. When set to true
, each
bucket preserves the active proxy/endpoint configuration and a
change to those will trigger creation of a fresh internally
persisted bucket storage access configuration.
Improvements, new features and functionality
UI Changes
Allow more dialogs in the UI to be closed with the
Esc
key.Improved dark mode toggle button's accessibility.
Improved accessibility when choosing a theme.
Time selector is now accessible by keyboard.
New feature to select text in the search page event list and include/exclude that in the search query.
Disable the option to creating a view if the user does not have Connect a view permission on any repository. This is more intuitive than getting an empty dropdown of repositories to choose from.
Added ability to resize search page query field by dragging or fitting to query.
New dialogs for creation of parsers and dashboards.
Hovering over text within a query now shows the result of interpreting escape characters.
GraphQL API
Improved the error messages when the GraphQL queries
SearchDomain.alert
,SearchDomain.action
, andSearchDomain.savedQuery
do not find the entity with the given ID.
Configuration
When using
ZOOKEEPER_URL_FOR_NODE_UUID
for assignment of node ID to Humio nodes, and value ofZOOKEEPER_PREFIX_FOR_NODE_UUID
(default/humio_autouuid
) does not match contents of localUUID
file, acquire a fresh nodeuuid
.Make
ZOOKEEPER_URL
optional. When not set, the zookeeper-status-logger job does not run, and the cluster administration page does not display information about a Zookeeper cluster.New configuration
BUCKET_STORAGE_MULTIPLE_ENDPOINTS
and many configurations usingSTORAGE_2
as prefix. See Bucket StorageReduce default value of
INGESTQUEUE_COMPRESSION_LEVEL
, the ingest queue compression level from 1 to 0. This reduces time spent compressing before inserting into the ingest queue by roughly 4x at the expense of a 10-20% increase in size required in Kafka for the ingest queue topic.Added INITIAL_FEATURE_FLAGS which lets you enable/disable feature flags on startup. For instance, setting INITIAL_FEATURE_FLAGS=+UserRoles,-UsagePage enables
UserRoles
and disablesUsagePage
.
Other
Improved the default permissions on the group page by leaving their view expanded once the user cancels update.
Added a job that scans segments which are waiting to be archived, this value is recorded in the metric:
s3-archiving-latency-max
.Added option to specify an IP Filter for which addresses hostname verification should not be made.
Added analytics on query language feature use to the audit-log under the fields
queryParserMetrics
.Allow the query scheduler to enqueue segments and
aux
files for download from bucket storage more regularly. This should ensure that queries fetching smallaux
files can more reliably keep the download job busy.Allow the same view name across organizations.
Added exceptions to the Humio logs from
AlertJob
andScheduledSearchJob
.Added a limit parameter to the
FieldStats
function. This parameter limits the number of fields to include in the result.Added granular IP Filter support for shared dashboards (BETA - API only).
Improved usability of the groups page.
Improved Humio's detection of Kafka resets. We now load the Kafka cluster id once on boot. If it changes after that, the node will crash.
Added warning logs when errors are rendered to browser during oAuth flows.
Improved the error message when an ingest request times out.
Added ability to override
max auto shard count
for a specific repository.Added job which will periodically run a query and record how long it took. By default the query is
count()
.
Bug Fixes
UI Changes
Humio now tries to avoid interrupting threads during shutdown, instead allowing them to finish their work. This should reduce log noise when shutting down.
The
AlertJob
andScheduledSearchJob
now only log validation errors from running the queries as warnings, previously, some of these were logged as errors.Errors on scheduled searches are now cleared more granularly. Errors when starting a query are cleared as soon as another query is successfully started, errors from polling a query are cleared when a query is successfully polled, and errors from invoking actions are cleared when at least one action has been successfully triggered.
SAML and OIDC only - During signout, Humio background tabs will be redirected to a signout landing page instead of to the login page.
Code completion in the query editor now also works on the right hand side of
:=
.Reenable a feature to make Humio fetch and check
hash
files from bucket storage before fetching the segments.Fixed an issue where repeating queries could cause other queries to fail.
Make Humio handle missing
aux
files a little faster when downloading segments from bucket storage.From the alerts overview and the scheduled searches overview, it is now possible to clear the error status on an alert or a scheduled search.
For HTTP Event Collector (HEC) the input field
sourcetype
is now also stored in@sourcetype
.When creating ingest and chatter topic, reduce desired max.message.bytes to what Kafka cluster allows, if that is lower than our desired values.
Fixed an issue where, if a custom parser was overriding a built-in parser, then the custom parser could accidentally be overwritten by creating a new parser with the same name.
Fixed an issue where the Humio query URLs sent by actions would land users on the search page in editing mode for the alert or scheduled search that had triggered. Now, they still land on the search page, but not in editing mode.
Errors on alerts are now cleared more granularly. Errors when starting the alert query are cleared as soon as the query is successfully started, errors from polling the query are cleared when the query is successfully polled, and errors from invoking actions are cleared when at least one action has been successfully triggered.
Reenable a feature to make Humio delete local copies of bucketed segments, even if they are involved in a query.
No longer allow requests to
/hec
to specify organizations by name. We now only accept IDs.Bumped the Humio Docker containers to Java 17. If you manually set any
--add-opens
flags in your JVM config, you should remove them. The container should set the right flags automatically.Fixed an issue in the Table widget. It will no longer insert 0-values for missing fields in integer columns. Empty fields will be shown consistently, independent of the column data type.
Make writes to Kafka's chatter topic block in a similar manner as writes to global.
When starting ingest, Humio checks that the computed starting position in Kafka is below the Kafka end offset. Ensure that the end offset is requested after the starting position is computed, not before. This might prevent a very rare spurious boot failure.
Removed a spurious warning log when requesting a non-existent
hash
file from S3.No longer allow organization- and system-level ingest tokens to ingest into sandbox and system repos.
Fixed a race condition that could cause Humio to delete more segments than expected when initializing a digester node.
Fixed a race condition that could cause digesters to calculate two different offsets during startup when determining where to start consuming, and which partially written segments to discard, which could lead to data loss when partially written segments were replayed from Kafka.
Fixed session() such that it works when events arrive out of time order.
Fixed an issue where nodes could request partitions from the query partitioning table that were not present.
The
repository/.../query
endpoint now returns a status code of.0 (BadRequest)
when given an invalid query in some cases where previously it returned503 (ServiceUnavailable)
.Fixed an issue where the digest coordinator could consider a host to be alive if the coordinator hadn't seen any timestamps from that host.
Fixed a compatibility issue with Filebeat 7.16.0.
The query endpoint API now supports languageVersion for specifying Humio query language versions.
Fixed an issue in the Export to file dialog on the search page. It is now possible to export fields with spaces.
Query partition tables updates are now rejected if written by a node that is no longer the cluster leader.
Queries on views no longer restart when the ordering of the view's connections is changed.
Fixed an issue where choosing a UI theme would not get saved properly in the user's settings.
The action message templates
{events_str}
and{query_result_summary}
always evaluate to the same string. To reflect this, the UI has been updated so that these templates are combined into the same item in the template overview for Email, Slack and Webhook actions.Fixed an issue where
top
would fail if the sum of the values exceeded 2^63-1. Exceeding sums are now pegged to 2^63-1.Fixed an issue where MaxMind databases would only update if a license was present at startup and not if it was added later.
Reduce noise in the log when the bucket storage upload job attempts to upload a file that is deleted concurrently.
Fixed a number of instability issues in the query scheduler. The scheduler should now more reliably ensure that each query either completes, or is cancelled.
Fixed an issue where live queries would sometimes double-count parts of the historic data.
When bootstrapping a new cluster, set the cluster version in global right away. Since nodes will not boot on a snapshot that doesn't specify a cluster version, it is important that this field exists in all snapshots.
The
/hec
endpoint no longer responds toOPTIONS
requests saying it supportsGET
requests. It doesn't and never has.Fixed Humio always reading and discarding an already processed message from the ingest queue on boot.
Fixed an issue that repeatedly tried to restart live queries from a given user upon the deletion of the user.
Fixed an issue where the
SegmentMoverJob
could delete the local copy of a segment, if a pending download of the segment failed the CRC check. The job will now keep the downloaded file at a temporary path until the CRC check completes, to avoid deleting a local copy created by other jobs, e.g. by bucket downloads.Remove
script-src: unsafe-eval
from content security policy.
Humio Server 1.34.3 Stable (2022-03-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.34.3 | Stable | 2022-03-09 | 2022-12-15 | 1.26.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 7184f2582bed56c0b29ffb2d39f508a5 |
SHA1 | 9d7beb007f9ec9e7603bcbf164b3006dce0932ef |
SHA256 | ac95c6538dc88b6af31f0c55aaa46740503860ea90ad41d330593402915d885b |
SHA512 | d4738190dfd9b100ac896969e70a541f1d0242fb822f312142636cb5055009f13f0dbca6193f6cb8ce89d36d9f3f8b9ebec5a684570a4f9500bd8ffc3379ee6a |
Value | JAR Checksum |
---|---|
humio-core-dev | 64547f071a29e5df7eb945f369b28cf6d365b1590f577163fd18fe8b76ce63ce |
humio-dev | 955acd05d628a4da69a546ea58134a786c77349bfc21e10631b3f5b2934140ab |
kafka-dev | b3318e88aa3aaaae09d88fae2bd37882d1a41738983a1ef783f9f07c30c73101 |
zookeeper-dev | 049489e9fcda7ca0ea11d96e45d8dde8d9a6582e0b9740b6865a952ec13332e5 |
Performance improvements of Ingest and internal caching.
Bug Fixes
Summary
Performance improvements of Ingest and internal caching.
Humio Server 1.34.2 Stable (2022-02-01)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.34.2 | Stable | 2022-02-01 | 2022-12-15 | 1.26.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | ebca829a100a92c4b96f05f421c9e5d2 |
SHA1 | f9d21990e4ae6f64eac6bd6aa6d65899583d1311 |
SHA256 | 2141bd8fb2537f0242b30998938d780bd53cedbf2b04622b956923f677a56350 |
SHA512 | 02d33bdfb65bf5ab949da8ae0a1bb9f04a509564c8d4a74cc08f5033040987152abd42743b0720290304f4bd5c4e50550327117efb6eda01d3b0ed8ef357938e |
JAR Checksum | Value |
---|---|
humio-core-dev | a927eb85f709561b659e3a566a5b0fd3e6b3be84b19db2832d70722897265cbb |
humio-dev | 426715cb9faedce379d6a6add003cfcaa3fe9ce5b5ce706fab202b89eb5c8c45 |
kafka-dev | f181a5a1668d6c3f1ebe5e5216a00b393ee20eb0f1845d1a93309fdbfac8406d |
zookeeper-dev | 361063a0a2eb0361209781f7dff9d5f0067b33806f14882fc4a0a0ff9f434b66 |
Updated dependencies with security fixes and weakness.
Bug Fixes
Summary
Updated dependencies to follow-redirects for CVE-2022-0155.
Fixes an issue with epoch and offsets not always being stripped from segments.
Fixed an issue where queries of the form #someTagField != someValue ... would sometimes produce incorrect results.
Updated dependencies to Jawn for CVE-2022-21653.
Updated dependencies to node-fetch for CVE-2022-0235.
Fixed an issue where live queries would sometimes double-count parts of the historic data.
Updated dependencies to nanoid for CVE-2021-23566.
Updated dependencies to Akka for CVE-2021-42697.
Humio Server 1.34.1 Stable (2022-01-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.34.1 | Stable | 2022-01-06 | 2022-12-15 | 1.26.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 1d6b54fc6b4f52abff6c1106a904e4d1 |
SHA1 | 67e6e0cd4e6eb59a0d88f85dc0f511aefacef1dc |
SHA256 | 23f50f620fd5e51755521aba8185b76e4ca0187206fd55e8ed5fbbe14e42578b |
SHA512 | 6ad8fe4040b7c2e80643071e05b1d305f6d66e74c4041d3a4ac56f84ec6fd3f2b63c04c421029c436f081b8ab22e8a60bf17c5330f7fe117d178c596526a344f |
Value | JAR Checksum |
---|---|
humio-core-dev | fa7e9355cd4f41e64b404e65e33166c28fdc6c2ce5ceeea382007778f9ff64ce |
humio-dev | e66c6b3fcf45bd36502c877e8a4a617f9f662c5cf672e6c6c73b45445d41ad20 |
kafka-dev | 459b3a6df8a678493bfb3266d243b867ed3ae4251464276c854afa0b2f784dac |
zookeeper-dev | 748cfc151533e1e2efc870299bc5c2b10fda97ec0c6f522dd8c8576d9aea315e |
Updated dependencies with security fixes and weakness.
Bug Fixes
Summary
Updated dependencies to Netty to fix CVE-2021-43797
Updated dependencies to log4j 2.17.1 to fix CVE-2021-44832 and CVE-2021-45105
Updated dependencies to Jackson to fix a weakness
Humio Server 1.34.0 Stable (2021-12-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.34.0 | Stable | 2021-12-15 | 2022-12-15 | 1.26.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 4dc3b67c42b44e59e0ad6cc02a220f12 |
SHA1 | 099a9ae07d5595fb06c145aaa80b46ba9f74dd10 |
SHA256 | 22cd6f60f030d56bcae159b853efe6dcd76f7add127e64c37bcca58c66d1a155 |
SHA512 | 2645369a9ec989c1b40b190993ecbd4eca8be63b60318a1b1259124819446c06c3bbba92a9c22f1e194133b9da5d05b6c0346369c33e8c33a9777a2a168ae524 |
1.34 REQUIRES minimum version 1.26.0 of Humio to start. Clusters wishing to upgrade from older versions must upgrade to 1.26.0+ first. After running 1.34.0 or later, you cannot run versions prior to 1.26.0.
Improvements, new features and functionality
UI Changes
Added buttons for stopping all queries, streaming queries, and historical queries from inside the query monitor.
Validation error messages are now more precise and have improved formatting.
Updated the links for Privacy Notice and Terms and Conditions.
The overall look of message boxes in Humio has been updated.
Added autofocus to the first field when opening a dialog using the save as functionality from the Search page.
Added maximum width to tabs on the Group page, so they do not keep expanding forever.
Allow resize of columns in the event list by mouse.
Dark mode is officially deemed stable enough to be out of beta.
Disable actions if permissions are handled externally.
GraphQL API
Added GraphQL mutation clearRecentQueries which a user can run to clear their recent queries in a specific view or repository.
The GraphQL field isEventForwardingEnabled on the HumioMetadata type is deprecated, as it is no longer in use internally. If you rely on this, please let us know.
Changed old personal user token implementation to hash based.
Renamed the deleteEvents related GraphQL mutations and queries to redactEvents. The redactEvents API is intended for redacting sensitive data from a repository, not for bulk deletion of events. We think the new name invites fewer misunderstandings.
Added three GraphQL mutations for stopping queries: stopAllQueries, stopStreamingQueries, and stopHistoricalQueries.
Added 2-phase migration that will allow old user api tokens to be used and clean global from secrets after a 30 day period.
Configuration
When checking if the ViewAction.EventForwarding action is allowed (with e.g. SearchDomain.isActionAllowed), the answer will now be false if the event forwarding is not enabled on the server.
Other
Improved shutdown logic slightly, helping prevent thread pools from getting stuck or logging spurious errors during shutdown.
Added new metric: bucket-storage-upload-latency-max. It shows the amount of time spent for the event that that has been pending for upload to bucket storage the longest.
Refactored query functions join, selfjoin, and selfjoinfilter into user-visible and internal implementations.
Added management API to put hosts in maintenance mode.
New metric: ingest-request-delay. Histogram of ingest request time spent being delayed due to exceeding limit on concurrent processing of ingest (milliseconds).
Node roles can now be assigned/removed at runtime.
Added validation and a more clear error message for queries with a time span of 0.
Retention based on compressed size will no longer account for segment replication.
Made the transfer coordinator display more clear errors instead of an internal server error for multinode clusters.
Added Australian states to the States dropdown.
Improved partition layout auto-balancing algorithm.
Added support in the humio event collector for organization- and system-wide ingest tokens and the ability to use a parser from a different repo than the one being ingested into.
It is now possible to create actions, alerts, scheduled searches, and parsers from Yaml template files.
Query validation has been improved to include several errors which used to first show up after submitting search.
Reduce limit on number of datasources for sandbox repositories created when a user is created to .0 by default.
Improved the error reporting when installing, updating or exporting a package fails.
Added "export as yaml" function to the list pages of parsers, actions and scheduled searches.
Improved error messages when an invalid regular expression is used in replace.
Minor optimization when using groupBy with a single field.
Prepopulate email field when invited user is filling in a form with this information.
Added checksum verification within hash filter files on read.
Improved handling of multiple nodes attempting to create views with the same names at the same time, as might happen when bootstrapping a cluster.
Added a precondition that ensures that the number of ingest partitions cannot be reduced.
A compressed segment with a size of 1GB will now always count for retention as 1 GB. Previously, a compressed segment with a size of 1GB might count for more than 1GB when calculating retention, if that segment had more replicas than configured. The effect on the retention policy was that if you had configured retention of .0GB compressed bytes, Humio might retain less than .0GB of compressed data if any of those segments had too many replicas.
It is now possible to ingest logs into Humio using LogStash v.7.13 and upwards.
Improved performance of the query functions drop() and rename() by quite a bit.
Added a minSpan parameter to timechart() and bucket(), which can be used to specify a minimum span when using a short time interval.
The
kvParse()
query function can now parse unquoted empty values using the new parameter separatorPadding to specify if your data has whitespace around the key-value separator (typically =). The default is "Unknown", which will leave the functionality of the function unchanged.Added a communityID function for calculating hashes of network flow tuples according to the [Community ID Spec](https://github.com/corelight/community-id-spec).
Added query function math:arctan2 to the query language.
Create, update, and delete of dashboards is now audit logged.
Query editor: improved code completion of function names.
Reword regular expression related error messages.
Added metric for the number of currently running streaming queries.
Bug Fixes
Other
When an alert query encounters a warning and Humio is not configured to trigger alerts despite warnings (ALERT_DESPITE_WARNINGS=true, see [docs](https://library.humio.com/preview/docs/automated/alerts/throttle-period/#errors-warnings)), the warning text will now be shown as an error message on the alert in the UI.
Fixed an issue where a dashboard installed with a YAML file could be slightly different than what was specified in the file.
Fixed an issue where clicking on the counters of parsed events on the Parsers page would open an empty search page, except for built-in parsers. Now, it correctly shows the latest parsed events for all parsers (except package parsers).
Fixed a bug where shared lookup files could not be downloaded from the UI.
Fixed an issue where series() failed to serialize its state properly.
Alerts and scheduled searches are now enabled per default when created. The check disabling these entities if no actions are attached has been replaced with a warning, which informs a user that even though the entity is enabled, nothing will trigger since no actions are attached.
Fixed an issue that in rare cases would cause login errors.
Changes to the state of IOC access on organizations are now reflected in the audit log.
Fixed styling issue on the search page where long errors would overflow the screen.
Fixed an issue when adding a group to a repository or view than an error message is displayed when the user is not the organization owner or root.
Fixed an issue where missing undersized segments in a datasource might cause Humio to repeatedly transfer undersized segments between nodes.
Fixed an issue where comments spanning multiple lines wouldn't be colored correctly.
Changed field type for zip codes.
Fixed an issue where a failing event forwarder would be cached indefinitely and could negatively impact Humio performance.
Changes to the state of backend feature flags are now reflected in the audit log.
Fixed an issue where some regexes could not be used.
Fixed an issue where a scheduled search failed and was retried, if it had multiple actions and at least one action was unknown to Humio. Now, the unknown action is logged, but the scheduled search completes successfully and continues to the next scheduled run.
Fixed an issue where the web client could start queries from the beginning of time when scrolling backwards through events in the UI.
Fixed a compatibility issue with Filebeat 7.16.0
Fixed some widgets on dashboards reporting errors while waiting for data to load.
Fixed an issue on on-prem trial license that would use user count limits from cloud.
Fixed an edge case where Humio might create multiple copies of the same datasource when the number of Kafka partitions is changed. The fix ensures only one copy will be created.
Fixed an issue where OIDC without a discovery endpoint would fail to configure if OIDC_TOKEN_ENDPOINT_AUTH_METHOD was not set.
Updated dependencies to log4j 2.16 to remove of message lookups (CVE-2021-44228 and CVE-2021-45046)
Fixed an issue where the segment merger would write that the current node had a segment slightly before registering that segment in the local node.
The field vhost in internal Humio logging is now reserved for denoting the host logging the message. Other uses of vhost now uses the field hostId.
Fixed an issue where streaming (exporting) query results in JSON format could include extra "," characters within the output.
Include view+parser-name in thread dumps when time is spent inside a parser.
Addressed an issue causing Humio to sometimes error log an ArrayIndexOutOfBoundsException during shutdown.
Fixed an issue causing Humio running on Java 16+ to return incorrect search results when the input query contains Unicode surrogate pairs (e.g. when searching for an emoji).
Browser storage is now cleared when initiating while unauthenticated.
Fixed incorrect results when searching through saved queries and recent queries.
Remove the ability to create ingest tokens and ingest listeners on system repositories.
Removed a spurious warning log when requesting a non-existent hash file from S3.
Fixed an issue where an alert would not be throttled until after its actions had completed, which could make the alert trigger multiple times shortly after each other if an action was slow. Now, the alert is throttled as soon as it triggers.
Temporary fix of issue with live queries not having first aggregator as bucket() or timechart(), but then later in the query having those as a second aggregator. As a temporary fix, such queries will fail. In later releases, this will get fixed more properly.
Fixed an issue where the SegmentMoverJob could delete the local copy of a segment, if a pending download of the segment failed the CRC check. The job will now keep the downloaded file at a temporary path until the CRC check completes, to avoid deleting a local copy created by other jobs, e.g. by bucket downloads.
Fixed a bug in the validation of the ‘bits’ parameter of hashMatch() and hashRewrite().
Support Java 17.
Fixed a bug where query coordination partitions would not get updated.
When checking if the ViewAction.ChangeRepoConnections action is allowed (with e.g. SearchDomain.isActionAllowed), the answer will now be false if checked on a repository, as the action only makes sense on views.
Fixed a bug where invalid UTF-16 characters could not be ingested. They are now converted to 'ufffd'.
Fixed an issue where certain problems would highlight the first word in a query.
Fixed a bug with the cache not being populated between restarts on single node clusters.
Removed error query param from URL when entering Humio.
Fixed an issue on sandbox renaming, that would allow you to rename a sandbox and end up in a bad state.
Use a fresh (random) name for the tmp folder below the datadir to ensure that it is a proper subdir of the datadir and not a mount point.
Changed default package type to "application" on the export package wizard.
Fixed a number of stability issues with the event redaction job.
Alerts and scheduled searches are no longer run on cloud for organizations with an expired trial license, and on-prem for any expired license.
When creating or updating an action, the backend now verifies that the host url associated with the action is prefixed with either 'http://' or 'https://'. This affects Actions of the type: Webhook, OpsGenie, Single-Channel Slack and VictorOps.
Fixed a race condition that could cause Humio to delete more segments than expected when initializing a digester node.
Fixed an issue where error messages would show wrong input.
Fixed an issue where a digest node could be unable to rejoin the cluster after being shut down if all other digest nodes were also down at the time.
When performing jobs triggered via the Redact Events API, Humio could restart queries for unrelated views until the delete job completed. This has been improved, so only views affected by the delete will be impacted.
Fixed a bug where only part of the Users page was loading when navigating from the All organizations page.
Fixed an issue where release notes would not close when a release is open.
Fixed an issue in the interactive tutorial.
Crash the node if any of a number of critical threads die. This should help prevent zombie nodes.
No longer return the "Query Plan" in responses, but return a hash in the new field hashedQueryOnView instead. The plan could leak information not otherwise visible to the user, such as query prefixes being applied.
When checking if the ViewAction.ChangeS3ArchivingSettings action is allowed (with e.g. SearchDomain.isActionAllowed), the answer will now be false if checked on a view, as the action only makes sense on repositories.
Fixed a bug where offsets from one Kafka partition could be used when deciding where to start consuming for another partition, in the case where there were too many datasources in the repo. This led to a crash loop when the affected node was restarted.
Fixed an issue where choosing a UI theme would not get saved properly in the user's settings.
Fixed an issue where the segment merger could mishandle errors during merge.
Fixed an issue where sort() would cause events to be read ina non-optimal order for the entire query.
When a digester fails to start, rather than restarting the JVM as previous releases did, keep retrying to start assuming that the issue is transient, such as data for a single ingest partition being unavailable for a short while. While in this situation the process reports the metric for ingest latency on the affected partitions as being uptime of the JVM process at this point. The idea is to signal that data is not flowing on those partitions, so that a monitored metric can raise an alarm somewhere. In lack of a proper latency in this situation, it's better to have a growing non-zero metrics than having the metrics being zero.
Prevent unauthorized analytics requests being sent.
Humio Server 1.33.3 Preview (2021-12-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.33.3 | Preview | 2021-12-10 | 2021-12-15 | 1.26.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 10d2ee69d0bcdc6313fb3529912007ba |
SHA1 | 5be098e4f3f6500704e85c0763c918763b90aa34 |
SHA256 | eaefa5ce2c162fbd9d0a57d3b7c47dee828848eabdd7e96d885a812208c20a46 |
SHA512 | a9268b87f416d9b857eccb506c304ba7ca552cd6408ac13791b160e0d17c3d82e67213025ec7bca820e970676e4a24d1a1f4d20ff27e3cbc5bc30edf874e58a0 |
More security fixes related to log4j
logging.
Bug Fixes
Summary
Updated dependencies to address a critical security vulnerability for the log4j logging framework, "log4shell", (CVE-2021-44228).
Humio Server 1.33.2 Preview (2021-12-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.33.2 | Preview | 2021-12-10 | 2022-12-10 | 1.26.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 393be03445adbf84f63ef93b522b85fa |
SHA1 | 36454936dfe7c3863656043a8ee1d8639c1c198e |
SHA256 | e03616ba1d8d92e80031231ad7e2b7666121e7ccf7eee10f7a816241a90706ac |
SHA512 | 5d0504538cfa1db51f7188d4f6fef03aeb5a69b466f2e8367e91208745c4bf9050f271ffdf52ed6027796487ac11106726fbf3d7c3d6e259efa49f369793aa96 |
Security fix related to log4j
logging, and
fix compatibility with Filebeat.
Bug Fixes
Summary
Fixed a compatibility issue with Filebeat 7.16.0
Updated dependencies to address a critical security vulnerability for the log4j logging framework, "log4shell", (CVE-2021-44228).
Humio Server 1.33.1 Preview (2021-11-23)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.33.1 | Preview | 2021-11-23 | 2022-11-23 | 1.26.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | d9f270df38f2ce472801c81a06fa67af |
SHA1 | c5740a06b4b86a8615767c388a7cf6d3e3a8ccf1 |
SHA256 | ed3c03b5dcb8fe2c7230bae2775346283d7cdc143854260672a5ba66f11d612b |
SHA512 | d2762a9fa648af32e85205b4d972ad15d47870fc030c111d31ca4d048ce9459ce6e50a3bce0063f0c7347a6640181b4e3c41d1273a4c82b297fd8d3c844c529a |
Critical bug fixes related to version dependencies, alert throttling, etc.; Improve Interactive Tutorial.
Bug Fixes
Summary
Fixed an issue that in rare cases would cause login errors.
Fixed an issue in the interactive tutorial.
Fixed an issue where an alert would not be throttled until after its actions had completed, which could make the alert trigger multiple times shortly after each other if an action was slow. Now, the alert is throttled as soon as it triggers.
Reverted from 1.33.0 Errors on alerts, which are shown in the alert overview, are now only cleared when either the alert query is updated by a user or the alert triggers. Previously, errors that occurred when actions were triggered would be removed when the alert no longer triggered. Now, they will be displayed until the actions trigger successfully. Conversely, errors that occur when running the query may now remain until the next time the alert triggers, where they would previously be removed as soon as the query run again without errors.
Fixed a race condition that could cause Humio to delete more segments than expected when initializing a digester node.
Updated a dependency to a version fixing a critical bug.
Humio Server 1.33.0 Preview (2021-11-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.33.0 | Preview | 2021-11-15 | 2022-11-15 | 1.26.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 2964782694b82a39cc5b644d040fae68 |
SHA1 | b520dbabec0321b953c496b960710ba5fb6614a7 |
SHA256 | 8b8de633ca08c9592ee2441b0498de1a86aa4093a505821923be7e8501b62526 |
SHA512 | be827349bf450d51b4c42c55c13120ba735196f598eaec798a7eb11b8e1320a6ad86caefca3841a3560013311e30347dc595a96ed59d4cb5c0cf946e72208ac2 |
You can now use the mouse to resize columns in the event list. Previously you had to click the column header and use the "Increase / Decrease Width" buttons.
Improvements, new features and functionality
UI Changes
Allow resize of columns in the event list by mouse.
Disable actions if permissions are handled externally.
Dark mode is officially deemed stable enough to be out of beta.
Added autofocus to the first field when opening a dialog using the save as functionality from the Search page.
Validation error messages are now more precise and have improved formatting.
The overall look of message boxes in Humio has been updated.
Added buttons for stopping all queries, streaming queries, and historical queries from inside the query monitor.
Added maximum width to tabs on the Group page, so they do not keep expanding forever.
Updated the links for Privacy Notice and Terms and Conditions.
GraphQL API
Renamed the deleteEvents related GraphQL mutations and queries to redactEvents. The redactEvents API is intended for redacting sensitive data from a repository, not for bulk deletion of events. We think the new name invites fewer misunderstandings.
Added GraphQL mutation clearRecentQueries which a user can run to clear their recent queries in a specific view or repository.
Changed old personal user token implementation to hash based.
The GraphQL field isEventForwardingEnabled on the HumioMetadata type is deprecated, as it is no longer in use internally. If you rely on this, please let us know.
Added three GraphQL mutations for stopping queries: stopAllQueries, stopStreamingQueries, and stopHistoricalQueries.
Added 2-phase migration that will allow old user api tokens to be used and clean global from secrets after a 30 day period.
Configuration
When checking if the ViewAction.EventForwarding action is allowed (with e.g. SearchDomain.isActionAllowed), the answer will now be false if the event forwarding is not enabled on the server.
Other
Added a minSpan parameter to timechart() and bucket(), which can be used to specify a minimum span when using a short time interval.
Improved performance of the query functions drop() and rename() by quite a bit.
Reword regular expression related error messages.
A compressed segment with a size of 1GB will now always count for retention as 1 GB. Previously, a compressed segment with a size of 1GB might count for more than 1GB when calculating retention, if that segment had more replicas than configured. The effect on the retention policy was that if you had configured retention of .0GB compressed bytes, Humio might retain less than .0GB of compressed data if any of those segments had too many replicas.
It is now possible to create actions, alerts, scheduled searches, and parsers from Yaml template files.
Added validation and a more clear error message for queries with a time span of 0.
Made the transfer coordinator display more clear errors instead of an internal server error for multinode clusters.
Added management API to put hosts in maintenance mode.
Refactored query functions join, selfjoin, and selfjoinfilter into user-visible and internal implementations.
Improved shutdown logic slightly, helping prevent thread pools from getting stuck or logging spurious errors during shutdown.
Create, update, and delete of dashboards is now audit logged.
Added Australian states to the States dropdown.
Added support in the humio event collector for organization- and system-wide ingest tokens and the ability to use a parser from a different repo than the one being ingested into.
Improved handling of multiple nodes attempting to create views with the same names at the same time, as might happen when bootstrapping a cluster.
Added metric for the number of currently running streaming queries.
Added new metric: bucket-storage-upload-latency-max. It shows the amount of time spent for the event that that has been pending for upload to bucket storage the longest.
Node roles can now be assigned/removed at runtime.
Query validation has been improved to include several errors which used to first show up after submitting search.
Improved error messages when an invalid regular expression is used in replace.
Minor optimization when using groupBy with a single field.
Query editor: improved code completion of function names.
Added "export as yaml" function to the list pages of parsers, actions and scheduled searches.
Reduce limit on number of datasources for sandbox repositories created when a user is created to .0 by default.
Added a communityID function for calculating hashes of network flow tuples according to the [Community ID Spec](https://github.com/corelight/community-id-spec).
Improved partition layout auto-balancing algorithm.
Added checksum verification within hash filter files on read.
It is now possible to ingest logs into Humio using LogStash v.7.13 and upwards.
Prepopulate email field when invited user is filling in a form with this information.
Improved the error reporting when installing, updating or exporting a package fails.
Retention based on compressed size will no longer account for segment replication.
New metric: ingest-request-delay. Histogram of ingest request time spent being delayed due to exceeding limit on concurrent processing of ingest (milliseconds).
Added a precondition that ensures that the number of ingest partitions cannot be reduced.
Added query function math:arctan2 to the query language.
The
kvParse()
query function can now parse unquoted empty values using the new parameter separatorPadding to specify if your data has whitespace around the key-value separator (typically =). The default is "Unknown", which will leave the functionality of the function unchanged.
Bug Fixes
Other
Fixed an issue where some regexes could not be used.
Temporary fix of issue with live queries not having first aggregator as
bucket()
ortimechart()
, but then later in the query having those as a second aggregator. As a temporary fix, such queries will fail. In later releases, this will get fixed more properly.No longer return the "Query Plan" in responses, but return a hash in the new field hashedQueryOnView instead. The plan could leak information not otherwise visible to the user, such as query prefixes being applied.
Changed default package type to "application" on the export package wizard.
Fixed an issue where release notes would not close when a release is open.
Errors on alerts, which are shown in the alert overview, are now only cleared when either the alert query is updated by a user or the alert triggers. Previously, errors that occurred when actions were triggered would be removed when the alert no longer triggered. Now, they will be displayed until the actions trigger successfully. On the other hand, errors that occur when running the query may now remain until the next time the alert triggers, where they would previously be removed as soon as the query run again without errors.
This change was reverted in 1.33.1.
Fixed incorrect results when searching through saved queries and recent queries.
Fixed a bug where only part of the Users page was loading when navigating from the All organizations page.
Fixed an issue where choosing a UI theme would not get saved properly in the user's settings.
Changed field type for zip codes.
Fixed an edge case where Humio might create multiple copies of the same datasource when the number of Kafka partitions is changed. The fix ensures only one copy will be created.
Fixed an issue when adding a group to a repository or view than an error message is displayed when the user is not the organization owner or root.
Fixed a bug where query coordination partitions would not get updated.
Fixed an issue where comments spanning multiple lines wouldn't be colored correctly.
Fixed styling issue on the search page where long errors would overflow the screen.
Browser storage is now cleared when initiating while unauthenticated.
When checking if the ViewAction.ChangeS3ArchivingSettings action is allowed (with e.g. SearchDomain.isActionAllowed), the answer will now be false if checked on a view, as the action only makes sense on repositories.
Fixed an issue causing Humio running on Java 16+ to return incorrect search results when the input query contains Unicode surrogate pairs (e.g. when searching for an emoji).
When a digester fails to start, rather than restarting the JVM as previous releases did, keep retrying to start assuming that the issue is transient, such as data for a single ingest partition being unavailable for a short while. While in this situation the process reports the metric for ingest latency on the affected partitions as being uptime of the JVM process at this point. The idea is to signal that data is not flowing on those partitions, so that a monitored metric can raise an alarm somewhere. In lack of a proper latency in this situation, it's better to have a growing non-zero metrics than having the metrics being zero.
Fixed some widgets on dashboards reporting errors while waiting for data to load.
Fixed a bug in the validation of the ‘bits’ parameter of hashMatch() and hashRewrite().
Fixed an issue where a failing event forwarder would be cached indefinitely and could negatively impact Humio performance.
Fixed an issue where certain problems would highlight the first word in a query.
Removed error query param from URL when entering Humio.
Fixed an issue where series() failed to serialize its state properly.
Fixed a number of stability issues with the event redaction job.
When checking if the ViewAction.ChangeRepoConnections action is allowed (with e.g. SearchDomain.isActionAllowed), the answer will now be false if checked on a repository, as the action only makes sense on views.
Fixed an issue where a digest node could be unable to rejoin the cluster after being shut down if all other digest nodes were also down at the time.
Use a fresh (random) name for the tmp folder below the datadir to ensure that it is a proper subdir of the datadir and not a mount point.
Fixed an issue where a scheduled search failed and was retried, if it had multiple actions and at least one action was unknown to Humio. Now, the unknown action is logged, but the scheduled search completes successfully and continues to the next scheduled run.
Fixed an issue where a dashboard installed with a YAML file could be slightly different than what was specified in the file.
Fixed an issue where sort() would cause events to be read ina non-optimal order for the entire query.
Include view+parser-name in thread dumps when time is spent inside a parser.
Fixed an issue where error messages would show wrong input.
Changes to the state of backend feature flags are now reflected in the audit log.
When creating or updating an action, the backend now verifies that the host url associated with the action is prefixed with either 'http://' or 'https://'. This affects Actions of the type: Webhook, OpsGenie, Single-Channel Slack and VictorOps.
Crash the node if any of a number of critical threads die. This should help prevent zombie nodes.
Fixed a bug where invalid UTF-16 characters could not be ingested. They are now converted to 'ufffd'.
Addressed an issue causing Humio to sometimes error log an ArrayIndexOutOfBoundsException during shutdown.
Fixed an issue where the SegmentMoverJob could delete the local copy of a segment, if a pending download of the segment failed the CRC check. The job will now keep the downloaded file at a temporary path until the CRC check completes, to avoid deleting a local copy created by other jobs, e.g. by bucket downloads.
When performing jobs triggered via the Redact Events API, Humio could restart queries for unrelated views until the delete job completed. This has been improved, so only views affected by the delete will be impacted.
Fixed an issue on sandbox renaming, that would allow you to rename a sandbox and end up in a bad state.
Alerts and scheduled searches are no longer run on cloud for organizations with an expired trial license, and on-prem for any expired license.
When an alert query encounters a warning and Humio is not configured to trigger alerts despite warnings (ALERT_DESPITE_WARNINGS=true, see [docs](https://library.humio.com/preview/docs/automated/alerts/throttle-period/#errors-warnings)), the warning text will now be shown as an error message on the alert in the UI.
Support Java 17.
Prevent unauthorized analytics requests being sent.
Fixed an issue where OIDC without a discovery endpoint would fail to configure if OIDC_TOKEN_ENDPOINT_AUTH_METHOD was not set.
The field vhost in internal Humio logging is now reserved for denoting the host logging the message. Other uses of vhost now uses the field hostId.
Fixed a bug with the cache not being populated between restarts on single node clusters.
Fixed an issue where the web client could start queries from the beginning of time when scrolling backwards through events in the UI.
Alerts and scheduled searches are now enabled per default when created. The check disabling these entities if no actions are attached has been replaced with a warning, which informs a user that even though the entity is enabled, nothing will trigger since no actions are attached.
Removed a spurious warning log when requesting a non-existent hash file from S3.
Remove the ability to create ingest tokens and ingest listeners on system repositories.
Fixed a bug where shared lookup files could not be downloaded from the UI.
Fixed a bug where offsets from one Kafka partition could be used when deciding where to start consuming for another partition, in the case where there were too many datasources in the repo. This led to a crash loop when the affected node was restarted.
Fixed an issue where the segment merger could mishandle errors during merge.
Fixed an issue on on-prem trial license that would use user count limits from cloud.
Fixed an issue where the segment merger would write that the current node had a segment slightly before registering that segment in the local node.
Changes to the state of IOC access on organizations are now reflected in the audit log.
Fixed an issue where missing undersized segments in a datasource might cause Humio to repeatedly transfer undersized segments between nodes.
Fixed an issue where clicking on the counters of parsed events on the Parsers page would open an empty search page, except for built-in parsers. Now, it correctly shows the latest parsed events for all parsers (except package parsers).
Humio Server 1.32.8 Stable (2022-03-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.8 | Stable | 2022-03-09 | 2022-10-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 94782d07a7feda72ffc831747e6740f1 |
SHA1 | 8c1afb6e1b4fe6e5eabe30823e7705b7a03a7af5 |
SHA256 | 76eaa3581ad45443af93dd9e6f92f51142bdc082ba8af234b0ffc7f4346ef630 |
SHA512 | 6929950a72ee073402aea63a3acc016b15ae435ba5c9cf4c24b94fbf51af01c4ccfa4da223374527b597c154f0ca72a114feb0ec45bfae55fad8be17645bccf5 |
JAR Checksum | Value |
---|---|
humio-core-dev | 49d2631113684a8fc8b3ad53e5545a661961607a3033357ee977ce50d0b49f0a |
humio-dev | d8f1892f444ab53d2e94419a096978da0eba8d7a995096d9b6f031162fd3bb3c |
kafka-dev | 3bbbaec63eb2ca089800172d94e95f6bb84266dcbac3e76217f50c4169133546 |
zookeeper-dev | 9830902ac961b08c778f38b8714dcfab6be076c1acc5366db459a8560cb6eb61 |
Updated dependencies with security fixes and weakness and improved performance.
Bug Fixes
Summary
Fixes issue with epoch and offsets not always being stripped from segments.
Performance improvements of Ingest and internal caching.
Fixed an issue where queries of the form #someTagField != someValue ... would sometimes produce incorrect results.
Updated dependencies to Akka to fix CVE-2021-42697.
Updated dependencies to jawn to fix CVE-2022-21653.
Humio Server 1.32.7 Stable (2022-01-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.7 | Stable | 2022-01-06 | 2022-10-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 30080b4b84bb4aba37eb11023019bd78 |
SHA1 | c53f4ac43beee249a68c90cae62d0b768b1284d7 |
SHA256 | 192b0554f6cbdfd5853cc90d8a418497df800da85bc0795238fc359aae8fa309 |
SHA512 | 0119341a2d041b0143a849881279274b7aef6589e8f90730907401562d03c631065bdb6f3e567b9cdffe31e572c570414f9386ef12e39ffaefdb4a8a5d70f479 |
Value | JAR Checksum |
---|---|
humio-core-dev | c1efbc9ae9dd76ccbaa674e63ff0029625724c1bb82f3b759cf692f65b3861fc |
humio-dev | c286be555ee8e333acaa87ff010a8b6ecda18cd57c57b2925513b300792c021c |
kafka-dev | e0d67223acc40bc46d9205286655b28e5c5adfdacbd86441e57e4939113805ee |
zookeeper-dev | c5a7a9ab2dc6be82defe163499b943b727697a3e5d06fc8ead128240e596beb9 |
Updated dependencies with security fixes and weakness.
Bug Fixes
Summary
Updated dependencies to Jackson to fix a weakness
Updated dependencies to log4j 2.17.1 to fix CVE-2021-44832 and CVE-2021-45105
Updated dependencies to Netty to fix CVE-2021-43797
Humio Server 1.32.6 Stable (2021-12-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.6 | Stable | 2021-12-15 | 2022-10-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 7faf420472dbc06536e7478f9b62ab9b |
SHA1 | 77ab5617ec6a9ea24d5db93d82e44a6baa9b8bc2 |
SHA256 | f77c2758074e6ed3b0543531e8ad8ca8a62b934484ee2ac820eabcdd9c572b20 |
SHA512 | 777a8f6e1f2371aea2f9aaeed46633c5c0837e96b1a902433adb7ad8fd98efdaf0f1b21fbae5c8ddb9b5099c4f85e70a0d5a7e9ca00a47b2f2293c9b37c129fe |
Security fix related to log4j
logging, and
fix compatibility with Filebeat.
Bug Fixes
Summary
Fixed issue where streaming (exporting) query results in JSON format could include extra "," characters within the output.
Updated dependencies to log4j 2.16 to remove of message lookups (CVE-2021-45046)
Humio Server 1.32.5 Stable (2021-12-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.5 | Stable | 2021-12-10 | 2022-10-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | e4475e8c2f6623ff22465ccd59bbfb8a |
SHA1 | 5affbdbd10674259ec178db75171d73eb2835f1d |
SHA256 | 92c0261e328c43f0ba46ffaa72fc5e8a1ef075438759286ab00ea5dbb5b5ca30 |
SHA512 | e698dd4a2aa8c85ca3d89cc596e05677106d509082f816e46b3dca6b4b3313690d4c41c3a5b5529d08d91e51ebbfb3f9217e7830d1f4ade54fd79b40f366f449 |
Security fix related to log4j
logging.
Bug Fixes
Summary
Updated dependencies to address a critical security vulnerability for the log4j logging framework, "log4shell", (CVE-2021-44228).
Humio Server 1.32.4 Stable (2021-12-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.4 | Stable | 2021-12-10 | 2022-10-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 237975851200cd2a21b749ea3994f307 |
SHA1 | 0e6acfcbc13150c83861af51798d8f4510de7bb4 |
SHA256 | 99a86034dc2e26f0779a64a11633563f59dbc94959b85f80f996e5c267053ae4 |
SHA512 | aba67fee43c26d832cc9fb0a5ce3af0faabb596bc33c597eaba83f8f7d3e7da1ec61f6554c257ca7063991a802fdd4149f90e25db856751ca538c1d2f5262a40 |
Security fix related to log4j
logging, and
fix compatibility with Filebeat.
Bug Fixes
Summary
Updated dependencies to address a critical security vulnerability for the
log4j
logging framework, "log4shell", (CVE-2021-44228).Fixed a compatibility issue with Filebeat 7.16.0
Humio Server 1.32.3 Stable (2021-12-01)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.3 | Stable | 2021-12-01 | 2022-10-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | a930565c1e42104fcf6b963089db33ec |
SHA1 | b4818b51348ae64bf79104813d89fb34ec183a71 |
SHA256 | a100e4eb4161b0dc01ac745dffd5bb22839c557fd120f2ddb8359981558af5d5 |
SHA512 | fb2439171324b098a870bb143e4442bacd007c0f18c2fce9ead458e6f05d8672f3f4309e4c59c7b74a6c74763b6936707f67f36eb645847f0daaee75badd4f9a |
Bug fix to resolve problem with clusters using bucket storage.
Bug Fixes
Summary
Fixed an issue that would result in a query not completing when one of the involved segments was deleted locally while the query was running. This could happen on clusters using bucket storage with more data than fits the local disks.
Humio Server 1.32.2 Stable (2021-11-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.2 | Stable | 2021-11-19 | 2022-10-26 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 098c372a532df86516d89e7d257f86b6 |
SHA1 | ea67955c0cad253a0278fe408fcce7d300491455 |
SHA256 | f2289d4bf0321e0dde905a8d4148d709e5ac846fdd055c7133172f5d33ef9fe0 |
SHA512 | 1bb52a2333339201a7c56f2d0d93997e60ea5b62d5b2ec1dc9f84d812b50c3e5ebca8039de029ecdb14e00885f9e9965532acc13dd339589a45a836a5548b849 |
Critical bug fix regarding version dependency, and race conditions.
Bug Fixes
Summary
Updated a dependency to a version fixing a critical bug.
Fixed a race condition that could cause Humio to delete more segments than expected when initializing a digester node.
Humio Server 1.32.1 Stable (2021-11-16)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.1 | Stable | 2021-11-16 | 2022-10-26 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 7717b075d0e60780caf64c8a70afdf57 |
SHA1 | 02e400753b475b1ba668399bc27126a12304e4a6 |
SHA256 | c5d36f6bbcd5c8bc90e5ba2a28ca15cf5f1c3657a56c40e9f46f7bfaf48149e1 |
SHA512 | 09d31840cd1442cfed31402bf52132a4c9960e3177b2c14e4b4da687333ae3995732a048c3b71ae7eb81ccfd40afee40e34085d6cc35da6b3cb826a57049f0a6 |
Bug fixes related to Amazon S3 log entries, saving a User Interface theme, Logtash, and general security.
Bug Fixes
Summary
Fixed an issue where choosing a UI theme would not get saved properly in the user's settings.
Security fix.
It is now possible to ingest logs into Humio using LogStash v.7.13 and upwards.
Removed a spurious warning log when requesting a non-existent hash file from S3.
Humio Server 1.32.0 Stable (2021-10-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.32.0 | Stable | 2021-10-26 | 2022-10-26 | 1.16.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 27311d8fb5172cc95aa7cb8d02f5c58c |
SHA1 | 0378ceb4d0ba9255dba6c213e1a728f7095e8ced |
SHA256 | 3dd0434039b1d8eaeb1d1242c860d51593ec222b3d09ae1d732503214edb6d06 |
SHA512 | b29267cd2e89cbbf88386a9c2e617c634ff05567388680b605804a0e3978fca4a55c483395d819ff27fbc53da6e29c09ff573c5f7ff00ab57dda45f5e20c1dd2 |
Humio packages can now carry scheduled searches, all types of actions, and files with lookup data (either CSV or JSON formatted). Additionally, we have improved the UI for managing packages, to make it easier to find the package you are looking for. This also marks the point where packages are brought out of beta.
Improvements, new features and functionality
UI Changes
Removed the pop-up link to edit an alert or scheduled search when on the form page. This link is only relevant when creating an entity from the search page via a dialog.
Updated the style of the email action template and made the wording used dependent on whether an alert or scheduled search was triggered.
Fixed some styling issue on Query Quotas page.
Cluster management pages style updates.
Breadcrumbs are aligned across all pages and show the package name with a link when viewing or editing an asset from a package.
The left navigation menu hides, and can be opened again, for mobile devices, on organization settings pages and repository settings pages.
The signup path was removed, together with the corresponding pages.
Identity provider pages style update.
Updated design for Package Marketplace and Installed Packages to make them easier to use and more consistent.
GraphQL API
Added a GraphQL mutation "cancelDeleteEvents" that allows cancelling a previously submitted deletion. Cancellation is best-effort, and events that have already been deleted will not be restored.
Deprecates the package field on the SearchDomain GraphQL type, in favor of packageV2. The new field has a simpler and more correct return type.
When using the GraphQL field allowedViewActions, the two previously deprecated actions ChangeAlertsAndNotifiers and ReadEvents are no longer returned. Look for their replacements ChangeTriggersAndActions and ReadContents instead.
Added information about the use of preview fields in the result from calling the GraphQL API. The information will be in the field extensions.preview and will be a list of objects with a name and reason field.
Deprecates the two GraphQL fields id and contentHash on the File type. The two fields are considered unused, so no alternatives are provided. If you rely on them, please let us know.
The GraphQL DateTime type now supports non-UTC time. Timestamps like 2021-07-18T14:13:09.517+02.0 are now legal, and will be converted to UTC time internally.
Extended 'Relative' field type for schema files to include support for the value 'now'.
The name, displayName, and location GraphQL fields on the File type are deprecated in favor of the new nameAndPath field.
Deprecates the copyFile GraphQL mutation, as it is no longer used. If you use this mutation, please let us know.
Deprecates the installPackageFromRegistry and updatePackageFromRegistry GraphQL mutations in favor of installPackageFromRegistryV2 and updatePackageFromRegistryV2.
The fileName, displayName, and location GraphQL fields on the UploadedFileSnapshot type are deprecated in favor of the new nameAndPath field.
Configuration
On a node configured as USING_EPHEMERAL_DISKS=true allow the local disk management deleting files even if a query may need them later, as the system is able to re-fetch the files from bucket storage when required. This improves the situation when there are active queries that in total have requested access to more segments than the local disk can hold.
Added compatibility mode for using IBM Cloud Object Storage as bucket storage via S3_STORAGE_IBM_COMPAT
The Scheduled Searches feature is no longer in beta and can be used by all users without enabling it first
Other
The test action functionality no longer uses alert terminology, as actions can be invoked from both alerts and scheduled searches. Also, it is now possible to also test the scheduled search specific message templates using it.
Added focus states to text field, selection and text area components.
New metric: "ingest-request-delay". Histogram of ingest request time spent being delayed due to exceeding limit on concurrent processing of ingest.
Improved handling of local disk space relative to `LOCAL_STORAGE_MIN_AGE_DAYS`: When the local disk would overflow by respecting that config, Humio can now delete the oldest local segments that are present in bucket storage, even when they are within that time range.
When selecting actions for alerts or scheduled searches, the actions are now grouped by the package they were imported from.
Raise size limit on ingest requests from 8MB to 1 GB
Added loading and error states to the page where user selects to create a new repository or view.
Added maximum width to tabs on the Group page, so they do not keep expanding forever.
You can now export and import packages containing any of the action types: Webhook, Email, Humio Repo, Pager Duty, Slack, Slack multi channel, Ops Genie and Victor Ops.
Added Dark Mode for Query Monitor page.
Allow launching using JDK-16.
Humio docker images is now based on the Alpine linux.
Warnings when running scheduled searches now show up as errors in the scheduled search overview page if [SCHEDULED_SEARCH_DESPITE_WARNINGS](https://library.humio.com/preview/reference/environment-variables/#var-scheduled-search-despite-warnings) is set to 'false' (the default).
Fixed an issue with using the browser back button while "advanced editing" the query text of a scheduled search or an alert would hide the blue bar that allows saving the query.
Scheduled search "schedule" is explained using human readable text such as "At 9.30 on Tuesdays".
Scheduled search "schedule" field is now validated, showing accurate help for each part of the crontab expression.
Improved search for users page.
Limit pending ingest requests by rejecting excess invocations. Rejections are signalled as status 429 "Too many requests" and a Retry-After header suggesting to retry in 5 seconds. Limiting starts when queued requests exceed INGEST_REQUEST_LIMIT_PCT of the total heap size, default is 5.
Added support for including dashboard and alert labels when exporting a package.
Improved audit log for organization creation.
Added explicit distribution information for elastic bulk API for elasticsearch API compatibility.
Improved error handling when running scheduled searches, so that a failed schedules search will be retried as long as it is within the [backfill limit](https://library.humio.com/preview/docs/automated/scheduled-search/#backfill-limit).
Added support for importing packages with CSV and JSON files. Exporting packages with files is not fully supported yet, but will be in a future release.
Improved performance in IP database lookups for the functions ipLocation(), asn() and worldMap().
Added a Data subprocessors page under account.
Package installation error messages are now much more readable.
Bug Fixes
Other
Fixed an issue where Humio attempted to fetch global from other nodes before TLS was initialized.
When accessing Humio through a URL with either a repository or view name in it and using an ingest token, it is now checked that the view on the token matches the repository or view in the URL, and a 403 Forbidden status is returned, if not.
Fixed an issue with the split() function which caused incorrect (usually, too few) query results in some cases where the output fields were refered to later in the query.
Fixed an issue where Shift+Enter would select the current completion rather than adding a newline.
Updated the examples on how to use the
match()
query function in the inline documentation.Fixed a bug causing the disk space job to use an expensive code path even when a cheaper one was available.
Fixed an issue where Humio would create auxiliary files (hash files) for segments unnecessarily when moving segments between nodes.
Fixed an issue that caused some errors to be hidden behind a message about "internal error".
When a search is able to filter out segments based on the hash filter files, and a segment file is not present locally on any node, fetch only the hash filter at first, evaluate that, and only if required, fetch the segment file. This speeds up searches that target segments only present in bucket storage and that have search filters that generate hash filter checks, such as regex and literal text comparisons.
Fixed a bug where a 404 Not Found status on an internal endpoint would be incorrectly reported as an 401 Unauthorized.
Fixed an issue where it was possible to submit queries to the Delete Events API that were not valid for that API. Only pure filtering queries are allowed.
Fixed an issue where the job responsible for deleting segment files off nodes was not deleting as many segments as it should.
The DiskSpaceJob now removes newly written backfilled segments off the local disk before it chooses to remove non-backfilled segments.
Fixed an issue where the query scheduler would spend too much time "shelving" queries, and not enough on getting them executed, leading to little progress on queries.
Fixed an issue where the job responsible for deleting segment files off nodes was not running as often as expected.
Updated dependencies with security fixes.
Amended an internal limit on how many segments can be fetched from bucket storage concurrently. The old limit was based on the number of running queries. The new limit is 32.
Fixed thread safety for a variable involved in fetching from bucket storage for queries.
Fixed an issue - when creating a repository a user is automatically assigned a role but isn't able to see himself in the roles list. Also, when editing roles the assignment is not counted correctly under usage.
Fixed an issue where new groups added to a repository got a query prefix that disallowed search. The default is now to allow search with the queryprefix *.
Fixed an issue where certain problems highlighted the first word in a query, not the location of the problem.
Updated the new asset dialog button text so that it will say 'Continue' when an asset will not be created directly.
Updated Elastic ingest endpoint to accept 'create' operations in addition to 'index' operations. Both operation types result in the same ingest behavior. This update was added as Fluent-Bit v1.8.3 began using the 'create' operation rather than 'index' for ingest.
Updated Slack action for messaging multiple channels, so it propogates errors when triggered. Previously errors were ignored.
Fixed an issue where Humio would create a broken hash file for the merge result when merging minisegments that did not originally have hash files.
Fixed an issue where the DiskSpaceJob could mark segments accessed slightly out of order during boot.
Truncate long user names on the Users page.
Cloning an asset now redirects you to the edit page for the asset for all assets.
Fixed a bug on queries that triggered an error while executing due to the input (such as a regex that exceeds limits on execution time) could result in the client getting 404 as status on poll, where it should get .0.
Removed an old Cloud Signups page. The page is not necessary since organizations were implemented for the Cloud environments.
Fixed an issue where the global consistency check job would fail to perform the consistency check, instead logging lines like "Global dump requested but global had expired". This line can still occur, but only when the consistency check takes too long.
Global snapshots are now uploaded to bucket storage more often when there are a lot of updates to it, leading to shorter replay times on startup.
The DiskSpaceJob no longer initializes based off of the segment last-modified timestamp, this only happens if no access order snapshot is stored locally. If a snapshot is present, we trust that.
Fixed an issue where the DiskSpaceJob could continue tracking segments if they were deleted from global, but the files were still present locally.
The simple and advanced permission model has been merged, thus allowing users who were using the simple permission model to create their own permission roles and groups, create groups with default roles, and all other features that were previously only available in advanced permissions mode.
Creating a new dashboard now opens it after creation.
Fixed an issue that could cause UploadedFileSyncJob to crash if an uploaded file went missing.
Fixed an issue where, looking at GraphiQL, the dropdown from the navigation menu was partially hidden.
Fixed an issue where metrics of type gauge with a double value were not reported to the humio-metrics repository, but only to the humio repository.
Split package export page into dialog with multiple steps.
Reworded a confusing error message when using the top() function with a limit parameter exceeding the limits configured with TOP_K_MAX_MAP_SIZE_HISTORICAL or TOP_K_MAX_MAP_SIZE_LIVE.
Security when viewing installed packages and packages on the marketplace are now less strict. Permissions are still required for installing and uninstalling packages.
Introduced a check for compatibility for packages and humio versions.
Fixed a bug where a hidden field named "#humioAutoShard" would sometimes show up in the field list.
Fixed an issue that caused some metrics of type gauge to be reported with a wrong value.
Fixed an issue where Humio would retain segments acquired from read-only buckets if those segments were deleted. Humio will now properly delete the segments locally, and drop the reference to the copy in the read-only bucket.
Fixed a bug which potentially have caused alerts to not re-fire after the throttle period for field-based throttling had passed.
Fixed an issue that could cause cluster nodes to crash when growing the number of digest partitions.
Fixed an issue where the {time_zone} [message template](https://docs.humio.com/docs/actions/message-template/) for actions would show a full description of the scheduled search instead of only the time zone.
Fixed an issue where top() with max= can yield the same key multiple times (ei. ...| top([queryId, query], max=totalSize)).
Humio Server 1.31.0 Preview (2021-09-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.31.0 | Preview | 2021-09-27 | 2021-10-26 | 1.16.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 4b4b4411d930d00275bc3a412c0c5c50 |
SHA1 | ca22652ca303a162f81711f43977e14e528f6e85 |
SHA256 | 908a907b5c1ffbdce667b932daea0aab46a8ece4e164072f5bae0eb77d3bdd6f |
SHA512 | bbc65ea8641ac3d9910da4a9dcda0c1817d2a8acc2e81491a389d2671af7e57c12f019ad71af7309d4ad68b67997a6cbd3b0fba3a2048f07b7c7567abd05b8ae |
We now distribute Humio as a tarball in addition to the fat jar format we've previously used. We will continue to distribute the fat jar for the time being. The tarball includes a launcher script, which will set a number of JVM arguments for users automatically. We believe this will help users configure Humio for good performance out of the box. For more information, see Launcher Script.
Search performance via hashfilter-first on segments in buckets
Some searches, including regex and literal string matches, now allow searching without fetching the actual segment files from the bucket, in case the segment is only present in the bucket and not on any local disk. Humio now fetches the hash filter file and uses that to decide if the segment file may have a match before downloading the segment file in this case.
Humio packages can now carry scheduled searches, all types of actions, and files with lookup data (either CSV or JSON formatted). Additionally, we have improved the UI for managing packages, to make it easier to find the package you are looking for. This also marks the point where packages are brought out of beta.
Improvements, new features and functionality
UI Changes
The left navigation menu hides, and can be opened again, for mobile devices, on organization settings pages and repository settings pages.
The signup path was removed, together with the corresponding pages.
Cluster management pages style updates.
Removed the pop-up link to edit an alert or scheduled search when on the form page. This link is only relevant when creating an entity from the search page via a dialog.
Identity provider pages style update.
Updated design for Package Marketplace and Installed Packages to make them easier to use and more consistent.
Fixed some styling issue on Query Quotas page.
Breadcrumbs are aligned across all pages and show the package name with a link when viewing or editing an asset from a package.
Updated the style of the email action template and made the wording used dependent on whether an alert or scheduled search was triggered.
GraphQL API
When using the GraphQL field allowedViewActions, the two previously deprecated actions ChangeAlertsAndNotifiers and ReadEvents are no longer returned. Look for their replacements ChangeTriggersAndActions and ReadContents instead.
Deprecates the two GraphQL fields id and contentHash on the File type. The two fields are considered unused, so no alternatives are provided. If you rely on them, please let us know.
The fileName, displayName, and location GraphQL fields on the UploadedFileSnapshot type are deprecated in favor of the new nameAndPath field.
Added a GraphQL mutation "cancelDeleteEvents" that allows cancelling a previously submitted deletion. Cancellation is best-effort, and events that have already been deleted will not be restored.
Extended 'Relative' field type for schema files to include support for the value 'now'.
The GraphQL DateTime type now supports non-UTC time. Timestamps like 2021-07-18T14:13:09.517+02.0 are now legal, and will be converted to UTC time internally.
Added information about the use of preview fields in the result from calling the GraphQL API. The information will be in the field extensions.preview and will be a list of objects with a name and reason field.
The name, displayName, and location GraphQL fields on the File type are deprecated in favor of the new nameAndPath field.
Deprecates the package field on the SearchDomain GraphQL type, in favor of packageV2. The new field has a simpler and more correct return type.
Deprecates the copyFile GraphQL mutation, as it is no longer used. If you use this mutation, please let us know.
Deprecates the installPackageFromRegistry and updatePackageFromRegistry GraphQL mutations in favor of installPackageFromRegistryV2 and updatePackageFromRegistryV2.
Configuration
On a node configured as USING_EPHEMERAL_DISKS=true allow the local disk management deleting files even if a query may need them later, as the system is able to re-fetch the files from bucket storage when required. This improves the situation when there are active queries that in total have requested access to more segments than the local disk can hold.
Added compatibility mode for using IBM Cloud Object Storage as bucket storage via S3_STORAGE_IBM_COMPAT
The Scheduled Searches feature is no longer in beta and can be used by all users without enabling it first
Other
Added loading and error states to the page where user selects to create a new repository or view.
The test action functionality no longer uses alert terminology, as actions can be invoked from both alerts and scheduled searches. Also, it is now possible to also test the scheduled search specific message templates using it.
Package installation error messages are now much more readable.
Humio docker images is now based on the Alpine linux.
Improved audit log for organization creation.
Added maximum width to tabs on the Group page, so they do not keep expanding forever.
Added support for importing packages with CSV and JSON files. Exporting packages with files is not fully supported yet, but will be in a future release.
Improved performance in IP database lookups for the functions ipLocation(), asn() and worldMap().
Improved error handling when running scheduled searches, so that a failed schedules search will be retried as long as it is within the [backfill limit](https://library.humio.com/preview/docs/automated/scheduled-search/#backfill-limit).
Added focus states to text field, selection and text area components.
Added explicit distribution information for elastic bulk API for elasticsearch API compatibility.
Scheduled search "schedule" field is now validated, showing accurate help for each part of the crontab expression.
Warnings when running scheduled searches now show up as errors in the scheduled search overview page if [SCHEDULED_SEARCH_DESPITE_WARNINGS](https://library.humio.com/preview/reference/environment-variables/#var-scheduled-search-despite-warnings) is set to 'false' (the default).
You can now export and import packages containing any of the action types: Webhook, Email, Humio Repo, Pager Duty, Slack, Slack multi channel, Ops Genie and Victor Ops.
When selecting actions for alerts or scheduled searches, the actions are now grouped by the package they were imported from.
Improved handling of local disk space relative to `LOCAL_STORAGE_MIN_AGE_DAYS`: When the local disk would overflow by respecting that config, Humio can now delete the oldest local segments that are present in bucket storage, even when they are within that time range.
Added a Data subprocessors page under account.
Allow launching using JDK-16.
Scheduled search "schedule" is explained using human readable text such as "At 9.30 on Tuesdays".
Added Dark Mode for Query Monitor page.
Added support for including dashboard and alert labels when exporting a package.
Fixed an issue with using the browser back button while "advanced editing" the query text of a scheduled search or an alert would hide the blue bar that allows saving the query.
Improved search for users page.
Bug Fixes
Other
Removed an old Cloud Signups page. The page is not necessary since organizations were implemented for the Cloud environments.
The simple and advanced permission model has been merged, thus allowing users who were using the simple permission model to create their own permission roles and groups, create groups with default roles, and all other features that were previously only available in advanced permissions mode.
Fixed an issue that could cause UploadedFileSyncJob to crash if an uploaded file went missing.
Security when viewing installed packages and packages on the marketplace are now less strict. Permissions are still required for installing and uninstalling packages.
Fixed an issue where the {time_zone} message template for actions would show a full description of the scheduled search instead of only the time zone.
Fixed an issue where the DiskSpaceJob could mark segments accessed slightly out of order during boot.
Updated the examples on how to use the
match
query function in the inline documentation.Fixed an issue where Shift+Enter would select the current completion rather than adding a newline.
Fixed an issue that caused some metrics of type gauge to be reported with a wrong value.
Fixed an issue where the global consistency check job would fail to perform the consistency check, instead logging lines like "Global dump requested but global had expired". This line can still occur, but only when the consistency check takes too long.
Fixed a bug which potentially have caused alerts to not re-fire after the throttle period for field-based throttling had passed.
Fixed a bug causing the disk space job to use an expensive code path even when a cheaper one was available.
The DiskSpaceJob no longer initializes based off of the segment last-modified timestamp, this only happens if no access order snapshot is stored locally. If a snapshot is present, we trust that.
Fixed an issue that could cause cluster nodes to crash when growing the number of digest partitions.
Creating a new dashboard now opens it after creation.
Fixed thread safety for a variable involved in fetching from bucket storage for queries.
Fixed an issue where Humio attempted to fetch global from other nodes before TLS was initialized.
Introduced a check for compatibility for packages and humio versions.
Cloning an asset now redirects you to the edit page for the asset for all assets.
Fixed an issue where metrics of type gauge with a double value were not reported to the humio-metrics repository, but only to the humio repository.
Fixed a bug on queries that triggered an error while executing due to the input (such as a regex that exceeds limits on execution time) could result in the client getting 404 as status on poll, where it should get .0.
Reworded a confusing error message when using the top() function with a limit parameter exceeding the limits configured with TOP_K_MAX_MAP_SIZE_HISTORICAL or TOP_K_MAX_MAP_SIZE_LIVE.
Truncate long user names on the Users page.
Fixed an issue where Humio would create auxiliary files (hash files) for segments unnecessarily when moving segments between nodes.
Updated Elastic ingest endpoint to accept 'create' operations in addition to 'index' operations. Both operation types result in the same ingest behavior. This update was added as Fluent-Bit v1.8.3 began using the 'create' operation rather than 'index' for ingest.
Fixed an issue where the DiskSpaceJob could continue tracking segments if they were deleted from global, but the files were still present locally.
Fixed an issue with the split() function which caused incorrect (usually, too few) query results in some cases where the output fields were refered to later in the query.
When accessing Humio through a URL with either a repository or view name in it and using an ingest token, it is now checked that the view on the token matches the repository or view in the URL, and a 403 Forbidden status is returned, if not.
Fixed a bug where a hidden field named "#humioAutoShard" would sometimes show up in the field list.
Fixed an issue where Humio would create a broken hash file for the merge result when merging minisegments that did not originally have hash files.
Global snapshots are now uploaded to bucket storage more often when there are a lot of updates to it, leading to shorter replay times on startup.
Fixed an issue where, looking at GraphiQL, the dropdown from the navigation menu was partially hidden.
Fixed an issue that caused some errors to be hidden behind a message about "internal error".
Fixed an issue where the query scheduler would spend too much time "shelving" queries, and not enough on getting them executed, leading to little progress on queries.
Split package export page into dialog with multiple steps.
Fixed an issue where the job responsible for deleting segment files off nodes was not running as often as expected.
Fixed a bug where a 404 Not Found status on an internal endpoint would be incorrectly reported as an 401 Unauthorized.
Updated Slack action for messaging multiple channels, so it propogates errors when triggered. Previously errors were ignored.
Fixed an issue where top() with max= can yield the same key multiple times (ei. ...| top([queryId, query], max=totalSize)).
Updated the new asset dialog button text so that it will say 'Continue' when an asset will not be created directly.
The DiskSpaceJob now removes newly written backfilled segments off the local disk before it chooses to remove non-backfilled segments.
Updated dependencies with security fixes.
Fixed an issue where certain problems highlighted the first word in a query, not the location of the problem.
Amended an internal limit on how many segments can be fetched from bucket storage concurrently. The old limit was based on the number of running queries. The new limit is 32.
When a search is able to filter out segments based on the hash filter files, and a segment file is not present locally on any node, fetch only the hash filter at first, evaluate that, and only if required, fetch the segment file. This speeds up searches that target segments only present in bucket storage and that have search filters that generate hash filter checks, such as regex and literal text comparisons.
Fixed an issue where new groups added to a repository got a query prefix that disallowed search. The default is now to allow search with the queryprefix *.
Fixed an issue where the job responsible for deleting segment files off nodes was not deleting as many segments as it should.
Fixed an issue where it was possible to submit queries to the Delete Events API that were not valid for that API. Only pure filtering queries are allowed.
Humio Server 1.30.7 Stable (2022-01-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.7 | Stable | 2022-01-06 | 2022-09-17 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 9612de72bdd0275e39d6af23c51067c8 |
SHA1 | 4ecdf75a4deae2b2c75abcf1101d9b4711cacf31 |
SHA256 | 3ae7ba0f40043f10c7fad02ea471bb55373cf38afd31ddfa2f47bdc87528f475 |
SHA512 | 5d3cadcb47c1c792c2e643fbaffef5207a2d327a41142a337196863a1be39a5b39de1a527853bc08a285497b6f6791b592c9e0bf69f8aef3a2e16d9db6cee7de |
Updated dependencies with security fixes.
Bug Fixes
Summary
Updated dependencies to log4j 2.17.1 to fix CVE-2021-44832 and CVE-2021-45105
Updated dependencies to Netty to fix CVE-2021-43797
Humio Server 1.30.6 Stable (2021-12-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.6 | Stable | 2021-12-15 | 2022-09-17 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 00b0fbed6da70bb28c130be8bab2f573 |
SHA1 | 033f9cb06618af70ebf605534af3d97692b1279e |
SHA256 | f389991e007489d9f5a0d6ca8b4cd3905b072ff40efcff3284bef47cf65d4e86 |
SHA512 | 12fec5a5954f8ec49cbc30f1b206302bdb8d21fc34330cc5120d5af68a08e80c4fa53faad2d9c707535ced94e6134beaaca141212da7daa1d748b29b9df286ee |
Fix log4j
dependencies.
Bug Fixes
Summary
Updated dependencies to log4j 2.16 to remove of message lookups (CVE-2021-45046)
Humio Server 1.30.5 Stable (2021-12-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.5 | Stable | 2021-12-10 | 2022-09-17 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | e4475e8c2f6623ff22465ccd59bbfb8a |
SHA1 | 5affbdbd10674259ec178db75171d73eb2835f1d |
SHA256 | 92c0261e328c43f0ba46ffaa72fc5e8a1ef075438759286ab00ea5dbb5b5ca30 |
SHA512 | e698dd4a2aa8c85ca3d89cc596e05677106d509082f816e46b3dca6b4b3313690d4c41c3a5b5529d08d91e51ebbfb3f9217e7830d1f4ade54fd79b40f366f449 |
Fix log4j
dependencies.
Bug Fixes
Summary
Updated dependencies to address a critical security vulnerability for the log4j logging framework, "log4shell", (CVE-2021-44228).
Humio Server 1.30.4 Stable (2021-12-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.4 | Stable | 2021-12-10 | 2022-09-17 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 815e193fd910b712d9be4420473101ec |
SHA1 | f909e62433a8ee4ff3ac2a4b78ab966c311eae54 |
SHA256 | bb2fcd20a21e9d8a7a8e2866ff579259f3f4b9975f31731bb4d57d879072d9ca |
SHA512 | 96f31a00f96e44bf64128b9c58b9007cef78ccd12a2abc7264b884415c62f44df7837f4540780aa5a75c04c64488a33a6977d256333e950a181b861d6966b686 |
Security fix related to log4j
logging, and
fix compatibility with Filebeat.
Bug Fixes
Summary
Fixed a compatibility issue with Filebeat 7.16.0
Updated dependencies to address a critical security vulnerability for the log4j logging framework, "log4shell", (CVE-2021-44228).
Humio Server 1.30.3 Stable (2021-11-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.3 | Stable | 2021-11-25 | 2022-09-17 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 1d3b908f6da95f2a02a69f220715b9ac |
SHA1 | 110fb83be1979070a55a6d9fc6662abcf8ef551a |
SHA256 | c87ae3a41303afa5d11750d2ae8fa36bb9892723cefb1ffcb19bf1d93e87dde0 |
SHA512 | 1c634b3401485aab33ca5ee6042d88596785f054c37933d37e5830a9b7817ec9dc995dda14bd1620f511f0cf685327b9c78f0e2d118f0b24ef04462c4d132136 |
Bug fix to resolve problem with race conditions.
Bug Fixes
Summary
Fixed a race condition that could cause Humio to delete more segments than expected when initializing a digester node.
Humio Server 1.30.2 Stable (2021-11-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.2 | Stable | 2021-11-19 | 2022-09-17 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 2395ce5b8017a632b02372da3dc0159b |
SHA1 | 049f9a0ed9c4e9acafcefe1a65997b65ba57d3f7 |
SHA256 | 815bcce962ac9f43022424e2abdfa587f8377ba1ecf3b4c5ef423a43175fe424 |
SHA512 | bc93c9bbf9fe89eb0a279d265b775bc4b4590b897f7f08a31d2516cd767b4952c59e7a3bad9986b26592487246c8a54f2e29e85d9a2a248dc790418ec68627d7 |
Bug fixes related to version dependency, problems with incomplete URLS, as well as requiring organization level permissions in certain situations.
Bug Fixes
Summary
Require organization level permission when changing role permissions that possibly affects all views and repositories.
Updated a dependency to a version fixing a critical bug.
Fixed an issue where a URL without content other than the protocol would break installing a package.
Humio Server 1.30.1 Stable (2021-10-01)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.1 | Stable | 2021-10-01 | 2022-09-17 | 1.16.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 790fc08715648deadf23b204f6e77cc9 |
SHA1 | 85ea236e0abbaf29740e7288d7cefeb2b1069260 |
SHA256 | e4f8dcc73fbeaa5dcc7d68aa6a972e3ab5ccbb66848c189743b2f50b8bcea832 |
SHA512 | 963ec5f550f5b496b08c9025e3fa9ed08c563e4270973092a4a1944a05bd79192316f3324d9a58e78dd014c2119ab389c1d6c566ef395b73c4df96f6d216e2c2 |
Fixes Humio ignoring MatchExceptions, the frequency of jobs
which delete segment files, problems with
USING_EPHEMERAL_DISKS
, and upgrades Kafka and
xmlsec addresses.
Bug Fixes
Summary
Fixed an issue where the job responsible for deleting segment files off nodes was not running as often as expected.
On a node configured as USING_EPHEMERAL_DISKS=true allow the local disk management deleting files even if a query may need them later, as the system is able to re-fetch the files from bucket storage when required. This improves the situation when there are active queries that in total have requested access to more segments than the local disk can hold.
Upgrade Kafka and xmlsec to address CVE-2021-38153 and CVE-2021-38153.
Fixed an issue causing Humio to log MatchExceptions from the calculateStartPoint method.
Fixed an issue where the job responsible for deleting segment files off nodes was not deleting as many segments as it should.
Humio Server 1.30.0 Stable (2021-09-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.30.0 | Stable | 2021-09-17 | 2022-09-17 | 1.16.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | c8989abb219663a61ae54be021fcd367 |
SHA1 | 44e1d48d09ca3ae8fd59a185e77b3c9a55a6de8f |
SHA256 | 25a880f34a0fef72ab3cb4bf93f92eae2fdac0022d116485bed1013b3f6683b4 |
SHA512 | 53b8055035bfcdd7176fa4369e607874ca9d5ee84de4a3beb964e3f0caba9578b3c46c04c10cb68657be34d8a165fa1089f1679716ecd4896ff57822d0b1e851 |
As a new feature Humio now includes an IOC (indicator of
compromise) database from CrowdStrike to enable lookup of IP
addresses, URLs and domains for malicious activity. This
database is updated hourly. This is described in more detail at
ioc:lookup()
Bug Fixes
Other
Fixed an issue where the query scheduler would spend too much time "shelving" queries, and not enough on getting them executed, leading to little progress on queries.
Fixed an issue where offsets from one Kafka partition could be used when deciding where to start consuming for another partition, in the case where there are too many datasources in the repo. This led to a crash loop when the affected node was restarted.
Fixed an issue where the UI page for new parser could have overflow in some browsers.
Humio Server 1.30.0 Includes the following changes made in Humio Server 1.29.0
Version Type Release Date End of Support Upgrades From Data Migration Config. Changes 1.29.0 Preview 2021-07-09 2022-07-09 1.16.0 No Yes Warning
This release has been revoked as it contained a known bug fixed in 1.29.1.
As a new feature Humio now includes an IOC (indicator of compromise) database from CrowdStrike to enable lookup of IP addresses, URLs and domains for malicious activity. This database is updated hourly. This is described in more detail at
ioc:lookup()
Improvements, new features and functionality
Bug Fixes
Humio Server 1.30.0 Includes the following changes made in Humio Server 1.29.1
Version Type Release Date End of Support Upgrades From Data Migration Config. Changes 1.29.1 Preview 2021-07-12 2022-07-12 1.16.0 No Yes
JAR Checksum Value MD5 6cea304226bb9eb096785375bb8f834f SHA1 77d7b92df1884b8ec457246d602cc276e46ee032 SHA256 e48d6a5c80e6979621b817c1ac53f778eae170185180ab9e70c295692dd1a7bc SHA512 c9e8019067a9ae1bd0b62215ee458ecabcee2b3a971688c6f66c58dc1009d498cdd560d4733f64f31e6d4204bebb6c8bc0934354ab04aaa008b3e21ef8bc7dee
Fixes an issue in the 1.29.0 release that made it appear as though ingest tokens had no associated parser.
Humio Server 1.30.0 Includes the following changes made in Humio Server 1.29.2
Version Type Release Date End of Support Upgrades From Data Migration Config. Changes 1.29.2 Preview 2021-09-02 2022-09-02 1.16.0 No No
Value JAR Checksum MD5 0b32f9520b7a5ec3f1af3321ce7f1dfe SHA1 4ae2567f9b3348d115819eefd5b9c078d6c2c6ad SHA256 0383277fd91b8933dfcdb94783e03d151975b01ee62dcc74515cbfb2d3299cdc SHA512 bbfb1f343f0567394128976ecddc6ad3b74f2996b0dc51e2fe0f9c5e0b60cbd7a935fc709b2ffc3b6a811a0e6a1c2fcc09e4e1552e5c7f87dd3670f07cf33b31
Bug Fixes
Humio Server 1.30.0 Includes the following changes made in Humio Server 1.29.3
Version Type Release Date End of Support Upgrades From Data Migration Config. Changes 1.29.3 Preview 2021-09-07 2022-09-07 1.16.0 No No
Value JAR Checksum MD5 96b4a0ff0c02a2dce2bb5ee467bdb9dd SHA1 b2a1ef55259f6c49ee7bf7de6efecc0f743d1bfa SHA256 95d9b52d6213d0af43dfc43cb66c878f1f584f446e4ba890137c5fd9923db1a4 SHA512 392489e94b1e6f6799a6340df78e7bdb7d9547b97ba1844cfbf3c525e1e418fd2221543378f2b759acf46d5c02d99627f9b98650447d7c1c32ba599157718bf8
Bug Fixes
Humio Server 1.30.0 Includes the following changes made in Humio Server 1.29.4
Version Type Release Date End of Support Upgrades From Data Migration Config. Changes 1.29.4 Preview 2021-09-09 2021-09-17 1.16.0 No No
Value JAR Checksum MD5 8145f9ddc7804a44efe1e46cd71f5c17 SHA1 8db4079f580357162891d0153a70668b4f29d642 SHA256 32adde840164668a96be651ede6052dbef3cf046ec9f83f39f62925d26e14104 SHA512 cadcd2eb07e949f052bd51ecc272d79f7decfec0f3b7613dfdf712aa1ff287471060d25443c5be1b06744aefa43194fb2e78e223c362005cea62a5917a93b62e Minor bug fixes
Bug Fixes
Humio Server 1.29.4 Preview (2021-09-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.29.4 | Preview | 2021-09-09 | 2021-09-17 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 8145f9ddc7804a44efe1e46cd71f5c17 |
SHA1 | 8db4079f580357162891d0153a70668b4f29d642 |
SHA256 | 32adde840164668a96be651ede6052dbef3cf046ec9f83f39f62925d26e14104 |
SHA512 | cadcd2eb07e949f052bd51ecc272d79f7decfec0f3b7613dfdf712aa1ff287471060d25443c5be1b06744aefa43194fb2e78e223c362005cea62a5917a93b62e |
Minor bug fixes
Bug Fixes
Other
Fixed an issue where it was possible to submit queries to the Delete Events API that were not valid for that API. Only purely filtering queries are allowed.
Added a GraphQL mutation
cancelDeleteEvents
that allows cancelling a previously submitted deletion. Cancellation is best-effort, and events that have already been deleted will not be restored.
Humio Server 1.29.3 Preview (2021-09-07)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.29.3 | Preview | 2021-09-07 | 2022-09-07 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 96b4a0ff0c02a2dce2bb5ee467bdb9dd |
SHA1 | b2a1ef55259f6c49ee7bf7de6efecc0f743d1bfa |
SHA256 | 95d9b52d6213d0af43dfc43cb66c878f1f584f446e4ba890137c5fd9923db1a4 |
SHA512 | 392489e94b1e6f6799a6340df78e7bdb7d9547b97ba1844cfbf3c525e1e418fd2221543378f2b759acf46d5c02d99627f9b98650447d7c1c32ba599157718bf8 |
Bug Fixes
Other
Remove limit on search interval on cloud sandboxes
Fixed an issue where the error TooManyTagValueCombination would prevent Humio from starting
Humio Server 1.29.2 Preview (2021-09-02)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.29.2 | Preview | 2021-09-02 | 2022-09-02 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 0b32f9520b7a5ec3f1af3321ce7f1dfe |
SHA1 | 4ae2567f9b3348d115819eefd5b9c078d6c2c6ad |
SHA256 | 0383277fd91b8933dfcdb94783e03d151975b01ee62dcc74515cbfb2d3299cdc |
SHA512 | bbfb1f343f0567394128976ecddc6ad3b74f2996b0dc51e2fe0f9c5e0b60cbd7a935fc709b2ffc3b6a811a0e6a1c2fcc09e4e1552e5c7f87dd3670f07cf33b31 |
Bug Fixes
Other
Fixed an issue where, looking at GraphQL, the dropdown from the navigation menu was partially hidden.
Fixed an issue where if a package failed to be installed, and it contained an action, the failed installation might not be cleaned up properly.
Fixed an issue that could cause UploadedFileSyncJob to crash, if an uploaded file went missing
Fixed an issue where new groups added to a repository got a query prefix that disallowed search. The default is now to allow search with the query prefix * (wildcard).
Humio Server 1.29.1 Preview (2021-07-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.29.1 | Preview | 2021-07-12 | 2022-07-12 | 1.16.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 6cea304226bb9eb096785375bb8f834f |
SHA1 | 77d7b92df1884b8ec457246d602cc276e46ee032 |
SHA256 | e48d6a5c80e6979621b817c1ac53f778eae170185180ab9e70c295692dd1a7bc |
SHA512 | c9e8019067a9ae1bd0b62215ee458ecabcee2b3a971688c6f66c58dc1009d498cdd560d4733f64f31e6d4204bebb6c8bc0934354ab04aaa008b3e21ef8bc7dee |
Fixes an issue in the 1.29.0 release that made it appear as though ingest tokens had no associated parser.
Humio Server 1.29.0 Preview (2021-07-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.29.0 | Preview | 2021-07-09 | 2022-07-09 | 1.16.0 | No | Yes |
Warning
This release has been revoked as it contained a known bug fixed in 1.29.1.
As a new feature Humio now includes an IOC (indicator of
compromise) database from CrowdStrike to enable lookup of IP
addresses, URLs and domains for malicious activity. This
database is updated hourly. This is described in more detail at
ioc:lookup()
Improvements, new features and functionality
GraphQL API
Field
createIngestListener
was deprecated inMutation
type, usecreateIngestListenerV2
insteadField
updateIngestListener
was deprecated inMutation
type, useupdateIngestListenerV2
insteadRemoved the Usage feature flag which is now always enabled. This breaks backwards compatibility for internal graphql feature flag mutations and queries.
Removed the argument includeUsageView from the graphql mutation createOrganizationsViews which breaks backwards compatibility for this internal utility method.
Field
assignIngestToken
was deprecated inMutation
type, useassignParserToIngestToken
insteadField
addIngestToken
was deprecated inMutation
type, useaddIngestTokenV2
insteadField
copyParser
was deprecated inMutation
type, usecloneParser
insteadDeprecated argument
name
was removed fromMutation.updateParser
fieldDeprecated argument
repositoryName
was removed fromMutation.updateParser
field
Configuration
Humio nodes will now pick a UUID for themselves using the
ZOOKEEPER_PREFIX_FOR_NODE_UUID
prefix, even if Zookeeper is not used. This should make it easier to enable Zookeeper id management in existing clusters going forward.Add a soft limit on the primary disk based on
PRIMARY_STORAGE_PERCENTAGE
andPRIMARY_STORAGE_MAX_FILL_PERCENTAGE
(roughly the average of the two values). When the soft limit is hit and secondary storage is configured, the segment mover will prefer moving segments to secondary storage right away, instead of fetching them to primary and waiting for the secondary storage transfer job to move them.Allow the internal profiler to be configured via an environment variable. See Environment Variables
Other
Enabled dark mode for cluster administration pages.
Make GlobalConsistencyCheckerJob shut down more cleanly, it could previously log some ugly exceptions during shutdown.
Return the responder's vhost in the metadata json.
Integrates the editing of alert searches and scheduled searches better with the search page
Created a new Dropdown component, and replaced some uses of the old component with the new.
Improved global snapshot selection in cases where a Kafka reset has been performed
Added dark mode support to Identity provider pages.
When editing a query, Enter no longer accepts a suggestion. Use Tab instead. The Enter key conflicted with the "Run" button for running the query.
Previously, the server could report that a user was allowed to update parsers for a view, even though parsers cannot be used on views, only repositories. Now the server will always say the user cannot change parsers on views.
Packages now support Webhook actions and references between these and alerts in the Alert schema.
Scheduled searches are now allowed to run once every minute instead of only once every hour.
Internal change to parsers adding an id, where previously they only had a name as key.
The "Save Search as Dashboard" Widget dialog now gives user feedback about missing input in a manner consistent with other forms.
In thread dumps include the job and query names in separate fields rather than as part of the thread name.
Speed up the SecondaryStorageTransferJob. The job will now delete primary copies much earlier after moving them to the secondary volume.
Organization pages refactoring.
Bug Fixes
Other
Fixed an issue where exporting a saved query did not include the options for the visualization, e.g. column layout on the event list.
When testing a Parser and more events are returned in a test an info message is now displayed conveying that only the first event is shown.
Fixed a bug where word wrapping in the event list was not always working for log messages with syntax highlighting (e.g. JSON or XML messages)
Fixed an issue with "show in context" feature of the event list did not quote the field names in the produced query string.
Fixed an issue related to validation of integer arguments. Large integer arguments would be silently truncated and lower limits weren't checked, which led to unspecified behavior. Range errors are now reported in the following functions:
concatArray()
formatDuration()
Fixed bugs in the test parser UI, so that it should now always produce a result and be able to handle parsers that either drop events or produce multiple events per input event.
Fixed a bug causing
match()
to let an empty key field match a table with no rows.Fixed a bug in the blocklist which caused "exact pattern" query patterns to be interpreted as glob patterns.
Fixed race condition that could cause event forwarding rules to not update correctly in rare cases
Fixed race condition that could cause parsers to not update correctly in rare cases
Address edge cases where QueryScheduler could throw exceptions with messages similar to "Requirement failed on activeMapperCount=-36"
Avoiding a costly corner case in some uses of glob-patterns.
Fixed an issue where the axis titles on the timechart were not showing up in dark mode
Fixed a bug in the Search View. After editing and saving a saved query in the Search View, the notification message would disappear in an instant, making it impossible to read and to click the link therein.
Humio Server 1.28.2 Stable (2021-09-29)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.28.2 | Stable | 2021-09-29 | 2022-06-15 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 87f31a6c318d9383a944521ee34b572a |
SHA1 | fc185c9a2f5f7e6d5425778995f679c49d430105 |
SHA256 | 62f25f3fe69239e1615fb6cb2bffe6f16ae0fe8adc2a17a0a9fa03ba226f7b5f |
SHA512 | 6fb65258a9c21a4d681690a0dcc050cd5be96440cc2f1c6273707658504fc0f21fa5fd1ba9cdb664ab0a5f9aabede181dca5e1ff882305db30a0b95c57f6fba9 |
Bug Fixes
Other
Fix a bug where offsets from one Kafka partition could be used when deciding where to start consuming for another partition, in the case where there are too many datasources in the repo. This led to a crash loop when the affected node was restarted.
Upgrade Kafka and xmlsec to address CVE-2021-38153 and CVE-2021-38153.
Humio Server 1.28.1 Stable (2021-08-24)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.28.1 | Stable | 2021-08-24 | 2022-06-15 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 1a2b8d3acc15ac6789534f7624265ecb |
SHA1 | 3cf96a324147967c1bc7753a7f9d94cbed8cd843 |
SHA256 | 8a355f8bbab9a74422ee3456f9bfe93302734a69197b7e12c254f7c0fd9905de |
SHA512 | e572352be7e71403f52fe0767567232a198861a60f100b7e9e32475e8e2720285902daf6493b62b79052ca71aa6550abe173d5ae5246e14e5ac30bda0883667c |
Bug Fixes
Other
The signup path was removed, together with the corresponding pages. Before, anyone could sign up for the Humio SaaS solution. However, with stricter policies, this became obsolete and had to be removed. The new process redirecta a potential customer to Humio's official website, where they have to fill in a form in order to be vetted. Once the vetting process is complete, Humio support creates an organization for the customer.
Fixed an issue that could cause cluster nodes to crash when growing the number of digest partitions.
Fixed an issue that could cause UploadedFileSyncJob to crash if an uploaded file went missing
Humio Server 1.28.0 Stable (2021-06-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.28.0 | Stable | 2021-06-15 | 2022-06-15 | 1.16.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 1a2b8d3acc15ac6789534f7624265ecb |
SHA1 | 3cf96a324147967c1bc7753a7f9d94cbed8cd843 |
SHA256 | 8a355f8bbab9a74422ee3456f9bfe93302734a69197b7e12c254f7c0fd9905de |
SHA512 | e572352be7e71403f52fe0767567232a198861a60f100b7e9e32475e8e2720285902daf6493b62b79052ca71aa6550abe173d5ae5246e14e5ac30bda0883667c |
Major changes, as well as requiring at least a trial license, require accepting privacy, terms, and conditions.
Bug Fixes
Summary
All users (including existing users) need to accept the privacy notice and terms and conditions before using Humio.
Humio will now try to upload more segments concurrently during a shutdown than during normal operation.
Backfilled data gets lower priority on local disk when in over-commit mode using bucket storage.
When searching through files in a dashboard parameter, users with CSV files greater than 50.0 records could see incomplete results.
Humio trial installations now require a trial license. To request a trial license go to Getting Started.
Fixed a bug that caused previous 1.27.x but not earlier versions to add "host xyz is slow" warnings to query results also when that was not the case.
While waiting for the upload of files to bucket to complete during shutdown, the threaddumping will continue running, and the node will report as alive as seen from the other nodes.
Humio Server 1.28.0 Includes the following changes made in Humio Server 1.27.0
Version Type Release Date End of Support Upgrades From Data Migration Config. Changes 1.27.0 Preview 2021-06-14 2022-06-14 1.16.0 No Yes
JAR Checksum Value MD5 cce0478c744d183db8491e338949bdfe SHA1 6dd0bf5c8e0d4ca1f74116e31f28f8cfa7b58323 SHA256 a3425e6141358cbc1115ab3c2691768c64d62f84cea3e018eb7b6debcb05f803 SHA512 ca63e89946e4a12422124adb052b59f8da30ca026b5c34b0bfe1ddcc35cf7546fedd4127d46def6c36b3e0f7278675cf4fe47362fe5070a6d7b29ffbcbd0bc49 Improvements, new features and functionality
Bug Fixes
Humio Server 1.28.0 Includes the following changes made in Humio Server 1.27.1
Version Type Release Date End of Support Upgrades From Data Migration Config. Changes 1.27.1 Preview 2021-06-15 2021-06-15 1.16.0 No Yes
JAR Checksum Value MD5 d45c8b1dd900bfaaae7ab6d7173f122a SHA1 9602b62cab67ca3f1d35fd888303bc642c024518 SHA256 ec2db12be413b83e52fb2f1cefa04bc9634e7c17657349c4e6b9c71c26a804f9 SHA512 6179ff0307e3cd804cb4dfcf56a98d30b67cebf51eb2673accde437a308a2d16fd433db983e2948a06768dfac8fa71aa302a357524ed78b675ccbb8491844f6e Security fixes and some minor fixes.
Bug Fixes
Humio Server 1.27.1 Preview (2021-06-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.27.1 | Preview | 2021-06-15 | 2021-06-15 | 1.16.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | d45c8b1dd900bfaaae7ab6d7173f122a |
SHA1 | 9602b62cab67ca3f1d35fd888303bc642c024518 |
SHA256 | ec2db12be413b83e52fb2f1cefa04bc9634e7c17657349c4e6b9c71c26a804f9 |
SHA512 | 6179ff0307e3cd804cb4dfcf56a98d30b67cebf51eb2673accde437a308a2d16fd433db983e2948a06768dfac8fa71aa302a357524ed78b675ccbb8491844f6e |
Security fixes and some minor fixes.
Bug Fixes
Summary
Fixed an issue where Humio could prematurely clean up local copies of segments involved in queries, causing queries to fail with a "Did not query segment" warning.
Fixed issue where certain queries would cause
NullPointerException
inOneForOneStrategy
.Updated dependencies with security fixes.
Humio Server 1.27.0 Preview (2021-06-14)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.27.0 | Preview | 2021-06-14 | 2022-06-14 | 1.16.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | cce0478c744d183db8491e338949bdfe |
SHA1 | 6dd0bf5c8e0d4ca1f74116e31f28f8cfa7b58323 |
SHA256 | a3425e6141358cbc1115ab3c2691768c64d62f84cea3e018eb7b6debcb05f803 |
SHA512 | ca63e89946e4a12422124adb052b59f8da30ca026b5c34b0bfe1ddcc35cf7546fedd4127d46def6c36b3e0f7278675cf4fe47362fe5070a6d7b29ffbcbd0bc49 |
Improvements, new features and functionality
GraphQL API
Deprecated GraphQL field
SearchDomain.recentQueries
in favor ofSearchDomain.recentQueriesV2
.Deprecated GraphQL mutation
setRecentQueries
, useaddRecentQuery
in future. The mutation will be removed after 2021-10-01. While setRecentQueries will remain in the API to not break existing clients, it will not modify the set of recent queries.
Configuration
Limit how many times we'll repeat a repeating regexp. The default max number of repetitions is .0 but the value is configurable between 50 and .0 by setting the
MAX_REGEX_REPETITIONS
env variable.Removed the log4j2-stdout-json.xml configuration file. The replacement log4j2-json-stdout.xml has been available for a while, and we want everyone to move to the new configuration, as the old configuration produces logs incompatible with the Humio Insights package.
Other
Add a label to the empty option for default queries on the repository settings page.
Added ability to set organization usage limits manually for cases where automatic synchronization is not possible.
Users with read repository permissions can now access and see files.
Fixed a problem where the global consistency check would report spurious inconsistencies because of trivial differences in the underlying JSON data
Improved error messages when exporting invalid dashboards as templates
Fixed an issue in the Query State Cache that could fail a query on time intervals with a fixed timestamp as start and now as end.
Fixed an OIDC group synchronization issue where users where denied access even though their group membership gave them access.
Working on merging of advanced and simple permission models, so that the roles can be added directly to users.
The Alert and Scheduled Search dialogs have gotten a makeover.
Included both ws and wss in csp header
Fixed an issue where it was possible to create an alert with an empty time interval or a blank name or throttle field.
Fixed an issue where UI stalled on the "Data Sources" page
Add a bit more debug logging to DataSnapshotLoader, for visibility around choice of global snapshot during boot
Debug logs which relate to the invocation of an action now contain an
actionInvocationId
. This trace id is the same for all logs generated by the same action invocation.Fixed various bugs for the worldmap widget. The bug fixes may cause your world map marks to look different that previously, but should now work as intended and correcting it should be as simple as tweeking the style parameters.
Added frontend validation on welcome page and invitation page fields
The Humio frontend no longer sends the
Humio-Query-Session
header to the backend, since it is no longer used.Removed requirement that SAML Id needs to be an URL (Now, only requirement is that the field is not empty)
In the time selector, you can now write "24" in the time-of-day field to denote the end of the day.
When looking at the details of an event, long field values will now extend beyond the viewport by default. Word wrapping can be enabled to stop it from extending outside the viewport.
Fixed a problem when some user-defined styles weren't being applied to a chart after a page refresh or when exported to a dashboard widget
Automatically reduce the precision of world maps when they exceed a certain size limit
Fixed an issue with AuthenticationMethod.SetByProxy where the search page would constantly reload.
With worldmap() function, you can now see the magnitude value by hovering marks on the map.
Fixed an issue in timeChart() where the horizontal line did not showing up.
Reimplement several part of Humio to use a safer mechanism for listening to changes from global. This should eliminate a class of race condition that could cause nodes to ignore updates received during the boot process.
The UI now consistently marks required field with a red asterisk across a number of dialogs.
The list of recent queries on the search page now has headers with the date the query was run.
Started internal work on memory quotas on queries' aggregation states. This should not have any user-visible impact yet.
Improved styling of header on organization overview page
Added a quickfix feature for reserved keywords
Reduced memory usage for groupBy() function, etc.; worst-case in particular but also average-case to some degree.
Fixed an issue where worldmap widgets would revert to event list widgets when changing styling options.
Updated the interactive tutorial with better descriptions
Fixed an issue where optimizeAndSaveQueryCoordinationPartitions could attempt to save a partitioning table to global with gaps in the partition list. This caused queries to fail, and repeated logging of a validation error.
Added button to delete the organization from the Organization Overview page
Improve thread safety of updates to global Hosts entities during bootup
Changed implementation of cluster host alive stats to attempt to reduce thread contention when threads are checking for host liveness.
The event distribution chart would sometimes show a bucket span reported in milliseconds instead of a more appropriate unit, when those milliseconds did not add up cleanly (e.g. "1h"). Now the bucket span can be reported with multiple units (e.g. "1h 30m")
Slightly improve performance of id lookups in global
When assigning a role, all the user which need a new role are choosen, and then the same role is assigned to them all.
Changed implementation of cluster host alive stats to trigger updates in the in-memory state based on changes in global, rather than running periodic updates.
Inviting users on cloud now requires the invited user to accept the invitation before assigning permissions to him. Moreover, it is possible to invite users who are in another organization on cloud.
Fixed an issue which caused queries to crash when "beta:repeating()" was used with a time interval ending before "now".
The New Action dialog validates user input in a more indulgent fashion and provides all validation errors consistently.
Fixed an issue for Firefox 78.10.1 ESR where the event list and event distribution chart would not be scrollable and resize incorrectly.
Fixed a rare issue that could fail to trigger a JVM shutdown if the Kafka digest leader loop thread became nonfunctional.
Bug Fixes
Other
Humio trial installations now require a trial license. To request a trial license go to getting-started
All users (including existing users) need to accept the privacy notice and terms and conditions <https://www.crowdstrike.com/terms-conditions/humio-self-hosted> before using Humio.
Humio Server 1.26.3 Stable (2021-06-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.26.3 | Stable | 2021-06-17 | 2022-05-20 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 8c880514f42787b5e5f85607bca347de |
SHA1 | e97e3ea8ebc5de0076186e6daa7aa16d4ca48c8c |
SHA256 | d906d0938e8c2283ab91dc999cac4f6a966591e3ee0089e309378123d13cd637 |
SHA512 | 826aea0625a8daac1801f11f12429a6bcb3b8ee58f4b536172d4602fc5f09252fe0be0afd72a5300520980c962a9caa99aeb4ee6c9ada79544963b4c9687b972 |
Security fixes and some minor fixes related to Firefox, Worldmap widgets, and problems with local file clean-up.
Bug Fixes
Summary
Fixed an issue for Firefox 78.10.1 ESR where the event list and event distribution chart would not be scrollable and resize incorrectly.
Fixed an issue where Worldmap widgets would revert to event list widgets when changing styling options.
Updated dependencies with security fixes.
Fixed an issue where Humio could prematurely clean up local copies of segments involved in queries, causing queries to fail with a "Did not query segment" warning.
Humio Server 1.26.2 Stable (2021-06-07)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.26.2 | Stable | 2021-06-07 | 2022-05-20 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 1ebc3d89c531e0ea11be7378e2f1d27c |
SHA1 | 4ac77b9dd3532d6e1f3bce39a72a2f337c300ccc |
SHA256 | 6d06e3734f6a5f30715754d210092b31f4225a42d97495d8e0c8a3d6eea53bfa |
SHA512 | d5c6e9b1b08ed10b5549359306e35734a28557088d3efa98d30ccc0080700ba053a8f83d694790686a6333c54734392e8199127cbaf1719a841979e5e9188e27 |
Several fixes related to the WorldMap and TimeChart widgets, OIDC group syncronization, and requirements for Humio trial installations, as well as privacy notices and terms and conditions, and other bugs.
Bug Fixes
Summary
Fixes issue where the world map widget would misbehave in different ways.
Fix a number of cases where Humio could attempt to write a message to global larger than permitted.
Fixes an issue in Timechart with horizontal line not showing up.
Fixes an OIDC group synchronization issue where users where denied access even though their group membership gave them access.
Update the minimum Humio version for Hosts in global when downgrading a node
Humio trial installations requires a trial license from this version, to request a trial license go to getting-started <https://www.humio.com/getting-started/>
All users (including existing users) need to accept the privacy notice and terms and conditions before using Humio.
Humio Server 1.26.1 Stable (2021-05-31)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.26.1 | Stable | 2021-05-31 | 2022-05-20 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 8322d138b790cb9839e44c96e0cb4ba8 |
SHA1 | d4f47c97d3faa5ae5d014b5c47ec0221d24b4496 |
SHA256 | bb3fde18139e575a053709c042322604e8e01188f096a764bca9f4338286118e |
SHA512 | 44e699237aca10e0e3c5c219a06260e8715b16d8da6fa8a6e5e878f2c66ad9c639ba0d69ecc5aef8d2afb91c42b7a36fe0b7969d3b36d3b2ace21c6bb2c512c2 |
Several fixes related to WorldMap widget, applying user-defined styles to a dashboard chart, and partitions.
Bug Fixes
Summary
Fix an issue when some user-defined styles weren't being applied to a chart after a page refresh or when exported to a dashboard widget.
Fix an issue where optimizeAndSaveQueryCoordinationPartitions could attempt to save a partitioning table to global with gaps in the partition list. This caused queries to fail, and repeated logging of a validation error.
Fix an issue where data was not visible on the
World Map
until the opacity setting had been changed.
Humio Server 1.26.0 Stable (2021-05-20)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.26.0 | Stable | 2021-05-20 | 2022-05-20 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 5f8abd037b3f73eaac8d5882fa58e4ec |
SHA1 | 85971d1f18228a81f46f6f6334196fd918647438 |
SHA256 | 4e0ad70a2c9275742aee8a0181eee2e20c6496ba16b8f6fb93490b84b5031b5e |
SHA512 | 425cacd3de3f54c2813dd3915ad35aed67de2f11a80d9c2fbf96055b030158b5d60c31686e121e613df855e6f0bdaad9d02f1c9e61a4df24b8f69cfd3193f56d |
The HEC ingest endpoint will no longer implicitly parse logs
using the built-in kv
parser. Previously, a
log ingested using this endpoint would implicitly be parsed with
the kv
parser when the supplied
event
field was given as a string. For
instance, this log:
{
"time" : 1537537729.0,
"event" : "Fri, 21 Sep 2018 13:48:49 GMT - system started name=webserver",
"source" : "/var/log/application.log",
"sourcetype" : "applog",
"fields" : { "#env" : "prod" }
}
Would be parsed, so that the resulting Humio event would contain
the field name=webserver
.
If you don't wish this behavior to change, you will have to perform this parsing operation explicitly.
When ingesting into the HEC endpoint, you are using an ingest token to authenticate with Humio. If that token does not have an associated parser, all you need to do is assign the kv parser to the token.
If your ingest token already has an assigned parser, you will need to prepend the code of that parser with this code snippet:
kvParse(@rawstring) | findTimestamp(addErrors=false) |
Bug Fixes
Other
Update the minimum Humio version for Hosts in global when downgrading a node
Humio trial installations requires a trial license from this version, to request a trial license go to: https://www.humio.com/getting-started/
Fix a number of cases where Humio could attempt to write a message to global larger than permitted.
All users (including existing users) needs to accept the privacy notice: https://www.crowdstrike.com/privacy-notice and terms and conditions https://www.crowdstrike.com/terms-conditions/humio-self-hosted before using Humio.
Fixes issue where the world map widget would misbehave in different ways
Known Issues
Other
A regression can cause 1.26.0 to repeatedly error log and fail to start queries in cases where the list of hosts in the cluster is not fixed. This is particularly likely to affect clusters running with ephemeral disks. The regression is fixed in 1.26.1.
Humio Server 1.25.3 Preview (2021-05-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.25.3 | Preview | 2021-05-10 | 2021-05-20 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 08d8b9bfd9692b992a0f564426041717 |
SHA1 | 463df975e2f50c3ae3de888b454a2d1a7285f148 |
SHA256 | 06167df8dabc6211a26edc4aede8d2461ded183e7bb6f1ef527f1b8a441f52b0 |
SHA512 | dbbed239b977af08889433e9f020bbdcb02b5f9496ab2a7eb410d967eb72ef7a4dcfde93374d36a3fe8c5798b35527f2594c025b6c68a3517c20e6f32e5d4ad9 |
Minor bug fixes, including removing error logs from alert jobs running in a Sandbox.
Bug Fixes
Summary
Minor bug fixes and improvements.
Removes error logs from the alert job when running alerts on a sandbox repository.
Humio Server 1.25.2 Preview (2021-05-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.25.2 | Preview | 2021-05-06 | 2022-05-06 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 29b0554b42990118d22fb674e0f6b397 |
SHA1 | ce0ee5e134123fa5ccde8dc012fb1822722140ff |
SHA256 | 9374d762c00d5aa1884f163391fa13149e74f22e428ff849f15124ded001c033 |
SHA512 | 52b14b36db509515fb1d25e2e346b3a920493cdfd7f4862ebdee892014d14394d19e2324da60ec7d1f7137b1eef50c9716499e174e1f910f7a33f437aee1c053 |
Bug fix related to global consistency checks with nodes.
Bug Fixes
Summary
Fixes problem where having many nodes and a large global could lead to deadlocks in the global consistency check.
Humio Server 1.25.1 Preview (2021-05-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.25.1 | Preview | 2021-05-04 | 2022-05-04 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 7e4477532960f4662ee7f3c11681d640 |
SHA1 | 8f7d79294eb27af73333252b2177e3b1467fa01e |
SHA256 | 44b0be0f312c747f1b4f32ca34613bccdc47330100d3d74381731e556e2da999 |
SHA512 | b3624257bd69d0d0e123e7af5010da3d49680f0d286c1ad4daae50f75bfc8ea0cea35836c8e233c09c1f3ee4e5c02ecbc91850c0a0af30afb59e26206c0de125 |
There is a serious issue affecting larger clusters in this
release. The global inconsistency checker job can cause the
thread responsible for reading changes from global to hang. It
is possible to work around this by disabling the job using
RUN_GLOBAL_CONSISTENCY_CHECKER_JOB=false
.
This is fixed in 1.25.2.
Bug Fixes
Other
Makes disabled items in the main menu look disabled in dark mode
Humio Server 1.25.0 Preview (2021-04-29)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.25.0 | Preview | 2021-04-29 | 2022-04-29 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | aa7d71e3617d71ec800f1e5e898cb328 |
SHA1 | 8e815fd8c1d6a0bc1c22e096e8f82d08d40ea172 |
SHA256 | 7f26e858df2f1e16a64f44c6ac72948267eb317d884ad1db72b3799adcc95696 |
SHA512 | 1f447d204ecb3e60c80835e02a4fe8e6c7984728df5b31827b23f2278e00a0862a78dabe8ef01a2295f925a351693bdbb1d649c83465bf0951b040eab466fbad |
There is a serious issue affecting larger clusters in this
release. The global inconsistency checker job can cause the
thread responsible for reading changes from global to hang. It
is possible to work around this by disabling the job using
RUN_GLOBAL_CONSISTENCY_CHECKER_JOB=false
.
This is fixed in 1.25.2 (and 1.26.0).
Improvements, new features and functionality
Other
The query scheduler now prioritizes new queries started by a user based on the cumulative cost of recent queries started by that user. Added new configuration QUERY_SPENT_FACTOR with the default value 0.5, which defines the weight of recent query costs when scheduling. Higher values mean that users with high recent query costs will see their queries penalized harder in the scheduling.
Bug Fixes
GraphQL API
Deprecates GraphQL fields
UserSettings.isEventListOrderChangedMessageDismissed
,UserSettings.isNewRepoHelpDismissed
, andUserSettings.settings
since they are not used for anything anymore, and will be removed in a future release.The
SearchDomain.queries
GraphQL field has been deprecated. UseSearchDomain.savedQueries
instead.Removes the deprecated
Repository.isFreemium
GraphQL field.The
SearchDomain.viewerCanChangeConnections
GraphQL field has been deprecated. UseSearchDomain.isActionAllowed
instead.The
updateSettings
GraphQL mutation has been marked as unstable, as it can control unstable and ephemeral settings.
Configuration
Removed the
QUERY_QUOTA_EXCEEDED_PENALTY
configuration.New config:
SEGMENTMOVER_EXECUTOR_CORES
allows tuning number of concurrent fetches of segments from other nodes to this node. Defaults to vCPU/8, must be at least 2.New config:
S3_ARCHIVING_IBM_COMPAT
for compatility with S3 archiving to IBM Cloud Object Storage.
Other
When running alerts and scheduled searches, all logging related to a specific alert or scheduled search will now be logged to the humio-activity repository, instead of the humio repository. Error logs will still be logged to the humio repository as well.
Make the
parseleef()
function more robust and optimize its memory usage.Added IP ASN Database license information to the Cluster Administration page
Some minor performance improvements in the ingest pipeline
Added audit logging when assigning a parser to an ingest token or unassigning a parser from an ingest token. Added the parser name to all audit logs for ingest tokens.
Allow user groups to be represented as a json string and not only as an array when logging in with oauth.
Fixed a bug that made it possible to rename a parser to an existing name and thereby overwriting the existing parser.
Fixed an issue where clicking the label of a parser rerouted erroneously
Made it possible to delete a parser overriding a built-in parser, even though it is used in an ingest token.
Rework how Humio caches data from global. This fixes a number of data races, where Humio nodes could temporarily get an incorrect view of global.
Added a warning to the Cluster Nodes page that warns you if not all Humio servers are running the same Humio version.
Bumped minimum supported versions of Chrome and Chromium from 60 to 69 due to updated dependencies
Optimized the
splitstring()
function.Improved error logging for event forwarding
The HEC ingest endpoint is no longer implicitly running
kvParse
. This used to be the case when ingesting events of the form"event" : "Log line..."
. If the ingested data is to be key-value parsed, addkvParse()
to the relevant parser for the input data.Reworked initialization of Humio's async listener infrastructure, to ensure that listeners do not miss any updates. This fixes a number of flakiness issues that could arise when a node was rebooted.
Refreshing actions while creating alerts and scheduled searches now happens automatically, but can also be triggered manually using a button.
Fixed a bug that made it impossible to copy a parser to override a built-in parser.
Fixed a bug where
cidr()
did not respect theinclude
parameterAdded new parameters
handleNull
andexcludeEmpty
toparseJson()
to control how null and empty string values are handled.Added a new query function:
base64Decode()
When installing an application package, you sometimes had to refresh the page to get the assets in the package linked to their installed counter parts.
Changed the built-in
audit-log
parser so that null values are stored as an empty string value. Previously, they were stored as the string "null". The defaults are consistent with the old behavior, so that null values become a "null" string and empty string values are kept.Fixed a bug which could cause
head()
,tail()
,sort()
within eitherbucket()
or a live query to return too few results in certain cases.When a query is cancelled, a reason for canceling the query is now always logged. Previously, this was only done if the query was cancelled due to an internal exception. Look for log lines starting with query is cancelled.
Added documentation link to autocomplete description in the Humio search field
Fixed a bug where a scheduled search would be executed repeatedly, as long as at least one out of multiple actions was failing. Now, execution is only repeated if all actions are failing.
Query poll responses meta data now include Query Quota spent for current user across queries. The cost so far of the current query was there already.
Humio Server 1.24.4 Stable (2021-05-31)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.24.4 | Stable | 2021-05-31 | 2022-04-06 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 83588b8570c97dc8a89b46524ea8d92a |
SHA1 | 15958a097eaba9689a43c557e1d6d14e2d566d6d |
SHA256 | cafca561035aec00f5971a15cf283b757794c8a2706829518a05ce089f92ea88 |
SHA512 | 15352a96bb6b4ed27ef1c7b238cf97142c36cfefe17be25bf671a706bd6afcf0c8ad8951a325838e259eeb52e643f3950b8f47f3186ecea049f34fc81e066eed |
Minor bug fixes, as well as fix a stackoverflow bug in large clusters.
Bug Fixes
Summary
Fix a stackoverflow that could occur during startup in larger clusters.
Minor bug fixes and improvements.
Humio Server 1.24.3 Stable (2021-05-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.24.3 | Stable | 2021-05-10 | 2022-04-06 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | adb3c4827d86d476d104ab2ba8ec3171 |
SHA1 | 06a25ba15bf28659900807a8505860f5b32a65d6 |
SHA256 | bae28e700dc6806496fd351ffb865a80420f0757613546076b4a2e9aae719d8d |
SHA512 | aff4adf71e1140ffdbeebfef7eae451d0bbff41f5af1753dee13d1287635644228336da0de300208fe1e667ae151198c74b74fdf10d830d37ae9b072f136a7a4 |
Minor bug fixes.
Bug Fixes
Summary
Minor bug fixes and improvements.
Humio Server 1.24.2 Stable (2021-04-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.24.2 | Stable | 2021-04-19 | 2022-04-06 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 69a6ef22d7f295f807ceef46c8c0c6d1 |
SHA1 | 6284ee05bd7c583044f6620f385864a3be3bab84 |
SHA256 | cc648f1c4efe01d20e9f93a77b1892291077ae76339d1b5dcbc0e504f9975e25 |
SHA512 | 54c60624a5c0ef19c12fcda05b4fecbe8ddf626246c3160d90f29cc76143dfbe4b07f7d884616699486848f0e7b8c519c0e1d5f5dd3e2be3e8b0a6f49fe960c5 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.24.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.24.1. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Reduced off-heap memory usage
Fixed an issue where a repository with very high number of datasources could trigger an error writing an oversized message to kafka from the ingest-reader-leader thread
Fixed an issue where cost spent in a long-running query got accounted as spent "now" when the query ended in terms of Query Quota
Humio Server 1.24.1 Stable (2021-04-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.24.1 | Stable | 2021-04-12 | 2022-04-06 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | b7fec8d3a5c0b521a371dbeb6e56d8b2 |
SHA1 | fbabef325eaaf1bd0a3052f51497f00779efad5f |
SHA256 | 223e48fe647fc681456b47cad81d0fca5936d6283791b2a41fa4c8dc199c1c76 |
SHA512 | 51663220d67bb25f67b7e44837e84c87c36c3f24da69918b1a6978fc751543a2f1f25f49f166681def7a0276881907b284a52bb302fa6d745d7b16859d3f7d96 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.24.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.24.1. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixes an issue where the user would get stuck in infinite loading after having been invited into an organization
Ensure that if the Kafka leader loop thread dies, it kills the Humio process. In rare cases it was possible for this thread to die, leaving the node incapable of performing digest work
Fixed a bug where ingestOnly nodes could not start on a more recent version that the statefull nodes in the cluster
Allow reverse proxies using 10s as timeout to work also for a query that takes longer than that to initialize
Humio Server 1.24.0 Stable (2021-04-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.24.0 | Stable | 2021-04-06 | 2022-04-06 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | cbee15b1c1af8d13984fbd938e9f9488 |
SHA1 | 8562af8753aca033d6b4966311787c2a681116dc |
SHA256 | 7cda1dd2188ec2ed5899c5a4c26cf45c2f2d4199439342da64819194475b5cf2 |
SHA512 | ad9e05ed84cd08f8774b5bbec44b8075ebb9e2cd7898f7d6f88fc445a5e1476284b86b1d3d5536ecdf1609b7c8b4e05d3ad27302dd79e41f95094140c12ce002 |
Important Information about Upgrading
This release promotes the latest 1.23 release from preview to stable.
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.24.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.24.0. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixed an issue which caused problems with forward/backward compatibility of LanguageVersion in GraphQL
Fixed an issue which prevented Safari users from seeing alert actions
Major changes: 1.23.0 and 1.23.1.
Removed the
QUERY_QUOTA_EXCEEDED_PENALTY
config (introduced in 1.19.0).Fixed a scrolling issues on the Kafka cluster admin page
The query scheduler now prioritizes new queries started by a user based on the cumulative cost of recent queries started by that user. Added new config
QUERY_SPENT_FACTOR
with the default value 0.5, which defines the weight of recent query costs when scheduling. Higher values mean that users with high recent query costs will see their queries penalized harder in the scheduling.Fixed an issue on the search page that prevented the event list from scrolling correctly.
Humio Server 1.23.1 Stable (2021-03-24)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.23.1 | Stable | 2021-03-24 | 2021-03-24 | 1.16.0 | No | No |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.23.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.23.1. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
New config:
S3_ARCHIVING_IBM_COMPAT
for compatibility with S3 archiving to IBM Cloud Object Storage.Allow users group to be represented as a json string and not only array when logging in with oauth.
Humio Server 1.23.0 Preview (2021-03-18)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.23.0 | Preview | 2021-03-18 | 2021-03-24 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 882c77cb19e867084fbb26dc80c079d8 |
SHA1 | 053d49648f03fd49f0766aa9df64f66921c72638 |
SHA256 | 898f1670010d25866f9fb27e054509a2ade615dbae612cdc70ce34371e03ac59 |
SHA512 | eba333bfec11983f6140ca4e64ec725c91c0d724f245c0250f2264a9221036a7d9e89aace2bf096ce7b5ecca72b4c24659348feba7098d89a5a4035359d8b8d3 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.23.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.23.0. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Humio will make some internal logs available in a new repository
called humio-activity
. This is meant for logs
that are relevant to users of Humio, as compared to logs that
are only relevant for operators. The latter logs are still put
into the humio
repository. For this release,
only new log events will be put into
humio-activity
, but in later releases, some
existing log events that are relevant for users, will be put
into the humio-activity
repository instead of
the humio
repository.
For cloud users, the logs for your organization can be accessed
through the humio-organization-activity
view.
For on-prem users, the logs can be accessed directly through the
humio-activity
repository. They are also
output into a new log file named
humio-activity.log
which can be ingested into
the humio
repository, if you want it
available there as well. If you do and you are using the
Humio
Insights Application, you should upgrade that to version
0.0.4. For more information, see
Internal
Logging documentation.
Humio has decided to adopt an evolutionary approach to its GraphQL API, meaning that we will strive to do only backwards compatible changes. Instead of making non-backwards compatible changes to existing fields, we will instead add new fields alongside the existing fields. The existing fields will be deprecated and might be removed in some later release. We reserve the right to still do non-backwards compatible changes, for instance to fix security issues.
For new experimental features, we will mark the corresponding GraphQL fields as PREVIEW. There will be no guarantees on backwards compatibility on fields marked as PREVIEW.
Deprecated and preview fields and enum values will be marked as
such in the GraphQL schema and will be shown as deprecated or
preview in the API Explorer. Apart from that, the result of
running a GraphQL query using a deprecated or preview field will
contain a new field extensions
, which
contains a field deprecated
with a list of
all deprecated fields used in the query and a field
preview
with a list of all preview fields
used in the query.
Example:
{
"data": ...
"extensions": {
"deprecated": [
{
"name": "alert",
"reason": "[DEPRECATED: Since 2020-11-26. Deprecated since 1.19.0. Will be removed March 2021. Use 'searchDomain.alert' instead]"
}
]
}
}
Deprecated fields and enum values will also be noted in the
release note, when they are first deprecated. All use of
deprecated fields and enum values will also be logged in the
Humio repository humio-activity
. They will
have #category=GraphQL
,
subCategory=Deprecation
and
#severity=Warning
. If you are using the API,
consider creating an alert for such logs.
Removed Support for CIDR Shorthand
Previous version of Humio supported a shorthand for IPv4 CIDR
expressions. For example 127.1/16
would be
equivalent to 127.1.0.0/16
. This was contrary
to other implementations like the Linux function
inet_aton
, where 127.1
expands to 127.0.0.1
. Support for this
shorthand has been removed and the complete address must now be
written instead.
Bug Fixes
Other
Fixed a bug which caused tag-filters in anonymous functions to not work in certain cases (causing to many events to be let through)
Made the S3 archiving save button work again.
Refactor client side action cache of allowed permissions.
It is again possible to sort the events on the test parser page.
Added support for CIDR matching on
match()
usingmode=cidr
.Removed the deprecated
Repository.isFreemium
GraphQL field.Fixed an issue causing undersized segment merging to repeatedly fetch the same segments, in cases where the merger job took too long to finish.
Deprecated
glob
parameter onmatch()
, usemode=glob
instead.Negated, non-strict
match()
orlookup()
is no longer allowed.Added a new introduction message to empty repositories.
Added an option to make it easier to diagnose problems by detecting inconsistencies between globals in different Humio instances. Each Humio instance has its own copy of the global state which must all be identical. It has happened that they were not, so now we check and if there is a difference we report an error and dump the global state into a file.
UI enhancements for the new repository Access Permissions page.
Deprecated GraphQL mutations addAlertLabel, removeAlertLabel, addStarToAlert and removeStarFromAlert as they did not follow the standard for mutation input.
Allow turning encryption of files stored in bucket storage off by explicitly setting
S3_STORAGE_ENCRYPTION_KEY=off
(similar forGCP_
)Fixed a bug which caused
in()
with values=[] to give incorrect resultsEnforce permissions to enter Organization Settings page.
Fixed a bug which caused glob-patterns in
match()
to not match newline charactersFixes a bug where events deleted with the delete-event API would appear deleted at first, but then resurface again after 24h. If user applying delete did not have permission to search the events being deleted.
Added GraphQL mutations addAlertLabelV2, removeAlertLabelV2, addStarToAlertV2 and removeStarFromAlertV2.
The GraphQL API Explorer has been upgraded to a newer version. The new version includes a history of the queries that have been run.
Refactor All Organizations page.
Restyled the alert dialogue.
The
SearchDomain.queries
GraphQL field has been deprecated, and will be removed in a future release. UseSearchDomain.savedQueries
instead.Implemented toggle button for dark mode.
Enforce accepting terms and conditions.
Refactor how the width of the repository name in the main navigation bar is calculated.
Deprecated the REST endpoints for alerts and actions.
Deprecated the
ReadEvents
enum variant from theViewAction
enum in GraphQL. Use theReadContents
variant instead, which has the same semantics, but a more accurate name.ReadEvents
will be removed in a future release.Deprecated
file
andcolumn
parameter oncidr()
. Usematch()
withmode=cidr
instead.Enforce permissions to enter creating new repository page.
Mark required fields on the Accept Terms and Conditions page.
Fixed a bug in event forwarding that made
start()
,end()
andnow()
return the time at which the event forwarding rule was cached. Instead, now() will return the time at which the event forwarding rule was run. start() and end() were never meant to be used in an event forwarding rule and will return 0, which means Unix Epoch.Removed support for shorthand IPv4 CIDR notation in
cidr()
. See section "Removed support for CIDR shorthand".Improved performance when using
match()
withmode=cidr
compared to using cidr() with file().The GraphQL API Explorer is now available from inside Humio. You can access it using the Help->API Explorer menu.
Improved memory use for certain numerical aggregrating functions
Fixed an issue where regular expressions too large to handle would sometimes cause the query to hang. Now we report an error.
Fixed an issue where changes to files would not propagate to parsers or event forwarders.
Fixed an issue where Prometheus metrics always reported 0.0 for humio_primary_disk_usage
Fixed an issue with the Missing Segments API that caused missing segments to not appear in the missing segments list if they had a replacement segment.
Improved performance of free-text search using regular expressions
Fixed a bug where the same regex pattern occurring multiple times in a query could cause incorrect results
The
SearchDomain.viewerCanChangeConnections
GraphQL field has been deprecated, and will be removed in a future release. UseSearchDomain.isActionAllowed
instead.Fixed the requirement condition for the time retention on a repository.
Added IP Filter for readonly dashboard links, and started to audit log readonly dashboard access. In this initial version. The readonly ip filter can be configured with the graphql mutation:
graphqlmutation { updateReadonlyDashboardIPFilter(ipFilter: "FILTER") }
The FILTER is expected in this format: IP Filter. From Humio 1.25 this can be configured in the configuration UI.
Refactor Organization Overview page.
Added GraphQL queries and mutations for alerts and actions, which correspond to the deprecated REST endpoints for those entities.
Added
mode
parameter tomatch()
, allowing different ways to match the key.Fixed an issue which caused ingest-to-multiple-repos to break, when the parser used copyEvent to duplicate the input events into multiple repositories
Changed the URL of the Kafka cluster page in the settings.
Fixed a bug which caused
match()
to give incorrect results in certain cases due to incorrect caching
Humio Server 1.22.1 Stable (2021-03-02)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.22.1 | Stable | 2021-03-02 | 2022-03-02 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 7d2fb4c0736d1c7f03197fba78a33c13 |
SHA1 | 36c3c2b7ffe3485fb9f87a75b515cb7b9efc5efc |
SHA256 | bc3122c71e8c1bdf57fc044912c660b86933c871758818fb93a8d609c9bc340d |
SHA512 | 54e1da57da87480a2b1b0cc577eb731b734b8fe7af0e2ac3afcd406d28f29ffa5b834d836b283dc5e730b10bba43d55484cd8579746c800bd26a26280a088200 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.22.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.22.1. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixes overflowing editor bug.
Fixes problem where alertpages have no height in Safari.
Fixes parserlist having no height on Safari.
Humio Server 1.22.0 Stable (2021-03-02)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.22.0 | Stable | 2021-03-02 | 2022-03-02 | 1.16.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 115532e6c7c321a1fe737bdde5731f4b |
SHA1 | 8a42ec6f7ba168939c60d521d30eba202479173e |
SHA256 | 4cff315346b9edb1ba625f48fe36105666dc9b95e711190578ff62752fa763e4 |
SHA512 | 0173d8b48f8612198cb4a20146b15d23769cacee4fac12a7c710a93ef2f17a30140ccee8e09c8f7c5262815cbb2e03876fe30986f276a9d36155832c4e03a233 |
Important Information about Upgrading
This release promotes the latest 1.21 release from preview to stable.
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.22.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.22.0. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
## UI revamp In this version the UI has been given a complete makeover. ## Details To see more details, go through the individual 1.21.x release notes (links in the changelog).
Bug Fixes
Other
Increase HTTP chunk size from 16MB to 128MB
Fixed issue where root users were not allowed to set unlimited time in retention settings
Fixed issue where local segment files would not get deleted in time, potentially filling the disk
Fix issue where updating account settings would present the user with an error even though the update was successful
Restrict concurrency when mirroring uploaded files within the cluster
Major changes: (see version 1.21.0 and 1.21.1 release notes)
Add the "ProxyOrganization" header to the list of general auth headers used on REST calls
Change log lines creating a 'kind' field. Kind is used as a tag for the different humio logs
Fixed issue where tag filters in anonymous parts within an aggregate did not get applied
Humio Server 1.21.1 Preview (2021-02-23)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.21.1 | Preview | 2021-02-23 | 2021-03-02 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 3f2b7ae5265ab8e81d339ebbd260b802 |
SHA1 | e406e539b9d3474a25accc82d49efdbcc94c7f4d |
SHA256 | 0ec0db6bfaa232c30d1e0056442f58e5d2c20d9b7716ba136b8350d2c5c05bdd |
SHA512 | 01383adbe54ceb73679aece980b0a7752b07478a40ac3f811a3aadbf9fb55077ebf08842cb2442628af1200e677d0db289a6007b3706794c79377787ef56e898 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.21.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.21.1. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Improve performance of "decrypt step" in downloads from bucket storage
Server:
header in responses from from Humio HTTP server now includes (Vhost, NodeRole) after the version string.New "prefetch from bucket" job. When a node starts with an empty disk it will download a relevant subset of segment files from the bucket in order to have them present locally for queries.
Humio Server 1.21.0 Preview (2021-02-22)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.21.0 | Preview | 2021-02-22 | 2022-02-22 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 3175d041a4c0a6948d5e23993b7a3bcd |
SHA1 | 1356a57098602623b5cab8511f530aab3b04a080 |
SHA256 | 8f576aca2a00533180ed3710971bd9c4c419e275d618c4c745d004b9a5ad9987 |
SHA512 | 475c72b5655744be0a900269478d930942cd7aae9ec8acf0e38c1eff2a4c7ec243c91293996ad8288ec2ed9c72b896436bb8e12b67f44b999fc03d1f43db4a2d |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.21.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.21.0. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Humio insights package installed if missing on the humio view when humio is started.
Made sure the humio view humio default parser is only installed when missing, instead of overwriting it every time humio starts.
The experimental function
moment
has been removed.Fixed a bug in
upper()
andlower()
which could cause its output to be corrupted (in cases where no characters had been changed).The deprecated built-in parser
json-for-notifier
has been deleted. It has been replaced by the parserjson-for-action
.Improve performance of
writeJson()
a bit.Fixed a bug where analysis of a regex could consume extreme amounts of memory.
Fixed a bug in
lowercase()
which caused the caselowercase(field="\*", include="values")
to not process all fields but only the field named"\*"
.The
replace()
function now reports an error if an unsupported flag is provided in theflags
argument.The functions
worldMap()
andgeohash()
now errors if requested precision is greater than 12.Fixed a memory leak in
rdns()
in cases where many different name servers are used.subnet()
now reports an error if its argumentbits
is outside the range 0 to 32.kvParse()
now only unescapes quotes and backslashes that are inside a quoted string.Change handling of
groupBy()
in live-queries which should in many cases reduce memory cost.When on ephemeral disks, nodes being replaced with new ones on empty disks no longer download most of the segments they had before being replaced, but instead schedule downloads based on is being searched.
The deprecated built-in parser
bro-json
has been deleted. It has been replaced by the parserzeek-json
.Fixed a bug which could cause saving of query state cache to take a rather long time.
Fixed an issue with lack of escaping in filename when downloading.
Running test of a parser is no longer recorded in the audit log, and irrelevant fields are no longer recorded upon parser deletion.
Raised the note widget text length limit to .00.
Packages can now be updated with the same version but new content. This makes iterating over a package before finalizing it easier.
The Auth0 login page will no longer load a local version of the Auth-Lock library, but instead load a login script hosted on Auth0's CDN. This may require opening access to
https://cdn.auth0.com/
if hosting Humio behind a firewall.Create, update and delete of an alert, scheduled search or action is now recorded in the audit log.
The
findTimestamp()
function has been changed, so that it no longer has a default value for thetimezone
parameter. Previously, the default wasUTC
. If no timezone argument is supplied to the function, it will not parse timestamps that do not contain a timezone. To get the old functionality, simply addtimezone=UTC
to the function. This can be done before upgrading to this release.Improve number formatting in certain places by being better at removing trailing zeros.
The default parser
kv
has been changed from using theparseemacs vTimestamp()
function to use thefindTimestamp()
function. This will make it able to parse more timestamp formats. It will still only parse timestamps with a timezone. It also no longer adds atimezone
field with the extracted timestamp string. This was only done for parsing the timestamp and not meant for storing on the event. To keep the old functionality, clone thekv
parser in the relevant repositories and store the cloned parser with the namekv
. This can be done before upgrading to this release. See Built-In kv Parser.Added support for disaster recovery of a cluster where all nodes including Kafka has been lost, restoring the state present in bucket storage as a fresh cluster using the old bucket as read-only, and forming a fresh cluster from that. New Configs: S3_RECOVER_FROM_REPLACE_REGION and S3_RECOVER_FROM_REPLACE_BUCKET to allow modifying names of region/bucket while recovering to allow running on a replica, specifying read-only source using
S3_RECOVER_FROM
* for all the bucket storage target parameters otherwise namedS3_STORAGE
*Fixed a bug which caused validation to miss rejecting window() inside
window()
andsession()
.Made loggings for running alerts more consistent and more structured. All loggings regarding a specific alert will contain the keys
alertId
,alertName
andviewId
. Loggings regarding the alert query will always contain the keyexternalQueryId
and sometimes also the keysqueryId
with the internal id andquery
with the actual query string. If there are problems with the run-as-user, the id of that user is logged with the keyuser
.Prevent Humio from booting when Zookeeper has been reset but Kafka has not.
Lowered the severity level for some loggings for running alerts.
The transpose function now reports an error if the arguments
header
orcolumn
is provided together with the argumentpivot
.Fixed an issue where merge of segments were reported as failed due to input files being deleted while merging. This is not an error, and is no longer reported as such.
Fixed a bug which could potentially cause a query state cache file to be read in an incomplete state.
Fixed an issue where cancelled queries could be cached.
Fixed bugs in
format()
which caused output from '%e'/'%g' to be incorrect in certain cases.Raised the parser test character length limit to .00.
kvParse()
now also unescapes single quotes. ('
)kvParse()
now unescapes backslashes when they're inside ('
or"
) quotes.Make the thread dump job run on a dedicated thread, rather than running on the thread pool shared with other jobs.
Fixed a number of potential concurrency issues.
When using filters on dashboards, you can now easily reset the filter, either removing it completely, or using the default filter if one is present.
Fixed an issue where repeating queries would not validate in alerts.
Fixed an issue causing Humio to crash when attempting to delete an idle empty datasource right as the datasource receives new data.
When exporting a package, you now get a preview of the icon you've added for the package.
The
split()
function no longer adds a@display
field to the event it outputs.Fixed a performance and a robustness problem with the function
unit:convert()
. The formatting of the numbers in its output may in some cases be different now.Fixed an issue causing segment tombstones to potentially be deleted too early if bucket storage is enabled, causing an error log.
Fixed an issue with the validation of the query prefix set on a view for each repository within the view: Invoking macros is not allowed and was correctly rejected when creating a view, but was not rejected when editing an existing connection.
Fixed a bug in parseJson which resulted in failed JSON parsing if an object contained an empty key (
""
).Fixed an issue where the segment mover might schedule too many segments for transfer at a time.
The
replace()
function now reports an error if the argumentsreplacement
andwith
are provided at the same time.Fixed a bug where referenced saved queries were not referenced correctly after exporting them as part of a package.
Made loggings for running scheduled searches more consistent and more structured. All loggings regarding a specific alert will contain the keys
scheduledSearchId
,scheduledSearchName
andviewId
. Loggings regarding the alert query will always contain the keyexternalQueryId
and sometimes also the keysqueryId
with the internal id andquery
with the actual query string. If there are problems with the run-as-user, the id of that user is logged with the keyuser
.Fixed a bug which caused
eventInternals()
to crash if used late in the pipeline.Fixed an issue causing event redirection to break when using copyEvent to get the same events ingested into multiple repositories.
Improve hit rate of query state cache by allowing similar but not identical queries to share cache when the entry in the cache can form the basis for both. The cache format is incompatible with previous versions, this is handled internally by handling incompatible cache entries as cache misses.
Humio Server 1.20.4 Stable (2021-02-22)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.20.4 | Stable | 2021-02-22 | 2022-01-28 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | e84da693a3ca628775ca56a33f27db91 |
SHA1 | fd2a37750456d861a92ee41840701c2040b71d79 |
SHA256 | 0fc7d2b010abbc263ef97ae4cb019994804133ff858f23de03e0bce69760011a |
SHA512 | 9af984c0a5896046cf0f3febd3b64aef7af501404df75a612c04452140aa9cd9c97f4ed2a5a95fe241ac227db3f3bbbe072ddaa2bed058053b6cfeafcbc388e5 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.20.4 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.20.4. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixed an issue causing event redirection to break when using
copyEvent()
function to get the same events forwarded to multiple repositories.New "prefetch from bucket" job - When a node starts with an empty disk it will download a relevant subset of segment files from the bucket in order to have them present locally for queries.
Connecting to the Package Marketplace now respects the Humio proxy configuration
Humio Server 1.20.3 Stable (2021-02-11)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.20.3 | Stable | 2021-02-11 | 2022-01-28 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | eb0a1ddfb3bd3440206fc7ce95fedd74 |
SHA1 | 0eedbdc67554a9efbb0fcc5f667a99c899ae43bc |
SHA256 | ecdcb4a299eb3668ed6d5435c97469b4f7b1423f239f4e0a4b95a88d9b8fd566 |
SHA512 | 53dd06169c01eaccc6766f53f6a7c71910c131d7600bfdcdb3f9796d61e7ccdcfa801d8b2a2b9ed4b205fa7c3e567dc2a9a3b6879c94e10f408892cd0d57d77d |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.20.3 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.20.3. In case you need to do a rollback, this can also only happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Improve auto completion suggestions.
Humio Server 1.20.2 Stable (2021-02-11)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.20.2 | Stable | 2021-02-11 | 2022-01-28 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | c8369fd679e4ef4fb1ddad2a632156e1 |
SHA1 | 7dc7214d24c3314fa9e60128106aed4078b2c7c9 |
SHA256 | e1c8188fd7e0dc92c648a675514627c4a9ae0f52658aac748d35a0105347c4ba |
SHA512 | fea474b22bebcbe7c5ad1e142fbf157f495b58726951e8b52820475fdda5eb48503a76bef7e2178ac3aeddcc6087d6bdd66c3ab5c67dbcf721da1ebc4bd671fa |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.20.2 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.20.2. In case you need to do a rollback, this can also only happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixed a bug that exporting a package with dashboard parameters would not set the correct name space for a saved query called in a parameter.
Query scheduling now tracks cost spent across queries for each user and tends to select next task so that users (rather than queries) each get a fair share of available CPU time.
Fixed an issue where cloning a dashboard or parser would clone the wrong entity.
Handle inconsistencies in the global entities file gracefully rather than crashing.
Fixed a bug that exporting a package using a saved query with spaces in the name would not export the correct name.
Fixed a bug where fields panel was not scrollable in Safari.
Fixed a bug in parseJson which resulted in failed JSON parsing if an object contained an empty key (
""
).Fixed an issue where some parts of regexes did not shown in the parser editor.
Reduce triggering of auto completion in the query editor.
Improve query cache hit rate by not starting queries locally when the preferred nodes are down, if the local node has just started — as there is a fair chance the preferred nodes will show up shortly too.
Fixed a bug in upper() and lower() functions which could cause its output to be corrupted (in cases where no characters had been changed).
Humio Server 1.20.1 Stable (2021-02-01)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.20.1 | Stable | 2021-02-01 | 2022-01-28 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 5f2ccaea9f97572ec047be936d7ff0de |
SHA1 | 5e434cc0df8b437a3974be645e80c3f2c56ec78a |
SHA256 | 74f2fcf3d5d2bc5b1e5830d98a03512395ac7beb6456bf754e69e48e89e1d7cf |
SHA512 | 16a58326069b3dd9e401688627e62e825249654501f63c939d245c6b501bd683c7682a634f9cb0265c17029ac8b7cdf038e57daa27a57478980115bce18c53ce |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.20.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.20.1. In case you need to do a rollback, this can also only happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Minor fix to Humio internal JSON logging when using the configuration
HUMIO_LOG4J_CONFIGURATION=log4j2-json-stdout.xml
Humio Server 1.20.0 Stable (2021-01-28)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.20.0 | Stable | 2021-01-28 | 2022-01-28 | 1.16.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 095aa44f1cbaf9cdffc9753286206248 |
SHA1 | fd4eb8cc488d18e7fedff3af212a9919d399b256 |
SHA256 | 79868d79d893ebb3114208e5e7f64d20ded44b76f4342b3b2d932df6288c927e |
SHA512 | 9b91b51b21654ec1961ee9ba31193ad5511850cdb3623d82403356191535a74febeb51a49fb711438408898fe4222f2522f3c37b33c81c75091b6a415c2f0924 |
Important Information about Upgrading
This release promotes the latest 1.19 release from preview to stable.
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.20.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.20.0. In case you need to do a rollback, this can also only happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixed an issue causing the secondary storage transfer job to plan more segments for transfer than necessary.
Major changes (see version 1.19.0 release notes)
Fixed a bug where merged segments could grow too large if the source events were large.
Enable Package marketplace (in beta)
Segment download timeout raised from 120s to 1.0s. Avoids situations where large segments could not be moved around a cluster.
Humio Server 1.19.2 Preview (2021-01-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.19.2 | Preview | 2021-01-25 | 2021-01-28 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 01e72a42b56685f50111466e91475e9b |
SHA1 | 7d09c09579a2c00cb2cc0a38c421969861f9c6a0 |
SHA256 | 83e7efdf3bd38eb806b30c81603e4eefe5ee17f88fa9c6440fd56d11c86d2869 |
SHA512 | 3ccc62d52899ecad9fd7626bb15f90b05bcabaf761d997c4aa63849f93702c6caf32d1f6ed191c981054c1df853ec6fbcdbd07fba0e76e289d4f71d39b542d9b |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.19.2 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded to minimum 1.16.0 before trying to upgrade to 1.19.2. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer, rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixed automatic installation of Humio Insights package to the humio repository
Fixed an issue for on-prem users not on multitenant setup by reverted a metric change introduced in 1.18.0, jmx and Slf4j included an OrgId in all metrics for repositories.
Humio Server 1.19.1 Preview (2021-01-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.19.1 | Preview | 2021-01-19 | 2022-01-19 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 7ba0f9e286f6933cb19b49be72df8078 |
SHA1 | 489be0b931419cd128d5a03e2b2fbce819095257 |
SHA256 | 2f8a22da0e6f85c4cd4479367635ad9c0a0586f2fc69df55533e349e3ea29bab |
SHA512 | b306f424ae1425145a382be5847e46f6f56d91777202ef94117c755be5f713dab787ae6da2a4acd0091d04d07d75b3b4154185eab5327f8db558071d1b4d301f |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.19.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded to minimum 1.16.0 before trying to upgrade to 1.19.1. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer, rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Do not cache cancelled queries.
Fixed bug in a saved query in the Humio Insights package
Update dependencies with known vulnerabilities
Fixed an issue - Do not delete datasource before the segments have been deleted also in bucket storage if present there.
Do not retry a query when getting a HTTP .0 error
Fixed bug where the format() function produced wrong output for some floating-point numbers
Humio Server 1.19.0 Preview (2021-01-14)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.19.0 | Preview | 2021-01-14 | 2022-01-14 | 1.16.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 63d03b5a7d362d1d9a5dfcb5a7d6fcea |
SHA1 | 7ed7776a690ff76afd4ff77ac585a28ef7ee1b2c |
SHA256 | 532dd54bc612b6f771a142899277430469a85c3a431a7824105c1ab69d21974e |
SHA512 | 9edc286d2409cdf36496cc9a7c69ab525ac3207006f1ce3aa194bd17e59e4601f676dbdec0c71cfecd197364b45d83398e5566cebbed82e0a10e1d19ae2e91eb |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.19.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.19.0. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixed bug where repeating queries would not validate in alerts.
API Changes (Non-Documented API):
getFileContent
has been moved to a field on the SearchDomain type.Introduced humio insights package that is installed per default on startup on the humio repository
The configuration option IP_FILTER_NOTIFIERS has been renamed to IP_FILTER_ACTIONS. The old name will continue to work.
Updated the permission checks when polling queries. This will results in dashboard links "created by users who are either deleted or lost permissions to the view" to get unauthorized. To list all dashboard links, run this graphql query as root: query { searchDomains {dashboards { readOnlyTokens { createdBy name token } } } }
Fixed an issue causing the secondary storage transfer job to select and queue too many segments for transfer at once. The job will now stop and recalculate the bulk to transfer periodically.
Fixed an issue causing queries using kvParse() to filter out too much in specific circumstances when filtering on a field assigned before kvParse().
The function parseCEF() now deals with extension fields with labels, i.e.
cs1=Value cs1Label=Key
becomescef.label.Key=Value
.Improve handling of broken local cache files
New feature "Event forwarding" making it possible to forward events during ingest out of Humio to a Kafka server. See Event Forwarding documentation. Currently only available for on-prem customers.
The built-in
bro-json
parser is deprecated and will be removed in a later release. It has been replaced by an identical parser with the namezeek-json
, see zeek-json.No longer overwrite the humio parser in the humio repository on startup.
Fixed an issue which caused free-text-search to not work correctly for large (>64KB) events.
Fixed timeout issue in S3 Archiving
Fixed an issue causing queries using kvParse() to be executed incorrectly in certain circumstances when kvParse() assigned fields starting with a non-alphanumeric character.
New validation when creating an ingest token using the API that the parser, if specified, actually exists in the repository.
Reduced the number of writes to global on restart, due to merge targets not being properly reused.
New config QUERY_QUOTA_EXCEEDED_PENALTY with value 50 by default. When set >= 1.0 then this throttles queries from users that are over their quota by this factor rather than stopping their queries. Set to 0 to disable and revert to stopping queries.
API Changes (Non-Documented API): Getting Alert by ID has been moved to a field on the SearchDomain type.
Humio no longer deletes an existing humio-search-all view if the CREATE_HUMIO_SEARCH_ALL environment variable is false. The view instead becomes deleteable via the admin page.
Fixed a rare issue where a node that was previously assigned digest could write a segment to global, even though it was no longer assigned the associated partition.
For ingest using a URL with a repository name in it, Humio now fails ingest if the repository in the URL does not match the repository of the ingest token. Previously, it would just use the repository of the ingest token.
Kafka client inside Humio has been bumped from 2.4.1 to 2.6.0.
Fixed an issue with the cidr function that would make some IPv4 subnets accept IPv6 addresses and some strings that were not valid IP addresses.
Fixed an issue where segment merge occasionally reported BrokenSegmentException when merging, while the segments where not broken.
Added config option for Auth0 based sign on method: AUTH_ALLOW_SIGNUP defaults to true. The config is forwarded to the auth0 configuration for the lock widget setting: allowSignUp
Fixed an issue where the segment rewrite job handling event deletion might rewrite segments sooner than configured.
Cluster management stats now shows segments as underreplicated if they are replicated to enough hosts, but are not present on all configured hosts.
Custom made saved queries, alerts and dashboards in the humio repository searching for events of the kinds metrics, requests or nonsensitive may need to be modified. This is described in more detail in the Internal Logging documentation.
Removed config IDLE_POLL_TIME_BEFORE_DASHBOARD_QUERY_IS_CANCELLED_MINUTES. Queries on dashboards now have the same life cycle as other queries.
Upgraded Log4j2 from 2.13.3 to 2.14.0.
Humio will only allow using Zookeeper for node id assignment (ZOOKEEPER_URL_FOR_NODE_UUID) when configured for ephemeral disks (USING_EPHEMERAL_DISKS). When using persistent disks, there is no need for the extra complexity added by Zookeeper.
Added mutation to update the runAsUser for a read only dashboard token.
The built-in
json-for-notifier
parser used by the Humio Repository action (formerly notifier) is deprecated and will be removed in a later release. It has been replaced by an identical parser with the namejson-for-action
, see documentation.Fixed logic for when the organization owner panel should be shown in the User's Danger zone.
Fixed an issue where canceling queries could produce a spurious error log.
Fixed an issue where the filter and groupBy buttons on the search page would not restart the search automatically
The configuration option HTTP_PROXY_ALLOW_NOTIFIERS_NOT_USE has been renamed to HTTP_PROXY_ALLOW_ACTIONS_NOT_USE. The old name will continue to work.
New filter function
test( <boolean expression> )
makes it convenient to test complex expressions.New function
hash
for computing hashes of fields. Seehash()
reference page.Made cluster nodes log their own version as well as the versions of all other nodes. This makes it easier to tell which versions are running in the cluster.
Fixed an rare issue where the digest coordinator would assign digest fewer hosts than configured.
Added timeout for TCP ingest listeners. By default the connection is closed if no data is received after 5 minutes. This can be changed by setting TCP_INGEST_MAX_TIMEOUT_SECONDS. See Ingest Listeners documentation.
Raised the parser test character length to .00.
API Changes (Non-Documented API): Queries and Mutations for Parser now expects an
id
field in place of aname
field, when fetching and updating parsers."Notifiers" have been renamed to "actions" throughout the UI and in log statements. The REST APIs have not been changed and all message templates can still be used.
When a host dies and Humio reassigns digest, it will warn if a fallback host is picked that is in the same zone as existing replicas. Eliminate warning if falling back to a host in the null zone.
Improved app loading logic.
Reduce contention on the query scheduler input queue. It was previously possible for large queries to prevent each other from starting, leading to timeouts.
Make the query functions
window()
andseries()
be enabled by default. They can be disabled by setting the configuration options WINDOW_ENABLED and SERIES_ENABLED tofalse
, respectively.unit
on timechart (and bucket) now works also when the function within uses nesting and anonymous pipelines.New config AUTO_UPDATE_MAXMIND for enabling/disabling updating of all maxmind databases. Deprecates AUTO_UPDATE_IP_LOCATION_DB, but old config will continue to work.
New ingest endpoint
/api/v1/ingest/raw
for ingesting singular webcalls as events. See Ingest API - Raw Data documentation.Fixed an issue that could cause node id assignment to fail when running on ephemeral disks and using Zookeeper for node id assignment. Nodes in this configuration will now try to pick a new id if their old id has been acquired by another node.
New config MAXMIND_IP_LOCATION_EDITION_ID for selecting the maxmind edition of the IP location database. Deprecates MAXMIND_EDITION_ID, but old config will continue to work.
Renamed LOG4J_CONFIGURATION environment variable to HUMIO_LOG4J_CONFIGURATION. See Configuration reference pages. The old variable will no longer work.
Fixed an issue where unit-conversion (by timechart) did not take effect through groupBy() and window().
Fixed an issue with updating user profile, in some situations save failed.
Introduction of the new log file humio-requests.log. Also the log format for the files humio-metrics.log and humio-nonsensitive.log has changed as described above. The guide for sending Humio logs to another Humio cluster has been updated.
New feature "Scheduled Searches" making it possible to run queries on a schedule and trigger actions (formerly notifiers) upon query results. See documentation.
The Humio Repository action (formerly notifier) now replaces a prefix '#' character in field names with @tag. so that
#source
becomes@tag.source
. This is done to make them searchable in Humio. You can change the name by creating a custom parser. See related documentation for more details.New feature: "stateless Ingest-only nodes": A node that the rest of the cluster does not know exists, but is capable of ingesting events into the ingest queue. Enable using NODE_ROLES=ingestonly.
Fixed crash in CleanupDatasourceFilesJob when examining a file size fails due to that file being deleted concurrently.
Add an error message to the event if the user is trying to redirect it to another repo using #repo, and the target repo is invalid.
Raised the limit for note widget text length to .00
New feature "Custom ingest tokens" making it possible for root users to create ingest tokens with a custom string.
In the GraphQL API, the value
ChangeAlertsAndNotifiers
on thePermission
enum has been deprecated and will be removed in a later release. It has been replaced by theChangeTriggersAndActions
value. The same is true for theViewAction
enum. On theViewPermissionsType
type, theadministerAlerts
field has been deprecated and will be removed in a later release. It has been replaced by theadministerTriggersAndActions
field.Added asn function for retrieving the ASN number for a given IP address, see
asn()
reference page.The names of the metadata fields added by the Humio Repository action (formerly notifier) has been changed to accomodate that it can now also be used from scheduled searches. See related documentation for more details.
In the GraphQL API, on the
Alert
type, thenotifiers
field has been deprecated and will be removed in a later release. It has been replaced by theactions
field.The transfer job will delete primary copies shortly after transferring the segments to secondary storage. The copies would previously only be deleted once a full bulk had been moved.
Fixed an issue causing Humio to retain deleted minisegments in global for longer than expected.
Fixed a bug where fullscreen mode could end up blank
Humio Server 1.18.4 Stable (2021-01-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.18.4 | Stable | 2021-01-25 | 2021-11-26 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d6d2999c1640e0b922b79163c9ec83b5 |
SHA1 | a0452151aaa9437a2d4f772f23d3f817080d015c |
SHA256 | b786cb7edf1d2b8729a44ff73ce8239688aefd2431940d283a15537b3be01b37 |
SHA512 | cfce44d51dce08213bfc26f5bd74cf3596185bc15e87518f63cf9b601f0e8118923d61afa17770827cd1fae6547a5d11decdacc9cffb57f95f0f3b351151632d |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.18.4 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.18.4. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Fixed an issue for on-prem users not on multitenant setup by reverted a metric change introduced in 1.18.0, jmx and Slf4j included an OrgId in all metrics for repositories.
Humio Server 1.18.3 Stable (2021-01-20)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.18.3 | Stable | 2021-01-20 | 2021-11-26 | 1.16.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 2db608cedd7603e6cd595c58aa9fad5d |
SHA1 | ea622d5f1a706daa3c6345bc1237918836498f9f |
SHA256 | 00f4f144647918d42cf85cb26ece7c0529a76af02d6a56dd483ada74b8028816 |
SHA512 | 2335597bf91028e1b476178039e15b47645cca2f8dfdf445514e279133a042ed44a5450c9456710a9843279d431b37fff85ba4c41abab56780d8923e81e6dcc9 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.18.3 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.18.3. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Do not cache cancelled queries.
Fixed bug where the format() function produced wrong output for some floating-point numbers
Update dependencies with known vulnerabilities
Do not retry a query when getting a HTTP .0 error
Humio Server 1.18.2 Stable (2021-01-08)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.18.2 | Stable | 2021-01-08 | 2021-11-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 325cfefc1a6eef3b4f9d1e6beeb5a53a |
SHA1 | a8af4a4a70c93cb6ff945c999bd0e6ea579d1a2a |
SHA256 | f2201aab5190ec92b540bc8be9b6ea59c2e840fece63b2d87891aff9d7fc284a |
SHA512 | 8a1e56622041d45db967e6aa003da14fb78143fc63d3dfb936e318d385761f8a10a57823040d68b8f200048fc28006df1d281e74baad1bcdef080334a8634af5 |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.18.2 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded at least to 1.16.0 before trying to upgrade to 1.18.2. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer. Rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Adds a new configuration option for auth0: AUTH_ALLOW_SIGNUP. Default value is true.
Improves handling when many transfers to secondary storage are pending.
Resolves problem when starting a query spanning very large data sets, a time-out could prevent the browser from getting responses initially.
Fixed bug where Humio could end in a corrupted state, needing manual intervention before working again.
Fixed bug so as to reduce contention on the Query input queue.
Humio Server 1.18.1 Stable (2020-12-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.18.1 | Stable | 2020-12-17 | 2021-11-26 | 1.16.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 23a1b98323ea040221d9314e181f5048 |
SHA1 | 2364af27ee4d0e12ff3732252e31aceaa12534a9 |
SHA256 | 9f83caa9a0aa483087c28e083fb10e2d418c9f66c109abe0b7464dd312d3e873 |
SHA512 | 682242210795e8b72f82589a01a3933072c7b744a8abdc54adca3964d08c32f02504e86abd44639278cf104d79587f8b0d0b89b807fc3ba321e04c3644c6dfab |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.18.1 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded to minimum 1.16.0 before trying to upgrade to 1.18.1. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer, rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Improve performance of S3 archiving when many repositories have the feature enabled.
Add GraphQL mutation to update the runAsUser for a read only dashboard token.
Fixes a bug where
top([a,b], sum=f)
ignored events where f was not a positive integer. Now it ignores negative and non-numerical input but rounds decimal numbers to integer value.Fixes a bug where a query would not start automatically when requesting to filter or group by a value.
Increase number of vCPUs used when parsing TCP ingest, twice the number of the 1.18.0 build.
Fixes a bug that would allow users with read access to be able to delete a file (#10133)
Add non-sensitive logging that lists the versions of Humio running in the cluster. These logs can be found by searching the Humio debug log for "cluster_versions".
Fixes a bug where queries with
@timestamp=x
where x was a timestamp with the current search interval could failFixes a bug where the merge of mini segments could fail during sampling of input for compression.
Improve handling of a node being missing from the cluster for a long time by letting other nodes handle the parts of the query that node would normally do.
Fixes a bug where the permissions check on editing a connection from a view to a repository allowed altering the search prefix of connections other than the one the user currently was allowed to edit.
Fixes a bug where some valid repeating queries would not validate in alerts
Fixes a bug where the
to
parameter to unit:convert would cause internal server errors instead of validation errors.Only install default Humio parser to the Humio view if it is missing. No longer overwriting local changes.
Humio Server 1.18.0 Stable (2020-11-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.18.0 | Stable | 2020-11-26 | 2021-11-26 | 1.16.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 0525cf2284207efde5655fd9174c411f |
SHA1 | 9d28fc3e60a033c27746584ac10fd5abedb2af69 |
SHA256 | 5f2a5cfa60bc13c859caa2e07a1dbd3a907d15483cc7d5829d02646f8350d61c |
SHA512 | be22b5126137fa75d0d5ac5a870c716fadee85155bb58822d710397e633de9acbb060c7500f46031a3996e826c5d3b3ee5c0b0c1d572b3944f1be5ebc05cffca |
Important Information about Upgrading
This release promotes the latest 1.17 release from preview to stable.
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.18.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded to minimum 1.16.0 before trying to upgrade to 1.18.0. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer, rolling directly back to an earlier release can result in data loss.
Bug Fixes
Other
Changed behaviour when the config ZONE is set to the empty string. It is now considered the same as omitting ZONE.
Removed config IDLE_POLL_TIME_BEFORE_DASHBOARD_QUERY_IS_CANCELLED_MINUTES. Queries on dashboards now have the same life cycle as other queries.
Major changes (see 1.17.0 release notes)
Fixed a bug where TCP listener threads could take all resources from HTTP threads
Humio Server 1.17.0 Preview (2020-11-18)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.17.0 | Preview | 2020-11-18 | 2020-11-26 | 1.16.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 9c47009810132eb67177966d10471544 |
SHA1 | 341a2607265420b1a2d461ad111c88aca06419ed |
SHA256 | 59001d9a738930f8774c11864ce3c36b3b4b4003f8cad0d4b36af13275ceefa9 |
SHA512 | ee8e2837a8fba2b28aab8d18b16269f452f19a5c80ad9826ecbeb73eaa062236acdf2191cc448e60d81390f1a2881374637adce7603ebf9f0861ca6246f6c82f |
Important Information about Upgrading
Beginning with version 1.17.0, if your current version of Humio is not directly able to upgrade to the new version, you will get an error if you attempt to start up the incompatible version. The 1.17.0 release is only compatible with Humio release 1.16.0 and newer. This means that you will have to ensure that you have upgraded to minimum 1.16.0 before trying to upgrade to 1.17.0. In case you need to do a rollback, this can also ONLY happen back to 1.16.0 or newer, rolling directly back to earlier release can result in data loss.
Bug Fixes
Other
New experimental query function window(), enabled by config option WINDOW_ENABLED=true, see
window()
reference page.Refuse to boot if the global topic in Kafka does not contain the expected starting offset.
Tweaked location of diagnostics regarding missing function arguments.
Fixes the case where Humio would consider local node state when deciding which ingest data was safe to delete from Kafka.
Fixes a bug where join function in some circumstances would fetch subquery results from other cluster nodes more than once.
Fixes a bug causing the sub-queries of join() etc. to not see events with an @ingesttimestamp occurring later than the search time interval.
New config option ENABLE_ALERTS makes it possible to disable alerts from running (enabled by default).
Switch from JDK to BouncyCastle provider for AES decrypt to reduce memory usage.
Fixes an issue which caused free-text-search to not work correctly for large (>64KB) events.
Setting the default query for a view in the UI has been moved from the "Save as Query" to the View's "Settings" tab.
Changed default TLS ciphers and protocols accepted by Humio, see TLS Configuration reference page.
API Changes (Non-Documented API): View Settings REST API has been replaced by GraphQL.
Free-text search has been fixed to behave more in line with the specification.
The
{events_html}
notifier template will now respect the field order from the query.The notifier list is sorted when selecting notifiers for an alert.
Refuse to boot if the booting node would cause violations of the "Minimum previous Humio version" as listed in the release notes.
Fix negating join expressions.
Improved wording of diagnostics regarding function arguments.
Fixes a bug causing join() to not work after an aggregating function.
New config option DEFAULT_MAX_NUMBER_OF_GLOBALDATA_DUMPS_TO_KEEP.
If KAFKA_MANAGED_BY_HUMIO is true, Humio will ensure unclean leader election is disabled on the global-events topic.
The Humio-search-all view will no longer be removed if CREATE_HUMIO_SEARCH_ALL is set to false. The view will instead become possible to delete manually via the admin UI.
New config option ALERT_DESPITE_WARNINGS makes it possible to trigger alerts even when warnings occur.
Reduce the number of merge target updates Humio will write to global on digest leader reassignment or reboot.
It is again possible to override a built-in parser in a repository by creating a parser with the same name.
New query function parseCEF used to parse events which are formatted according to the Common Event Format(CEF), see
parseCEF()
.Improve logic attempting to ensure other live nodes can act as substitutes in case the preferred digest nodes are not available when writing new segments.
Fix several cases where Humio might attempt to write a message to Kafka larger than what Kafka will allow.
New config option IP_FILTER_NOTIFIERS, to set up IP filters for Alert Notifications, see IP Filter reference page.
Reduce the max fetch size for Kafka requests, as the previous size would sometimes lead to request timeouts.
Fixes an issue causing Humio to fail to upload files to bucket storage in rare cases.
New query function parameter to parseJson,
removePrefixes
, seeparseJson()
reference page.Fixes a bug where unit:convert couldn't handle numbers in scientific notation.
Allow running Humio on JDK-14 and JDK-15 to allow testing these new builds.
Fixes the issue where Humio could behave incompatibly with Kafka versions prior to 2.3.0 if KAFKA_MANAGED_BY_HUMIO was true.
Fixes a bug causing sort()/head()/tail() to work incorrectly after other aggregating functions.
New experimental query function beta:repeating(), see
beta:repeating()
reference page.API Changes (Non-Documented API): Saved Query REST API has been replaced by GraphQL.
Crash the node if an exception occurs while reading from the global Kafka topic, rather than trying to recover.
Periodically release object pools used by mapper pipeline, to avoid a possible source of memory leaks.
Fixes an issue where Humio might try to get admin access to Kafka when KAFKA_MANAGED_BY_HUMIO was false.
Rename a few scheduler threads so they reflect whether they're associated with streaming queries ("streaming-scheduler") or not ("normal-scheduler")
New experimental query function series(), enabled by config option SERIES_ENABLED=true, see
series()
reference page.Fixes the case where datasources receiving data might not be marked idle, causing Humio to retain too much ingest data in Kafka.
New query function concatArray, see
concatArray()
reference apge.
Humio Server 1.16.4 Stable (2020-11-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.16.4 | Stable | 2020-11-26 | 2021-10-09 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d83c60916b9cb3c12501c541253b5aee |
SHA1 | fa164160b4874f1f1524ff61d49584a62c471868 |
SHA256 | 362d0640d4673b985c6ad9fcdcac7404dc127a65d33d0d423d15e20a5478c642 |
SHA512 | 1803bf4fa4cd533e7fd569584cd9d5ae86d649dfccbf92fdd6cf3eae6155fee9baf40ab7d252681e84ea4045264b5408cc9144fa0d6ef3b0a8a9b631cfdce45c |
Many bug fixes: related to join( )
, TCP
listerner threads, etc.
Bug Fixes
Summary
Fixed a bug causing the sub-queries of join etc. not to see events with an @ingesttimestamp occurring later than the search time interval.
Fixed a bug where the
{events_html}
message template was formatted as raw HTML in alert emails.Fixed a bug causing
sort`/`head`/`tail
to work incorrectly after other aggregating functions.Fixed an issue causing Humio to fail to upload files to bucket storage in rare cases.
Fixed a bug where TCP listener threads could take all resources from HTTP threads.
Switched from JDK to BouncyCastle provider for AES decrypt to reduce memory usage.
Fixed an issue preventing the metric
datasource-count
from counting datasources correctly.Fix negating join expressions.
Humio Server 1.16.3 Stable (2020-11-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.16.3 | Stable | 2020-11-10 | 2021-10-09 | 1.12.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 294a84c0d1a54ccb83045af2a59a711e |
SHA1 | 74088d0dcce3e2e853d236e00d18af18ad06c0e6 |
SHA256 | 8bd243f29dbafa1ece847aff22ce9754b3ec3fd6fe8726d1517ed5462c5653fe |
SHA512 | ad95a600b21990508e9e174273726b8c2514b2a0f688bf45422394971375c0ad8821626ca6ca7672faffd41e4b2f80a62c357e581cdc6b34f4c482ddb5389410 |
Improved memory usage of some query functions, and fixes problems with datasource cleanup, resource usage of HTTP requests, and with large free-text searches.
Bug Fixes
Summary
Fixed an issue when starting a query, where resources related to HTTP requests were not released in a timely manner, causing an error log when the resources were released by hitting a timeout.
Fixed an issue which caused free-text-search to not work correctly for large (>64KB) events.
Reduce memory usage when using the
match( )
orregex( )
query functions.Fixed an issue where cleanup of empty datasource directories could race with other parts of the system and cause issues.
Humio Server 1.16.2 Stable (2020-10-30)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.16.2 | Stable | 2020-10-30 | 2021-10-09 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 625e7c2ab7d9ae2ad61c6b5a6847e0ec |
SHA1 | 092049bbc1604af6fd2e0a6b8f6f53fe7f6132ae |
SHA256 | 3850217dcbda7666178a475fcf135b3c94715ef83a4b66236921b3bb2ee4c2f9 |
SHA512 | d7aec9e4c0bdd6102ce56df5dbac36cb896182c987b1cb8c84d1065610ed78e9e519bce7ef94b784412fa8946b63bfe51f6ef78071b60e59e955588c22ccf6d4 |
Improved delete options in large clusters, and fix problems with generating http links.
Bug Fixes
Summary
Optimize how certain delete operations in the global database are performed to improve performance in large clusters.
Prevent automatic URL to link conversion in email clients.
Humio Server 1.16.1 Stable (2020-10-21)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.16.1 | Stable | 2020-10-21 | 2021-10-09 | 1.12.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | f5a2ac232db869d279159781ba5cdf57 |
SHA1 | e165eff2f323df2702e8eb697602739ad8e71af8 |
SHA256 | eda9a02789d70732451e0bdd01a329ca878a39dc160c95c3902acc5db693f22b |
SHA512 | aa13e65ce4b6896aaecfeb8dcb3996681d7014bacde126045c01d230c8f3b75a34a594653b9b7785ee8c4417a71df1908263c2931c8806893db30293780e1bf4 |
Several bug fixes related to Humio UI, Prometheus, Clusters,
RegEx queries, etc. — as well as improved
GroupBy( )
, jvm-hiccup
,
etc.
Bug Fixes
Summary
Fixed an issue where errors were not properly shown in the Humio UI.
Improved the performance for
GroupBy( )
.Convert some non-fatal logs to warning level instead of error.
Fixed an issue where RegEx field extraction did not work in a query.
Add query parameter sanitization for login and signup pages.
Fixed an issue with truncating files on the XFS file system, leading to excess data usage.
Avoid logging the license key.
HTML sanitization for user fields in invitation mails.
Log information about sorting of snapshots.
Fixed an issue where missing input validation in alerts could lead to HTML injection in email notifications.
Fixed an issue where it was impossible to bootstrap a new cluster if ingest or storage replication factors had been configured greater than 1.
Raise time to wait until deleting data to improve handling of node failures.
Ensure metric label names can be sent to Prometheus.
Fixed an issue where sorting of work in the Humio input could end up being wrong.
Returning bad request when hitting authentication endpoint without a provider id.
Added new metric
jvm-hiccup
for measuring stalls/pauses in the JVM.
Humio Server 1.16.0 Stable (2020-10-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.16.0 | Stable | 2020-10-09 | 2021-10-09 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 41a3eb30f6d92f92b414661545f0c8bc |
SHA1 | 31829cf2558430a4a6f170d4adf00573f7a7db08 |
SHA256 | f04127a4195e8e1e576bc9a32e9b582b48ffb6eb3fdbc368b4f2c0e2fc22e1c6 |
SHA512 | 45e067a2b79618e979e9839cb987ce6bd76a27514a0d3da22dd3e9b5259f48b8b75c5c9730078ccba81f10516a456b733956bc48bdec6c9bd5adb9dd0de13363 |
This release promotes the latest 1.15 release from preview to stable. To see more details, go through the individual 1.15.x release notes (links in the changelog).
Bug Fixes
Other
Fixed a problem preventing saved queries from being edited.
Fixed a problem where it was not possible to rename a dashboard.
Fixed missing cache update when deleting a view.
Fixed a problem with the retention job calculating what segments to delete.
Added metrics for:
JVM Garbage Collection
JVM Memory usage
Missing nodes count
Improved merging of segments by evaluating less data.
Fixed a problem where errors would not be shown in the UI
Fixed a problem where the QueryScheduler could spend time idling even though there was work to do in situations where digest delays were high.
Major changes: (see 1.15.0 release notes)
Fixed a problem with auto sharding not working when two repositories had the same tags but differing shard counts.
Other changes: (see 1.15.1 release notes)
Fixed an issue where Humio could behave incompatibly with Kafka versions prior to 2.3.0 if KAFKA_MANAGED_BY_HUMIO was true.
Log query total cost when logging query information.
Log Humio cluster version in non-sensitive log.
Support for license files in ES512 format.
Changed limits for what can be fetched via HTTP from inside Humio.
Fixed a problem where the Zone configuration would not be propagated correctly.
Fixed a problem preventing file export/download from the search page.
Fixed several cases where Humio might attempt to write a larger message to Kafka than what Kafka allows.
Add view to log lines for alerts
Other changes: (see 1.15.2 release notes)
Fixed a problem where some deleted segments could show up as missing.
Bulk Global operations for segments in S3 to avoid overloading Kafka with writes.
Added background job to fix problems with inconsistent data in global.
Humio Server 1.15.2 Preview (2020-09-29)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.15.2 | Preview | 2020-09-29 | 2020-10-09 | 1.12.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 682ce1370121f12351ade4d22aac9d59 |
SHA1 | 4b0a7d089cadc867582ab067e80ccbaa421d6869 |
SHA256 | 64179665b0993212736c526d4c9e5af57511d2225673646c6de9f54c6685e9f9 |
SHA512 | 3d63d22285b955637128bfaaf8223e4f59c32a92b66180997307b22cdda6d360c2436f0b63fb55ee57b52cdb34a0b0ddc2ad28f4db9d63ae62e10c8f0846dc80 |
Many bug fixes, including fixes related to login from Safari and
Firefox, the join( )
function.
Bug Fixes
Summary
Changed priorities when fetching segments to a node which have been offline for a longer period. This avoids waiting too long before the cluster becomes fully synced.
Fixed a bug in the partition table optimizer that lead to unbalanced layouts.
In the dialog for saving a search as an alert, the save button is no longer always grey and boring, but can actually save alerts again.
Fixed a problem with scrolling on the login page on screens with low resolution.
Improved handling of sub-queries polling state from the main query when using
join()
.Fixed a bug causing an authentication error when trying to download a file when authenticating by proxy.
Fixed a problem where the login link did not work in Safari and Firefox.
Added logging to detect issues when truncating finished files.
Changed the query scheduling to account for the work of the overall query, rather than per job started. This allows fairer scheduling of queries hitting many dataspaces e.g. when using search-all.
Generate ingest tokens in UUID format, replacing the current format for any new tokens being created.
Fixed a memory leak when authenticating in AWS setups.
Fixed an issue where a slow data stream could cause Humio to retain more data in Kafka than necessary, as well as cause a restarted Humio node to reprocess too much data.
Improved naming of threads to get more usable thread dumps.
Avoid overloading kafka with updates for the global database by collecting operations in bulk.
Only consider fully replicated data when calculating which offsets can be pruned from Kafka.
Made the login and sign up pages responsive to the device.
Fixed an issue showing duplicate entries when searching for users.
Humio Server 1.15.1 Preview (2020-09-22)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.15.1 | Preview | 2020-09-22 | 2021-09-22 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | ec66230819ad11297969c2f8d6641c6d |
SHA1 | f3b0201a632842dd67f104c325c241b201d246a6 |
SHA256 | 81de2fd8b1ccc692f30083f0461364155f83b96b893c0cdff4444fbbb97abf32 |
SHA512 | 2281a3fbf186bd96d56343a7ec46caefcd59fa6656ca8885f841af2ce16c32068739d510b7a0913e9c5db5670948fbf43e998595b8a535246299d7ecd418e21b |
Fixes bugs related to AWS and STS tokens, timestamp display results, reverting Humio UI login method.
Bug Fixes
Summary
Fixed a problem with AWS, where STS tokens would fail to authenticate.
Revert login Humio User Interface to same behavior as before version 1.15.0.
Fixed a problem in the UI, where the wrong timestamp was displayed as
@ingesttimestamp
.The job for updating the IP location database now uses the configured HTTP proxy, if present.
Humio Server 1.15.0 Preview (2020-09-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.15.0 | Preview | 2020-09-15 | 2021-09-15 | 1.12.0 | Yes | Yes |
JAR Checksum | Value |
---|---|
MD5 | 516ed995115eeaa9218bdbc96aec01b2 |
SHA1 | 79bd7daeaa49644e7d7bcc429862f43c5d028057 |
SHA256 | 26c95dacd1164ba20db16917dcc436cc8a8f5a86811b697917b6febfae9fbd61 |
SHA512 | 64841a7ddfcb7c9cff0e7636e78c05c8e52cd63f5c537c858f70795e6dfb5ff52efa8705cf9d3e3fccc1f2ca3901fbae25fb3920fe09f440813f2e587b367173 |
Improves ingest timestamps, field based throttling, the ability to configure better alert notifiers, Slack notifiers, etc.
Bug Fixes
Other
Auto-balanced partition table suggestions. See ZONE, DIGEST_REPLICATION_FACTOR, STORAGE_REPLICATION_FACTOR in configuration. See Configuration reference pages.
Field based throttling on alerts.
Upgrade to AWS SDK v2. When using Java system properties for configuring Humio bucket storage, use
aws.secretAccessKey
instead ofaws.secretKey
.Bug Fix: CSV files can no longer contain unnamed columns and also trailing commas are disallowed. Queries based on such files will now fail with an error.
New explicit signup and login pages for social login.
New alert notifier type logging to a Humio repository.
S3 communication can be configured to not use an HTTP proxy.
Humio will set the field
@ingesttimestamp
on all events.Improved error handling when a parser cannot be loaded. Before, this resulted in Humio returning an error to the log shipper. Now, data is ingested without being parsed, but marked with an error as described in Parser Errors.
Newly added users will by default get an email.
New alert notifier template
{events_html}
formatting events as an HTML table.If automatically creating users upon login and syncing their groups from the authentication mechanims, the configuration ONLY_CREATE_USER_IF_SYNCED_GROUPS_HAVE_ACCESS now controls whether users should only be created if the synced groups have access to a repository or view. The default is false.
Alert notifiers can be configured to not use an HTTP proxy.
Humio Server 1.14.6 Stable (2020-10-30)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.14.6 | Stable | 2020-10-30 | 2021-08-26 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d49223f102edc33a255dd9d7178d95f0 |
SHA1 | 70b446b461381e1e02d3a994deb88c5ba3e682f2 |
SHA256 | 17d82d593a4f290867819f8095a59d0367083c022d45d9db1c33417337d7a5b8 |
SHA512 | 1d7bcdd2bd5d8385af487b8cd5a1b6da11d6a1893ade5ac5b06d44817f57e48e2679df13e9fe0f99e73723b2c306e282807fdfde9650176c19ef461c646c39fc |
Email Notification Improvements
Bug Fixes
Summary
Fixed an issue where missing input validation in alerts could lead to HTML injection in email notifications.
Prevent automatic url to link conversion in email clients.
Humio Server 1.14.5 Stable (2020-10-21)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.14.5 | Stable | 2020-10-21 | 2021-08-26 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 097c33aba188611a3157a00cdb7366af |
SHA1 | 3ac3a1722ff46530ebdf6cf1a2e977437a8917e9 |
SHA256 | cb4aa5b17dba7ca6a79494401cfaaa3e1aefce77fb029b33e24a551e9fab9a22 |
SHA512 | e737fa3bddab0c236a37b0725f2210efd4d761977646581addb29833c31081f0cc6e84f5c514be7e860dc4e848afeae5a77ab0b3536347a1d6757ba4b1547be7 |
Bug Fixes and New Metric
Bug Fixes
Summary
Fixed an issue where Humio might attempt to write a larger message to Kafka than what Kafka allows.
Added new metric
jvm-hiccup
for measuring stalls/pauses in the JVM.Fixed an issue where Humio could behave incompatibly with Kafka versions prior to 2.3.0 if KAFKA_MANAGED_BY_HUMIO was true.
Humio Server 1.14.4 Stable (2020-10-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.14.4 | Stable | 2020-10-09 | 2021-08-26 | 1.12.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 1a728a2eee16db13d2c5114ada74382c |
SHA1 | ec61329a161dce7a387976343babf7d3ff44527b |
SHA256 | 2b49f98b2b112e54ec310ffb08013debcf9005af35bf97eca36cb69e438f1366 |
SHA512 | 61e0628975aee35f01b9b6d63770c307b0a2f47fe41623bef56a0bdc2f6758ec3fe3145ed1e2b4118a482c5cd0f65b1d8fc4dbf881cc63e53a724b271f4634a7 |
Bug Fixes and Stability Enhancements
Bug Fixes
Summary
Fixed a problem where some deleted segments could show up as missing.
Log Humio cluster version in non-sensitive log.
Avoid overloading Kafka with updates for the global database by collecting operations in bulk.
Changed limits for what can be fetched via HTTP from inside Humio.
Fixed a problem where duplicated uploaded files would not be deleted from /tmp.
Fixed several cases where Humio might attempt to write a larger message to Kafka than Kafka allows.
Humio Server 1.14.3 Stable (2020-09-24)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.14.3 | Stable | 2020-09-24 | 2021-08-26 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 98d17b3fcca4f158e5cfe0c7d95d0ac7 |
SHA1 | 57dd7e54bc414213de946119b102d6612cd0f7a1 |
SHA256 | 661b21efd3128da29f20d987cd6d9e89541bdfacd8e0391a99bef5ba3255d7ba |
SHA512 | 7ccf6574c4da5a92975029236e762713be319c09032f066d28473ded25462d39e446ed402fa6463f8172077e05f9d91cd224c6d3a9ad3de5876fdd472bae8c0d |
Bug Fixes and Improved Query Scheduling
Bug Fixes
Summary
Change priorities when fetching segments to a node which have been offline for a longer period. This avoids waiting too long before the cluster becomes fully synced.
Fixed an issue where a slow data stream could cause Humio to retain more data in Kafka than necessary, as well as cause a restarted Humio node to reprocess too much data.
Improve naming of threads to get more usable thread dumps.
Improve handling of sub-queries polling state from the main query when using join().
Add logging to detect issues when truncating finished files.
Changed the query scheduling to account for the work of the overall query, rather than per job started. This allows fairer scheduling of queries hitting many dataspaces e.g. when using search-all.
Fix missing cache update when deleting a view.
Humio Server 1.14.2 Stable (2020-09-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.14.2 | Stable | 2020-09-17 | 2021-08-26 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | c3eb561c270dce0fe7468c34cbd4322f |
SHA1 | 85c1c0e16507fa152c7adbba5844aed2c83c0e03 |
SHA256 | 5f4e382586a6069c5ebde1d1a620ab3d1f8f1c532e9ecce972a348ab669b2c2d |
SHA512 | f3be7379941c9f3ae677b351dc65f90da71aaf43fdc78e93eca99d3b8dfc4fd28618c9fd4d22bf4657cdc0d9b9f80d59589c3984860958aefff61f0a769251a7 |
Bug Fixes, HEC Endpoint Validation and New Metrics
Bug Fixes
Summary
Improved handling of data replication when nodes are offline.
Include user email in metrics when queries end.
The job for updating the IP location database now uses the configured HTTP proxy, if present.
Fixed a race condition when cleaning up datasources.
Fixed a problem where segments could be downloaded to stateless frontend nodes from Bucket storage.
HEC endpoint is now strictly validated as documented for top-level fields, which means non-valid input will be rejected. See HEC.
Fixed a problem where too many segments could be generated when restarting nodes.
New metrics for scheduling of queries:
local-query-jobs-wait: Histogram of time in milliseconds that each query waited between getting any work done including exports
local-query-jobs-queue: Count queries currently queued or active on node including exports
local-query-segments-queue-exports-part: Count of elements in queue as number of segments currently queued for query for exports
local-query-jobs-queue-exports-part: Count queries currently queued or active on node for exports
Added log rotation for humio-non-sensitive logs.
Humio Server 1.14.1 Stable (2020-09-08)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.14.1 | Stable | 2020-09-08 | 2021-08-26 | 1.12.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | b57e75be1b07018a158585f04cdcb9d8 |
SHA1 | 6e1754ba60abeb35233a728dcb78ae11f0986d8a |
SHA256 | 5939bb412601b4356ccc431d87e3e8290a48db967a0739f638b0ea587e1a9eb7 |
SHA512 | a90b03b4081cd8ee73d06c0f925705740c769ff405b09cb1c06a51b8566775d7e2540bd6275ae1f8f7e4e0a65d241d7f1f195d26c6c3474894639d6b19b7d3d3 |
Bug Fixes
Summary
Remove restriction on expire time when creating emergency user through the emergency user API. See Emergency Access.
Remove restriction on length of group names from LDAP.
Improve performance when processing streaming queries.
Humio Server 1.14.0 Stable (2020-08-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.14.0 | Stable | 2020-08-26 | 2021-08-26 | 1.12.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d0ede2c5d1075119507701bff7a04b29 |
SHA1 | b4fc3f50fabe0abdea5db2a2b502c0b2b0b71aa7 |
SHA256 | e9ddafa574576eb890cf22d241e0307caf613cc5b1bd9fdc84e50e975a40d67b |
SHA512 | 16506530541f87579660b630265171c137b8de787b5c5d11b145fc1d18ff04038514b91469b040212dbd27bddc2cee4cb5cca0054f547917624137fedb23ba20 |
Free Text Search, Load Balancing of Queries and TLS Support. This release promotes the latest 1.13 release from preview to stable. To see more details, go through the individual 1.13.x release notes (links in the changelog).
Bug Fixes
Configuration
Other changes: (see 1.13.3 release notes)
Other changes: (see 1.13.2 release notes)
Other changes: (see 1.13.1 release notes)
Other changes: (see 1.13.4 release notes)
Other changes: (see 1.13.5 release notes)
Handling of digest in the case where a node has been offline for a long time has been improved. As an example, running a Humio cluster with a replication factor of 2 and having one node go offline for a long time would leave some ingested data to only reside on one Humio node (and on the ingest queue in Kafka). But this data would not be regarded as properly replicated until the second node returned. If the only node that was left handling a digest partition did a failover, Humio would end up going far back on the Kafka ingest queue to reread data. This has been changed. Now another node from the set of digest nodes will take over if a node goes offline, to keep the replication factor as desired. This means that other hosts, than those specified for a given digest partition on the cluster management page, can actually be handling the digest data for that partition. Only digest nodes will be selected as hosts.
Improved handling of query restarts to avoid unnecessary restarts in some scenarios.
Major changes: (see 1.13.0 release notes)
Humio Server 1.13.5 Preview (2020-08-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.13.5 | Preview | 2020-08-12 | 2020-08-26 | 1.12.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 0e9345ea59cb8f76a14cf84c7889de19 |
SHA1 | 6e27b7e2ec68090ad2c6019e0b3dea56d03d4059 |
SHA256 | 3f9e0865df1c28dc69d45f764c65c39aeccfacfadeb0ec04165655ef423c7fff |
SHA512 | 256ba3cbd99245327176569cdfde8d8cee3f8c15c2f60c0c2e02115e8fd6eefec0be3cd3dac5592d4fd2b6d5e2a609e414a963af2c6ead317171228cc001666b |
Security and Bug Fixes
Bug Fixes
Summary
This release fixes a security issue. More information will follow when Humio customers have had time to upgrade. See: Humio Security Disclosures.
Bug Fix: missing migration of non-default groups would result in alerts failing until the user backing the alert logs in again.
Bug Fix: export to file can now include query parameters
Bug Fix: export to file now allows for fieldnames with special characters.
Humio Server 1.13.4 Preview (2020-08-05)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.13.4 | Preview | 2020-08-05 | 2021-08-05 | 1.12.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 56dd1acc53af27871de4260ff14c03f2 |
SHA1 | 10e4f5ad2079fb9c85f5fbf7f970a40a3951910c |
SHA256 | 256b45cb00097da6ff219713d8ed4d5bf8c4dc5b1094f856de3586c2a9f7618f |
SHA512 | 411a0f5aa3b6c96eb72dd7680d9fa94ea51e3da927c318bac0df37a2c7dee0cac9714e9807473a10417f11a3106f65107982669f9c3e29f2ac7a7a1a901a93df |
Security and Bug Fixes
Bug Fixes
Summary
This release fixes a security issue. For more information see: Humio Security Disclosures.
Fix issue where a node with no digest assignment could fail to delete local segment copies in some cases.
Fix issue where a query could fail to search all segments if digest reassignment was occurring at the same time as the query.
Humio Server 1.13.3 Preview (2020-08-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.13.3 | Preview | 2020-08-04 | 2021-08-04 | 1.12.0 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 93a48eb23b149780fac8e065d28e3bc1 |
SHA1 | 6f78a25d48e79482c6e98cf2dc2125208d3c906f |
SHA256 | d526f5d0d1b9f1d1061b93e0a5c1c66d5ecd2a88cf732318d6f8fe8fcee9df30 |
SHA512 | a7fed48de308a679b5907a485ac7dc54008d9dfee32a08d41c23df2f3bc2ff7f3184a0283cf211562eaf4a9b7cc926e70ef22243ba8e3d3ed463dc872b3662bd |
Security and Bug Fix
Bug Fixes
Summary
Bug Fix: avoid forbidden access error on shared dashboard links by ensuring correct use of time stamps
This release fixes a security issue. For more information see: Humio Security Disclosures.
Humio Server 1.13.2 Preview (2020-08-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.13.2 | Preview | 2020-08-03 | 2021-08-03 | 1.12.0 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 32b80ba726b370fc740ba7960d537ccc |
SHA1 | fc8a67b2fad623b0806405f9409b6e2d94d713a6 |
SHA256 | fcdac4812ef43784c3dc575e8970ecdc2d45f954773867a2b43bde97c9176142 |
SHA512 | 4a0e86276d19da61b795bd937ecb0145bcfdb59a9678a5d1ed93045964db7b61d937ec69d1bd13bc79447ef74555f9de925bc416388b6cb742765191f79cb08e |
Bug Fixes
Bug Fixes
Summary
Bug Fix: make sure join-subqueries gets canceled when the main query is canceled
Bug Fix: export to file no longer fails/timeouts on heavy sub queries
Bug Fix: joins will now propagate limit warnings from sub queries to the main query
Bug Fix: all ingest methods now support the ALLOW_CHANGE_REPO_ON_EVENTS configuration parameter
Default groups added
Bug Fix: avoid saving invalid bucket storage configurations
Humio Server 1.13.1 Preview (2020-07-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.13.1 | Preview | 2020-07-03 | 2021-07-03 | 1.12.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | f097c9c95c06f12ec55c008b9963f9ee |
SHA1 | 8acc122717d30f5a3333175a172e4c26a3c20569 |
SHA256 | 9dd7736569cc823182140ffd7ed91609cdafb97f99586d0d91def412a37bd548 |
SHA512 | eaceff5d2ffc55c18f6175f519ecd0c97a684cb2a1d46c3e242513181bf29217331deb934eba45ba7d55f795a1cccd0ae25cf76b685dd484ed681a2f66791f01 |
Bug Fixes and Improved Search Speeds for Many-Core Systems
Bug Fixes
Summary
Improved query scheduling on machines with many cores. This can improve search speeds significantly.
Bug Fix: Bucket storage in GCP could did not clean up all tmp files
Support for a new storage format for segment files that will be introduced in a later release (to support rollback)
Bug Fix: S3Archiving could write events twice in a special case (When a merge happens where all inputs have been archived, write in global that the merge-result was archived too).
Humio Server 1.13.0 Preview (2020-06-24)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.13.0 | Preview | 2020-06-24 | 2021-06-24 | 1.12.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | c9dca247bec107fa41c6ec1fe5bb5d3b |
SHA1 | 51e898057d10d80e6a50ab86ab5bedf71d348f5b |
SHA256 | b5c21c0028f1d61104821e5d4749b15cea7e208aa9bfb9307a9b10e077f6f7b6 |
SHA512 | 5b148d8d8fd8680fd61c642bda45f7dba2cb0aa21efeb2752b02a6467a7063036f1b31ea347816ecdcba676cf1d9d199e409620bd6b1acd2cc2fdeff78767375 |
Many improvements, including some related to free-text
searching, load balancing queries, TLS support,
IPlocation( )
query function, and some
configuration changes.
Bug Fixes
Configuration
Humio can now balance and reuse existing queries internally in the cluster. See Configuration reference pages
Added support for WebIdentityTokenCredentialsProvider on AWS.
Free text search now searches all fields rather than only @rawstring.
The data source for the ipLocation() query function is no longer shipped with humio but installed/updated separately.
Introduced a new
ChangeViewOrRepositoryDescription
permission for editing the description of a view or repository. This was previously tied toConnectView
and any user with that permission will now have the new permission as well.Internal communication in a Humio installation can now be encrypted using TLS. See the TLS Configuration reference page.
Humio Server 1.12.7 Stable (2020-09-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.7 | Stable | 2020-09-17 | 2021-06-09 | 1.10.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 438fc3f94d9e252184cbeaee2dacc740 |
SHA1 | 08254ec21b51d6522a0336b92548943d9fe0b140 |
SHA256 | 814d522ef2aef4f3a81ab8380c5ad746ef9d13f302124bc0c13c64378ef4feec |
SHA512 | e2e936e1d20a6e60e312e995d1557085976531cfa2c50daa19cd0ce474ff398acdda3cf2431ab4a0aa33625ee45dc798685e6e485d282281f668c2c587bf69be |
Bug Fix and Additional Metrics
Bug Fixes
Summary
New metrics for scheduling of queries:
local-query-jobs-wait: Histogram of time in milliseconds that each query waited between getting any work done including exports
local-query-jobs-queue: Count queries currently queued or active on node including exports
local-query-segments-queue-exports-part: Count of elements in queue as number of segments currently queued for query for exports
local-query-jobs-queue-exports-part: Count queries currently queued or active on node for exports
Fixed a race condition when cleaning up datasources
Humio Server 1.12.6 Stable (2020-09-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.6 | Stable | 2020-09-03 | 2021-06-09 | 1.10.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 43c5c6e2a7de76e73d63002c04f8693c |
SHA1 | dfff8f766cedca6a7b1888e2d060b07fba035b61 |
SHA256 | 3928f42354195c4217d60a86d4df70307477af81fa4ca2d87d29c921dbc1ae5a |
SHA512 | 32e8e1b008b945545159b87d183ab1ef76d649a8a96ac92f54799446c345e205a1e13953f43a8feac264596ee69de7e10e57e2a532bb860bef062559c60442a6 |
Bug Fixes
Bug Fixes
Summary
Remove restriction on length of group names from LDAP.
Improved handling of query restarts to avoid unnecessary restarts in some scenarios.
Humio Server 1.12.5 Stable (2020-08-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.5 | Stable | 2020-08-12 | 2021-06-09 | 1.10.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 99fc31c507d0a6193c0257b3a1a1e708 |
SHA1 | d0c7fa652713473d04923d1c5921374144a38aed |
SHA256 | 94c3f8cbb84dfe6870bdcfa4771f46a124ba8bca5d85332f0a0150a3e6f54a49 |
SHA512 | 1b25c775757af29f65597dbb3d5504637485a75f2fc5b29412ea646527aebee31b4f0b96f732c70e7ed9e0d4e1c48776c4c893398e3da3222c9ccce8d762676c |
Security and Bug Fixes
Bug Fixes
Summary
This release fixes a security issue. More information will follow when Humio customers have had time to upgrade. See Humio Security Disclosures.
Bug Fix: missing migration of non-default groups would result in alerts failing until the user backing the alert logs in again.
Fix issue where a node with no digest assignment could fail to delete local segment copies in some cases.
Bug Fix: avoid forbidden access error on shared dashboard links by ensuring correct use of time stamps.
Humio Server 1.12.4 Stable (2020-08-05)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.4 | Stable | 2020-08-05 | 2021-06-09 | 1.10.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 33fe0d36c64e58ff875496facf68e65a |
SHA1 | 7122a470bf146e40ddce711349007dd1a4f7961c |
SHA256 | 4cd4fa7b21fbdd14b095cb20e7d5d6af0c78bccc0bbc152c7417149db5d0d194 |
SHA512 | 879822ef357dbb1dcdd969ba053bd09cabaf42b4748495543b72b63f43f8c9c6b0feb25911446f07ae37468ec663e7b278c752dc441a52136762d429c18a7f5b |
Security Fix
Bug Fixes
Summary
This release fixes a security issue. For more information see: Humio Security Disclosures.
Humio Server 1.12.3 Stable (2020-08-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.3 | Stable | 2020-08-04 | 2021-06-09 | 1.10.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | b6de082e67d662de761d5b79915152b8 |
SHA1 | 78cf6419a7a092e7d2a8200000ada4535f2f5b5c |
SHA256 | cec300a428f0f5998bbd13d56283fb54dbe47f1205d97115b23dfabf4f3dcbc7 |
SHA512 | 0704b189c70073e304ce115808441e6b44b6aa267df66fe9cac3998a80adc340fe5692829469c99dfceae3cb60e6bcc152ba7f77d509331d50d9621cfc7a1bfc |
Security Fix
Bug Fixes
Summary
This release fixes a security issue. For more information see: Humio Security Disclosures.
Humio Server 1.12.2 Stable (2020-07-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.2 | Stable | 2020-07-03 | 2021-06-09 | 1.10.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 33890ac97e42a107f8f8618312029ca0 |
SHA1 | 0a097631134aa0078e0aea54f32cf58c0be8066b |
SHA256 | 446acdcd64f3c33cdffd886e530201576e75c781184708da30af2dfc7b4bcd14 |
SHA512 | 1931cf27039d17b5aeb4c6fe4022b88a263d41464cb304ba4d30dd936a9cb6202af36dd6c97a5c3e183dd60042def96538e62de3ee86a3204e1108b60a9d9852 |
Bug Fixes and Improved Search Speeds for Many-Core Systems
Bug Fixes
Summary
Bug Fix: S3Archiving could write events twice in a special case (When a merge happens where all inputs have been archived, write in global that the merge-result was archived too).
Improved query scheduling on machines with many cores. This can improve search speeds significantly.
Bug Fix: Bucket storage in GCP could did not clean up all tmp files
Support for a new storage format for segment files that will be introduced in a later release (to support rollback)
Humio Server 1.12.1 Stable (2020-06-24)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.1 | Stable | 2020-06-24 | 2021-06-09 | 1.10.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d6a8a2fa268c92a46024af8e8ba7b27a |
SHA1 | 20660ae440fdcaf818c3919f4b3d467f71da37ce |
SHA256 | 16c96f36554425939b78c5df889cc689368f598a3b14ce336e3a28ad1dc1abbd |
SHA512 | e518b4778b7c6c50861fbaa25a2d95fc3f639e1dfcbb526c0a7727aefe650177d6975ee50caa51d8ccfd636eacdb6fba2ee3cd3a7d1f150eae09147a06c3e2f4 |
Bug Fixes: Safari Freeze, SAML, Bucket Storage Clean-Up, Regex and Field-Aliasing
Bug Fixes
Summary
Fixed an issue with SAML IDPs requiring query parameters to be passed via the configuration SAML_IDP_SIGN_ON_URL
Fixed an issue where queries using lookahead in regex would fail to parse - "invalid or unsupported Perl syntax"
Fixed an issue with CSP that could cause the Humio UI to freeze on Safari browsers
Fixed an issue that prevented deletion of unused objects in bucket storage, if the bucket contained .0 millions of objects or more
Fixed an issue where events could be skipped even though they should not, for queries containing field-aliasing (e.g., a:=b) and using subsequent checks on the aliasing field.
Humio Server 1.12.0 Stable (2020-06-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.12.0 | Stable | 2020-06-09 | 2021-06-09 | 1.10.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 73a3fc77b4b603df3d492a3c8f740cb2 |
SHA1 | 0e70382492ca4a59b3139fad1ee22344f0b257e8 |
SHA256 | dbf34321f44a4e60726a10d67d1a73db7915c94d7e786ad332d5832f34a81c81 |
SHA512 | 4f2840a8b552395735006481107c55567dbbd865025fb0fbfdf5d590938eafb541a780b4065a4ed4419b12e7e894c9a768902ea8f5c21ed7debc3368e6a7e528 |
Export to Bucket, findTimestamp(), selfjoin(), Emergency User Sub-System This release promotes the 1.11 releases from preview to stable. To see more details go through the individual 1.11.x release notes (links in the changelog).
Bug Fixes
Other
Other changes: (see 1.11.1 release notes)
Major changes: (see 1.11.0 release notes)
Humio Server 1.11.1 Preview (2020-05-28)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.11.1 | Preview | 2020-05-28 | 2020-06-09 | 1.10.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 5cb65fb38f5882c86e170fc19932bc2c |
SHA1 | d8639e7541b0de1b2ef5c3909f88d864b18faf63 |
SHA256 | 63e5264b32fc02774e1f4dd3a7dbd1ddbb124158e915d5df219b355faaf278d0 |
SHA512 | 7c7832559a5a1f43f87d7cf12bbb63b5a7ea6c0922a4c917b652caba08fe77375b49517f2675f819f9fdf0519e90310e572bee1cee8e72bade531605ddd14942 |
Bug Fixes and Memory Optimizations
Bug Fixes
Other
Elastic Bulk API change
Several improvements to memory handling
Dashboard widgets now display an error if data is not compatible with the widget
Several improvements to query error handling
Known Issues
Other
Fluent Bit users might need to change the Fluent Bit configuration. To ensure compatibility with the newest Beats clients, the Elastic Bulk API has been changed to always return the full set of status information for all operations, as it is done in the official Elastic API.
This can however cause problems when using Fluent Bit to ingest data into Humio.
Fluent Bit in default configuration uses a small buffer (4KB) for responses from the Elastic Bulk API, which causes problems when enough operations are bulked together. The response will then be larger than the response buffer as it contains the status for each individual operation. Make sure the response buffer is large enough, otherwise Fluent Bit will stop shipping data. See: https://github.com/fluent/fluent-bit/issues/2156 and https://docs.fluentbit.io/manual/pipeline/outputs/elasticsearch
Humio Server 1.11.0 Preview (2020-05-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.11.0 | Preview | 2020-05-19 | 2021-05-19 | 1.10.0 | Yes | Yes |
JAR Checksum | Value |
---|---|
MD5 | 70406b0710c9c999ec5293357e03b05a |
SHA1 | f50294f5d0267d582d7207f7df33e16eee2744af |
SHA256 | c1a79a8f1ca41e14158992ba5dfff0a05ce39292b5ed5bfa8d5507973d054fdb |
SHA512 | f0f210d24aac849457839588202d662294911bf095e0f5a791093c61c435969b300f0a303d457a0e8cdbb13d742a81b3d09c6e11fad28f927ee9782153d05fc8 |
Export to Bucket, findTimestamp(), selfjoin(), Emergency User Sub-System
The selfJoin()
query function allows
selecting log lines that share an identifier; for which there
exists (separate) log lines that match a certain filtering
criteria; such as "all log lines with a given userid for which
there exists a successful and an unsuccessful login".
The findTimestamp()
query function will try
to find and parse timestamps in incoming data. The function
should be used in parsers and support automatic detection of
timestamps. It can be used instead of making regular expressions
specifying where to find the timestamp and parsing it with
parseTimestamp()
. See the
findTimestamp()
reference page for details.
As an alternative to downloading streaming queries directly, Humio can now upload them to an S3 or GCS bucket from which the user can download the data. See Bucket Storage.
If there are issues with the identity provider that Humio is configured to use, it might not be possible to log in to Humio. To mitigate this, Humio now provides emergency users that can be created locally within the Humio cluster. See Emergency Access.
Behavior Changes
Scripts or environment which make use of these tools should be checked and update for the new configuration:
Allow for emergency logins if the primary login provider is having problems. See Enabling Emergency Access.
Bug Fixes
Dashboards and Widgets
Gauge widget now works for arbitrary numbers not only for aggregated numbers.
Configuration
New configuration MAX_CHARS_TO_FIND_TIMESTAMP. Default value should work for most deployments. See the Configuration reference pages
Functions
Query function
selfJoin()
Query function
formatDuration()
Query function
selfJoinFilter()
Query function
unit:convert()
Query function
findTimestamp()
Other
New built-in parser zeek-json.
Humio Server 1.10.9 Stable (2020-08-05)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.9 | Stable | 2020-08-05 | 2021-04-27 | 1.10.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | a9fc2ea12707d4b1c581151e0026f1b9 |
SHA1 | d4f374af166c4138a1c5ef715ae7e6299fc4a51f |
SHA256 | b2f676c80a61a444b799295f6ca5e3284209aa1d4611182503e78c4b4ca64623 |
SHA512 | 146baf45e4181694b327849665771cc859a4757e32e0b982990da80171f144b12a01a47fcba2bdb728a4c10fede2a1ff0ff25c7b5bbf8be3a80caf6a982af9e2 |
Security Fix
Bug Fixes
Summary
This release fixes a security issue. For more information see: Humio Security Disclosures.
Humio Server 1.10.8 Stable (2020-08-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.8 | Stable | 2020-08-04 | 2021-04-27 | 1.10.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | ebc006bf64fc1f310f6c29a8854da2f7 |
SHA1 | 1461cd0e70f1ddb30b316cf9d0010a0840a11241 |
SHA256 | 7432902332b1a87f6899870e3bd47a18077a04980a63427896a0eac204300e2d |
SHA512 | c63714a10b7d06a869ab47bf4a84c31e88656f7e78c14281fdc9b78dc6139fc94b08f02dfd810352844bc0662838790227c18877a518b11cf67ad39c12e7ca0b |
Security Fix
Bug Fixes
Summary
This release fixes a security issue. For more information see: Humio Security Disclosures.
Humio Server 1.10.7 Stable (2020-07-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.7 | Stable | 2020-07-03 | 2021-04-27 | 1.8.5 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 36d8bcdffeb41720006c2d07ae38669a |
SHA1 | 83fda60fe22239101cf1e81fd41bec04071f5ae5 |
SHA256 | 4aa66055218f4f4d7ad65a7476e7f8b6ddd57f8187472e80e2bef1506aa3484f |
SHA512 | c34ae669043a70d4ebc760365bcb82477fbbbaadb0f3229083732b1549e646444ffbb42d2e1285b9f0ca8e1213e9fef42a14d587b66ba3adf883fedc8ba09c72 |
Bug Fixes and Improved Search Speeds for Many-Core Systems
Bug Fixes
Summary
Bug Fix: S3Archiving could write events twice in a special case (When a merge happens where all inputs have been archived, write in global that the merge-result was archived too).
Improved query scheduling on machines with many cores. This can improve search speeds significantly.
Bug Fix: Bucket storage in GCP could did not clean up all tmp files
Support for a new storage format for segment files that will be introduced in a later release (to support rollback)
Humio Server 1.10.6 Stable (2020-06-24)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.6 | Stable | 2020-06-24 | 2021-04-27 | 1.8.5 | No | No |
Value | JAR Checksum |
---|---|
MD5 | ff8b12b453b9e600ac6a5f917a799f8b |
SHA1 | c6bf4610bc284c7838d92e0c110461349511afeb |
SHA256 | 04503cb6691db596b5237e65e9f639013caab3010c753796392d1d59a9e06413 |
SHA512 | d6a8c3c898c4d93ac8dd564ec0394a5d5db4d06711bd498e38ce58a2b026bd8d6e1f2b664e30de92eb60afb7b452b34b4c17e0e6370331afdcc2030407f74674 |
Bug Fixes: Safari Freeze, SAML and Bucket Storage Clean-Up
Bug Fixes
Summary
Fixed an issue with SAML IDPs requiring query parameters to be passed via the configuration SAML_IDP_SIGN_ON_URL
Fixed an issue with CSP that could cause the Humio UI to freeze on Safari browsers
Fixed an issue that prevented deletion of unused objects in bucket storage, if the bucket contained .0 millions of objects or more
Humio Server 1.10.5 Stable (2020-06-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.5 | Stable | 2020-06-09 | 2021-04-27 | 1.8.5 | No | No |
JAR Checksum | Value |
---|---|
MD5 | e26c8dcab38cf8ae70146af0c20de708 |
SHA1 | 38b4cd3f334845ebdc91d02b9f24cab628290805 |
SHA256 | 3234edd2ec5a01b67c07f8d87d57a967fb37a2e6b29a34317545a37796650a83 |
SHA512 | 281bfc2da26ef9f14c123c695943149499f43f7c67e20ff2150420bed7e745a7f6e2483b6073a366e453589f657a3717031071e6374b124657cb5b8c77542255 |
Bug Fixes: humio-search-all and Query Timeouts
Bug Fixes
Summary
Fixed a number of issues with export and alerts in the humio-search-all repository
Fixed an issue where long running queries started as part of an export, or by calls to the /query API would time out
Fixed an issue where a query could get a "Result is partial" warning when the query took more then 15 minutes to complete while a merge of segments addressed by the query happened in the background
Humio Server 1.10.4 Stable (2020-05-29)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.4 | Stable | 2020-05-29 | 2021-04-27 | 1.8.5 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 8fd134e50a88aa016037aff59bca7f70 |
SHA1 | 184f4c0d1b477eef81357e7efcbe2cafb2920fef |
SHA256 | 3398a9e1cc4f3e2f70e952f0c6481fe3c31f447e68d1589904ee26e614cb9a30 |
SHA512 | fab832e462afeaed828a55bc7a6b3d637317ace396ff0751fbf1813d4f0ce01f8cf11e4d3ed6cb6eda898e5521739de766b8ade609fcc98ca774a5d079f76509 |
Bug Fixes for Long-Running Queries
Bug Fixes
Summary
Fixed a number of bugs that would cause long-running queries using join, selfJoin or selfJoinFilter to timeout or fail
Humio Server 1.10.3 Stable (2020-05-20)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.3 | Stable | 2020-05-20 | 2021-04-27 | 1.8.5 | No | No |
Value | JAR Checksum |
---|---|
MD5 | b534f6427bbc73720246c88df097d962 |
SHA1 | 4fd7b762eefcd241c14a0dcc74642ab5f96066a3 |
SHA256 | 03fbcdfffbd4e730ab6ac97ce1e0c88dfa2b2c544de01767647ac9fc1a606c97 |
SHA512 | cc1cd46e9e38cf9215e82da0246ba7cfd27b50becbe9b9a17c0c3c88427649b93339b6cffc6780bc241c2bd152d8f781b7f6d421dcd641def3cef66a8290841f |
Bug Fixes
Bug Fixes
Summary
Bug Fix: An issue could result in malformed messages being put into the ingest queue. This version is able to read and skip such messages. The issue causing such malformed messages has been fixed.
Humio Server 1.10.2 Stable (2020-05-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.2 | Stable | 2020-05-19 | 2021-04-27 | 1.8.5 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 34618e12957e3394f06dd86d7b283bb7 |
SHA1 | b9e75509bbec4093019a475cc3660c28295bd1c4 |
SHA256 | c4868bd4067833744cceaa44dac29a5af2b450d112c34f3dfd8d46906cf115f8 |
SHA512 | 5789415e8c6d748c7a724f702606e96ba48f7595517787d76b7e7581766e23c1de7af1eec5b66cc22d73241d61fb4866f3b12a88d73ee6ca453c8bab255fb331 |
Optimizations, Improved Humio Health Insights and Bug Fixes
Bug Fixes
Summary
Better sorting when computing query prefixes in order to reuse queries.
Bug Fix: A couple of memory leaks have been found and fixed.
Bug Fix: Humio search all repo interaction with alerts and notifiers.
Improvements made to speed of frontpage loading. Noticeable for customers with many repositories and groups.
Bug Fix: Autocreate users on login when synchronizing groups with external provider.
Paging in UI. administration/Users & Permissions.
Humio Server 1.10.1 Stable (2020-05-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.1 | Stable | 2020-05-04 | 2021-04-27 | 1.8.5 | No | No |
Value | JAR Checksum |
---|---|
MD5 | abca8999c6542ff0a4d60b897eb5acf3 |
SHA1 | 176e416e63d13200dee21a509fa9ae2401b8a0ca |
SHA256 | 8a1a419c3bd664a006918ee0b957ed2f1fbdea20dda2ea8114ab4db7b039425a |
SHA512 | 93a8d7a1c86e646f9e7fb26f8feeb05f5bf22774cd69e2b0ac113c48f7736242554ddeb0065ff19ab9723546aa75a064af4e7f7779a8d2efa91651aa7f61f630 |
Optimizations, Improved Humio Health Insights and Bug Fixes
Bug Fixes
Summary
Thread pools have been reorganized to require fewer threads and threads have been given new names.
This release fixes a security issue. For more information see: Humio Security Disclosures.
New internal jobs logging system stats: Search for
#type=humio | NonSensitive | groupby(kind)
to see them.Improved protocol within cluster for submitting queries to allow faster start of queries on huge repositories.
Memory requirements set using
-XX:MaxDirectMemorySize
is much lower now. Suggested value is ((#vCpu+3)/4) GB.New metric: "query-delta-cost": 30s delta cost on queries per repo, for the entire cluster.
Humio Server 1.10.0 Stable (2020-04-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.10.0 | Stable | 2020-04-27 | 2021-04-27 | 1.8.5 | Yes | Yes |
Value | JAR Checksum |
---|---|
MD5 | 4f1ed6fa41cb1f96c7a68b4242ff7280 |
SHA1 | 5e334e72d7a2e59ece26062007fd3baa6361cfb6 |
SHA256 | 36245d9e2d93650455dd2e69f7ad4b48f625c482334d9742674a9e4edfed17d4 |
SHA512 | fce509692d77f483a919e5e5abbe82b5c58edbeec05afd25add03cb5500603e741ef66fdb886b85bfe3db535d3ce41d43e57bbb31e72c5cd4517bfb7321c941e |
UI for Role Based Access Control (RBAC), Health Check API, Kafka Version Update, Vega Charts. This release promotes the 1.9 releases from preview to stable. This release is identical to 1.9.3 apart from the version string. To see more details go through the individual 1.9.x release notes (links in the changelog).
Bug Fixes
Other
Major changes: (see 1.9.0 release notes)
Chart styling support (Pie, Bar)
Added humio Health Check APIs
Time Chart series roll-up
Support for controlling color and title in widgets
Replaces chart library with Vega, can be disabled using the ENABLE_VEGA_CHARTS=false flag.
Dealing with missing data points in timecharts
Add Role Based Access Control (RBAC) to the Humio UI
Control widget styling directly from dashboards
NetFlow support extended to also support IPFIX.
Several improvements to Query Functions
Linear interpolation now default. New interpolation type: Basis
Other changes: (see 1.9.1. 1.9.2, and 1.9.3 release notes)
New line interpolation options
Humio Server 1.9.3 Preview (2020-04-22)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.9.3 | Preview | 2020-04-22 | 2020-04-27 | 1.8.5 | No | No |
JAR Checksum | Value |
---|---|
MD5 | e2a84e14721946391ec9dddf66412723 |
SHA1 | 4b439142bf46d49c9e1b9c9685a2beacb921ef18 |
SHA256 | 646c3069015b1516dae2ef577d827a30d0deb62a393360fead05074a37edc670 |
SHA512 | bf673036d37ec539d1abeb04b9388e87f8c6ddfc781602d67bb7e28a5beda6195b827bba61bc9f769836f4a764330d93a33ae4788700758ca23cd7f8ecb88ae4 |
Security Fixes, Bug Fixes, and timechart() Improvements
Bug Fixes
Other
Allow dots in tagged field names.
New Time Chart interpolation options.
Improves responsiveness of the recent queries dropdown, and limits the number of stored recent queries to .0 per user per repository.
Bug fix: The segment queue length metric was not correct when segments got fetched from bucket storage by a query.
More efficient "collect" function implementation.
Bug fix: api-explorer not working due to CSP inline script.
Bug fix: the
query
metric only measured time for streaming queries, now it includes non-streaming as well.New options for dealing with missing data in Time Charts.
Styling improvements in the "Style" panel for widgets.
Allow more concurrent processing to take place in "export" query processing.
New query function
fieldstats()
.If at startup the
global-snapshot.json
file is missing, then try loading the ".1" backup copy.Security: [critical] Fixed more security vulnerabilities discovered through proactive penetration testing (more information will be forthcoming).
Improve disk space monitoring when using bucket storage.
Humio Server 1.9.2 Preview (2020-03-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.9.2 | Preview | 2020-03-25 | 2021-03-25 | 1.8.5 | No | No |
Value | JAR Checksum |
---|---|
MD5 | f457859662db92bd00c282aa3daa1393 |
SHA1 | a7d40e09f6a2e09a90fd2e3a2fc53618ac96a57f |
SHA256 | b33d955d51ddbc2b067b4539f1a447f4e6268e3944ead92dd7e03e56e754d95f |
SHA512 | e24b7f6b31c42b6e2b138eaa23bc6a1760dfff18b53bed6c16d1dcca79c31aabf01bbe913eee7cbe3629f410491754af77415bee14a81220099a7c4c8d1bb316 |
Security Fix and Bug Fixes
Bug Fixes
Summary
Security: [critical] Fixed a security vulnerability discovered through proactive penetration testing (more information will be forthcoming).
Added API to the list and deleted missing segments from global.
Humio Server 1.9.1 Preview (2020-03-23)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.9.1 | Preview | 2020-03-23 | 2021-03-23 | 1.8.5 | No | No |
Value | JAR Checksum |
---|---|
MD5 | a3fb1c5f2be309f2fca630f151522bc9 |
SHA1 | c9bee3ec060d2b0cc75fba8fd085769c66224dcb |
SHA256 | 4ae4ed141342c8daa193d61351919832bf63f07b02b103c2d97eac18888b61e7 |
SHA512 | 6e43adfff7e5bf9a6078060ec2660fb23e799b97b45b3f895eacf95bf344fc4b5acef9562018db133460ff97f8bd7dd883d1c9284b6e34cd1462a257597e37b9 |
Security Fix and Bug Fixes
Bug Fixes
Summary
This is a critical update. Self-hosted systems with access for non-trusted users should upgrade immediately. We will follow up with more details when this update has been rolled out.
Bug fix: the health-check failed-http-status-check would get stuff in warn state, this has now been fixed
Humio Server 1.9.0 Preview (2020-03-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.9.0 | Preview | 2020-03-12 | 2021-03-12 | 1.8.5 | Yes | Yes |
Value | JAR Checksum |
---|---|
MD5 | 81a34e3166d583b2a3479b7a4d82f64c |
SHA1 | 3f6646fc133c955d2c51977081da118f5b9b3fac |
SHA256 | f0877cc533ed58c3ca9630989b6848c79ba69f5217ee2dc6278909d4e586d076 |
SHA512 | e932eacb43d25cd10a95ad59ce07a0e7b68e7859e6b5ccf1d463cb9a23ddbf8cd0d186776a538a59ab3dcd57f1048f8dc9e6fe020ca907334f195ea22f3acdf8 |
UI for Role Based Access Control (RBAC), Health Check API, Kafka Version Update, Vega Charts
Bug Fixes
Summary
Improved (reduced) memory consumption for live groupby, and for groupby involving many distinct keys.
Be aware that updating Kafka also requires you to update Zookeeper to 3.5.6. There is a migration involved in updating Zookeeper. See Zookeeper's migration FAQ here. Use the migration approach using an empty snapshot. The other proposed solution can loose data.
When updating Kafka/Zookeeper we recommend setting these Zookeeper properties
Do not start the new admin server. Default port 8080 conflicts with Humio port.admin.enableServer=false
purge old snapshot files autopurge.purgeInterval=1
Allow 4 letter commands. Used by Humio to get info about the Zookeeper cluster 4lw.commands.whitelist=*
New selectLast function, which is like select but aggregate.
Queries involving join can now be with 'used export to file' and the
/query
HTTP endpoint.Updated Kafka and Zookeeper Docker images to use Kafka 2.4. Updating to Kafka 2.4 should be straightforward using Humio's Kafka/Zookeeper Docker images. Zookeeper image will handle migration. Stop all Kafka nodes. Stop all Zookeeper nodes. Start all Zookeeper nodes on the new version. Start all Kafka nodes on the new version. Before updating Kafka/Zookeeper, we recommend backing up the Zookeeper data directory. Then, add the Zookeeper properties described below. If you are deploying Kafka/Zookeeper using other tools, for example Ansible scripts, be aware there is a migration involved in updating Zookeeper.
New
caseSensitive
option added to the parseTimestamp query function.Updated Humio to use Kafka 2.4. Humio can still use versions of Kafka down through 1.1.
Humio Server 1.8.9 Stable (2020-03-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.9 | Stable | 2020-03-25 | 2021-01-27 | 1.6.10 | No | No |
JAR Checksum | Value |
---|---|
MD5 | f366932ccffe66883cbf84fc1ab7c9e0 |
SHA1 | 8a37d7255ec24d2c3fe85b7fcdcf5fe9020746d9 |
SHA256 | fc42241e1f7dd2f928ddcf145eee85906764c004b765bf3509a65a33817a0f3a |
SHA512 | 9c5d08fd844f1058b036c2e588120ac70c3d2abe5e98eddedbdb85f6674d57acf4f0425fc66d8b175953f98c312ed44a5943333083a4a6c45ecb4e7014ce2027 |
Security Fixes
Bug Fixes
Summary
Security: [critical] Fixed a security vulnerability discovered through proactive penetration testing (more information will be forthcoming).
Humio Server 1.8.8 Stable (2020-03-23)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.8 | Stable | 2020-03-23 | 2021-01-27 | 1.6.10 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 0c0359bdfe15cb2f8f14487038c8043e |
SHA1 | 994919268e463ed643ff4977d9f131873833717b |
SHA256 | 3918516569ff4a03f9ac1131658b8ac4046186f5f4d17333e0ec555227136f63 |
SHA512 | c12b2e7630d97b618a7552290b942b443017005e607fa819459b0979b0e05e553b0bdd61fc5d508ce766247269e711ad370df7acb755b4928b54f7e25790ef5d |
Security Fixes
Bug Fixes
Summary
Fix security problem. This is a critical update. On-prem system with access for non-trusted users should upgrade. We follow up with more details when this update has been rolled out.
Humio Server 1.8.7 Stable (2020-03-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.7 | Stable | 2020-03-12 | 2021-01-27 | 1.6.10 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 7c6181f950bb99ca50c5b444dc072cd8 |
SHA1 | 0cf020232fb2b5621c288dded8d3d9d3626db521 |
SHA256 | 8c003212b861957529332ad8d62facf2796bdbe58a66107559eb691c44762dea |
SHA512 | c8e7acdd3812408fa87ad6afa29573c09a8b9ec7518b03a6f41e7caa8205f4e172f78fe7f0d146020cc68eb80b0519d1e11571675b340639e0a73aa666e0cf8f |
Bug Fixes
Bug Fixes
Summary
Bug fix: Alerts and exports now work on the special view "humio-search-all".
Bug fix: When a merge of segment files fails, delete the tmp-file that was created.
Bug fix: The Kafka and Zookeeper images tagged with "1.8.6" were partially upgraded to Kafka 2.4.0.
Humio Server 1.8.6 Stable (2020-03-09)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.6 | Stable | 2020-03-09 | 2021-01-27 | 1.6.10 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 59a11140391a8f7a47de89bb2c3cf932 |
SHA1 | 05cf1d4355af997b5591f1b77e517d0f703cc5db |
SHA256 | cfc9736d19dac1a9b2c1f3ce082bd28e900178b4aeb781d7aef350557778a215 |
SHA512 | 47dbe78aba22795cbdbea741099bb5abe2c03d491479a8a0795793c6605cbbcad2b62eca3953e87c7635cafe57f496341887fff1704725e9a2d2db4071865d6a |
Fixes bug related assigning ingest tokens in a Sandbox.
Note: Do not install the Kafka, Zookeeper or "single" Docker images of this build. Install 1.8.7 or later.
Bug Fixes
Summary
Bug fix: Assigning ingest tokens to parsers in sandbox repos.
Note: Do not install the Kafka, Zookeeper or "single" Docker images of this build. Install 1.8.7 or later.
Humio Server 1.8.5 Stable (2020-02-28)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.5 | Stable | 2020-02-28 | 2021-01-27 | 1.6.10 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d9e4b78b03e7c5f53eba4bc0c75f865c |
SHA1 | 56725db4c01ea082769143361c978d17cffb931e |
SHA256 | ec3fc0e337a01b5e772176b708620bbeca16a871d7a3fced6451704546b960be |
SHA512 | 6ec7cfca8f64bd72e372540a0b375581e6b115e5e84108bdbd9f2606619887f940d8d0f213eba0011381a1a835b6ad3793ffe74741bd1fcd5571d11026149898 |
Bug Fixes
Bug Fixes
Summary
Bug fix: Fixed a race in upload of segment files for systems set up using ephemeral disks.
Bug fix: "Export" queries could hit an internal limit and fail for large datasets.
Lower ingest queue timeout threshold from 90 to 30 seconds.
Bug fix: TCP socket ingest listener would spend a lot of CPU when connected but not receiving any data.
Humio Server 1.8.4 Stable (2020-02-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.4 | Stable | 2020-02-19 | 2021-01-27 | 1.6.10 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 628055e8a489f8da436795da3b74c83b |
SHA1 | 693c732a14ab780fd2160194bb909599ef016a0f |
SHA256 | cb784f6287b75195d624013005b2ac6db3dfc1d3d56ed777efaf6502cb00a629 |
SHA512 | 9a30326b010e8e09288f9112d34017fcb2d3a7d26c9f6bf85804abb2977dc99784d32146b2236989230360e0b5525c92b46282bc768f3f42787cbcd5b1af4246 |
UI Scroll Bug Fix for Chrome 80 (again). This release is purely a fix for the Humio UI. After upgrading to Chrome 80, people have been experiencing issues with scrolling in some of Humio's widgets. We did not find all the problems in the previous release.
Bug Fixes
Summary
Bug fix: Fix more scrolling issues in Chrome 80 and above.
Humio Server 1.8.3 Stable (2020-02-13)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.3 | Stable | 2020-02-13 | 2021-01-27 | 1.6.10 | No | No |
JAR Checksum | Value |
---|---|
MD5 | f975edf282bf83febc974c154906611c |
SHA1 | a1e49cd77ffeae0e95daf3380d3d4138ee6b4b04 |
SHA256 | 28dc5287957bdfcb414f0f1ecd71ea8721ff8b87e713d6f02b26922c5e44f97b |
SHA512 | a6f251ab388038d54e40efec2e51e967c6c276f320a615f95bcbc9f139134ba25182430208d0917496bb2228c1608f296f979a2d24e10b32ede3fe301c29d364 |
UI Scroll Bug Fix for Chrome 80. This release is purely a fix for the Humio UI. After upgrading to Chrome 80 people have been experiencing issues with scrolling on the Search page - specifically when the "Field" panel is visible.
Bug Fixes
Summary
Bug fix: Fix scrolling issue in Chrome 80 on the Search Page.
Humio Server 1.8.2 Stable (2020-02-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.2 | Stable | 2020-02-10 | 2021-01-27 | 1.6.10 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | b3b553543c7db54d05b721550a4c9b3d |
SHA1 | 7a24873c6485caaf99abfed3bac79d982056793e |
SHA256 | 995787f60bcf744d6447b53282f48d547a89962202a81f3f4ba65dbf0dbe6398 |
SHA512 | 1814b6a443381fd0191f93bfdf49fa6c57b4bbf163500b56f742673780384a44d8a603121d5b0417b593ad24a4752edd82f8a3c965b56bfdb5d58de8f1014351 |
Bug Fixes
This is a bug fix release.
Bug Fixes
Summary
Bug fix: When a node was missing for an extended period of time the remaining nodes would create smaller segment files than they should.
Bug fix: Bucket storage download could report "download completed" also in case of problems fetching the file.
Bug fix: The new feature for ephemeral servers using Zookeeper to UUID did not properly reconnect when the network failed.
Humio Server 1.8.1 Stable (2020-02-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.1 | Stable | 2020-02-03 | 2021-01-27 | 1.6.10 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | e99a4e6eb8ae5174416f3ba2ac6f975a |
SHA1 | c0ed5c06b6fc6d9f2bb6bc2c7d4afeb4aeabcd01 |
SHA256 | 156eadb8a285e688aecde7040505e6266407ab5ce6c58826ef9d6d12299fb5db |
SHA512 | 86acc3eef2c2817ba7e5f83b030319bb70a63ca90568fd1a949210177653951cfa76687c22d23518626fdcc08719b9ff67c66c918842b0010860c56696b171a5 |
Bug Fixes
This is a bug fix release.
Bug Fixes
Summary
New feature for ephemeral servers: Let Zookeeper assign the UUID that in turn assigns the node ID in the cluster. This is turned on by setting the config option ZOOKEEPER_URL_FOR_NODE_UUID to the set of Zookeepers to use for this. The option ZOOKEEPER_PREFIX_FOR_NODE_UUID (default
/humio_autouuid_
) sets the prefix to allow rack awareness. Note: Do not turn this on for an existing cluster. Do not turn on if running older 1.7.x or 1.8.x builds.Bug fix: Avoid calling fallocate on platforms that do not support this (for example, ZFS).
Bug fix: Fix edge case errors in the regex engine. Some case insensitive searches for some Unicode characters were not supported correctly.
Humio Server 1.8.0 Stable (2020-01-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.8.0 | Stable | 2020-01-27 | 2021-01-27 | 1.6.10 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 323f7c8a332086ce7f5f0d9796d346f7 |
SHA1 | 4423ccb2afcfcc7f83fe9802ee494abe4085f314 |
SHA256 | 318d70019a0678d65b721dccff6643818bd151497d5b873a59d9e9cc95ad4f77 |
SHA512 | a196b0f8cde842b395bf6e0401410ebc61d1052507d07aa37b78214acc0ba460cd0f926cb54c5be5530d8eb6d6e80998845bb2f0b1f148d683a3685c67c868e8 |
Joins, Bucket Storage Backend, Query Quotas, UI Improvements. This release promotes the 1.7 releases from preview to stable.
Bug Fixes
Summary
the ability to use See Bucket Storage providers such as S3 and Google Cloud Storage for data storage, and
Query Quotas - putting limits on the amount of resources a given user can spend. Besides those, there are a number of UI improvements, back-end improvements, and Bug Fixes.
Other changes: (see 1.7.1, 1.7.2, 1.7.3, and 1.7.4 release notes)
Major changes: (see 1.7.0 release notes)
Humio Server 1.7.4 Preview (2020-01-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.7.4 | Preview | 2020-01-27 | 2020-01-27 | 1.6.10 | No | No |
JAR Checksum | Value |
---|---|
MD5 | cdfb4241fdc8daa44f9f2e54cca1355e |
SHA1 | b5e01c98c21e4ffcbc115b8585ab28ec90bc79f7 |
SHA256 | 63a8945e903755bcfc430d1b404f3a64558e8b7e26728f4a2c10ca22f6c67347 |
SHA512 | dedbf948de640e141ab246cdb431dbbcbfd190b1947dde2fe7896c0a3ad904e60ee7d2aaaffcf6efb63e8a65919a8554fab1fa5ea111b5ab2111b195d5d48fd3 |
Bug Fixes
Bug Fixes
Summary
Bug fix: join now accepts absolute timestamps in millis in start and end parameters.
Add Chromium to the list of compatible browsers
Allow webhook notifiers to optionally not validate certificates.
Bug fix: Allows "Force remove" of a node from a cluster.
Bug fix: Stabilized sync of uploaded files within a cluster in combination with bucket storage.
Humio Server 1.7.3 Preview (2020-01-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.7.3 | Preview | 2020-01-17 | 2021-01-17 | 1.6.10 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 4265deddaccfa78f648a6426faa28ce6 |
SHA1 | abc76135b365f4bb09793af9749a03b157b56176 |
SHA256 | 0becd94c687e07aa6a0ce116a96b2b6e7bace87e77e6fd7a4c01a5e837050c8f |
SHA512 | 2b5606a0ae94e95d9c8271628b2c3fc4c56c9a74f27c9735e334957fb7baf8d5de5cc7cd50f8f2fb5ee3cea6e3323bfb645efb4bc083e3f65f4a3803c6811a8f |
Bug Fixes
Bug Fixes
Summary
ERROR logs get output to stderr instead of stdout to avoid breaking the potential stdout format.
top() function allows limit up to 20.0 by default now. Used to be 1.0.
New log output option for the LOG4J_CONFIGURATION configuration now allows the built-in:
log4j2-stdout-json.xml
to get the log in NDJSON format, one line for each event on stdout.
Humio Server 1.7.2 Preview (2020-01-16)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.7.2 | Preview | 2020-01-16 | 2021-01-16 | 1.6.10 | No | No |
Value | JAR Checksum |
---|---|
MD5 | b523d1cdac2d03b7f215379080eb9053 |
SHA1 | 3846dfc31446f7788c1ac6b86821073397b0d462 |
SHA256 | 7bed62c85e26ff73feb19554b4296d0d9590c6d65f45e9685b9b5ffb356963a3 |
SHA512 | 54192cfc366ba7b3626ae3b6e0e5fb47bdc8dffb828a68198e9fa1f1800b4c2763abe765c4da34533b5beb1906b79dc3e40aa1234be684e34c1b266ae348070b |
Bug Fixes
Bug Fixes
Summary
New config: LIVEQUERY_STALE_CANCEL_TRIGGER_DELAY_MS and LIVEQUERY_STALE_CANCEL_COST_PERCENTAGE controls discard of live queries that have not been polled by a client for a while when the system experiences digest latency of more than the delay.
Change: When the system starts with no users at all, the first user to log get root privileges inside the system.
Bug fix: Retention could in fail to delete obsolete files in certain cases.
Bucket storage: Continue cleaning the old buckets after switching provider from S3 to GCP or vice versa.
New config: USING_EPHEMERAL_DISKS allows running a cluster on disks that may be lost when the system restarts by assuming that only copies in Bucket Storage and the events in Kafka are preserved across restarts. If the filesystem remains during restart this is also okay in this mode and more efficient then fetching the files from the bucket.
The "query monitor" and "query quota" new share the definition of "cost points". The definition has changed in such a way that quotas saved by version up to 1.7.1 and earlier are disregarded by this (and later) versions.
New config: LIVEQUERY_CANCEL_TRIGGER_DELAY_MS and LIVEQUERY_CANCEL_COST_PERCENTAGE controls canceling of live queries that have been consuming the most cost for the previous 30s when the system experiences digest latency of more than the delay. New metrics:
livequeries-canceled-due-to-digest-delay`, `livequeries-rate-canceled-due-to-digest-delay
andlivequeries-rate
New config: LOG4J_CONFIGURATION allows a custom log4j file. Or set to one of the built-in:
log4j2-stdout.xml
to get the log in plain text dumped on stdout, orlog4j2-stdout-json.xml
to get the log in NDJSON format, one line for each event on stdout.Bug fix:
Top(x, sum=y)
now also support non-integer values of y (even though the internal state is still an integer value)Bug fix: Bucket storage, GCP variant: Remove temporary files after download from GCP. Previous versions left a copy in the tmp dir.
Bug fix:
#repo=*
never matched but should always match.Bucket storage: Support download after switching provider from S3 to GCP or vice versa.
Bug fix: Restart of queries using lookup/match/cidr when the uploaded file changes only worked for top-level functions, not when nested inside another function.
Bug fix: Query of segments only present in a bucket now works even if disabling further uploads to bucket storage.
Bucket storage: Also keep copies of the "metadata files" that you use for lookup and match functions in the bucket and restore from there when needed.
Bug fix: The Zookeeper status page now shows a warning when the commands it needs for the status page to work are not whitelisted on the ZK server.
New Utility inside the jar. Usage
java -cp humio.jar com.humio.main.DecryptAESBucketStorageFile <secret string> <encrypted file> <decrypted file>
. Allows decrypting a file that was uploaded using bucket storage outside the system.
Humio Server 1.7.1 Preview (2020-01-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.7.1 | Preview | 2020-01-06 | 2021-01-06 | 1.6.10 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | df8268ca40d896676a0d771e40e84766 |
SHA1 | f2826fed2741cc74128a07f5f67c2bed498d58bc |
SHA256 | 6f29f7d3abb1df8547cc0be5470ec714469febfd2c8553ed58555e5936b27fbb |
SHA512 | 14529ec3496dcafee383a2d6ef85d0862a8071f144e9b0ac59bd59f3b9742a8d1e46092f16e0db32e0ab071bdd2235754f319c4fc95007d470c34bb304c52ce9 |
Bug Fixes and Removal of Limitations
Bug Fixes
Summary
Allow explicit
auto
as argument to thespan
parameter in bucket and timechart. This makes it easier to set span from a macro argument.Bug fix: Saved Queries/macros was not expanded when checking if a live dashboard query could reuse an existing query.
Bug fix: Reuse of live dashboard queries on the humio-search-all repository did not work correctly. As an effect the number of live queries could keep increasing.
Bug fix: Handle large global snapshot files (larger than 2 G).
Remove 64 K restriction on individual fields to be parsed by parsers.
Bug fix: The Postmark integration was always assuming a humio.com from address. This has been fixed by introducing a new POSTMARK_FROM configuration parameter.
Humio Server 1.7.0 Preview (2019-12-17)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.7.0 | Preview | 2019-12-17 | 2020-12-17 | 1.6.10 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 949b46169cff1182c3da25c6f7f641f3 |
SHA1 | 9b9187c045ee4a4a8051ed233b7a8fdf056f514d |
SHA256 | aa53e3998b390863edb435a4658b5c51551d54c68f1b1983886063e297cd8cbc |
SHA512 | f3766baf64dbf62450970207cafabd65588a660cebceb8f447dd8d8d6baba8f5e26ac69e4873d8170a84c011264a5f16247d8beed28604e3fb91073af8435ba2 |
Join, Bucket Storage Backend, Query Quotas, UI Improvements
Bug Fixes
Dashboards and Widgets
UI: The time selector on dashboards now allow panning and zooming - like the one on the search page.
UI: Bug Fix - Ensure counts of fields and value occurrences on the event list are reliable.
Function: New function xml:prettyPrint()
Top Feature: Query errors will now be highlighted as-you-type in on the search page.
UI: Queries page removed, and delete and edit saved query functionality moved into "Queries" dropdown on search page.
Upgrading: After installing this version, it is not possible to roll back to a version lower than 1.6.10. Be on version 1.6.10 before upgrading to this version.
UI: Word-wrap and event list orientation is now sticky in a session, meaning revisiting the search page will keep the previous selected options.
Function: New function callFunction, allows you to call a Humio function by name. This is useful if you for instance want a dashboard where you can control what statistics your widgets show based on a parameter, e.g. timechart(function=callFunction(?statistic, field=response_time))
Function: The function top has a new
max=field
argument, that can be used to make it work as a more efficient alias a groupby/sort combination, liketop(field, max=value, limit=5)
is equivalent (and much faster than)groupby(field, function=max(value)) | sort(limit=5)
.Top Feature: Query quotas allowing limiting how many resources users can use when searching, see Query Quotas
UI: Bug Fix - Don't show "unexpected error" screen when Auth Token expires.
UI: Add support for loading a specific time window when launching a dashboard, by setting time= and window= in the URL.
Top Feature: Joins allowing subqueries and joining data from multiple repositories, see Join.
Top Feature: The "Queries" page has been replaced with a dropdown on the Search page, that allows searching saved and recent queries.
Top Feature: Bucket Storage with support for S3 and Google cloud storage, see See Bucket Storage.
UI: Improved Query Monitor in the administration section, making it much easier to find expensive queries. See Query Monitor
UI: Improve word-wrap and allow columns in the event list to be marked as 'autosize'. Autosizing columns will adapt to the screen size when word-wrap is enabled.
Function: New function json:prettyPrint()
UI: Allow disabling automatically searching when entering a repository search page, on a per-repo basis.
Configuration
Config: Autosharding can now bet set "sticky" which means fixed as set by user on a specific (input) datasource. The API also allows listing all autosharding rules, both system-manages and sticky.
Config: Add SHARED_DASHBOARDS_ENABLED configuration setting which allows disabling access to the shared dashboards feature - if e.g. your organization has strict security policies.
Config: COMPRESSION_TYPE=high is now the default compression type. Clusters running with default configuration, will change to high compression unless the configuration COMPRESSION_TYPE=fast is set.
Functions
Function: The implementation of the percentile function has been updated to be more precise (and faster).
Other
Use case-insensitive comparison of usernames (historically an email address) when logging into Humio.
Java 13 is the recommended Java version. Docker images are now running Java 13.
New stable/preview release versioning scheme. See description.
Humio Server 1.6.11 Stable (2020-01-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.11 | Stable | 2020-01-06 | 2020-08-22 | 1.5.19 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 95b8814ef3035ec68887dd3605e10b1f |
SHA1 | 42c2fbff389d6e75a05450abd326b3dd7da71bce |
SHA256 | fddbe1edb8b7501d277550e3a044f97d3448de6ccd0c3e02390d239841d3be2e |
SHA512 | 8238028be9c1fb9ce1c027b7fcb21d4cea6b1db4e984d2aaf951c6e3a1ecf961285ce6d4ff41a373abe7c8a94f3d3cd7eca80284a126efa5e4bf90903a38e822 |
Handle Large Global Snapshot File
Bug Fixes
Summary
Bug fix: Handle large global snapshot files (larger than 2 G).
Humio Server 1.6.10 Stable (2019-12-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.10 | Stable | 2019-12-12 | 2020-08-22 | 1.5.19 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | c8cfd22a5be0456f5905247b6f2bab3b |
SHA1 | 4c4b734217c5ac90bd9be5f6e2f34c4e182f8fa6 |
SHA256 | 2a2529e2b2bdbd54162075adb55b514d80bbe60ec1854b8044fb7cbea985c006 |
SHA512 | 883ee5a113ceeab99063d07d3b19b935e382dfdab598903fb896392d225d8dddc91716db56e29f4a92053d7b37e818806fcdad86126b9a5e2b68c17ad4f32c76 |
Bug Fixes and LDAP improvements. There are some changes to the configuration that will be required. See the change log below.
Bug Fixes
Summary
Bug Fix: Query sessions were not properly cleaned up after becoming unused. This lead to a leak causing high amount of chatter between nodes.
Username/email is treated case-insensitive in Humio. This is more expected behavior of usernames as emails addresses are often used. In some rare occasions duplicate accounts might have been created with difference in casing and this change can trigger the otherwise dormant account to be chosen when logging in the next time. If this happens, use the administrations page to delete the unwanted user account and let the user log in again.
Require setting LDAP_SEARCH_DOMAIN_NAME explicitly when using
ldap-search
authentication method.Add LDAP_USERNAME_ATTRIBUTE and LDAP_GROUPNAME_ATTRIBUTE configuration settings to enable more control over names carried from LDAP into Humio.
LDAP: It is now possible to specify an attribute within the LDAP record to use for the username rather than the default (an email address). This is only the case when using
ldap-search
method by specifying the LDAP_USERNAME_ATTRIBUTE in the environment. Group names when using LDAP have historically been the distinguished name (DN) for that group, it is now possible to specify and attribute in the group record for the name by setting LDAP_GROUPNAME_ATTRIBUTE. These changes necessitated a breaking change in theldap-search
code path in cases where users of Humio authenticate with a username (e.g.user
) rather than an email address (e.g. user@example.com). To elicit the same behavior as previous versions of Humio simply specify the LDAP_SEARCH_DOMAIN_NAME which in the past would default to the value of LDAP_DOMAIN_NAME but no longer does.
Humio Server 1.6.9 Stable (2019-11-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.9 | Stable | 2019-11-25 | 2020-08-22 | 1.5.19 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 078266ac0716bd634fdc03fc7ef24ee7 |
SHA1 | 2457f4a35cef44b75351ed1ce794e32a253416b4 |
SHA256 | 26934b20ede90d7b4d4a855fe9fb2af749ec37a27bfbf44e79cb5d6c38c133d9 |
SHA512 | dce9bdffddf89c9de819feb46bfbf59cd7bbc22da4d9131de588236a82306b131dacffbed3d6969f50e40a34e74b31d073cb31c814fa04a43e68e1063f89c435 |
Bug Fixes and a new background job that reduces number of small files on disk. No configuration changes required, but see changes to backup in 1.6.6.
Bug Fixes
Summary
Improved memory usage from having large global.
Detect when event ingested are more than MAX_HOURS_SEGMENT_OPEN (24h by default) old and add the tag
humioBackfill
to them in that case to keep "old" events from getting mixed with current "live" events.New background job: Find segments that are too small compared to the desired sizes (from current config) and merge them into larger files. For COMPRESSION_TYPE=high this will recompress the inputs while combining them. This job runs by default and may be turned off by MERGE_UNDERSIZED_SEGMENTS_ENABLED=false.
Humio Server 1.6.8 Stable (2019-11-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.8 | Stable | 2019-11-19 | 2020-08-22 | 1.5.19 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 002f3f8e6d2139542912f503d9a97b6c |
SHA1 | acf4b53e6363b85bb94ee7afff1961c712a3d21a |
SHA256 | e25243edf2fa906c18b61ce838b7114bf7cf03e787a638effc0881d645161227 |
SHA512 | 258b86a43f403caed0852903cdbcfd10664bbced66ea773f5a517bbca7c45143b07829a73bed4c92c12b29166cce3a22d5314b633ef8e091f8480d122432dae6 |
Bug Fixes
No configuration changes required, but see changes to backup in 1.6.6.
Bug Fixes
Summary
Support for "sticky autosharding" and listing of current autosharding settings for all datasources in a repository.
Bug Fix: Segment merge could leave out some parts when merging, leading to segments not on average becoming a large as is desired.
Humio Server 1.6.7 Archive (2019-11-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.7 | Archive | 2019-11-04 | 2020-11-04 | 1.5.19 | No | No |
JAR Checksum | Value |
---|---|
MD5 | cc498d9bfbbae9fc815d046887e93ace |
SHA1 | bb9c4e01199a5c8727e4b825651139c808964b2f |
SHA256 | ede04107d73323f9b24374e9d6f45a8d62f56b484a2d042a4e3e0cd7781ddfc8 |
SHA512 | a13ae84ae29339410d5de53cc77a2975f529c6baed9e61941ed9eb2f35130eea6ae0cb14595f7c7f8fb320e2c0cecd7a3e6e690a0f156ba87ceb404d5035f21e |
Bug Fixes and Performance Improvements
No configuration changes required, but see changes to backup in 1.6.6.
Bug Fixes
Summary
Fix security bug. See Security Disclosures
Humio Server 1.6.6 Archive (2019-10-23)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.6 | Archive | 2019-10-23 | 2020-10-23 | 1.5.19 | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 6f5f5a9ca0cc982b8368feab633178bf |
SHA1 | 82feebc7020bda86e42acdb18db6bc162020539a |
SHA256 | b969805efafe28497a2517ca3a3268dd1bb849bc39eb56ab31d62070ae07a5e0 |
SHA512 | 02df102a6589da27b9027b36447bc11222c616ca2c83bd00978d756001843464332b6cfcf886bc4dd749a31abe89ef62ba426bfce286ff37330a95c2ba809566 |
Bug Fixes and Performance Improvements
See changes to backup in 1.6.6.
Bug Fixes
Summary
Performance improvements in digest pipeline.
It's now possible to change the description for a repository or view.
Bug Fix: In Chrome, saving a query and marking it as the default query of the repo would previously not save the default status.
Humio's built-in backup has been changed to delay deleting segment data from backup. By default Humio will wait 7 days from a segment file is deleted in Humio until it is deleted from backup. This is controlled using the config
DELETE_BACKUP_AFTER_MILLIS
. Only relevant if you are using Humio's built-in backup.Improved error recovery in query language. This should make query error messages easier to read.
Bug Fix: Looking at the events for e.g. a timechart was previously untenable, due to a scrolling bug.
Humio Server 1.6.5 Archive (2019-10-01)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.5 | Archive | 2019-10-01 | 2020-10-01 | 1.5.19 | No | No |
JAR Checksum | Value |
---|---|
MD5 | d5426b20769fcea54bdb6a296a1b853d |
SHA1 | 7881a0845b5548afd23938731abef349259a5002 |
SHA256 | d4d8abbdc1e4730141a36718101444377ed106c8a3db8557e572ca3eaec35bfa |
SHA512 | b71876f6d325b99cadbabb65acd304ca713ffb62e319a29941e16c5645540bf824a07c0fcc3d8820c735ae1e027bff1fad05ec150b36bf5bb973bc71d34ac274 |
Bug Fixes and Performance Improvements
No data migration required, but see version 1.6.3.
Bug Fixes
Summary
Improved performance of internal jobs calculating the data for the cluster management pages.
The new metric
ingest-queue-latency
measures the latency of events through the ingest queue in Kafka from the "send" to kafka and until it has been received by the Digest node.Redefined the
event-latency
metric to start measuring after parsing the events, just before inserting them into the ingest queue in Kafka. This metric is the basis of autosharding decisions and other scheduling priority choices internally and thus needs to reflect the time spent on the parts influenced by those decisions.Bug Fix: Apply the extra Kafka properties from config also on deleteRecordsBefore requests.
Bug Fix: Support reading events from the ingest queue in both the format written by 1.6.3 and older and 1.6.4.
The new metric
event-latency-repo/<repo>
includes time spent parsing too and is heavily influenced by the size of the bulks of events being posted to Humio.
Humio Server 1.6.4 Archive (2019-09-30)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.4 | Archive | 2019-09-30 | 2020-09-30 | 1.5.19 | No | No |
Bug Fixes and Performance Improvements. Retracted - did not properly support existing events in ingest queue.
No data migration required, but see version 1.6.3.
Bug Fixes
Summary
Do not install this build. Do not roll back from this build to 1.6.3 - update to 1.6.5 instead.
Improved word wrap of events list.
Improved performance of timecharts when there are many series and timechart need to select the "top n" ones to display.
Bug Fix: Creating new labels while adding labels to a dashboard did not actually show the labels as available.
/query
endpoint andqueryjobs
endpoint now coordinate thread usage lowering the maximum total number of runnable threads from queries at any point in time.New metrics tracking number of active datasources, internal target latency of digest, number of threads available for queries, latency of live query updating and segment building, and latency of overall ingest/digest pipeline tracked for each repository.
Humio Server 1.6.3 Archive (2019-09-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.3 | Archive | 2019-09-25 | 2020-09-25 | 1.5.19 | No | No |
Value | JAR Checksum |
---|---|
MD5 | b4a29de04d375c5f71eda06a73ddb324 |
SHA1 | e3d60d5ec6fb651b35b12dbf4e004872e4558ee2 |
SHA256 | 1ea140db06de2ebe78769e1bc1d827f6d5b007fb9419ecd746250d2a1abfa984 |
SHA512 | 4c472f8250e41729b73295296816094eb0b8bd53265a4dede89091c413bf9288b5b03c3864f16aba40bcd1cdede28438df4b0aad7fa79dae5acc0c7312f1061c |
Dashboard parameters improvements and Bug Fixes. Data migration is required: Hash filters need rebuilding.
Bug Fixes
Other
New config: HASHFILTER_MAX_FILE_PERCENTAGE defaults to 50. Hash filter files that are larger than this relative to their segment file do not get created. This trades the work required to scan them on search for disk space for files that are not very large.
Bug Fix: In Chrome, it was sometimes not possible to rename a dashboard, clone a dashboard, duplicate a widget, and other actions. This has been fixed.
Bug Fix: The "Show in context" window on event list would "jump" when used and a live query on dashboards.
Bug Fix: Fix issue where streaming queries failed when a node in the cluster was unavailable.
LDAP login code rewritten.
Bug Fix: Fix issue that made the timestamp column wrap on some platforms.
New Feature: File based parameters on dashboards can now filter parts of a file out, by specifying a subset of entries in the file that should be used. This filtering can also be based on other parameters, so entries pulled from the file can depend on e.g. a query based parameter.
Bug Fix: Fix issue with layout of pagination of table widgets in dashboards overflowing when it has a horizontal scroll bar
New config: MAX_JITREX_BACKTRACK default to 1.0.0: Limits CPU resources spent in a regex match, failing the search if exceeded.
EventList column header menu opens on click now, instead of on mouse hover.
New config: MAX_EVENT_SIZE defaults to 1 MB. Increasing this may have adverse affects for overall system performance.
Bug Fix: Previously, exporting data from queries with parameters would always fail. This now works as expected.
Bug Fix: Make JSON word-wrapping work when a column is syntax highlighted.
Improved names and states in thread dumps and added a
group
field to the traces. Run#type=humio class=threaddump state=RUNNABLE | timechart(group,limit=50,span=10s)
in the Humio repo to get an idea of variations in what the CPU time is being spent on.Bug Fix: Exporting a search (Or using
/query
endpoint in other contexts) would fail if any node was down even when the files needed to satisfy the search were available on other nodes. Note that a search in progress will still fail if a node goes missing while the search runs. (Searches in the UI restart in this case but that is not possible for an export.)Bug Fix: The Event List widget no longer shows column menus on dashboards. Editing was not possible, but the menus would open anyway.
Bug Fix: Latin-1 characters (those with code point 128 - 255) were not added correctly to hash filters. To fix this, Humio needs to rebuild the existing hash filters: The old hash files get deleted, and a new file prefix "hash5h3" is applied to the new files. This will be done in the background after updating to this version. For estimation of time to complete use a rate of .0GB/core/hour of original size. While rebuilding hash filter files the system will have a higher load from this and from searches that would benefit from the filters but need to run without them.
Regex matching gets rejected at runtime if it spends too many resources.
When setting up Humio the server will refuse to start if Kafka is not ready in the sense that the number of live Kafka brokers is less than number of Kafka bootstrap hosts in the configuration for Humio.
Replication of segment files among nodes now runs in multiple threads to allow faster restore form peers for a failed node.
Bug Fix: Using dropEvent() in a parser did not work when using the "Run Tests" button.
Humio Server 1.6.2 Archive (2019-09-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.2 | Archive | 2019-09-04 | 2020-09-04 | 1.5.19 | No | No |
Value | JAR Checksum |
---|---|
MD5 | dbd67c77d4a876f223d5cf30f5765d7b |
SHA1 | 5d4f8b045ed5a98b85c906bbf190d5ea95de4c88 |
SHA256 | 407b5f8e24843bb18072ed4ce43e381a1022efb275f18c0f717e8e3784a92228 |
SHA512 | 872c39a7893b7196d65fde5d9ddcac31d30ba70ba2b7f4613e59396d06565a6410193036713eb3a4792e0fcfdf75b77bb83673ed8afce7f4f0a47aef568eb1f9 |
Event List Columns and Bug Fixes. The release replaces the event list on the search page with a table view where you can control which columns you would like to see.
Bug Fixes
Summary
Users are now notified about the dashboard reload 5s before reloading.
The default order of the events on the search page has been reversed. It is more natural to have newer events (lines) below older ones - just like logs appear in a log file. This can be changed in "Your Account".
You can now add favorite fields to your views. These fields will always be started to the top of the fields panel, and be visible even if they are not part of the currently visible events.
New Event List with customizable columns.
Improve scheduling of uploads in S3 archiving to achieve better throughput.
New query function
hashRewrite()
to hide values of selected fieldsThe UI now only checks the version of the Humio installation when determining if it should reload dashboards.
Saving a default query for you repository also saves the selected columns and will show them by default.
If a field that you would like a column for is not present in the list of fields. You can manually add it from the toolbar of the fields panel.
Bug Fix: timechart with limit selecting top series was nondeterministic when live.
Use the keyboard arrows and Enter key to quickly add and remove columns while in the "Filter Fields" textbox.
Bug Fix: Fixed issue where some cluster nodes where configured differently than others, it would trigger a dashboard reload every 10s.
New query function
hashMatch()
to be able to search (for exact value) on top of the hashed values.The special handling of @display has been removed. The field is now like any other. If you use it today, you can add it as a column in your default columns.
The fields panel is open by default. You can change this in "Your Account" preferences.
Browser minimum versions get checked in the UI to warn if using a version known to miss required features.
Humio Server 1.6.1 Archive (2019-08-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.1 | Archive | 2019-08-26 | 2020-08-26 | 1.5.19 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 333a5243ca407814dc5437c71d7affc7 |
SHA1 | fa3be4c0332421af5b5531fcda456f5a404199f0 |
SHA256 | dd22a4a6c291d78537a4711aea71c0243646b3bdd6b645b9626c6266629c3039 |
SHA512 | 5c600ee0f7e88cbcb47500e235a9d2e9581b5630e4cfe596b000d2801219c6dc363ec9d0572a40a3bdd93c77868fbe7603d4502f4bdcbb008ab9e30af09d8f92 |
Bug Fixes
Bug Fixes
Summary
Bug Fix: Live queries could lock the HTTP pool, leading to a combination of high CPU and problems accessing the HTTP interface.
Bug Fix: Fixed issue preventing you from clicking links in Note Widgets.
Humio Server 1.6.0 Archive (2019-08-22)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.6.0 | Archive | 2019-08-22 | 2020-08-22 | 1.5.19 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 19c48ed4689582534bdb4d2351224497 |
SHA1 | 8cb74a483006d732fedb52d835120663800d53a2 |
SHA256 | 4e519242ffa15eb15344e912479e350e60376c493d9c51b056c0c1f6b5349122 |
SHA512 | a51db1066c5c7fc21c52a6a1a47d03ddb0b2a7bc977f37c1a65f27fb553ca9099587a5af74a942110f4cbd345b1a468f98407d320ea37e87b4a3cfe70892e044 |
Improved compression. Note Widgets and YAML Template Files
Bug Fixes
Other
Bug Fix: Styling of the dashboard "Labels" dropdown has been fixed.
Added Note Widget support for dashboards.
COMPRESSION_LEVEL_MINI allows adjusting the compression level for high and extreme types of the compression inside the critical digest pipeline. Default is 0, max is 6. Keep low for optimal digest throughput.
COMPRESSION_LEVEL now supports the range 0 - 9. Default is now 3 for
fast
type, and 9 for the others. (Up to 17 was allowed previously: Check your config, as values above 9 will be rejected and Humio will refuse to start!)The function
sort()
query function now ignores case when sorting strings.Removed internal REST API for shared dashboards.
Changed GraphQL fields for dashboard widgets.
COMPRESSION_TYPE=extreme uses the stronger compression also in the digest part, even though it is not as effective there due to the gain from having a larger file after the merge.
Pending parameter edits toggle, so that parameter changes are not immediately applied if the user desires not to.
The sizes of the compressed files and the associated hash-filter files are tracked separately for the merged part, allowing you to see in the UI how well the long-term compression works as part of the total set.
This update does not support rolling updates. Stop all Humio nodes. Then start them on the new version.
The function
parseJson()
now accepts an exclude and include parameter. Use this to specify which fields should not be included.Introducing a new YAML dashboard file format.
Added cluster information pages for the Zookeeper & Kafka Cluster used by Humio. Both are available under Administration.
New function
urlEncode()
and functionurlDecode()
functions allow for encoding or decoding the value of a field for use in urls.Bug Fix: Drawer heights were not being persisted between browser sessions.
Bug Fix: Changing Dashboard labels will no longer trigger a "Dashboard was modified remotely" notification.
COMPRESSION_TYPE=fast (Default!) corresponds to versions before 1.6.x
Note! Rolling back to v1.5.x is supported only for COMPRESSION_TYPE=fast which is the default in this release. The default is expected to change to "high" later on. The new compression types "high" and "extreme" are considered BETA release.
Renaming a repository is now possible in settings.
New function
start()
and functionend()
functions provides the time range being queried as fields.New function
copyEvent()
function allows duplicating an event into another datasource while ingesting. Usecase
to make the two events differ.Added GraphQL fields for shared dashboards.
COMPRESSION_TYPE=high turns on a stronger compression when segments get merged. This results in better compression, at the expense of having slightly lower compression for the very recent events. The improvement is typically 2-3 times better compression for the merged segments.
Humio Server 1.5.23 Archive (2019-07-31)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.23 | Archive | 2019-07-31 | 2020-07-31 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 11cc896c1d0f7157e63acc1b34428106 |
SHA1 | 54b32056d10f567c56dcbad58f658ad88d5f0617 |
SHA256 | 0495a5384f2759d6e1adb9ff9030f9ded72b463ac667f74481878b8f2b0df5ed |
SHA512 | 7013f12452a3f191a69630a105a171f6f496d6eca88ca8bae794d7f304669e99a296d17d1b9a9123ed97da8514f657abfa01403048412016be44f250671eb09c |
Maintenance Build
Bug Fixes
Summary
New config property: CACHE_STORAGE_SOURCE defaults to
both
, and also allowssecondary
to only cache files from the secondary storageBug Fix: Include size spent on hash filter files on disk in the cluster overview as Humio data rather than system data.
Bug Fix:
case
that assigned fields inside was not handled properly when pre-filtering using the hash filters.function
collect()
now requires the set of fields to collect.
Humio Server 1.5.22 Archive (2019-07-11)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.22 | Archive | 2019-07-11 | 2020-07-11 | 1.5.8 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 03a4585d4f91d76dcf32eb2605b2f2a5 |
SHA1 | 8b449045065f1fcac5fa4720154dd5c07b671dec |
SHA256 | dcf4c3c2646071ef7ec4e96daba79fc62b10b7d23e7afab168fdd0f1047ffee7 |
SHA512 | e455968440ae5b86d001f700616789dbfa3298cd02e769b473478bf5ff04f888b5c162d1afe5322cc35b040fdbe5d5817feaa850f26770e4f91b0928e595b78e |
Maintenance Build
Bug Fixes
Summary
There is now a
humio-query-id
response header on responses to "/query" search requests.Bug Fix: Always close everything when Akka actorsystem is terminated.
Bug Fix: Improved performance of "/query" endpoint.
Humio Server 1.5.21 Archive (2019-07-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.21 | Archive | 2019-07-04 | 2020-07-04 | 1.5.8 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 3e69e9568f9def1fe56c9772266e529e |
SHA1 | 17a1f945b825bb6220aa6cf4cf1d4675420578ac |
SHA256 | 84550bd4f356c57e37055b34f5a0fc00c25a20e08faa2d6a0f8843e029550932 |
SHA512 | dcbf18ea92afa7f5c0cbf1f41835a948e3aa0a6b2e303d1c40d8c2c8bd9c9084186e73c1a2aa76221381bf6f66872b7708e994243969273344e28fcb73b7db1c |
Maintenance Build
Bug Fixes
Summary
New function: function
dropEvent()
lets you discard an event in the parser pipeline. If a parser filters out events using e.g. a regex match that does not match the parser will just keep the incoming events. Use this new function (typically in acase
) to explicitly drop an event while parsing it when it does not match the required format.If an events gets
@error=true
in the ingest pipeline (including in the parser) it will also get#error=true
as a tag. This makes events with an error become a separate datasource in Humio allowing you to delete them independent from the others and makes problems from parsing timestamps not disrupt the pipeline when back filling old events.
Humio Server 1.5.20 Archive (2019-07-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.20 | Archive | 2019-07-04 | 2020-07-04 | 1.5.8 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 6e7fc0c55dcb7e983c3e9ed01fe2a998 |
SHA1 | bee0844d369a237d7ce7da118806be97bb1fab83 |
SHA256 | d647ba881452c4905e44894168461f389bce43e9aa93c58d719f1ec9de62dd13 |
SHA512 | 4631ea0f892c5a6044a7c0b008b1350ce2d3408883e73fb3d357bb4f9920c762efbcf7efbb26b1fa3bb5577c327f260c243371c6a367d566ed0dc48794600499 |
Maintenance Build
Bug Fixes
Summary
Bug Fix: "services" is no longer a reserved repo name.
Humio Server 1.5.19 Archive (2019-07-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.19 | Archive | 2019-07-03 | 2020-07-03 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | fa9d61d17a037583bbe067a4aab64ab3 |
SHA1 | 1793534d22cfc53c5b15dde0dc60d008ad9c9204 |
SHA256 | 6e21cd3874a948a3ddf3554911c3104e60a2ca33e8e4a039755eca42c03e1508 |
SHA512 | ec09a60164c981970b20fd401140a5dac2e3814f6e1254c3472721ace2db957b92f9035b8833436008054220385b55e1e83b93f6b1547842c289a0194522913c |
File based parameters on dashboards. This release makes it easier to configure load balancers by adding sticky session headers to most UI Http requests.
Bug Fixes
Other
Make failover to the next node in digest when a node gets shut down gracefully faster by delaying the shutdown a few seconds while letting the follower catch up.
Improved performance on servers with many cores for functions (such as top) that may require large states internally.
The HTTP request header Humio-Query-Session is now added to most requests from the UI.
New shared files. Shared files can be used like the existing files, that are uploaded to repositories. A shared file is visible in all repositories and can be used by everyone. Only root users can create and manage them. For now, shared files can only be added using Humio's Lookup API. Shared files are visible in the files tab in all repositories for all users. Root users can also edit and delete shared files there. Shared files can be used from query functions like function
lookup()
and functionmatch()
they are referenced using the path /shared/filename.Bug Fix: Fixed Interval Queries on dashboards used the time of the dashboard being loaded as the definition of "now". It will now use the time of the last change in the dashboard's global time.
New type of parameter: Dashboards can now have file based parameters, which are populated with data from files uploaded to Humio
Humio Server 1.5.18 Archive (2019-06-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.18 | Archive | 2019-06-26 | 2020-06-26 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | c4d0166d229209681cd23f4d34ce0e75 |
SHA1 | 23aeac090b6069258d168f235d025d497baf6147 |
SHA256 | db78a9fdc47bc3f3687e758c9e1dc5c13c14525626199568889226121eca4629 |
SHA512 | a8b66956d7d58a6bba71884ea01c91fea88d96b1c58ff9ba63a0f111da84f270e8bee16e87e1148415635425704472a5d4156b4300b1d7bb58ddd96091cdee49 |
New function parseXml
and support ephemeral
drives for caching.
Bug Fixes
Summary
MAX_EVENT_FIELD_COUNT
(default .0) controls the enforced maximum number of fields in an even in the ingest phase.Bug Fix: Parameter input fields for query based parameters initially always showed
*
even when a default value was set. It now correctly shows the default value for the parameter.New built in parser
corelight-es
to parse Corelight data send using the Elastic protocol.Bug Fix: Certain regular expressions involving
^
and$
could fail to match.Bug Fix: Reduce size of global snapshots file.
Humio can now keep a cache of the latest files on when told the path of a cache-dir using
CACHE_STORAGE_DIRECTORY
. Humio will then write copies of some of the files from primary and secondary storage here, assuming it is faster to read from the cache. The cache does not need to remain after a restart of Humio.CACHE_STORAGE_PERCENTAGE
(Default 90) controls how much of the available space on the drive Humio will try to use. This is useful on system such as AWS where the primary data storage is durable but slow due to being across a network (e.g. EBS) while the server also has fast NVME-drives that are ephemeral to the instance.New function
parseXml()
for use in parsersRemove configuration flags: REPLICATE_REMOTE_GLOBAL_HOST and REPLICATE_REMOTE_GLOBAL_USER_TOKEN
Humio Server 1.5.17 Archive (2019-06-20)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.17 | Archive | 2019-06-20 | 2020-06-20 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d40aa67958efee188fbbd801389ca6a0 |
SHA1 | 912ff791cc76312bdc3c3e72877e9872b0cebca7 |
SHA256 | 45a48f7cdb99d4e08f95f1ef6802ecf730e8ae997b23ad1ba6f2f1e5fec14e91 |
SHA512 | ce51829c5152bed8c2d67581239365c4055ddc038545f20877c6a1d499aca6f69b920bc006d2499659194d0b4bf1ebdef7be7d55262318620dd73ee76c8d822b |
Maintenance Build
Bug Fixes
Summary
Bug Fix: Updates to repos with reserved names on legacy repos did not work.
Update BitBucket OAuth integration to version 2
Humio Server 1.5.16 Archive (2019-06-11)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.16 | Archive | 2019-06-11 | 2020-06-11 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 1ae08e9fa6216dd50b413b0b733054d3 |
SHA1 | 9da479f33fa955645eb6f8c048a335dee59ff5a8 |
SHA256 | a5738bb660340e67570f673652c49efc2b6e9e4281ddab1c2bc6fdd242418644 |
SHA512 | b96b45050e0cb5d0a1b90968bf22b2bc8ee746076a266f147802b33f920cbac73dc2d5418ff86ed672411758c304fe4d387bb1bdc8c068594acda682fd66ec5b |
Maintenance Build
Bug Fixes
Summary
Bug Fix: Invalid parser no longer prevents ingest token page from loading.
On Windows, the Ctrl+O shortcut no longer opens the "jump" menu on the home page, but Ctrl+Y does instead, to avoid conflicts with browser shortcuts.
Bug Fix: Ability to read global-snapshot.json when the file is larger than 1GB.
Humio Server 1.5.15 Archive (2019-06-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.15 | Archive | 2019-06-06 | 2020-06-06 | 1.5.8 | Yes | No |
JAR Checksum | Value |
---|---|
MD5 | ad5393b90a76798037d974eb15274170 |
SHA1 | a39f7d6a55a9e20d35a76cc77d1593e733f82fa0 |
SHA256 | ef07ed1498a14912ae33c438dbce446bd3c515598b56a53590bb28e0da764eac |
SHA512 | 35d8cf32cfffc01456fea778186098acc17fadd6003ca910eca6165c6113cbd5ad9a68a5fcd52a9ab9934a51bc3e9175f1f139a5b400e4249cfcd7f2b7faddda |
Dashboard Improvements and Bug Fixes
Bug Fixes
Summary
Bug Fix: Regex with
[^\W]
did not execute[\w]
as it should.New config: VALUE_DEDUP_LEVEL default to the compression level. Range is [0 ; 63]. Higher values may trade extra digest time to get lower storage of events with many fields.
Dashboard parameters with fixed list of values can now have labels for each of the values
Dashboard parameters with fixed list of values now keep the order they were configured with
Humio metrics have now been documented.
New function eventFieldCount() that returns the number of fields that this event uses internally for the values, use along with eventSize() to get statistics on how your events are stored.
Humio Server 1.5.14 Archive (2019-05-29)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.14 | Archive | 2019-05-29 | 2020-05-29 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | a04ea786b04438c4028a880948ab4ac0 |
SHA1 | 8d82c939347c1a28e46efa5605b5592e5b25824d |
SHA256 | edc162b7dcd604948cca55d924838754ca0162e3d5d97ba26a5e8cfd0df512b2 |
SHA512 | 30935d7230af57de26beb316a5d7c79a35a01d23e41dc4a5d06268910a7aa95535e1f7fbe88448a9f504e7e9a2c97fd43bfa0f90e4ce2a12c1976e5250a0999a |
Improved Pre-Filters
Bug Fixes
Summary
`cidr(): When file and column` parameters are used together, load subnet list from given CSV.
Bug Fix: When an alert fails to send the notification, don't restart the query, just retry the notification later.
New config: BLOCK_SIZE_MAX_KB defaults to 1024. Select maximum target block size for data files, in KB.
New config: BLOCK_SIZE_MIN_KB defaults to 384. Select minimum target block size for data files, in KB.
New config: HASHFILTER_FILL defaults to 30. Sets the target number of percent bits to be set in the pre-filters. (Range 10-.0).
The format of the new
hash5h2
files is different from the previousbloom5h1
and the system will generate new files from scratch for all existing segment files and delete any existingbloom5h1
file.Improved pre-filters to support more searches while adding less overhead in disk space.
The disk space occupied by the pre-filter files now get included when enforcing retention by compressed size.
Humio Server 1.5.13 Archive (2019-05-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.13 | Archive | 2019-05-27 | 2020-05-27 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 894e1bbdc1a57f2f0b46c162f42c3f46 |
SHA1 | ba223177715e7090610100557f0929eb9c628ac0 |
SHA256 | 5eb2a227ca5964915ebdd96bce5ae7bb0adb611e983714459440685ab45c86b6 |
SHA512 | 07a7237614c98045b72e5dffc3cb5d480adbf7b62747e9932e1599579128b205c9a80cf73983ea2c724dab0a9ba0d2226c84b9cffdbb45ab9e7bdb4eb938d623 |
Metrics are now send to a separate file humio-metrics.log.
Bug Fixes
Summary
Fix some cases where parameters would not be picked up by the UI because of regex or string literals in the query.
New log file humio-metrics.log. Metrics data has been removed from the humio-debug.log and moved to humio-metrics.log. Metrics will still also be in the default Humio repository. If you are collecting the Humio log files, with for example Filebeat, you need to add humio-metrics.log to the collector.
Humio Server 1.5.12 Archive (2019-05-20)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.12 | Archive | 2019-05-20 | 2020-05-20 | 1.5.8 | Yes | No |
Value | JAR Checksum |
---|---|
MD5 | a560cb0ce83c1809b9a5058b69591d7e |
SHA1 | b631299178941b9b104a35c5d446942b183889ec |
SHA256 | de58549b4e0b8cc5e1f57c75592259cea90eb022f280f422f1bcb8bdd7068c6b |
SHA512 | 58c40dae601d284b1a4c4fdf19629955c19c74abcb186aec61a8ce1f3c192909c21503f4eec8fc17ede7238f473e497dfe32b24a4e1a6a4c36902cf1ae4c4c0f |
Parameters can be used to make dashboards and queries dynamic.
Bug Fixes
Summary
URLs now contain parameter values making it easy to share specific dashboard configurations.
You can now use the syntax ?param in queries. This will add input boxes to the search and dashboard pages. Read more in the Dashboard Parameters documentation.
Parallel upload of segment files to S3. Degree of parallelism can be controlled with e.g. S3_ARCHIVING_WORKERCOUNT=4. Default is 1 if nothing is specified.
Humio Server 1.5.11 Archive (2019-05-16)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.11 | Archive | 2019-05-16 | 2020-05-16 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 4f01eabfd30739ac228e423a5f51582f |
SHA1 | e7c174433f19fbe81a13f6e7b2b8d849c480d22b |
SHA256 | e2eb4d827bd1a1a67923c30a535d8b968f4574c9bbf59bfc84c8a2fcfbccaec2 |
SHA512 | 952f9de0089c9528accfee959951a54ef400a3ce49d37d1666234a7ec3f1d9de1e7e164d8ff101e461e62f31faf4331575e63eb2fc4b54484bb9f6d9267e8bb2 |
Bug Fix Release
Bug Fixes
Summary
Named groups in regular expressions supports having
. [ ]
in their names.Moving segments to secondary storage can no longer be blocked by merging of segment files / s3 archiving.
Bloom filters are now always on.
Humio Server 1.5.10 Archive (2019-05-13)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.10 | Archive | 2019-05-13 | 2020-05-13 | 1.5.8 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | 1b828fd0d80aa3c80aa9f1d4bba0dbd6 |
SHA1 | 998c039c894acdbe30d83efa414428ab77de2d7e |
SHA256 | b18d7b1844f4482f0e1aa8afe7e67ad1bf06e8bb5f40faebe9179c49dc72a412 |
SHA512 | cb3efdf806231d2f3d71d378054e7513eed3bd73ccb445159f8232da4df14bae1f1165bde27d5536554f178dbcde3973d2d64e2f33271247e734cc3d6b88fd3f |
New bloom filters, but please upgrade to 1.5.11 to avoid known problems in this build.
Bug Fixes
Summary
The bloom filter files will be generated as part of digest work, and also generated for "old" segment files when Humio is otherwise idle. Thus, when the feature is initially enabled, it will be visible that the CPU load is higher for a period of time.
When enabled, this will write files along with the segment files with prefix
bloom5h1.
, which add approximately 5% storage overhead.It is safe to just delete any
bloom5h1.
files while the system is running, or in case the feature needs to be disabled.New experimental bloom filters that speed up searching for constant strings such as UUIDs and IP-addresses; the longer the search string, the bigger the speedup. The bloom filters also help regular expression searching, including case insensitive ones.
MUST be enabled with BLOOMFILTER_ENABLED=true (Note! defaults to
false
in this release, which makes searches skip events they should not).
Humio Server 1.5.9 Archive (2019-05-06)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.9 | Archive | 2019-05-06 | 2020-05-06 | 1.5.8 | No | No |
Value | JAR Checksum |
---|---|
MD5 | b6dc38838aac82596ea8eebf294b9a97 |
SHA1 | ca35bf05425265706467adc415c8ff558bad12f9 |
SHA256 | 4d0af39687972dc6bb476928edf9c0b10d956336a564d0a828b8e036174e1da5 |
SHA512 | a2b8e9512fc287c8ff3f2d40a734d5bab872ccedf995bdeeb8a3fc900169a7d1bfaa85a6a30e43e0272ea97bf3e3f44e6f397535818e6e7b1fac15ca0ced98d2 |
Bug Fix Release
Bug Fixes
Summary
Bug Fix: Alerts with multiple notifiers could result in notifications not adhering to the configured notification frequency resulting in notification spam.
Bug Fix: Default filters in dashboards could cause search to not find anything.
Add information on query prefixes to the Query Monitor. When inspecting a running query in the Query Monitor the query prefix can now be found in the details pane.
Bug Fix: Enable
sourcetype
field in the HEC endpoint to choose parser (unless another parser is attached to the parser token).
Humio Server 1.5.8 Archive (2019-04-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.8 | Archive | 2019-04-25 | 2020-04-25 | 1.4.x | No | Yes |
Value | JAR Checksum |
---|---|
MD5 | 4898c50c07b21c557e16f9ecb0525b64 |
SHA1 | 6f7de5e75418ab04752927081ac4af0156b78df9 |
SHA256 | 449c36c1b9cf793db02250e1d089594491fde458f46b33b2b4b2967ef7e0bef7 |
SHA512 | d382620aa86df5fc7d24977d6097f1d40829e5b1c5cce5431ce6110ca256be99a636bdb1d5b0d322fee1cc784d55f7b4cc12ae78da059b4089cbb9739494e7e0 |
New dashboard editing code and many other improvements
Bug Fixes
Summary
Validation of bucket and region when configuring S3 archiving.
Humio's own Jitrex regular expression engine is again the default one.
Bug Fix: Alerts notifiers with standard template did not produce valid JSON.
In tableview, if column data is of the form
\[Label](URL)
it is displayed asLabel
with a link to URL.Bug Fix: Built-in audit-log parser now handles a variable number of fractions of seconds.
Bug Fix: parseTimestamp() now handles dates, e.g. 31-08-2019.
The Auth0 integration now supports importing Auth0-defined roles. New config
AUTH0_ROLES_KEY
identifies the name of the role attribute coming in the AWT token from Auth0. See new auth0 config options <https://library.humio.com/stable/docs/security/oauth#mapping-auth0-roles>__.S3 archiving now supports forward proxies.
config property
KAFKA_DELETES_ALLOWED
has been removed and insteadDELETE_ON_INGEST_QUEUE
is introduced.DELETE_ON_INGEST_QUEUE
is set totrue
by default. When this flag is set, Humio will delete data on the Kafka ingest queue, when data has been written in Humio. If the flag is not set, Humio will not delete from the ingest queue. No matter how this flag is set, it is important to configure retention for the queue in Kafka. If Kafka is managed by Humio, Humio will set a 48hour retention when creating the queue. This defines how long data can be kept on the ingest queue and thus how much time Humio has to read the data and store it internally.Dashboard queries that are not live and uses a timeinterval relative to now, are migrated to be live queries. Going forward, queries with timeintervals relative to now will be live queries when added to dashboards.
@source and @host is now supported for Filebeat v7.
Humio Server 1.5.7 Archive (2019-04-10)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.7 | Archive | 2019-04-10 | 2020-04-10 | 1.4.x | No | No |
Value | JAR Checksum |
---|---|
MD5 | 5ed44bb802f54fc03ea606da0e5d2afe |
SHA1 | d3c3d7705366851dfa019214c3cf2b653914c7f2 |
SHA256 | 41d0da3dd48732136ae245209cb549946e46f31ff0bca9a2fd37d2d9c73b05f4 |
SHA512 | f07ac6a204637973c64f830082245475b7ec3b6dfe01eb98d63a68adaa5f352a0c4647ec189cbc12f543c50e093d63475377031b869538be076c097394a853dc |
Bug Fix Release
Bug Fixes
Summary
Temporarily disable deletes of events from the ingest queue to allow recovering events skipped in the queue due to the above infinite loop problem.
Bug Fix: Revert default Regex engine from jitrex to RE2J. jitrex has a case where it may loop infinitely and this will break the digest pipeline if this happens in a live query.
Humio Server 1.5.6 Archive (2019-04-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.6 | Archive | 2019-04-04 | 2020-04-04 | 1.4.x | No | No |
Value | JAR Checksum |
---|---|
MD5 | 614a06c67d4e93e1a3f2083ce5cfe4c0 |
SHA1 | 57d3259a0469703caa38975a0be19062f0954e57 |
SHA256 | e410583413293132f0e6f09884c3387282892b31164c77472cb0f4343f4d6ec6 |
SHA512 | 0a00735576c700ee063824ead2845452cbf1f00530014be127d13cb7da89a55143d64192755b00e3039f175cc64985cad736cd9dbe08f54005163f43008c1a1c |
Bug Fix Release
Bug Fixes
Summary
Bug Fix: LDAP integration.
Humio Server 1.5.5 Archive (2019-04-03)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.5 | Archive | 2019-04-03 | 2020-04-03 | 1.4.x | No | No |
JAR Checksum | Value |
---|---|
MD5 | 39a4777bd2dae7d69177426d063dc6df |
SHA1 | 6d27f9ae18dbcb49bfc37f7c014db93f331652ea |
SHA256 | e3ec14f8cbc6d78c4beede209fe4be958e5c727fe3a7fcb2d7919afc81c3c85d |
SHA512 | 7d3c645974227a9e9dfd8ea261923f516b626d02eea73ab5bd7fdccd3bfdfbfab7f05e37abe49019d7a0ff97bd3824646e4de1ff8f587fdbf3623bed77c9da42 |
Event Context
Bug Fixes
Summary
Uploaded files cannot be bigger than specified in the config MAX_FILEUPLOAD_SIZE. Default value is .0 megabytes. The default value is used in our cloud.
Restart all relevant queries when an uploaded file gets changed. This allows live queries and alerts to refresh using the latest version of the file.
New event context searches let users select and search around one specific event.
Bug Fix: Fix bug in regex not recognizing
[0-9]
as part of\w
New configuration keys: MAX_SERIES_LIMIT and MAX_BUCKET_POINTS.
A GET on
/api/v1/users
that lists all known users on the system no longer includes information on the repositories for the user, as that made it too slow.Bug Fix: Segment merging could reuse a tmp file when the system was restarted, which would block the merging process on that host from making progress.
Display information on disk space usage of primary / secondary storage location in cluster management UI.
The size of the Drawer, showing event details on the search page, is remembered (by being saved to local storage)
Bug Fix: Live timecharts could accumulate data for 2 buckets instead of 1 into the bucket that was right-most when the charts starts.
Humio Server 1.5.4 Archive (2019-03-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.4 | Archive | 2019-03-26 | 2020-03-26 | 1.4.x | No | No |
JAR Checksum | Value |
---|---|
MD5 | d3c301554f98e7540728d412b6452e49 |
SHA1 | c172bf5c456df3ded1e08f37f232b0ea7fbf96eb |
SHA256 | d4b23822b1a63846913dbd9421cfc3a7d937af4c3b3d17262b3674e5a4a99a16 |
SHA512 | 82a2f80540e623f05eab2219cf79283f406255b18ae10083de1eecf30038ab8b413d497138c1cfa6c758978c490cbfbc21b3e4abc63e19c1d3bf47c8f1625fb9 |
Bug Fix Release
Bug Fixes
Summary
Bug Fix: Query scheduler could get into a state of doing no work when overloaded during startup. Workaround while working on proper solution: Raise the queue size internally.
Humio Server 1.5.3 Archive (2019-03-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.3 | Archive | 2019-03-26 | 2020-03-26 | 1.4.x | No | No |
Value | JAR Checksum |
---|---|
MD5 | 64439aad4fb74f03ab9cf140de039d2e |
SHA1 | 16f55ee1018400f92aec8fd0330e54b81077d4dd |
SHA256 | 6acb0265a88ee250390a1021db382724148e8b09a7738fa7c948fd6f95d06870 |
SHA512 | 9705984865b1852aff9b4237d391ea94b40e0cee972e1ed82fc4e5b9f84a08a69e71bfd5614ad2b141479ff1b1b50523ab1ef9e7b05c5ce31eb6a35d51f40c96 |
Bug Fix Release
Bug Fixes
Summary
Bug Fix: Webhook request could end up with malformed requests.
new Config flag WARN_ON_INGEST_DELAY_MILLIS. How much should the ingest delay fall behind before a warning is shown in the search UI. Default is 30 seconds.
Humio Server 1.5.2 Archive (2019-03-25)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.2 | Archive | 2019-03-25 | 2020-03-25 | 1.4.x | No | No |
JAR Checksum | Value |
---|---|
MD5 | 5df6f461a9703cdf6ae3095f73502e53 |
SHA1 | 5400b067c8e7c56b1febc4ed4903e62499f83470 |
SHA256 | 8814989d98be9aa7b53ddcdeaffa394056ca70c08edf6c5e2cdcf05a4db21c86 |
SHA512 | de757392b3ae568ed348af4bd0153ebc76b15e4f2b16a540f9af756235479f833b0a8f1d92cd3a87ea011dded75841f1dea91f1d15675ec7c465cc6db32f637d |
New functions for Math and Time operations.
Bug Fixes
Summary
Bug Fix: Query prefixes for users were not properly applied to the "export" api.
New functions for "Math" and "Time" operations.
Bug Fix: Repositories with names starting with "api" were inaccessible.
Bug Fix: Date picker marked the wrong day as current.
Java version check: Allow JDK-11 and 12.
Humio Server 1.5.1 Archive (2019-03-22)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.1 | Archive | 2019-03-22 | 2020-03-22 | 1.4.x | No | No |
Value | JAR Checksum |
---|---|
MD5 | 669f2e0e026ac5ce1ada07221cbd2397 |
SHA1 | 9157d3100b8c35d1c36ef03323aa1431de11b0d4 |
SHA256 | 846f0de0235cf4835e5da75853d4fbc069ad6d0fb2c74bafda3a0d471e1041c7 |
SHA512 | 5e27430929861a3ef0c3aea3accc88d7b57b8ac133d87dd1757cbc8ed88cb3914a93592c368886eed2b938c576d81099ee97fa60a79118fb4f6d120060dbb705 |
The default regex engine has been replaced.
Bug Fixes
Summary
Bug Fix: Kill query or blacklist query was not always killed on all nodes.
New implementation backing
match(...)
for exact matching (glob=false
) allows using.cvs
files up to 1 million lines. The limit for exact match state size can be set usingEXACT_MATCH_LIMIT=.0.0
No owls were hurt in the production of this release.
Timechart more efficient in the backend, better supporting more than 1 series.
New regex engine (Humio jitrex) is now the default; configure using DEFAULT_USER_INPUT_REGEX_ENGINE=HUMIO|RE2J. If you experience issues with regular expressions try setting configuration back to the previous default RE2J. You can also pass the special flags
/.../G
(for Google re2j) or/.../H
(for Humio jitrex) to compare.
Humio Server 1.5.0 Archive (2019-03-15)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.5.0 | Archive | 2019-03-15 | 2020-03-15 | 1.4.x | Yes | No |
Value | JAR Checksum |
---|---|
MD5 | c3615501d40a6cb19301c26174548841 |
SHA1 | 0cb80023e27a2e43e6b0281711ed4483e1415caf |
SHA256 | 5ec7ad5370a1768d886885ecf118ea6bcd09af362175011521e1209308ab35b6 |
SHA512 | f5e5d71332d774f87e13143b458707c1ddbf114901292c4b1cbdef27844f0c6e7460afde36c6fa0f5e638c6251b908fcae3b22bcb908506726824399d568b78c |
All parsers are now written in Humio's query language.
Bug Fixes
Summary
Bug Fix: Non root users could not see sandbox data when using RBAC.
Migrated regex parsers with the option 'PARSE KEY VALUES' enabled has different parse semantics. If the regex fails key values will no longer be extracted.
New BETA feature: Delete Events allows deleting a set of events from the internal store using a filter query and a time range. At this point there is only API (Graphql and REST) for this but no UI.
The option 'PARSE NESTED JSON' on the old json parser creation page is no longer available/supported. Instead use parseJson on specific fields, e.g. 'parseJson() | parseJson(field=foo)'. This has to be done manually for migrated json parsers!
All parsers created before the introduction of parsers written in Humio's query language are migrated.
Bug Fix: permission for editing retention when running with ENFORCE_AUDITABLE=true.
Humio Server 1.4.9 Archive (2019-03-13)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.9 | Archive | 2019-03-13 | 2020-03-13 | 1.3.2 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 658abeee302dd14ad05a2b7d50ca5a6a |
SHA1 | c5bf3e514152899299880a77faf08fb7bb0595d8 |
SHA256 | dc48a0753a3113ced36f67fd91814735ba31f01cf51cdd6cd4ab31614460acb0 |
SHA512 | fa0f2732aaca9ad7bfde148270547efeec8da6a1d237c88d5d315e25269666054fb0ef76e08d2cfbebef5a29b460a947d75d3994f18c9e0bf0676d226b16fffd |
Bug Fix of retention not working.
Bug Fixes
Summary
Bug Fix: white space in field templates in alerts.
Increasing AUTOSHARDING_MAX default from 8 to 16 and start autosharding at 4 instead of 2,
Bug Fix: Retention was not applied to all segment files in a clustered setup. The bug was introduced in 1.4.4.
Bug Fix: Prevent labels in gauge widgets from being clipped.
Humio Server 1.4.8 Archive (2019-03-11)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.8 | Archive | 2019-03-11 | 2020-03-11 | 1.3.2 | No | No |
JAR Checksum | Value |
---|---|
MD5 | b4757d785261fc262a3d618296d690d1 |
SHA1 | 1dc9f2712b87567e40889262da8095086e060d6a |
SHA256 | 0eed830ffdd0ae4bfbacf5f2627a29104a0928e1e3b6635553cf841cef5f0aa2 |
SHA512 | 0950bc904e0b80b501c4fca4ee8634db2ca9fcca4fd9154e77dd8c223e867e754d1147b9013434cf15566d5fe21ccfe6056416d1ecf6d242a974141f88673acd |
Bug Fix Release
Bug Fixes
Summary
Bug Fix introduced in last release for handling error messages
Bug Fix create default directories in the Zookeeper Docker Image
Humio Server 1.4.7 Archive (2019-03-07)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.7 | Archive | 2019-03-07 | 2020-03-07 | 1.3.2 | No | Yes |
JAR Checksum | Value |
---|---|
MD5 | d09b1e4945cff155ce459cdd293bb4e9 |
SHA1 | d44e10514f3c9b1e46c9b3ccaef5f9418226b4e1 |
SHA256 | bd950358b9eb8f20269ee2823fd579a856c535237d49002891f6f9455c117fd7 |
SHA512 | f3b838a1c2b284467b99e395963685e47ca57a2c774c8a77ef3b51878fece9a8d6dd5371818f9897c6f591996a50f158a233b9cf511ce3167bd887047f4aec92 |
Saved queries allowed in case
and
match
.
Bug Fixes
Summary
Upgraded to Kafka to 2.1.1 in our Docker images and the Java client in Humio. Humio is still be compatible with older versions of Kafka. Lowest supported Kafka version is 1.1.0.
Humio now requires Java version 11. The docker images for Humio now include Java 11. If you run the "plain jar" you must upgrade your Java to 11.
Improved handling of the "Kafka reset" aka "Start from fresh Kafka" aka "Set a new topic prefix". Humio detects and properly handles starting after the user has wiped the Kafka installation, or pointed to a fresh install of Kafka.
Saved queries now supported in
case
andmatch
.
Humio Server 1.4.6 Archive (2019-03-04)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.6 | Archive | 2019-03-04 | 2020-03-04 | 1.3.2 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 8cf206c7d6972c1268f9b01d78b231a7 |
SHA1 | b2b550a80c08715ee6a5f073612e05da7e16468d |
SHA256 | 38aaad962f12cd6d3bc44d0d2467cd9c8e6d12568f9fbe2cd527fbfa23895968 |
SHA512 | f078c07a386aa88ac910f198d81fd6d8d230c5e5e3b205afad6a29741ab1a4e6cb918828d8e2e1fe16e8c3e705705b6eeab5d0cfce17740367ba97b8d0804fe4 |
Bug Fix Release
Bug Fixes
Summary
When
@timestamp
is in the filter part of the search then let that limit the timeinterval as if selected in the time selector.Bug Fix: The personal sandbox was missing in list of visible repos for non-root users when READ_GROUP_PERMISSIONS_FROM_FILE was enabled.
Bug Fix: Prevent 'http response splitting' attack in the "export as" function.
New config: ENABLE_PERSONAL_API_TOKENS defaults to true. When set to false the API tokens are no longer valid as auth-tokens.
Humio Server 1.4.5 Archive (2019-02-27)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.5 | Archive | 2019-02-27 | 2020-02-27 | 1.3.2 | No | No |
Value | JAR Checksum |
---|---|
MD5 | a40c7e599b3e4fafc887ef8712552f70 |
SHA1 | 61f99d83c67f6a8d993f5bb13ca5f59887f85358 |
SHA256 | 5af2499bd32943ccdc3377b609b244ebf87c32e5c4d4d2c632dc2e7ee1921c3f |
SHA512 | 21f1a835d97f96347b0480b3a9b122cf7ff2a6e2cab7ad0a47b00d8b36ba3a24dafd78d34ee2404659388bbbf319ca066ce47cee7aa2048037fd03a475324c3f |
Bug Fix Release
Bug Fixes
Summary
Bug Fix: Shutdown of digest had a timeout of 10 seconds internally, which could lead to being dropped too soon while shutting down or restarting. This could result in ingest lag rising to over .0 seconds, where the expected lag is the time from the shutdown is initiated until a fe seconds after the new instance is started. There is a new config SHUTDOWN_ABORT_FLUSH_TIMEOUT_MILLIS which defaults to .0.0 millis (5 minutes) to allow proper shutdown also on systems with many datasources or slow filesystems / disks.
NODE_ROLES being applied in more background tasks.
Bug Fix: Timechart in "steps mode" now displays the the the right of the label instead of to the left, which matches the fact that the labels are the start time.
Many background tasks now get executed only on hosts with segment storage partitions assigned, and the hosts use the storage partition assignments as the key to decide which hosts must execute the tasks, thus freeing up resources on the other hosts.
Humio Server 1.4.4 Archive (2019-02-26)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.4 | Archive | 2019-02-26 | 2020-02-26 | 1.3.2 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 03050687bddbd6ffe56830ed84f827e4 |
SHA1 | f1f9cabbcbddb014e4aef0f8e1869fbbd8c60c8d |
SHA256 | 8ab6c51081d0b918de61340f7a6d241f740b3ec77ae9d3a7517805c925412af3 |
SHA512 | 718e7abf3b89076d07bc36c89606b9a72cc5b7c15432550b903931172ce6fca323aff85a0feecc4e1de5de5a02cc7ccb099c79166d59376ca8dc5dee78c8f2ee |
Bug Fix Release
Bug Fixes
Summary
Bug Fix: Having timezone offset larger than the span in a timechart could result in errors.
Bug Fix: On a cluster with many segments and a node with no segments, the cluster administration page could time out.
Bug Fix: Making a repository or view a favorite failed on recently created items.
Bug Fix: Repository statistics displayed on frontpage were out of date on servers without any digest partitions. This also made the search page display the warning "You don't have any data yet, consider the following options..." when searching until a result of the search was returned.
Detect if a host in the cluster is being set to have the same vHost index as this host, and exit in this case.
Humio Server 1.4.3 Archive (2019-02-21)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.3 | Archive | 2019-02-21 | 2020-02-21 | 1.3.2 | No | No |
JAR Checksum | Value |
---|---|
MD5 | fb4d7742cb6418b51024f84bb61f9346 |
SHA1 | 6ba6f2f9636a28db9c4b882e07df356e2c255f6b |
SHA256 | 440bc3d0321042007c8b0c3749d93175e15d554dae66c1863495bb7464a9dcc4 |
SHA512 | f7a5c820e7482889371217d32faabda602f31389242876b5f7e49a2a8081804707b4013be6dd3323da03b3518aa852cb88c2820ebc44732fbb26330b03102436 |
Improved restart of live queries.
Bug Fixes
Summary
Humio's UI is programmed in Elm and we upgraded to use Elm 0.19.
New config option: NODE_ROLES with current options being "all" or "httponly". The latter allows the node to avoid spending cpu time on tasks that are irrelevant to a nodes that has never had any local segments files and that will never be any assigned segments either.
Improved restart performance to better support restarting (or upgrading) the servers in a large cluster with large amounts of data.
Restart live queries if their query prefixes change when using Role based authentication and access control (RBAC).
Remove migration from internal data formats older than what v1.3.x writes. Do not start this version without having upgraded to 1.3.2 or 1.4.x first.
Humio Server 1.4.2 Archive (2019-02-19)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.2 | Archive | 2019-02-19 | 2020-02-19 | 1.3.2 | No | No |
Value | JAR Checksum |
---|---|
MD5 | cf5177de7c89a5c02121d29b4d359dab |
SHA1 | 08fc9b230423eb1abde2f8f3c43c6c06e230b457 |
SHA256 | 4cfef752ca7286a2cbb91e33ca7619488c06e59079640f7f8f2fd11779066b11 |
SHA512 | 2997e1f2a5ea57ce2e7b8ce2c360e113f9dfa2a983abb2e02bcab8e555591783cf7b7b29f4f567bb0531aa83136daa98461b3b4b8cf217d22eb8f4fa8fe513fa |
Minor release. Improve restarting of queries and Ingest listener performance.
Bug Fixes
Summary
Bug Fix ldap authentication code.
Humio Server 1.4.1 Archive (2019-02-18)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.1 | Archive | 2019-02-18 | 2020-02-18 | 1.3.2 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 78e0cf1a91b21be2f13f92f4551c212a |
SHA1 | 4f0dc81ffd99d0a7802f2a5f4a1cc492646a5ffc |
SHA256 | 68b99a2998f50c77c91f098e5d033347ab51912e8c639751a6012b29559abd5e |
SHA512 | 1d877446dba301b5e39d723b2e58a88edba98bc46d7c969821adf2db32ae115ef46b90f1ce3d2b0ddfc7df6aa75e5d5f3042e59840007d03c2433197f9c6de87 |
Minor release. Improve restarting of queries and Ingest listener performance.
Bug Fixes
Summary
Improved restarting searches when a node go away.
Improved Ingest listener performance. One socket can more throughput than before.
Humio Server 1.4.0 Archive (2019-02-14)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.4.0 | Archive | 2019-02-14 | 2020-02-14 | 1.3.2 | No | No |
JAR Checksum | Value |
---|---|
MD5 | fb0290d5203f178cfbbef8df7b89106a |
SHA1 | 7e2f17d867734264c91c697849884bb530fbc450 |
SHA256 | cce65b639ab277dd50cf29f2d53ff119d705c64d33a4a118b8e49b899d8dd27c |
SHA512 | 7cfad54614ef63f35fe6d3cc50d2239650845b390e0aea63f1e2e199745a68854524fdb24cad5f59867339cbe0eb2432bd904cef7e7a90e9b115d5abe6f1a52a |
High availability for ingest and digest.
Bug Fixes
Summary
Digest partitions can now be assigned to more than one host. Doing so enables the cluster to continue digesting incoming events if a single host is lost from the cluster.
Bug Fix: Clone existing dashboard when creating from the frontpage was broken.
Limit match/lookup functions to 20.0 rows or whatever "MAX_STATE_LIMIT" is set to.
Emphasis is on efficiency during normal operation over being efficient in the failure cases: After failure the cluster will need some time to recover during which ingested events will get delayed. The cluster needs to have ample cpu to catch up after such a fail-over. There are both new and reinterpreted configuration options in the config environment for controlling how the segments get build for this.
Segments are flushed after 30 minutes. This makes S3 archiving likely to be less than 40 minutes after the incoming stream.
If rolling back, make sure to roll back to version 1.3.2+
Humio Server 1.3.2 Archive (2019-02-12)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.3.2 | Archive | 2019-02-12 | 2020-02-12 | 1.3.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | 78600bc158479cc9f830aa5091a2e5b2 |
SHA1 | ae23e67395282d4d639a074e38e83194d7830a6d |
SHA256 | 22756db5d14705888e67f6dc0d70bd42e55af29e72dc33511e405139a637c0d7 |
SHA512 | bd64769af08191c2fb79bd332b891c38adf6484d56b211768efadb952b94b666bad30abd484514c2d49420d2c8fd944cc571491f4f04fdac7036cac0aba27434 |
Allow an alert to have multiple notifiers, e.g. both Slack and PagerDuty
Bug Fixes
Summary
Bug Fix: Bar charts got incorrect height.
Allow an alert to have multiple notifiers, e.g. both Slack and PagerDuty.
Bug Fix: HEC ingest of array of numbers fixed.
Bug Fix: Sandbox permissions for the owner of the sandbox.
Humio Server 1.3.1 Archive (2019-02-08)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.3.1 | Archive | 2019-02-08 | 2020-02-08 | 1.3.0 | No | No |
Value | JAR Checksum |
---|---|
MD5 | d4a36b05d6937062d63eb86bc4b8c605 |
SHA1 | c1cb90603d98ea824f0b86a8fa1e6d8763023533 |
SHA256 | 513759afc48f71d35a23c3ab6bf9bace08737175ab721aef4bb4c658f23ffd72 |
SHA512 | e911929e8e2cbf0bbf0727735d8ce36b265b0f5a664dc1f1e6a70fc36740998dbc217614e5411846cffa123a27d2039d1785228583075947fca4cbe0691b5ebe |
Bug Fixes in addition to a new permission model.
Bug Fixes
Summary
Bug Fix: LDAP changes being rolled back to allow users to login using just their username again.
Humio Server 1.3.0 Archive (2019-02-07)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.3.0 | Archive | 2019-02-07 | 2020-02-07 | 1.2.0 | Yes | Yes |
Value | JAR Checksum |
---|---|
MD5 | c2c8064b9528569f55bae4809823d688 |
SHA1 | 0ca51526a8fb204a6d7f5d98ef3df9b99b9d9bb8 |
SHA256 | 0f4b789dfe2a36cab77850f9a2c1aa2c5d6db9f13527760fb58d428ff3bf6edc |
SHA512 | d6ec65028371383b770fedb57488530a144edc3ec5a684ed829d1997ff4a2bc6d4607a22d100e6729fcf8c3d30b3e480d45cd9975507754e2a891d0bafee43aa |
New permission model
Bug Fixes
Summary
Bug Fix: Metric of type=HISTOGRAM in the internal "humio-metrics" repo had all values a factor of 10^6 too low.
New permission model used for Role Based Access Control is now in use all the time. Default setup includes the roles
member
,admin
, andeliminator
as usual.Bug Fix: LDAP fix; may require users to login with full
user@domain
user name, not justuser
.Bug Fix: worldmap function forgot about normalize option.
The config for RBAC has changed (config file has a new name, environment variable names have changed).
Humio Server 1.2.12 Archive (2019-02-05)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.2.12 | Archive | 2019-02-05 | 2020-02-05 | 1.2.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | 8e5166154004d10cc532edf628ff9a75 |
SHA1 | 52d1c821efb9faa1e2929e37c18d4b31301ba06c |
SHA256 | 27c07d34ab9f3f1b71f4c69bdd6fa416fbb4e64a6c150dd25fef19261b0541da |
SHA512 | 87f05b4ab55a92ed45c3f0b0594a281b2ebf47b13656b69da0e7c698e0ec2676ad7000fd6bb3cca656057931319af27536ca68e290447b610afeffa7efc18645 |
Optimizations and Bug Fixes
Bug Fixes
Summary
Running queries now show only top-.0 queries to avoid overloading the browser in case of many queries.
Improvements to Query monitor
Added a timechart of bulk size to built-in dashboard "Humio stats".
Optimizing for many datasources in a repo by removing a bottleneck related for "tag grouping" auto-detection.
Bug Fix: lowercase function now preserves unmodified fields in the "include=both" case, and no longer modifies "@timezone".
Humio Server 1.2.11 Archive (2019-01-31)
Version | Type | Release Date | End of Support | Upgrades From | Data Migration | Config. Changes |
---|---|---|---|---|---|---|
1.2.11 | Archive | 2019-01-31 | 2020-01-31 | 1.2.0 | No | No |
JAR Checksum | Value |
---|---|
MD5 | abb43dfa8ee8f12402a76a179410176b |
SHA1 | 1a03197336c007c67d50dbee4a10fb9255f6babc |
SHA256 | 31917a8d9b99a7374e84d2992bf4c7abf17e9a584b1a87ad2c0c4b2ef7413563 |
SHA512 | e808107e58221d854235b2eb4b882ce6f7ce607fe5ad7daf6e3d9cebaef34cf2be39530f9f3f90c7e1af3ee3f007c755e7c9f4570712d776b82ac66e8b857d8b |
Support for non-loadbalanced queries, optimizations and Bug Fixes
Bug Fixes