VariableVALUE_DEDUP_LEVEL
DescriptionVALUE_DEDUP_LEVEL Environment Variable

Many events have fields with values where one field holds a substring of the value from another. This is the case in particular if the event arrives with a @rawstring with the full event which then gets parsed using a parser that stores copies of many substrings from @rawstring in other fields. Humio removes duplication of these values before storing them in the segment files. This config limits how much cpu time is spent on that effort. The default is to follow the compression level. Default: 9. Minimum: 0. Maximum: 21. Adding one allows double the time.

ini files
COMPRESSION_TYPE=high
COMPRESSION_LEVEL=9
COMPRESSION_LEVEL_MINI=0
VALUE_DEDUP_LEVEL=COMPRESSION_LEVEL

See COMPRESSION_TYPE above for more information.