|Description||Limits the CPU time spent on removing duplication of values|
Many events have fields with values where one field holds a substring of the value from another. This is the case in particular if the event arrives with a @rawstring with the full event which then gets parsed using a parser that stores copies of many substrings from @rawstring in other fields. LogScale removes duplication of these values before storing them in the segment files. This configuration limits how much CPU time is spent on that effort. The default is to follow the compression level. Default: 9. Minimum: 0. Maximum: 21. Adding one allows you to double the time.
COMPRESSION_TYPE=high COMPRESSION_LEVEL=9 COMPRESSION_LEVEL_MINI=0 VALUE_DEDUP_LEVEL=COMPRESSION_LEVEL
COMPRESSION_TYPE above for more information.