MaxDedupPrefixLength

OptionMaxDedupPrefixLength
Description Maximum number of bytes of earlier values that LogScale searches for a copy of a field value.
Introduced Version1.267.0
Default (Not set)

During ingest, LogScale removes duplicate field values within a segment block. For each field value, it searches the values already written for the same event. This setting limits that search to the given number of bytes. Use this setting to tune how much effort ingest spends on deduplication.

The setting is not set by default. When you set it, its value overrides the value that VALUE_DEDUP_LEVEL provides. When you do not set it, VALUE_DEDUP_LEVEL applies. The MaxDedupFieldCount setting works the same way.