Dynamic Configuration Parameters

Dynamic Configuration parameters allow for setting configuration values for the cluster while it is running.

Table: Dynamic Configuration Parameters Table

VariableDefault ValueAvailabilityDescription
BucketStorageKeySchemeVersion2 MBintroduced in 1.51.0 Sets a new format for the keys (file names) placed in the bucket.
BucketStorageWriteVersion3introduced in 1.68.0 Allows files larger than 2GB in bucket storage for less memory pressure.
FdrEnablefalseintroduced in 1.40.0 Turns FDR polling on/off on the entire cluster with a single update.
FdrExcludedNodesemptyintroduced in 1.40.0 Excludes specific nodes from polling from FDR.
FdrMaxNodes5 nodesintroduced in 1.40.0 Maximum number of nodes that simultaneously poll data from the same FDR feed.
GroupDefaultLimit20,000 group elementsintroduced in 1.51.0 Default limit of group elements allowed in functions like groupBy() or selfJoin().
GroupMaxLimit1,000,000 group elementsintroduced in 1.51.0 Maximum limit of group elements allowed in groupBy().
JoinRowLimit200,000 rowsintroduced in 1.51.0

Max number of rows that join() and selfJoin() can return.

LiveQueryMemoryLimit100,000,000 bytesdeprecated in 1.116.0, introduced in 1.51.0 Amount of memory that a live query can consume during its execution.
MaxIngestRequestSize33,554,432 bytesintroduced in 1.64.0 Size limit of ingest requests after content-encoding has been applied.
QueryMemoryLimit100,000,000 bytesdeprecated in 1.116.0, introduced in 1.51.0 How much memory a non-live query can consume during its execution.
QueryResultRowCountLimit100,000 rowsintroduced in 1.51.0 How many events a query can return.
StateRowLimit20,000 rowsintroduced in 1.51.0

Maximum number of rows allowed in functions.

TargetMaxRateForDatasource2 MBintroduced in 1.51.0 Target maximum rate of ingest for each shard of a datasource.
UndersizedMergingRetentionPercentage20 %introduced in 1.63.1 Time span percentage that can be merged together when selecting undersized segments to merge.