Dynamic Configuration Parameter

Dynamic Configuration parameters allow for setting configuration values for the cluster while it is running.

Table: Dynamic Configuration Parameters Table

VariableDefault ValueAvailabilityDescription
BucketStorageKeySchemeVersion2 MB  Allows to set a new format for the keys (file names) placed in the bucket. When the new format is applied, the listing of files only happens for the prefixes tmp/ and globalsnapshots/. The new format is applied only to buckets created after this dynamic configuration has been set to 2.
BucketStorageWriteVersion3  Sets the format for files written to bucket storage to use a format that allows files larger than 2GB and incurs less memory pressure when decrypting files during download from the bucket.
FdrEnablefalse  Used by administrators to turn FDR polling on/off on the entire cluster with a single update.
FdrExcludedNodesempty  Used by administrators to exclude specific nodes from polling from FDR.
FdrMaxNodes5  Used by administrators to put a cap on how many nodes at most should simultaneously poll data from the same FDR feed.
FlushSegmentsAndGlobalOnShutdownfalseintroduced in 1.76.1

When set, and when USING_EPHEMERAL_DISKS environment variable is set to true, forces all in-progress segments to be closed and uploaded to bucket, and also forces a write (and upload) of global snapshot during shutdown.

When not set, this avoids the extra work and thus time shutting down from flushing very recent segments, as those can then be resumed on next boot, assuming that next boot continues on the same Kafka epoch. When set to the default, allows faster shutdown.

GroupDefaultLimit20,000  Default value for the limit parameter in groupBy(), selfJoin() and some other functions, when not specified. See Limits & Standards for details.
GroupMaxLimit1,000,000  Max value for the limit parameter in groupBy() function. See Limits & Standards for details.
JoinRowLimit200,000 

Max number of rows that join() and selfJoin() can return. It can be set using GraphQL.

Used as an alternative to the environment variable MAX_JOIN_LIMIT

.
LiveQueryMemoryLimit100,000,000 bytesdeprecated in 1.116.0 Determines how much memory a live query can consume during its execution.
MaxIngestRequestSize33,554,432  Size limit of ingest requests after content-encoding has been applied; expressed in bytes.
QueryMemoryLimit100,000,000 bytesdeprecated in 1.116.0 Determines how much memory a non-live query can consume during its execution.
QueryResultRowCountLimit    Globally limits how many events a query can return. This flag can be set by administrators through GraphQL.
StateRowLimit20,000 

Maximum number of rows allowed in functions.

Used as an alternative for the environment variable MAX_STATE_LIMIT.

TargetMaxRateForDatasource2 MB  Sets the target maximum rate (in MB/s) of ingest for each shard of a datasource.
UndersizedMergingRetentionPercentage20  When selecting undersized segments to merge, this setting controls how wide a time span can be merged together. The setting is interpreted as a percentage of the repository's retention by time setting. A reasonable range is 0 through to 90.