Dynamic Configuration Parameters

Dynamic Configuration parameters allow for setting configuration values for the cluster while it is running.

Table: Dynamic Configuration Parameters Table

VariableDefault ValueAvailabilityDescription
BucketStorageKeySchemeVersion2 MB  Sets a new format for the keys (file names) placed in the bucket.
BucketStorageUploadInfrequentThresholdDays   Minimum data retention days remained to switch from default "S3 Standard" to "S3 Intelligent-Tiering".
BucketStorageWriteVersion3  Allows files larger than 2GB in bucket storage for less memory pressure.
FdrEnablefalse  Turns FDR polling on/off on the entire cluster with a single update.
FdrExcludedNodesempty  Excludes specific nodes from polling from FDR.
FdrMaxNodes5 nodes  Maximum number of nodes that simultaneously poll data from the same FDR feed.
FlushSegmentsAndGlobalOnShutdownfalse  Allows the shutdown of all in-progress segments and forces a write (and upload) of global snapshot.
GroupDefaultLimit20,000 group elements  Default limit of group elements allowed in functions like groupBy() or selfJoin().
GroupMaxLimit1,000,000 group elements  Maximum limit of group elements allowed in groupBy().
IngestFeedAwsDownloadMaxObjectSize2,147,483,648 bytesintroduced in 1.113.0 Max size of objects downloaded from S3.
IngestFeedAwsProcessingDownloadBufferSize8,388,608 bytesintroduced in 1.113.0 Size of the buffer when downloading.
IngestFeedAwsProcessingEventBufferSize1 MBintroduced in 1.113.0 Size of the buffer after preprocessing and splitting into individual events.
IngestFeedAwsProcessingEventsPerBatch1,000 eventsintroduced in 1.113.0 Number of events ingested per batch.
IngestFeedGovernorGainPerCore100,000introduced in 1.113.0 Change in rate when under/over the setpoint. Increasing this will make the governor more aggressive in changing the ingest rate.
IngestFeedGovernorIngestDelayHigh10 secondsintroduced in 1.113.0

Default ingest delay high setpoint for the ingest feed governor.

IngestFeedGovernorIngestDelayLow5 secondsintroduced in 1.113.0

Default ingest delay low setpoint for the ingest feed governor.

JoinRowLimit200,000 rows 

Max number of rows that join() and selfJoin() can return.

LiveQueryMemoryLimit100,000,000 bytesdeprecated in 1.116.0 Amount of memory that a live query can consume during its execution.
MaxIngestRequestSize33,554,432 bytes  Size limit of ingest requests after content-encoding has been applied.
QueryCoordinatorMaxHeapFraction0.5  Configures query queueing based on the available memory in the query coordinator.
QueryMemoryLimit100,000,000 bytesdeprecated in 1.116.0 How much memory a non-live query can consume during its execution.
QueryPartitionAutoBalancetrue  Turns on/off automatic balancing of query partitions across nodes.
QueryResultRowCountLimit100,000 rows  How many events a query can return.
ReplaceANSIEscapeCodestrue  Specifies whether replaces ANSI escape codes in the result set.
StateRowLimit20,000 rows 

Maximum number of rows allowed in functions.

StaticQueryFractionOfCores2  Limit in the queries that one organization or user can run on a certain percentage of mapper threads.
TargetMaxRateForDatasource2 MB  Target maximum rate of ingest for each shard of a datasource.
UndersizedMergingRetentionPercentage20 %  Time span percentage that can be merged together when selecting undersized segments to merge.