Dynamic Configuration Parameters

Dynamic Configuration parameters allow for setting configuration values for the cluster while it is running.

Table: Dynamic Configuration Parameters Table

VariableDefault ValueAvailabilityDescription
BucketStorageKeySchemeVersion2 MB  Sets a new format for the keys (file names) placed in the bucket.
BucketStorageUploadInfrequentThresholdDays   Minimum data retention days remained to switch from default "S3 Standard" to "S3 Intelligent-Tiering".
BucketStorageWriteVersion3  Allows files larger than 2GB in bucket storage for less memory pressure.
FdrEnablefalse  Turns FDR polling on/off on the entire cluster with a single update.
FdrExcludedNodesempty  Excludes specific nodes from polling from FDR.
FdrMaxNodes5 nodes  Maximum number of nodes that simultaneously poll data from the same FDR feed.
FlushSegmentsAndGlobalOnShutdownfalse  Allows the shutdown of all in-progress segments and forces a write (and upload) of global snapshot.
GroupDefaultLimit20,000 group elements  Default limit of group elements allowed in functions like groupBy() or selfJoin().
GroupMaxLimit1,000,000 group elements  Maximum limit of group elements allowed in groupBy().
IngestFeedAwsDownloadMaxObjectSize2,147,483,648 bytesadded in 1.113 Max size of objects downloaded from S3.
IngestFeedAwsProcessingDownloadBufferSize8,388,608 bytesadded in 1.113 Size of the buffer when downloading.
IngestFeedAwsProcessingEventBufferSize1 MBadded in 1.113 Size of the buffer after preprocessing and splitting into individual events.
IngestFeedAwsProcessingEventsPerBatch1,000 eventsadded in 1.113 Number of events ingested per batch.
IngestFeedGovernorRateOverride100,000added in 1.113 Change in rate when under/over the setpoint. Increasing this will make the governor more aggressive in changing the ingest rate.
IngestFeedGovernorIngestDelayHigh10 secondsadded in 1.113

Default ingest delay high setpoint for the ingest feed governor.

IngestFeedGovernorIngestDelayLow5 secondsadded in 1.113

Default ingest delay low setpoint for the ingest feed governor.

JoinRowLimit200,000 rows 

Max number of rows that join() and selfJoin() can return.

LiveQueryMemoryLimit100,000,000 bytesdeprecated in 1.116 Amount of memory that a live query can consume during its execution.
MaxIngestRequestSize33,554,432 bytes  Size limit of ingest requests after content-encoding has been applied.
QueryCoordinatorMaxHeapFraction0.5  Configures query queueing based on the available memory in the query coordinator.
QueryMemoryLimit100,000,000 bytesdeprecated in 1.116 How much memory a non-live query can consume during its execution.
QueryPartitionAutoBalancetrue  Turns on/off automatic balancing of query partitions across nodes.
QueryResultRowCountLimit500,000 rows  How many events a query can return.
ReplaceANSIEscapeCodestrue  Specifies whether replaces ANSI escape codes in the result set.
StateRowLimit500,000 rows 

Maximum number of rows allowed in functions.

StaticQueryFractionOfCores2  Limit in the queries that one organization or user can run on a certain percentage of mapper threads.
TargetMaxRateForDatasource2 MB  Target maximum rate of ingest for each shard of a datasource.
UndersizedMergingRetentionPercentage20 %  Time span percentage that can be merged together when selecting undersized segments to merge.