Queue (queue)

The queue block is part of the Sinks (sinks) and configures the behaviour of the queue. If the queue block is not defined in the Log Collector configuration, the collector uses a memory queue with default settings. See Queue Memory for more details.

See Queue Disk for related information.

Note

If a Log Collector experiences network issues, it queues logs locally until connectivity is restored. The LogScale queuing mechanism operates on a 'first in, first out' (FIFO) basis, which means that when network connectivity is re-established, the Collector processes and sends the oldest queued logs first.

yaml
queue:
      type: memory
      # fullAction determines queue behavior when it is full.
      #   pause = queue pauses ingesting new batches if it is full (Default if not mentioned) deleteLatest is no longer supported and automatically set to pause.
      #   deleteOldest = queue deletes the oldest batch to accept new batches if it is full
      # Default: pause
      fullAction: pause
      maxLimitInMB: 1024
      # The flushTimeOutInMillisecond option only applies to "memory".
      flushTimeOutInMillisecond: 1000
      # The storageDir option only applies to "disk".
      #storageDir: [storage directory path]

Table: Queue

ParameterTypeRequiredDefault ValueDescription
fullActionqueuefullactionoptional[a] 'pause' Specify the action to take when the memory is full.
   Values
   deleteOldestAccepts new batches but deletes the oldest batch and whichever is reached first triggers the data to be sent to Falcon LogScale.
   pauseThe queue does not ingest new batches when it is full. Note that deleteLatest is no longer supported and automatically set to pause.
typequeuetyperequired   Configures the storage used for the queue of events being collected. When disk is specified the data is written in the dataDirectory/queue/sinkName/ by default.
   Values
   diskDisk
   memoryMemory

[a] Optional parameters use their default value unless explicitly set.