Description Primary segment files' storage limit

SECONDARY_DATA_DIRECTORY enables using a secondary file system to store segment files. When to move the files is controlled by PRIMARY_STORAGE_PERCENTAGE. Secondary storage is not enabled by default. Note, that when using Docker, make sure to mount the volume into the container as well. See Secondary Storage for more information.


These properties define the disk space limits at which LogScale will throttle itself to avoid filling the disks. When the primary disk cap is hit, LogScale will attempt to use the secondary storage instead. If both caps are hit, the affected LogScale node will pause processing of logs, and will avoid downloading segments from other nodes or buckets, until disk space is freed.

The disk space limit is also used for deciding how full the node is, in order to balance disk usage in the cluster. If the secondary configuration exists, it is used for this purpose, otherwise the primary configuration is used.