|Primary segment files' storage limit
SECONDARY_DATA_DIRECTORY enables using a secondary file
system to store segment files. When to move the files is controlled by
PRIMARY_STORAGE_PERCENTAGE. Secondary storage is not
enabled by default. Note, that when using Docker, make sure to mount the
volume into the container as well. See
Secondary Storage for more
These properties define the disk space limits at which LogScale will throttle itself to avoid filling the disks. When the primary disk cap is hit, LogScale will attempt to use the secondary storage instead. If both caps are hit, the affected LogScale node will pause processing of logs, and will avoid downloading segments from other nodes or buckets, until disk space is freed.
The disk space limit is also used for deciding how full the node is, in order to balance disk usage in the cluster. If the secondary configuration exists, it is used for this purpose, otherwise the primary configuration is used.