Option | BLOCKS_PER_SEGMENT | |
Description | Desired number of blocks in a final segment | |
Default | 30,000 |
The BLOCKS_PER_SEGMENT
variable is used to set the desired number of blocks (each ~1 MB
before compression) in a final segment after merge. Segments
will get closed earlier if expired due to
MAX_HOURS_SEGMENT_OPEN
. Increasing this to a
higher value means larger merged segments, with the tradeoff
being that while larger merged segments take up less space in
global, the files are larger, so segment movement between nodes
or from bucket storage may end up moving more data than it
otherwise would.
ini
MAX_HOURS_SEGMENT_OPEN=24
FLUSH_BLOCK_SECONDS=1800
BLOCKS_PER_SEGMENT=8000
#BLOCKS_PER_MINISEGMENT=128
#BLOCK_SIZE_MIN_KB=384
#BLOCK_SIZE_MAX_KB=1024