Option | S3_STORAGE_PREFERRED_COPY_SOURCE | |
Description | Sets how to download segments from bucket storage when prefetching | |
Default | false |
Sets how LogScale chooses segments to download from bucket
storage when prefetching. If
S3_STORAGE_PREFERRED_COPY_SOURCE
is
false
, the prefetcher will only download
segments that are not already on another host. Otherwise, it
will download as many segments as necessary to follow the
configured replication factor. This should help avoid excessive
bucket downloads when nodes in the cluster have lots of empty
disk space.
From version 1.179, this sets the preferred transfer type for LogScale. Causes LogScale to try to fetch from local nodes if possible, and only fetch from bucket storage if there is no other option. This means you can now get LogScale to prefer one type of transfer.
With
false
,
local fetching will always be used unless the segment is only in
bucket storage, and segment prefetching will only download
segments that are not on another host.
With
true
local fetching will never be used unless the segment has not
been uploaded to bucket storage yet, and prefetching will fetch
as many segments as necessary to follow the configured
replication factor.