LZ4

A lossless compression algorithm that prioritizes speed over compression ratio, providing extremely fast compression and decompression with minimal CPU overhead. In LogScale, LZ4 is used to compress mini-segments containing recently ingested data, enabling immediate searchability while the data is still being processed. This speed-focused approach allows real-time queries on newly arrived data, with the data later being recompressed using Zstd for better long-term storage efficiency.

Related ContentRelated Terms