LogScale Internal Architecture

LogScale is a log management product. The primary goal for LogScale is to ingest and support searching large volumes of timestamped data, typically from text-based logs and analytics data.

This guide to the LogScale architecture has been designed to provide successive levels of detail into how LogScale works. The first level of the detail provides an overview of the information designed to give you a good grounding of the main components, themes and capabilities. The next level goes into more detail about the specific processes, and the last level provides a detailed description of how LogScale stores and retrieves data.

This guide is split into three broad sections:

  • LogScale Logical Architecture

    Describes the logical architecture of LogScale and how these components support processing requests, ingest and store data, and process and return queries.

  • LogScale Operational Architecture

    Describes the operation architecture of LogScale, including the process and steps involved in storing, indexing and searching data and how LogScale parses, ingests, and assembles information to be efficiently processed.

  • LogScale Physical Architecture

    Describes the physical components of a typical LogScale cluster and how they work together to support the LogScale operational and logical features.

To start, read the Design Principles to understand why LogScale was developed and the problems it was designed to solve.

Each section contains a deeper level of description. If you a want a more detailed view of what is going on under the hood within LogScale, work through to the deeper sections. For an overview, read only the high level content.