Cluster Management and Health Monitoring

Monitor cluster health, manage nodes, and troubleshoot problems in self-hosted LogScale deployments

Workflow 1

New to Cluster Operations?

Start with the concepts

Learn how LogScale cluster health works before you start configuring monitoring. Understand what health checks measure, how nodes contribute to cluster stability, what Kafka does in the architecture, and how to read critical warnings before problems escalate.

  • Cluster Health Concepts
  • Nodes and Node Identifiers
  • Kafka's Role in the Cluster
Start Here Workflow 2

Ready to Set Up Monitoring?

I understand the concepts - show me how to monitor and respond

You understand how LogScale cluster health works and are ready to configure monitoring, set up logging, and act on problems. Follow this path to get visibility into your cluster, configure alerting, and build a troubleshooting practice for production deployments.

  • Health Checks and Monitoring Setup
  • Internal Logging and Metrics
  • Kafka Monitoring
  • Troubleshooting Cluster Issues
Get Started

Workflow 1: New to Cluster Operations?

Build a solid understanding of how a LogScale cluster stays healthy before you configure monitoring. Knowing what to watch for makes it much easier to respond quickly when something goes wrong.

1

Cluster Health Overview

Understand how LogScale measures and reports cluster health

Understanding Cluster Health

conceptintermediate

Learn what cluster health means in LogScale: how the platform assesses the state of the cluster, what conditions trigger health warnings, and how health status is surfaced in the UI and API.

Health Checks

guideintermediate

Understand the individual health checks that LogScale runs continuously. Learn what each check tests, what a failing check indicates, and how checks relate to overall cluster stability.
2

Nodes and Node Identifiers

Understand how nodes make up a cluster and how to identify them

Cluster Nodes

guideintermediate

Learn how nodes work together in a LogScale cluster: their roles, how data is distributed across them, and what happens when a node becomes unavailable.

Node Identifiers

troubleshootingintermediate

Understand how LogScale identifies nodes and why stable node identifiers matter for cluster operations, data distribution, and troubleshooting.
3

Kafka's Role in the Cluster

Understand why Kafka is central to LogScale's ingest pipeline and cluster coordination

Kafka Cluster

guideintermediate

Learn how LogScale uses Kafka for ingest buffering and cluster coordination. Understand what Kafka topics and brokers do, and why Kafka health directly affects LogScale's ability to ingest and process data.

Workflow 2: Ready to Set Up Monitoring?

Configure health monitoring, set up internal logging, watch for critical warnings, and build a consistent troubleshooting practice for your production cluster.

1

Set Up Health Monitoring

Configure health checks and establish your monitoring baseline

Health Checks

guideintermediate

Configure and review the health checks that LogScale runs on your cluster. Understand which checks are enabled by default and how to interpret their output.

Health Check Reference

referenceintermediate

Complete reference for all available health checks: what each check tests, the conditions that cause it to fail, and the recommended response for each failure type.

Monitoring Priorities

guideintermediate

Understand which aspects of cluster health to prioritize when monitoring a production deployment. Use monitoring priorities to focus attention on the conditions most likely to affect stability.
2

Measure and Monitor Cluster Performance

Use built-in metrics and statistics to track cluster performance over time

Measure and Monitor

guideintermediate

Configure LogScale's built-in monitoring capabilities. Access cluster-level metrics for ingest throughput, query load, storage utilization, and node performance.

Cluster Statistics

guideintermediate

Review the cluster statistics page for a real-time snapshot of ingest rates, data volumes, and cluster-wide resource utilization. Use statistics to establish performance baselines and detect anomalies.
3

Configure Internal Logging

Set up LogScale's own logging so you can investigate cluster issues after they occur

LogScale Internal Logging

guideintermediate

Configure how LogScale logs its own activity. Internal logs are essential for diagnosing cluster issues, understanding ingest failures, and investigating node behavior.

Monitor LogScale with Insights

guideintermediate

Use the built-in Insights application to monitor LogScale's own health using its internal logs. Get pre-built dashboards and queries for tracking cluster behavior without building monitoring from scratch.

Ship Internal Logs to Another Cluster

guideintermediate

Send LogScale's internal logs to a separate cluster for independent monitoring. This ensures you retain observability even when the primary cluster is experiencing problems.
4

Monitor Kafka

Keep the Kafka cluster healthy to ensure reliable ingest and cluster coordination

Kafka Cluster

guideintermediate

Monitor the health of the Kafka cluster that LogScale depends on. Understand how broker and topic health affects ingest reliability and what to check when ingest latency increases.

Kafka Topics

guideintermediate

Review and manage Kafka topics used by LogScale. Understand topic configurations that affect throughput and how to identify topic-level issues.

Kafka Brokers

guideintermediate

Monitor broker status and identify broker-level problems that affect LogScale's ability to process incoming data.
5

Manage Nodes

Monitor node status and respond to node-level issues

Cluster Nodes

guideintermediate

View the status of all nodes in your cluster. Identify nodes that are underperforming, unavailable, or carrying disproportionate load.

Auxiliary Nodes

guideintermediate

Understand the role of auxiliary nodes and how to configure them to offload specific workloads from primary cluster nodes.
6

Troubleshoot Cluster Issues

Diagnose and resolve problems using critical warnings, GraphQL, and problem-prevention guidance

Critical Warnings

guideintermediate

Review and act on critical warnings surfaced by LogScale. Each warning links to specific guidance for resolving the underlying condition.

Prevent and Resolve Problems

guideintermediate

Reference guide for diagnosing and resolving common cluster problems: ingest backlog, node failures, storage pressure, and performance degradation.

Cluster Management with GraphQL

guideintermediate

Use GraphQL mutations and queries for advanced cluster management tasks that are not available in the UI. Useful for scripting operational procedures and investigating cluster state programmatically.