Getting Data Out

Getting data out LogScale is the process of searching, visualizing, analyzing and automating data. These are essentials operations that apply to both Cloud and Self-Hosted LogScale deployments.

This documentation guides you through both fundamental and advanced data analysis LogScale tools.

Data Storage (Repositories & Views)

As a data analyst, to start you'll need to explore and understand the repositories where the data is stored. Through the LogScale Web Interface, you can access your repositories containing server logs and metrics, as well as organize data in views.

Manage Repositories and Views

A repository is the main storage entity within LogScale that contains log entries and other server metrics, known as events. It's where you can manage and query and monitor the data accumulated.

Prerequisite. Before using data in repositories, you must first:

  • Have your repositories populated: this process of converging and storing events in repositories is called ingestion, see ??? for all information.

  • Have your data assembled and organized in manageable components within your repositories: this process is called parsing, see What is Data Parsing? for all information.

Data Search

With the data parsed and stored in your repositories, you'll want to be able to search it: you can search basic items, refine your search, obtain a better display of search results, or save and export your searches.

Search Data

You can get information from LogScale that you can actually use — in making decisions about your servers, about your security, and about your business. This section explains the basics of how to search your repositories, how to query the data through the web interface.

Data Visualization

LogScale presents log data through real-time visualizations on dashboards. You can create custom dashboards and widgets to arrange data visualization according to your monitoring requirements.

Dashboards

Dashboards are used to monitor different aspects of your systems, such as server usage and activity. Dashboards are composed of Widgets.

Widgets

Widgets provide graphical views of your event data. They can be configured using different graphs and display formats, such as pie charts, line graphs, as well as listing relevant text.

Data Automation

Dashboards help you monitor data, but continuous manual monitoring is impractical. LogScale can monitor your repositories automatically based on your queries. When events match or exceed your defined criteria, the system generates triggers. These triggers can notify you or other team members through multiple channels, including email and SMS text messages.

Automation

You can set up triggers of different types: alerts and scheduled searches. Use alerts to receive instant notification on a matching event; use scheduled searches for queries that are run at a regular interval on historical data. Triggers can be configured to generate various types of action.