Limits and Standards
This page lists the various limits and standard operating parameters of LogScale. See Best Practice for the best practices relative to ingest via the Ingest API.
General Limits and Parameters
Below is a list of general limits and parameters:
Note
Unless otherwise specified, all multiple-byte data sizes are expressed in SI units using decimal (Base 10). For example:
1KB = 1,000 Bytes
1MB = 1,000,000 Bytes
1GB = 1,000,000,000 Bytes
1TB = 1,000,000,000,000 Bytes
Data Structure
Limit | Default Value | Dynamic Variable | Config Variable | Availability |
---|---|---|---|---|
Max number of datasources in a repository. |
| |||
Max number of fields in an event. During ingest, fields are sorted alphabetically by name and the first fields are parsed, the remainder of the named fields are dropped. The @rawstring field is not modified and will contain all data. |
Variable default: 1,000 fields | |||
Max event size. When the configured event size max is reached,
either in @rawstring and/or in other
fields, the overall data will be truncated. Fields will be
removed entirely, and @rawstring will be
truncated down to the allowed max size with added
|
|
Variable default: 1 MiB | ||
Max file upload size (see Lookup Files) |
|
Query Related Limits
Limit | Default Value | Dynamic Variable | Config Variable | Availability |
---|---|---|---|---|
Max memory a live query can consume during its execution.
|
100,000,000 bytes |
Variable default: | ||
Max query length in characters |
| |||
Maximum amount of memory, in bytes, that a worker node can allocate to each historic/static query during its execution.
Since version 1.116, it cannot be configured directly: its value
is set by the
|
100,000,000 bytes |
Variable default: | ||
Maximum amount of memory, in bytes, a historic/static query can consume during its execution.
See also |
100,000,000 bytes |
Variable default: | ||
Number of pipes that can be included in a query. |
| |||
Max number of results that any query can give. Increasing this value beyond the default limit may cause browser performance issues, including memory exhaustion or UI hanging when rendering large result sets. | ||||
Maximum number of events processed in a given function. It is
strongly recommended to not change this limit beyond its current
default value as the consequences of doing so are cluster
instability or cluster crashes. If you experience a lot of query
load, particularly from the |
| |||
Maximum amount of memory, in bytes, that a worker node can allocate to each live query during its execution. It cannot be configured directly.
For non-live queries, their memory limit is determined by the
|
100,000,000 bytes |
Variable default: |
Function Limits
Limit | Default Value | Dynamic Variable | Config Variable | Availability |
---|---|---|---|---|
Default value for the
|
|
Variable default: | ||
Max value for the
Due to stability concerns this variable will not allow
|
|
Variable default: | ||
Max number of rows that
Dynamic configuration |
|
Variable default: | ||
Max number of events in |
| |||
Max number of events in an RDNS request. See
|
| |||
Memory limit for the mapper phase of a
|
| |||
Memory limit for the mapper phase of a
|
|
API Limits
Limit | Default Value | Dynamic Variable | Config Variable | Availability |
---|---|---|---|---|
Max body size in POST requests after decompression. |
| |||
Max body size in POST requests before decompression. |
|
Standards
Below are some standards in LogScale.
Character sets
LogScale works with the JVM standard charsets. The character sets below are guaranteed to be supported in future JVM versions.
Note
These are the character sets LogScale accepts in the HTTP request and this may not necessarily be the same character sets accepted by the log shipper, such as Log Collector or another third-party log shipper, when ingesting files. When ingesting files, they are read by a log shipper that then makes HTTP requests to LogScale, and the character set supported by the log shipper is unlikely to have anything to do with what LogScale supports in the HTTP layer.
US-ASCII
ISO-8859-1
UTF-8
UTF-16
UTF-16BE
UTF-16LE
UTF-32
UTF-32BE
UTF-32LE
If you have any questions about whether a character set is accepted or supported, contact LogScale Support Team.