Troubleshooting: Using Non-OSS Beats Elastic API Causes Errors

Affects:

  • Filebeat™ version(s) all

  • Winlogbeat™ version(s) all

  • Metricbeat™ version(s) all

  • Packetbeat™ version(s) all

Condition or Error

Log shippers cannot communicate with LogScale

LogScale doesn't receive data from Beats log shippers

Invalid license errors from beats products

Error invalid license found, requires a basic or a valid trial license and received Open source

Error ERROR => invalid license found, requires a basic or a valid trial license and received Open source

Error in logs ERROR [publisher_pipeline_output] pipeline/output.go:154 Failed to connect to backoff(elasticsearch(http://13.211.167.47:8080/api/v1/ingest/elastic-bulk)): Connection marked as failed because the onConnect callback failed: invalid license found, requires a basic or a valid trial license and received Open source

When using one of the Beats log shippers to load data into LogScale, data fails to load, or you get an explicit error in the logs. For example, check your filebeat.log log.

Causes

  • When using an Elastic Beats log shipper such as Filebeat or Winglogbeat, the version used must be compatible with LogScale. You may have downloaded the commercial or non-OSS version. The Non-OSS versions of these products are not compatible with LogScale. Using a Non-OSS version will raise an error, or fail to load the data effectively.

Solutions

  • Ensure that you download the OSS version of the product that you want to use, making sure that you keep a copy of your configuration files before deleting the non-OSS version.

    You can download OSS versions of the Beats log shippers from the following links: