Visibility timeout configuration for FDR feeds using the FDR_VISIBILITY_TIMEOUT variable controls how long LogScale waits before retrying failed SQS message ingestion. Understanding and properly configuring visibility timeouts is crucial to prevent duplicate message ingestion, with the ability to set timeouts up to 12 hours for optimal performance.

You can configure the visibility timeout by using the FDR_VISIBILITY_TIMEOUT configuration option which will apply to all your FDR feeds.

This determines how long it takes before LogScale retries an SQS message it has previously failed to ingest.

If LogScale spends more time ingesting an SQS message than defined by the visibility timeout, there is a risk that LogScale will read the message again and thus ingest it twice.

To avoid a duplicate ingest in this case, you can try to increase the visibility timeout up to 12 hours.