OptionKAFKA_INGEST_QUEUE_PRODUCER_
Introduced Version1.173.0
Description Prefix that allows you to pass Kafka configuration parameters to specific Kafka producer clients writing to the ingest queue. Replaces EXTRA_KAFKA_CONFIGS_FILE.

It's possible to pass Kafka configuration properties to LogScale's Kafka clients using the using the KAFKA_INGEST_QUEUE_PRODUCER_ prefix. For example, this enables LogScale to connect to a Kafka cluster using SSL and SASL.

Kafka configuration options, such as request.timeout.ms can be passed with the prefix using a simple rewrite:

  1. Write the option name in uppercase (example: REQUEST.TIMEOUT.MS).

  2. Replace . with _ (example: REQUEST_TIMEOUT_MS)

  3. Apply the prefix for the target client (example: KAFKA_INGEST_QUEUE_PRODUCER_REQUEST_TIMEOUT_MS)

  4. Pass this as an environment variable to LogScale on boot (example: KAFKA_INGEST_QUEUE_PRODUCER_REQUEST_TIMEOUT_MS=30000)

For a list of all possible Kafka producer configuration options, see Producer configs.

If you want to pass a configuration to all clients, see the KAFKA_COMMON_ prefix instead. Settings configured using the client-specific prefixes have precedence if the setting is present with both prefixes.