Skip to content
This repository was archived by the owner on May 27, 2022. It is now read-only.
This repository was archived by the owner on May 27, 2022. It is now read-only.

Excessive warnings in in logs when topic or broker not present #97

Open
@pratikaher88

Description

@pratikaher88

We are successfully able to connect to the designated broker and topic. But when we try to test for a situation when there is a situation with some issue with the broker then we get get following Warnings:
WARN 09/07/2020:06:37:39.722[::::][kafka-producer-network-thread | -default-logback-relaxed] org.apache.kafka.clients.NetworkClient [Producer clientId=-default-logback-relaxed] Error while fetching metadata with correlation id 68252 :
{some_topic=UNKNOWN_TOPIC_OR_PARTITION}
The correlation ID starts from 1 and doesnt seem to stop.

These warnings don't stop and they quickly fill up the logs. Is there some configuration that we need to set in logstash appender to avoid these excessive logs

configs used:

	<producerConfig>acks=1</producerConfig>
	<producerConfig>linger.ms=10000</producerConfig>
	<producerConfig>retries=0</producerConfig>
	<producerConfig>max.block.ms=100</producerConfig>
	<producerConfig>batch.size=655360</producerConfig>
	<producerConfig>buffer.memory=33554432</producerConfig>

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions