fix: Increase the internal librdkafka producer queue size
Given that we've increased the max message size by a factor of 10, also
increase the internal producer queue max size by a factor of 10 to
reduce the number of retries needed to successfully enqueue messages to
Kafka.
Connects to
@@ -70,6 +70,7 @@ impl KafkaBufferProducer {
cfg.set("bootstrap.servers", &conn);
cfg.set("message.timeout.ms", "5000");
cfg.set("message.max.bytes", "10000000");
+ cfg.set("queue.buffering.max.kbytes", "10485760");
let producer: FutureProducer = cfg.create()?;
