fix: limit kafka consumer queue to 10MB
I think that while this value limits the maximum memory consumption, it
is too optimistic.
@@ -255,7 +255,7 @@ impl KafkaBufferConsumer {
cfg.set("session.timeout.ms", "6000");
cfg.set("enable.auto.commit", "false");
cfg.set("statistics.interval.ms", "15000");
- cfg.set("queued.max.messages.kbytes", "100000");
+ cfg.set("queued.max.messages.kbytes", "10000");
// Create a unique group ID for this database's consumer as we don't want to create
// consumer groups.
