Consumer lag hit 400k and the fix wasn't more partitions
Lag was growing on a healthy-looking cluster. Throughput was flat, CPU was idle, and the rebalance rate was the only metric moving. Partitions were never the problem.
Blog
Engineering notes
Things I learned building and running backend services and web applications — mostly Java, Spring Boot, Kafka, React and TypeScript.
1 post