https://topicpartition.io Last 10 notes on TopicPartition Quartz -- quartz.jzhao.xyz https://topicpartition.io/kafka/community/ https://topicpartition.io/kafka/community/ Kafka Community Spotlight is an initiative to bring more life, depth, and visibility to the Kafka community by regularly highlighting the people involved in Kafka ... Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/kafka/kafka https://topicpartition.io/kafka/kafka Kafka is a good thing. Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/blog/kip-1150-diskless-topics-in-apache-kafka https://topicpartition.io/blog/kip-1150-diskless-topics-in-apache-kafka TL;DR KIP-1150 introduces Diskless Kafka topics that write directly to S3 instead of replicating between brokers. It literally reduces costs by 97% (from $1.8M to $20K annually for a 1GiB/s cluster) and brings operational benefits for diskless topics like: no disk management headaches, instant broker scaling, and simplified load balancing. Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/blog/kip-1150-vs-freight https://topicpartition.io/blog/kip-1150-vs-freight TL;DR KIP-1150 introduces Diskless Kafka topics that write directly to S3 instead of replicating between brokers. It literally reduces costs by 5x+ off of the most optimized Kafka deployment (10x+ otherwise) and brings operational benefits for diskless topics like: no disk management headaches, instant broker scaling, and simplified load balancing. Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/blog/ursa-a-new-lakehouse-first-storage-engine-for-kafka https://topicpartition.io/blog/ursa-a-new-lakehouse-first-storage-engine-for-kafka In case you haven’t been following, the event streaming Kafka space has been in fierce competition recently1. What used to be dominated by unicorn-turned-public-company Confluent now consists of 20+ vendors (of which IBM controls 5 now after it bought Confluent)2. Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/definitions/consumer-groups https://topicpartition.io/definitions/consumer-groups Consumers are clients that read data from Kafka via the KafkaConsumer API. Consumer Groups are a bunch of Consumers that share state and coordinate how to distribute the work between them. Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/definitions/the-log https://topicpartition.io/definitions/the-log The Log is the data structure that Kafka is based on. It’s very simple. It’s an ordered structure of bytes that only supports appends — you can’t edit or delete records in place. Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/definitions/topic-partition https://topicpartition.io/definitions/topic-partition a topic partitionn. Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/ https://topicpartition.io/ This is a blog about Apache Kafka. Here’s some of my best writing: Kafka is fast — I’ll use Postgres Why Was Apache Kafka Created? No One Will Tell You The Real Cost of Apache Kafka If you’d like to reach out, you can find me on LinkedIn or X (Twitter). Fri, 08 May 2026 09:30:51 GMT https://topicpartition.io/blog/everyone-is-talking-their-book https://topicpartition.io/blog/everyone-is-talking-their-book An uncomfortable truth is that in public tech circles, everyone is just shilling their product. Everyone is talking their book. Can’t blame them - when your competition is, you need to too, in order to stand out. Fri, 08 May 2026 09:30:51 GMT