Part 1: Apache Kafka - Walkthrough of a distributed system

The Computing Podcast

Welcome to our 2nd episode. This is the first part of a two part series where we walk through a stateful distributed system. Join us as we take apart the famous Apache Kafka so as to look under the hood and understand more of the amazing engineering and computer science that has gone into building it. We’ll touch upon consensus algorithms, guarantees and the path taken by a message making its way through Kafka. Follow us on Twitter @dosco @strlen Links Kafka design Virtual synchrony The Log ZooKeeper Atomic Broadcast Kafka Replication Design Kafka design: replication Amazon Aurora under the hood: quorums and correlated failure