Part 2: Apache Kafka - Walkthrough of a distributed system

The Computing Podcast

Welcome to our 3nd episode. This is the second part of a two part series where we walk through a stateful distributed system. Join us as we take apart the famous Apache Kafka so as to look under the hood and understand more of the amazing engineering and computer science that has gone into building it. In this part we’ll talk about Apache Zookeeper the best kept secret in a lot of open source distributed systems. We’ll also touch upon clients, atomic broadcasts and things that can hurt availability. Hope you enjoy the ride as we walk the route taken by messages through Apache Kafka. Remember to subscribe for more interesting, deep tech conversations. Follow us on Twitter @dosco @strlen Links ZooKeeper: Wait-free coordination for Internet-scale systems ZooKeeper’s atomic broadcast protocol: Theory and practice PacificA: Replication in Log-Based Distributed Storage Systems Bigtable: A Distributed Storage System for Structured Data The Chubby lock service for loosely-coupled distributed systems