Apache Kafka Architectures and Fundamentals

Presented by

Henrik Janzon, Solutions Engineer

About this talk

Apache Kafka is a community distributed event streaming platform capable of handling trillions of events a day. Initially conceived as a messaging queue, Kafka is based on an abstraction of a distributed commit log. Since being created and open sourced by LinkedIn in 2011, Kafka has quickly evolved from messaging queue to a full-fledged event streaming platform. In this session Martijn Kieboom, Senior Solutions Engineer at Confluent, explains Apache Kafka’s internal design and architecture. by attending you will learn why companies like LinkedIn, ING, Dominos Pizza, Nordea, & Royal Bank of Canada are now sending trillions of messages per day to Apache Kafka. In addition you will come to understand the underlying design in Kafka that leads to such high throughput. This talk provides a comprehensive overview of Kafka architecture and internal functions, including: •Topics, partitions and segments •The commit log and streams •Brokers and broker replication •Producer basics •Consumers, consumer groups and offset
Related topics:

More from this channel

Upcoming talks (0)
On-demand talks (328)
Subscribers (10608)
Confluent is building the foundational platform for data in motion. Our cloud-native offering is designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organisation. With Confluent, organisations can create a central nervous system to innovate and win in a digital-first world.