Kafka
Apache Kafka is an open-source distributed event streaming platform, created at LinkedIn in 2011 and later handed over to the Apache Foundation.
Apache Kafka is an open-source distributed event streaming platform, created at LinkedIn in 2011 and later handed over to the Apache Foundation.
Kafka stores event streams in partitioned topics, persisted on disk and replicated, with per-partition ordering guarantees and a throughput of several million messages per second. Producers and consumers are decoupled and can replay history at will.
It is the backbone of real-time data at most large platforms: change data capture (CDC), event sourcing, streaming ML pipelines, event-driven microservices. Confluent is its main commercial vendor; AWS MSK and Aiven offer managed Kafka.
