Apache Kafka
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.
Confluent is the company behind and hosts a SaaS service if you need it. Acquired b IBM, see Data Engineering Acquisitions.
Superstream (Formerly Memphis) ( memphisdev/memphis-broker ) has an open-source alternative.
# Features
# AWS S3
NEW: Direct-to-S3 topics are coming to Apache Kafka: KIP-1150: Diskless Topics was just published on the mailing list.
# Alternatives
# Further Reads
Origin:
References:
Apache Kafka