StreamSets: Where DevOps Meets Data Integration

Apache Kafka is a scalable and fault tolerant messaging system common in publish and subscribe (pub/sub) architectures. Apache Kafka is used for a range of use cases including message bus modernization, microservices architectures and ETL over streaming data. High throughput -- Each server is capable of handling 100s MB/sec of data. High availability -- Data can be stored redundantly in multiple servers and can survive individual server failure. High scalability -- New servers can be added over time to scale out the system.