Arroyo
lastmod 2023-04-19created 2023-04-191 edits
A distributed stream processing engine written in Rust
Features
- Designed to perform Stateful Computation efficiently on data streams
- Answers complex queries over large volumes of real-time data within 1 second
- Why, when there is already Kafka/Spark/Flink?
- Serverless operation: designed to run in modern cloud environments. Supports seamless scaling, recovery, and rescheduling
- High-performance SQL
- Designed for non-experts: separates the pipeline API from the internal implementation. No need to become a streaming expert to build real-time data pipelines