Skip to main content
FlowMatrix is a distributed stream processing engine written in Rust, designed to efficiently perform stateful computations on streams of data. Unlike traditional batch processors, streaming engines can operate on both bounded and unbounded sources, emitting results as soon as they are available. In short: FlowMatrix lets you ask complex questions of high-volume real-time data with sub-second results. FlowMatrix FlowMatrix can be self-hosted, or used via the FlowMatrix Cloud service managed by FlowMatrix Systems.

​
Features

  • Pipelines defined in SQL, with support for complex analytical queries
  • Scales up to millions of events per second
  • Stateful operations like windows and joins
  • State checkpointing for fault-tolerance and pipeline recovery
  • Event time processing with watermark support

​
Use cases

Some example use cases include:
  • Detecting fraud and security incidents
  • Real-time product and business analytics
  • Real-time ingestion into your data warehouse or data lake
  • Real-time ML feature generation

​
Why FlowMatrix

There are already a number of existing streaming engines out there, including Apache Flink, Spark Streaming, and Kafka Streams. Why create a new one?
  • Serverless operations: FlowMatrix pipelines are designed to run in modern cloud environments, supporting seamless scaling, recovery, and rescheduling
  • High performance SQL: SQL is a first-class concern, with consistently excellent performance
  • Designed for everyone: FlowMatrix cleanly separates the pipeline APIs from its internal implementation. You don’t need to be a streaming expert to build real-time data pipelines.

​
Getting Started

FlowMatrix ships as a single binary, which can be easily installed locally or run in a container. 
brew install flowmatrixsystems/tap/flowmatrix
See the getting started guide to get up and running with a local FlowMatrix deployment.

​
In production

FlowMatrix supports several deployment targets for production use, including native support for Kubernetes. See the deployment docs for more information.

​
License

FlowMatrix is fully open-source under the Apache 2.0 license.

​
Support

​
Commerical support

Commercial support is offered by FlowMatrix Systems, the creators of FlowMatrix. Reach out to support@flowmatrix.systems to get in touch.

​
Community support

Community support is offered via the FlowMatrix Discord where the FlowMatrix development team and community are actively engaged in helping users get started and solve their problems with FlowMatrix.

​
Telemetry

By default, FlowMatrix collects limited and anonymous usage data to help us understand how the system is being used and to help prioritize future development. You can opt out of telemetry by setting DISABLE_TELEMETRY=true when running FlowMatrix services.