SQLFlow - Easy Stream Processing
A flink alternative powered by DuckDB
Start new thread
Danny Mican

SQLFlow - Easy Stream Processing - A flink alternative powered by DuckDB

by•
SQLFlow models stream-processing as SQL queries using the DuckDB SQL dialect. Express your entire stream processing pipeline—ingestion, transformation, and enrichment—as a single SQL statement and configuration file.

Add a comment

Replies

Best
Danny Mican
Maker
📌
SQLFlow is an affordable easy-to-use alternative to stream processing systems like Flink. SQLFlow models stream-processing as SQL queries using the DuckDB SQL dialect. Express your entire stream processing pipeline—ingestion, transformation, and enrichment—as a single SQL statement and configuration file. Process 10's of thousands of events per second on a single machine with low memory overhead, using Python, DuckDB, Arrow and Confluent Python Client. Tap into the DuckDB ecosystem of tools and libraries to build your stream processing applications. SQLFlow support parquet, csv, json and iceberg. Read data from Kafka.