SQLFlow - Easy Stream Processing

A flink alternative powered by DuckDB

7 followers

A flink alternative powered by DuckDB

7 followers

SQLFlow models stream-processing as SQL queries using the DuckDB SQL dialect. Express your entire stream processing pipeline—ingestion, transformation, and enrichment—as a single SQL statement and configuration file.

SQLFlow - Easy Stream Processing gallery image

Free

Launch tags:Analytics•Developer Tools•GitHub

Launch Team / Built With

Viktor.comAn AI coworker that actually does the work

Promoted

Maker

📌

SQLFlow is an affordable easy-to-use alternative to stream processing systems like Flink. SQLFlow models stream-processing as SQL queries using the DuckDB SQL dialect. Express your entire stream processing pipeline—ingestion, transformation, and enrichment—as a single SQL statement and configuration file. Process 10's of thousands of events per second on a single machine with low memory overhead, using Python, DuckDB, Arrow and Confluent Python Client. Tap into the DuckDB ecosystem of tools and libraries to build your stream processing applications. SQLFlow support parquet, csv, json and iceberg. Read data from Kafka.

Report

1yr ago

Reviews

No reviews yetBe the first to leave a review for SQLFlow - Easy Stream Processing