OpenAutoLoader

OpenAutoLoader

Databricks Auto Loader, but open-source and Spark-free.

2 followers

OpenAutoLoader is a high-performance, incremental ingestion engine built on Polars. It tracks processed files, handles schema drift with Rescue Mode, and sinks data to Delta Lake with full ACID guarantees. No Spark, no JVM, just fast Python.

OpenAutoLoader makers

Here are the founders, developers, designers and product people who worked on OpenAutoLoader