OpenAutoLoader
p/openautoloader
Databricks Auto Loader, but open-source and Spark-free.
0 reviews2 followers
Start new thread
trending
Nitish Katkade

13d ago

OpenAutoLoader - Databricks Auto Loader, but open-source and Spark-free.

OpenAutoLoader is a high-performance, incremental ingestion engine built on Polars. It tracks processed files, handles schema drift with Rescue Mode, and sinks data to Delta Lake with full ACID guarantees. No Spark, no JVM, just fast Python.