Nitish Katkade

Forums

OpenAutoLoader - Databricks Auto Loader, but open-source and Spark-free.

OpenAutoLoader is a high-performance, incremental ingestion engine built on Polars. It tracks processed files, handles schema drift with Rescue Mode, and sinks data to Delta Lake with full ACID guarantees. No Spark, no JVM, just fast Python.