Nitish Katkade

Badges

Tastemaker
Tastemaker
Veteran
Veteran

Forums

OpenAutoLoader - Databricks Auto Loader, but open-source and Spark-free.

OpenAutoLoader is a high-performance, incremental ingestion engine built on Polars. It tracks processed files, handles schema drift with Rescue Mode, and sinks data to Delta Lake with full ACID guarantees. No Spark, no JVM, just fast Python.
View more