Hasyimi Bahrudin

Polynya - Turn your Postgres into workspaces for AI

by
Polynya replicates your data into Iceberg, and gives your agent an ephemeral ClickHouse instance on demand. Polynya also provides persistent workspaces — collections of views that survive across sessions. So from your agent's point of view, it's a 24/7 data warehouse. It's currently free on early access, so do try it out and give me any feedback! Currently there is no web dashboard yet (coming soon), you interact with it 100% through CLI.

Add a comment

Replies

Best
Hasyimi Bahrudin
I've been working in data engineer field for the past 4 years, and in every company that I've worked with, there is always the same pain: how to correctly and cheaply move data from OLTP to OLAP in near real time. So I decided to build what I think is the right solution for this problem. Polynya focuses on just Postgres and Iceberg, since I believe the industry has converged onto both of these as the standard for data: Postgres for OLTP, Iceberg for OLAP. I have also open-sourced the heart of Polynya: pg2iceberg (https://pg2iceberg.dev/). Polynya extends on pg2iceberg by providing persistent workspaces on top of ephemeral ClickHouse so you can feel the magic of this architecture with just a fraction of the cost of running traditional data replication stack that does the same thing.