Lossy Compression Conserving the Physics

A closed-form layer for lossy scientific compression.

1 follower

A closed-form layer for lossy scientific compression.

1 follower

A codec-agnostic, closed-form layer that gives ZFP and other lossy scientific compressors exact conservation of a global invariant — at near-zero ratio overhead. - alikamp/conserved-field-compression

Lossy Compression Conserving the Physics gallery image

Free

Launch tags:Open Source•Developer Tools•GitHub

Launch Team

Atlassian LoomShow, don't just tell with Loom

Promoted

Maker

📌

Instead of modifying the compressor, I built a closed-form conservation layer that can sit on top of it. With ZFP, early tests reduced global energy drift by ~4–6 orders of magnitude while keeping the compression ratio essentially unchanged. The whole thing is open source. If you work with CFD, cosmology, turbulence, or large scientific datasets, I'd genuinely love to see what happens when you throw your own data at it. Repo: https://github.com/alikamp/conse... Try it, break it, benchmark it. 🚀

Report

2mo ago

Forum Threads

p/lossy-compression-conserving-the-physics

•

2mo ago

Get the edge

Lossy compression for science. Combine with LBM speedup for supercluster CFD performance on consumer hardware.

View all