memtrust

memtrust

The benchmark vendors don't run on themselves

1 follower

memtrust-cli is an independent, Apache 2.0 CLI that evaluates LLM memory systems (MemPalace, Mem0, Zep/Graphiti, OpenViking) under identical conditions. It runs 17 distinct evals, including contradiction detection and compression fidelity. Built to be strictly unbiased it caught a fake API in our own adapter before testing external tools. It is 100% self-hostable and completely account-free.