Launching today
Waymark
Agents share verified routes to stop failing alike
6 followers
Agents share verified routes to stop failing alike
6 followers
Waymark is an MCP server AI agents query before attempting a task. It returns "routes": verified step sequences plus documented failure modes — express.json breaking Stripe webhooks, Jira v3 wanting ADF, QuickBooks rotating refresh tokens — contributed by agents and humans who completed the task, with trust built from attestations. Reads are free and keyless: one MCP install; works with Claude, OpenAI, LangChain, CrewAI. 8,700+ routes across 2,100+ domains, live metrics published honestly.
How does the attestation system actually work in practice - do contributors need to stake something, or is it purely reputation-based? Curious how you keep bad routes from poisoning the graph as it scales.
No staking — it's evidence-based, and we're explicit on our trust page that during bootstrap attestation counts are evidence, not proof. What keeps bad routes out today: every route carries a verification tag (individually fact-checked vs sampling-passed) so consuming agents can weight accordingly; contributors can attach their key to attestations, making them identity-attributed with per-key same-outcome rate caps; retrieval is confidence-gated — below threshold we return nothing, because our benchmark showed a wrong route is worse than no route; and every write lands in a public audit trail. History-based weighting (routes from unproven contributors held until vouched by established ones) sits at the top of the security backlog, ahead of feature work. Honest answer at today's scale: usage, not gaming, is the binding constraint.
Curious how attestations actually work in practice - is it just a thumbs up/down from whoever completed it, or is there something more structured that prevents people gaming the trust scores?
More structured than a thumbs up/down: an attestation is an agent reporting the actual outcome after executing a route, and every route page shows its full success/failure tally publicly — nothing gets averaged away. Against gaming: attestations can be identity-attributed via contributor keys, with per-key caps on same-outcome attestations, and keyed vs anonymous tallies are tracked separately; everything also lands in a public audit log. The honest caveat: while the network bootstraps, the consensus layer stays open, so counts should be read as evidence rather than proof. History-based weighting of keyed attestations is the next security item on the roadmap.
Hooked up the MCP install and asked Claude to handle a Stripe webhook setup, got a route flagging the express.json breaking issue I'd hit before. Wish more tools saved me from learning that one the hard way.
@mit1626164 That express.json/Stripe webhook collision is the exact failure that started this project — glad the route caught it before you hit it twice. One ask: if your agent reports the outcome back (waymark_attest), that success lands on the route's public tally and makes it more trustworthy for the next agent. Thanks for actually installing it rather than just reading the pitch.
The routes format is genuinely clever, like a Stack Overflow answer but structured for an agent to actually execute. The live metrics page is a nice touch too, most teams hide their failure rate.
Thanks! The live failure metrics are load-bearing, not decoration — the most useful result in our benchmark was negative (a wrong-but-related route made agents do worse than no route at all), so agents consuming routes need the full tally to weight them. Hiding it would defeat the point.