Launching today
Promptic
Optimize GenAI applications for quality and cost
121 followers
Optimize GenAI applications for quality and cost
121 followers
Promptic is the optimization platform for GenAI applications, better quality at lower cost. Benchmark models, tune prompts and agents, and optimize tool use against your own data and business metrics. Every candidate is scored on the quality and cost you actually care about, so you ship the configuration that wins instead of the one that sounded right. Runs wherever you are, dashboard UI, your CI, or your coding agent.
Promptic
Promptic
We built Promptic because GenAI teams should not have to choose prompts, models, or agent architectures by intuition. Promptic brings optimization to the GenAI era by turning your own examples, evaluations, and production traces into an optimization loop. Define what good means, compare candidates on quality, cost, and latency, and ship the best-value configuration.
Today we are opening the platform to everyone. We would love to hear what you are optimizing, where your current workflow falls short, and which tradeoffs matter most for your application.
@dominik_bura being able to use our own production traces for the optimization loop is a massive selling point.
@dominik_bura Awesome to see more tooling focused on post deployment ai observability.
Is there a way to export the benchmark reports to share with non-technical stakeholders? congrats for shipping
Promptic
Thanks, @vikramp7470 ! Not yet, but that’s a great suggestion. We’ll add benchmark report sharing to our roadmap. Would you consider PDF export or a shareable link to be more useful?
@danielschroterthuem I think a PDF export would be great, especially for attaching to formal reports or sharing with clients. good luck for the launch🫡
CtrlOps
Seem interesting. Optimising prompts as well!
Promptic
@parth_makwana07 Yes! Question is whether switching to a cheaper model, will lower your performance metric and then especially how much quality can you recover by optimizing the prompt for that model? Typically there is no time for manual prompt tuning of all sorts of model-prompt combinations. These type of questions we want to answer with promptic in order to finde the best cost-value fit.
Scoring quality and cost together is the right call. Most of our savings came from trimming what we sent the model, not switching models.
Promptic
@salman_parvez Exactly. A cheaper model isn’t always the answer. Sometimes the biggest win is sending less context while keeping the quality your use case needs (prompt/context engineer).