Harshil Siyani

Harshil Siyani

PromptPerfPromptPerf
59 points
All activity
Turn your business website into viral memes with AI. Enter your URL and let our AI create hilarious, shareable memes that capture your brand personality. --Best part Wall of Meme, share the memes you generate for site visitors to have fun and when clicked opens your product page.
MemeMVP
MemeMVPTurn Your Brand Into Viral Memes
The Problem: You're using ChatGPT because everyone does. But is it actually the best AI for YOUR specific task? Maybe Claude writes better code. Maybe Llama is 10x cheaper and just as good. The Solution: PromptPerf lets you test your actual prompts across 100+ AI models simultaneously and shows you which one wins. ✨ What's New in 2.0: • 100+ models • Speed benchmarks • Ready-to-use templates • Save tests and re-run when models update
PromptPerf 2.0
PromptPerf 2.0Find which AI wins for YOUR prompts. Test 100+ models free.
Harshil Siyanistarted a discussion

Just launched PromptPerf 2.0 on Product Hunt — test your prompts on 100+ AI models free

Hey everyone! 7 months ago I launched PromptPerf on Product Hunt and got feedback that changed everything: - "Sadly no Gemini" → Now there's 100+ models - "API key friction" → Now works without signup - "Need multi-model comparison" → Now compare 5 models side-by-side Today we're back with 2.0 and I built exactly what the community asked for. What it does: You enter your actual prompt + what a...

Harshil Siyanileft a comment
Looks great. Keen to try the application
Paperguide Article GPT
Paperguide Article GPTWrite research-backed articles with citations
Harshil Siyanistarted a discussion

A Big Thank You! and a Big Ask

Thank you everyone for the support. I have received nearly 40 signups and 1 paid user which is massive for me as I am still on the early stages of validating the product. So thank you everyone. Next steps: Even though the signups are coming in I am tracking the usage of the app and I dont see many users running the evaluations and I need help. How should I get you to try and test the product....

Harshil Siyanistarted a discussion

Building with AI? Then you know this pain.

Prompt A + Model B = Output C... Until it suddenly doesn't. Same input. Same config. Totally different output. Because LLMs aren’t deterministic and when your product depends on stable responses, it feels like building on sand. I got tired of playing prompt roulette. Tired of: Copy-pasting prompts into playgrounds Switching models manually Changing temperature settings Scoring responses by eye...

PromptPerf lets you test a prompt across GPT-4o, GPT-4, and GPT-3.5 and compares results to your expected output using similarity scoring. Models change fast. Prompts break. This helps you stay ahead. Unlimited free runs. More models coming soon.
PromptPerf
PromptPerfInstantly test and compare AI prompts results across models
Harshil Siyanileft a comment
Been following the journey on X! incredible growth
Peek
PeekAI personal finance coach that guides you through decisions
Harshil Siyanileft a comment
Just signed up, so far liking what im seeing. Great product
Extrovert
ExtrovertWarm-up and nurture prospects at scale on linkedin
Harshil Siyanileft a comment
Automate prompt testing promptperf.dev
Aaron O'Leary
Pitch your startup in 5 words or less
Aaron O'LearyJoin the discussion
Harshil Siyanistarted a discussion

Still manually tweaking AI prompts & praying for the best?

I've completed my proof-of-concept for the AI evaluation tool - successfully testing prompts across configs (Models x Temps x Runs). https://promptperf.dev/ Hi, I am building a AI Model Prompt Optimising tool that will run through multiple AI models across various temperature settings for X number of runs. This saves time doing multiple tests, example user wants to test 3 questions/prompts for...