Harshil Siyani

Harshil Siyani

PromptPerfPromptPerf

Forums

Harshil Siyani

1mo ago

MemeMVP - Turn Your Brand Into Viral Memes

Turn your business website into viral memes with AI. Enter your URL and let our AI create hilarious, shareable memes that capture your brand personality. --Best part Wall of Meme, share the memes you generate for site visitors to have fun and when clicked opens your product page.

Just launched PromptPerf 2.0 on Product Hunt — test your prompts on 100+ AI models free

Hey everyone!

7 months ago I launched PromptPerf on Product Hunt and got feedback that changed everything:

- "Sadly no Gemini" Now there's 100+ models

- "API key friction" Now works without signup

Harshil Siyani

1mo ago

PromptPerf 2.0 - Find which AI wins for YOUR prompts. Test 100+ models free.

The Problem: You're using ChatGPT because everyone does. But is it actually the best AI for YOUR specific task? Maybe Claude writes better code. Maybe Llama is 10x cheaper and just as good. The Solution: PromptPerf lets you test your actual prompts across 100+ AI models simultaneously and shows you which one wins. ✨ What's New in 2.0: • 100+ models • Speed benchmarks • Ready-to-use templates • Save tests and re-run when models update

A Big Thank You! and a Big Ask

Thank you everyone for the support. I have received nearly 40 signups and 1 paid user which is massive for me as I am still on the early stages of validating the product. So thank you everyone.
Next steps: Even though the signups are coming in I am tracking the usage of the app and I dont see many users running the evaluations and I need help. How should I get you to try and test the product.
My current thoughts are:
- User using their API keys means friction and would go away from the platform as can't test it immediately so perhaps allow free trial with my API key which involves unlimited runs with 3 test cases.

- Create a onboarding guide? Like the ones of enterprise softwares that says "Click here" "Next Steps": What tool can I use for this?

For both the options above will still need to inform them about the updates and hope they will signin again.

- Reach out to all 40 users for a 1-1 15 mins call and show them the product. Assuming 30% respond that 12 calls booked.
Do you have any suggestions? Keen on feedback. This is critical as I need to solve these issues before building next features i.e (Adding more models and multi model runs).

Harshil Siyani

9mo ago

Building with AI? Then you know this pain.

Prompt A + Model B = Output C...
Until it suddenly doesn't.

Same input.
Same config.
Totally different output.

Because LLMs aren t deterministic and when your product depends on stable responses, it feels like building on sand.

I got tired of playing prompt roulette.

Harshil Siyani

9mo ago

Still manually tweaking AI prompts & praying for the best?

I've completed my proof-of-concept for the AI evaluation tool - successfully testing prompts across configs (Models x Temps x Runs). https://promptperf.dev/

Hi, I am building a AI Model Prompt Optimising tool that will run through multiple AI models across various temperature settings for X number of runs.
This saves time doing multiple tests, example user wants to test 3 questions/prompts for an expected answer across 4 models and the test would include 3 temperature options, each test to be done atleast 10 times to ensure consistency.
3x4x3x10 = 360 API calls + Reporting and Analysis of each result. Now imagine doing this multiple times for multiple prompts every-time, this can be 100 calls, or 1000 calls based on your requirements.
How It Works:
1. Define Your Prompt

  • Input the prompt you want to optimize whether it's a question, instruction, or complex task for the AI.

2. Set Expected Output

Harshil Siyani

9mo ago

PromptPerf - Instantly test and compare AI prompts results across models

PromptPerf lets you test a prompt across GPT-4o, GPT-4, and GPT-3.5 and compares results to your expected output using similarity scoring. Models change fast. Prompts break. This helps you stay ahead. Unlimited free runs. More models coming soon.

Pitch your startup in 5 words or less

Forget the pitch deck for a second. This is about grabbing attention fast. Share your startup in five words or less. The goal is to be clear, clever, or just bold enough to make people stop scrolling. Who knows, it could be a good marketing exercise

Pitch your startup in 5 words or less

Forget the pitch deck for a second. This is about grabbing attention fast. Share your startup in five words or less. The goal is to be clear, clever, or just bold enough to make people stop scrolling. Who knows, it could be a good marketing exercise

Product Huntp/producthuntAaron O'Leary

10mo ago

🚨 Community landing page roast: give a roast, get a roast 🚨

Let s bring back everyone s favorite kind of feedback: brutally honest and weirdly helpful.
Drop a link to your landing page in the comments. Then roast someone else s. Keep it real, keep it useful, keep it (mostly) kind

We re talking:

  • What s confusing?

  • What s missing?

  • What s great but buried?

  • Would you actually sign up or bounce?

The rules:

Harshil Siyani

5yr ago

CourseCreator - Changing how Education is delivered. Create online classroom

Recently developed a web-based application which allows teachers to create online courses and share them with their students.
Currently we have to approve the teachers inorder for them to be able to create courses. By default every new user is a student.