Hey Product Hunt!
I built PromptForge because I was tired of the endless trial-and-error cycle of prompt engineering. As someone who works with AI daily, I found myself constantly tweaking prompts, losing track of what worked, and having no systematic way to evaluate improvements.
The problem: Most prompt tools are just fancy text editors. You write, you test, you hope for the best. But there's no real engineering discipline.
What makes PromptForge different:
Systematic evaluation - Generate comprehensive test suites automatically
Built-in analytics - Track what actually works across different scenarios
Variable testing - Test edge cases, robustness, and consistency
Prompt library - Never lose a working prompt again
Dual analysis - AI-powered feedback on your prompts before you even test them
Why I built it: I wanted to bring the same rigor to prompt engineering that we have in software engineering - version control, testing, systematic improvement.
Currently supporting Claude, GPT-4, and Azure OpenAI with more providers coming soon. Docker deployment makes it dead simple to get started.
What would you want to see in a prompt engineering tool? Always looking for feedback from fellow AI builders!
This is cool — would love to be able to run it locally and use @LM Studio or @Ollama for inference. Would that be possible? (I also have Docker installed but it'd be nice to avoid unnecessary $$ cloud bills)
@chrismessina Thanks, Love this feedback! Local inference is definitely on the roadmap!
The Docker setup already runs locally - you just need to plug in your API keys. But adding LM Studio/Ollama support would be AMAZING for cost-free local inference!
Would you prefer Ollama integration first? And what models are you running locally? Always looking to prioritize based on real usage!
@khiemlee Thank you! 🚀 It's been an incredible journey building this. I'll surely checkout what you are releasing . Btw what kind of prompts do you work with most? Code, creative writing, data analysis? Always looking to improve the tool based on real use cases! ✨
Report
@insaanimanav I played with this a little bit the UI is a bit confusing to me. After you generate the evals, I was expecting to be able to save the tests and re-run them but I couldn't figure out how to do that. Is that supported?
🔥 Loving the response! Quick question for everyone trying PromptForge:
What's your biggest prompt engineering pain point?
- Starting from scratch every time?
- Not knowing if prompts will work?
- No systematic way to test?
Would love to hear your specific use cases! 👇
Report
Congrats on the launch! Quick question. Does PromptForge support comparing performance between different prompt versions? Really looking forward to trying it out!
Olvy
@insaanimanav nice work. Good luck.
Smart name tag.
Olvy
@django_vinci Haha thanks
@insaanimanav awesome idea, thanks for sharing. when will this be ready for actual use?
Olvy
@the_league Its out right now you can clone the repository and use the setup instructions to start using it
Osaurus
This is cool — would love to be able to run it locally and use @LM Studio or @Ollama for inference. Would that be possible? (I also have Docker installed but it'd be nice to avoid unnecessary $$ cloud bills)
Olvy
@chrismessina Thanks, Love this feedback! Local inference is definitely on the roadmap!
The Docker setup already runs locally - you just need to plug in your API keys. But adding LM Studio/Ollama support would be AMAZING for cost-free local inference!
Would you prefer Ollama integration first? And what models are you running locally? Always looking to prioritize based on real usage!
Thanks for the great suggestion!
Olvy
@chrismessina We now have support for local inference in prompt-forge you can now use ollama for local inference thanks to the work by https://github.com/halilugur
Olvy
For everyone checking out the demo - what surprised you most?
And what feature should we prioritize next? Your feedback shapes our roadmap! 🚀
@insaanimanavNice one!! i've upvoted your product and try it out, awesome. We will launch our AI product soon, hope you'll upvote for us too!!
Olvy
@khiemlee Thank you! 🚀 It's been an incredible journey building this. I'll surely checkout what you are releasing . Btw what kind of prompts do you work with most? Code, creative writing, data analysis? Always looking to improve the tool based on real use cases! ✨
@insaanimanav I played with this a little bit the UI is a bit confusing to me. After you generate the evals, I was expecting to be able to save the tests and re-run them but I couldn't figure out how to do that. Is that supported?
Olvy
🔥 Loving the response! Quick question for everyone trying PromptForge:
What's your biggest prompt engineering pain point?
- Starting from scratch every time?
- Not knowing if prompts will work?
- No systematic way to test?
Would love to hear your specific use cases! 👇
Congrats on the launch! Quick question. Does PromptForge support comparing performance between different prompt versions? Really looking forward to trying it out!
Olvy
@iam_sofia Thanks Sofia for asking that . That sounds like an amazing addition adding to the roadmap right away thanks for the suggestion
Olvy
🔥 245 votes! The prompt engineering community is incredible!
Quick question: What's the FIRST prompt you'd generate if you had AI assistance?
- Code reviews?
- Creative writing?
- Data analysis?
- Marketing copy?
Drop your ideas below! 👇
Olvy
Love seeing all the developers here!
Real talk: How do you currently build prompts?
- Trial and error?
- Copy from blogs?
- Start from scratch?
Tell me your pain points!