I was on the lookout for a platform that would accommodate the maximum functionality of prompt stylability testing. The first thing I came across was GenumLab. The product has recently entered beta and has already surprised me! It's still raw and as I understand in the active development stage, but you can already see the great potential! This plaftorm is positioning itself as PromptFinOps. After it I came across PromptForge. According to the description of functionality, they are as similar as possible. What is the difference between them? I would like to know the advantages and disadvantages of these platforms
Olvy
@insaanimanav nice work. Good luck.
Smart name tag.
Olvy
@django_vinci Haha thanks
@insaanimanav awesome idea, thanks for sharing. when will this be ready for actual use?
Olvy
@the_league Its out right now you can clone the repository and use the setup instructions to start using it
Osaurus
This is cool — would love to be able to run it locally and use @LM Studio or @Ollama for inference. Would that be possible? (I also have Docker installed but it'd be nice to avoid unnecessary $$ cloud bills)
Olvy
@chrismessina Thanks, Love this feedback! Local inference is definitely on the roadmap!
The Docker setup already runs locally - you just need to plug in your API keys. But adding LM Studio/Ollama support would be AMAZING for cost-free local inference!
Would you prefer Ollama integration first? And what models are you running locally? Always looking to prioritize based on real usage!
Thanks for the great suggestion!
Olvy
@chrismessina We now have support for local inference in prompt-forge you can now use ollama for local inference thanks to the work by https://github.com/halilugur
Olvy
For everyone checking out the demo - what surprised you most?
And what feature should we prioritize next? Your feedback shapes our roadmap! 🚀
@insaanimanavNice one!! i've upvoted your product and try it out, awesome. We will launch our AI product soon, hope you'll upvote for us too!!
Olvy
@khiemlee Thank you! 🚀 It's been an incredible journey building this. I'll surely checkout what you are releasing . Btw what kind of prompts do you work with most? Code, creative writing, data analysis? Always looking to improve the tool based on real use cases! ✨
@insaanimanav I played with this a little bit the UI is a bit confusing to me. After you generate the evals, I was expecting to be able to save the tests and re-run them but I couldn't figure out how to do that. Is that supported?
Olvy
🔥 Loving the response! Quick question for everyone trying PromptForge:
What's your biggest prompt engineering pain point?
- Starting from scratch every time?
- Not knowing if prompts will work?
- No systematic way to test?
Would love to hear your specific use cases! 👇
Congrats on the launch! Quick question. Does PromptForge support comparing performance between different prompt versions? Really looking forward to trying it out!
Olvy
@iam_sofia Thanks Sofia for asking that . That sounds like an amazing addition adding to the roadmap right away thanks for the suggestion
Olvy
🔥 245 votes! The prompt engineering community is incredible!
Quick question: What's the FIRST prompt you'd generate if you had AI assistance?
- Code reviews?
- Creative writing?
- Data analysis?
- Marketing copy?
Drop your ideas below! 👇
Olvy
Love seeing all the developers here!
Real talk: How do you currently build prompts?
- Trial and error?
- Copy from blogs?
- Start from scratch?
Tell me your pain points!