Prompt Picker

Choose better system prompts

14 followers

Choose better system prompts

14 followers

Visit website

LLMs

•

Testing and QA software

•

Prompt Engineering Tools

Prompt Picker helps you choose better system prompts (aka custom instructions) for your LLM-powered applications by running experiments over simulated user inputs. In other words, it helps answer "...but which *exact* system prompt should I be using?"

Free

Launch tags:User Experience•Developer Tools•Artificial Intelligence

Launch Team

ClarifyThe autonomous CRM that helps you sell more

Promoted

Maker

📌

Hi everyone! Like many others, I have been tinkering with building apps on top of the language model APIs (e.g. GPT-3.5) that have recently been released. But I couldn't find any robust approaches for experimenting with and optimising the system prompts that I fed into these apps... so I built Prompt Picker, which has since ended up being a side project of its own. The basic idea was: don't bother with prompt engineering, just run iterative experiments over prompts and choose whichever give better responses to users. It's already been helpful for me on a few other projects, but I'd love to hear what you guys think!

Report

3yr ago

Awesome idea Ryan!! 🔥 Loved the keyboard shortcut quick picker for cycling through options. One bit of feedback is it's not immediately obvious that the prices for inputs are for 1,000 calls. I'd maybe consider making this a suffix for the price instead of a tooltip (e.g. $0.020 per 1,000 calls) 😊

Report

3yr ago

Maker

@cohenmatt thanks Matt! Good suggestion, I can definitely see how it could be clearer

Report

3yr ago

Reviews