PromptTokenizer lets you visualize and analyze how LLMs like GPT-4, Claude, and Llama tokenize text. Count tokens, compare models, and optimize your prompts.
No reviews yetBe the first to leave a review for PromptTokenizer
Maker
š
Hey Product Hunt š
I built PromptTokenizer because I got tired of being surprised by LLM API bills.
A prompt that looked "short" would somehow consume hundreds of tokens. JSON payloads were larger than expected. Code tokenized differently than prose. And the same prompt could cost dramatically different amounts depending on whether I sent it to GPT, Claude, Llama, Gemini, or another model.
Most token counters I found were either:
⢠Limited to a single provider
⢠Hidden behind API keys
⢠Or just gave a number without showing why
I wanted a tool that made tokenization visible.
So I built PromptTokenizer:
šØ Visualize every token with color-coded chips
š¢ Count tokens
š¤ Support for GPT models today, with Claude, Gemini, Llama, Mistral, and others planned
š° Spot expensive patterns before they impact your costs
š 100% free and privacy-friendly ā everything runs in your browser
I use it daily when:
⢠Designing system prompts
⢠Optimizing RAG chunk sizes
⢠Estimating API costs
⢠Comparing models before deployment
I'd love your feedback:
ā Which models should I add next?
ā What features would make this part of your workflow?
ā What tokenization edge cases have caught you off guard?
Try it here ā https://prompt-tokenizer.site/
Thanks for checking it out, and I'm happy to answer any questions in the comments! š