JSON is the industry standard for APIs, but is it actually the best format for a language model? We did a deep dive into possible advantages when using Markdown and the short answer is that JSON is costing you a lot of unnecessary tokens. JSON is full of nested braces, trailing commas, and strict structural noise. LLMs do not need this to understand the data.
Why Markdown?