Alconost.MT/Evaluate

Hi everyone!

We're excited to share Alconost.MT/Evaluate with you. It's an experimental LLM-based tool for translation quality evaluation using GPT-4, Claude, and Gemini (more models coming very soon).

We originally built this for internal use (we do a lot of localization), but quickly realized it could be interesting for translators, LQA folks, AI researchers, and anyone who works with translated content, whether it's human or machine-generated.

Internally, Alconost uses 10+ traditional translation quality metrics to assess quality. Recently we added one more: assessment by LLMs. Surprisingly, it catches many things on its own and can be used independently. So we built a UI for it and now we're opening it to the world.

You can paste in a few lines or upload full files (XLIFF, CSV). The tool scores each segment on fluency, accuracy, terminology, and style, and even suggests edits with explanations. Don't have a translation ready? Just grab any random text (even this comment), translate it with Google Translate, DeepL, ChatGPT, or whatever you use, and paste both the original and translation into the tool. It's a fun way to try it out.

It's an experimental tool and still very much in development, so it's not perfect, especially on adapted or creative content - LLMs can make mistakes. That's where you come in: we'd love your feedback.

Try it, break it, and tell us what worked (and what didn't). Questions, ideas, suggestions – please drop them here!

Thanks for checking it out!

The Alconost.MT/Evaluate team

I found this tool helpful not only for checking quality and getting explanations, but also for obtaining actual translations.

Hey everyone! We’re the team behind Alconost.MT/Evaluate, and we’re so excited to finally share our experimental AI tool with you! It’s designed to help evaluate translation quality using top-tier LLMs like GPT, Gemini, and Claude. We’ve worked hard on it and can’t wait to hear your thoughts.

Congrats on the launch! Exciting to see practical AI tools coming from real localization pros.

If you have any questions about how Alconost.MT/Evaluate works or need any help, don’t hesitate to reach out. We’re here and ready to chat!

So good to see this live! Knowing the team behind it, I’m sure this will only get better.

Excited to see you guys experimenting in public. Congrats on shipping something this cool and useful! :)