PlotChat

Hi all! Beside using AI model like GPT-4 Vision for comprehension of images, and making sense of the data there, it's possible to leverage Google's Deplot + LLM to do similar thing and basically chat with the data in images. I've taken inspiration from some parts of the code available online and build PlotCh.at - https://plotch.at/.

Great job @michaltakac! It is really impressive that you can chat and analyze data in images. What a unique and useful idea!

It works really well even at this early stage! I was able to ask questions about charts, it gave me correct results. This is game-changing tool, ease of understanding even complex data visualisations has gone better!

I got an idea: making this into an app that connects screenshotting followed by a chat interface could make the experience even faster! You would just jump around your plots in any document, press some hotkey to take a screenshot and then immediately you’re presented with the chat right next to your image, where you can ask anything and PlotChat Bot will analyze the data for you.