What are peoples thoughts on ai / LLMs doing math??

Question

Hey everyone! I'm working on a financial tracking tool called Fina (https://fina.xyz) - we plan on launching here on PH at the end of May.

We are building some interesting use-cases for using ai to ask plain English questions about your (live) cleaned personal financial data.

One of the core things we're doing is pairing semantic queries to our data computation engine to provide actual math-based answers so there's no hallucination from the LLM. We see this as fundamental because math needs 100% precision. It's slower to build because it requires us to create the tracking scenarios first, but it lets us ensure accuracy.

I was curious about GPT-4...it seems to still be very bad at math, but seems to have somewhat improved on it since GPT-3.5.

Does anyone think eventually it will be able to handle math well or do people unanimously agree that the LLMs will always need to pair to some computation engine for the math side to ensure accuracy?

Just want to hear how others are thinking about this?
(I know wolfram alpha made a plugin for chatGPT which is an interesting use case as well).

André J · Accepted Answer

We will soon find out. There are lots of math problems that can net you a lot of money if solved.

Clay Raterman · Answer

@eonpilot Agreed! The math use-cases are more interesting to me than the writing use-cases for sure

Sam James · Answer

We need to learn math at school so that we don't have to turn to artificial intelligence later.

Debin Alsa · Answer

Math courses are designed to develop critical thinking and problem-solving abilities. By learning different mathematical concepts and techniques, you can improve your analytical skills and apply them to various real-life situations with takemymathclasspro.

edward · Answer

We will soon find out geometry spot. There are lots of math problems that can net you a lot of money if solved.

Teresa Pemd · Answer

We need to learn math at school so that we don't have to turn to artificial intelligence later. Cazoom Math offers an exceptional collection of math worksheets tailored for Grade 6 students, aged 11-12. As a reliable provider of educational resources, we ensure that our worksheets are not only engaging but also aligned with the common core state standards. Whether for classroom instruction or supplementary home learning, our math worksheets cater to diverse learning needs. Join over 50,000 educators, parents, and schools worldwide who trust our math resources for comprehensive and effective learning experiences. Visit the page: https://www.cazoommaths.com/us/m...

Clay Raterman · Answer

@guzzyleroy But the connection between LLM's and computation doesn't seem like it's there yet. (wolfram alpha plugin aside). If we view math as a different type of language the same way we view code as a language I imagine it will eventually get there and I totally agree!

What are peoples thoughts on ai / LLMs doing math??

Replies