Mondly is an EdTech company that develops a freemium language learning platform which includes a website and apps with free and paid courses for 33 languages. The company also offers lessons in virtual and augmented reality.
@abadesi, I believe AR can radically change the way we learn and MondlyAR is the first step to improving the way we learn languages. You should give MondlyAR a go. Would like to hear about your experience.
Hola Product Hunt, and Danke for hunting us, @chrismessina!
4 years ago we created Mondly with a sole vision: to help people learn languages online so they can have meaningful conversations in real life.
I truly believe that conversations are the ultimate goal of every language learner.
Here are the steps we made towards our vision in the past few years:
-Released the 1st voice-enabled language chatbot in the world (August 2016)
-Launched MondlyVR, the first virtual reality language app with speech recognition for Oculus (February 2017) and Daydream (September 2017)
-Today, we are introducing MondlyAR - The first augmented reality language learning experience with chatbots and speech recognition (March 2018) on ARCore
Mondly AR introduces a lifelike avatar that carries humanlike conversations and offers instant feedback on your pronunciation.
With the power of ARCore it can virtually teleport all kinds of objects into your living room, creating a new kind of immersive experience. This makes learning fun and memorable.
We are thrilled with this version of the product, but there's room to grow. Now Iβm turning to you, the toughest crowd in the tech world, for feedback and ideas on how to take Mondly one step forward.
Report
@iliescualex What does Augmented Reality add to this? It seems to me like it adds nothing meaningful at all to the learning process, just an additional step that will grow tiresome for users. Let me know if I'm missing something.
@william_falloon Hi William, great question!
What we are seeing with AR is that it's able to create a better feeling of immersion that stimulates better interaction with the learning materials.
Nothing compares with the illusion of seeing a 10 ft elephant, moving and trumpeting in your room. A photo or an illustrated image in an app cannot cannot convey that emotion.
Or admiring a life-size grand piano with all its details and from any angle, blending perfectly in your environment, with spatial sound that changes its intensity while you move to explore this work of art.
While this exploration happens, Mondly, the virtual teacher is aware of you and your environment at any moment.
She knows if youβre facing her, if youβre at the right or left of the piano and she can use this information in a dialogue: βIf you move to the left youβll see the stringsβ.
She can move closer to you, looks at you, follows you, gesticulates just like a real teacher would do to reinforce language and make the experience more memorable.
She can change from a teacher to a conversational partner just like in a SF movie. Want to practice ordering food at a restaurant? No problem - Mondly will change her outfit to accommodate the situation: βQue desea seΓ±or?β
She can understand what you are saying and help correct your pronunciation and can even answer some of your random questions.
I hope you see how combining the spatial capabilities of AR with the interactivity of chatbots and speech recognition can create a more personal and immersive learning experience, which is recognised by all studies to be the ideal ingredients for fast and effective learning.
@katriketoja, indeed it does. MondlyAR works on 100 million Android devices that are ARCore enabled. Any of these phones will do: Pixel 1, 2, Samsung Galaxy S7, S8, Note 8, LGβs V30, ASUS Zenfone AR and OnePlus 5. Here's the Android download link: https://play.google.com/store/ap...
Clever but what's the value of learning a language from a bot in AR? It seems like this would be less accessible than more traditional, non-AR apps like Duolingo. What am I missing?
@rrhoover Hello Ryan, thanks for the thoughtful questions.
VR and AR are less accessible than simple mobile apps in the same way that planes are less accessible than cars.
While it requires newer hardware, AR is able to create a feeling of immersion that traditional mobile apps are not capable of.
Nothing compares with the illusion of seeing a 10 ft elephant, moving and trumpeting in your room. A photo cannot cannot convey that emotion.
Or admiring a life-size grand piano with all its details and from any angle, blending perfectly in your environment, with spatial sound that changes its intensity while you move to explore this work of art.
While this exploration happens, Mondly, the virtual teacher is aware of you and your environment at any moment.
She knows if youβre facing her, if youβre at the right or left of the piano and she can use this information in a dialogue: βIf you move to the left youβll see the stringsβ.
She can move closer to you, looks at you, follows you, gesticulates just like a real teacher would do to reinforce language and make the experience more memorable.
She can change from a teacher to a conversational partner just like in a SF movie. Want to practice ordering food at a restaurant? No problem - Mondly will change her outfit to accommodate the situation: βQue desea seΓ±or?β
She can understand what you are saying and help correct your pronunciation and can even answer some of your random questions.
I hope you see how combining the spatial capabilities of AR with the interactivity of chatbots and speech recognition can create a more personal and immersive learning experience, which is recognised by all studies to be the ideal ingredients for fast and effective learning.
@graeme_fulton Hello Graeme, we thought this would be a great idea too. So we have object recognition working in our labs and we'll release it soon with an update.
Report
@graeme_fulton@iliescualex This will be a true game changer. If it can basically recognize things around me and teach me that, my god would that be super useful and a fantastic use of AR
@graeme_fulton@iliescualex@swiftpolar Imagine applying this tech to teach more subjects in schools like chemistry or biology. Or imagine having games where you use speech recognition to make them feel more real than ever
As a US expat living in Berlin, trying to learn German, Mondly has been a huge help. I've used many language learning apps in the past but I tend to get bored after a while. Mondly seems to be the only app that I stick with longer than a few months. Now with AR, it makes learning German more engaging and entertaining. Of all the apps integrating AR into their products, this [for me] is the best use of AR I have seen. Great job guys!
Hustle Crew Academy
Mondly Languages
Mondly Languages
Mondly Languages
Mondly Languages
Mondly Languages
Questo
Questo
Product Hunt
Mondly Languages
Prototypr
Mondly Languages
Questo
Questo
Gummicube
Questo