Ben Lang

Eyeware Beam - Turn your iPhone into a head and eye tracker for your Win PC

by
Top Product
β€’

Turn your iPhone or iPad into a head and eye tracker device for your Windows PC!
Using the TrueDepth selfie camera of your iPhone or iPad, Beam offers you a quick and easy way to activate head tracking and eye tracking for your games and streams.

Add a comment

Replies

Best
Mihai Sava
Great stuff!!! Do you see any use cases outside of gaming?
Kenneth Funes
@miz252 hi and thanks for spending your time to check us out! Thanks for the support! Great to see people are enthusiastic about Beam. Definitely! I mean, we're in the field of eye tracking R&D for many, many years and there've been a lot of use cases that we explored and are still exploring. Currently, what we're focusing on apart from the gaming and streaming industries, are the UX and academic research markets. There are some projects in the oven that are waiting to see the daylight. I don't have anything public to share yet, but if you wanna talk about these, we can continue the conversation in private. Also, for anyone interested in an API please reach out to us here https://beam.eyeware.tech/develo....
Kenneth Funes
@miz252 one other use case we approached with the eye tracking technology we developed is for example automotive. This is a B2B collaboration and the scope was to offer eye tracking technology that can work under any lighting conditions and for anyone when coupled with small automotive-grade camera sensors. This is the same eye tracking tech we developed, but coupled with other types of cameras. Purpose of technology is to enhance safety for drivers by alerting them when they are tired and should take a break for example. More about this topic can be checked out here: https://www.melexis.com/en/news/...
Mihai Sava
@kenneth_funes I've seen a similar example a while back!! I was just curious to find out more; but anyhow, this looks super exciting!
Kenneth Funes
@miz252 thanks man! It's a wild ride and there's so many amazing things that can be built!
Tom Reed
@miz252 @kenneth_funes This would be super useful for drivers, but how do you protect the data? (Car crash -> insurance company denies all claims because the driver wasn't as "attentive" as they demand.)
Ugur KILCI 😈
Wow, this is so good. 😱
Kenneth Funes
@ugur2nd Thank you for your feedback! Happy to see that the content creators on YouTube are enthusiastic to use Beam πŸ”₯! You can join us on Discord and keep in touch with us and the community here: https://discord.com/invite/7ZKB8tm. What kind of content do you create?
Ugur KILCI 😈
@kenneth_funes My friends produce this content. I also recommended it to my friend who streams Twitch.
Kenneth Funes
@ugur2nd That's great! Thanks for spreading the word among your friends. Saw you joined the Discord server - welcome to the family and enjoy your stay with us :D!
Valeriy Kozlov
Pretty cool idea! If you can combine it with any emotions tracking gadget (for example, based on skin resistance measuring), you will be able to measure user's emotional response to media, games and entertainment products.
Kenneth Funes
@valeriykozlov2 thank you for your appreciation! Yeah, that's something that indeed happens. And you have all these multi-modal data points that you could potentially work with. Sounds like maybe you are working in the field of UX research?
Kenneth Funes
Hi @valeriykozlov2, getting back at you! - we just launched our API, in case you find it useful for you or your team: https://beam.eyeware.tech/develo...
Bogdan Ionita
Really cool use of truedepth, congrats guys!
Kenneth Funes
@bogdan_ionita Thanks! Really appreciate the support! We were super excited to see the iPhone X launching back in 2017. We were already working for some years in developing our core eye tracking tech, but we only had bulky sensors to work with (no where near the TD size). When the TrueDepth camera module emerged, we immediately knew this was the beginning of a beautiful friendship :). There are so many opportunities and use cases to be enabled. You can even think of research or accessibility applications. Have you worked with applications that were using the TrueDepth camera functionality?
Serban Mogos
@bogdan_ionita mersi Bogdan 😊
Alexandra Petrus
Bringing eye and head tracking to daily uses like gaming and streaming via a device in our pocket (ok iPhone X above but still), and enjoying extra immersion or improved gameplay at the tap of a few buttons and in record time, sounds to me like eye tracking democratization. Well done to the entire team! Beautiful use of eye and head tracking in a daily use! Twitch, streaming, here I come. I look fw to seeing new metrics for in-game engagement unlocked via the eye tracking use. Oh, and count me in as a beta tester for when/if you add pairing for iOS - MacOS as well. The M1 chip brings gaming to life to MacOS.
Bastjan Prenaj
@alexandra_petru_ Thanks Alexandra! You're first in line as soon as we have the Mac version ready ;)
Serban Mogos
@alexandra_petru_ Thank you Alex! Indeed, our goal is to bring eye tracking enabled experiences to many more users and use cases, and gaming and streaming is an exciting first step. Would love to have you as a tester soon, the MacOS release is also in the oven 😊
Kenneth Funes
Hello Product Hunt people! We're very excited to share with you the iOS/Windows app we've been working on! It’s called Eyeware Beam and it turns your iPhone or iPad into a head and eye tracker device for gaming and streaming on a Windows PC. We aim to support and contribute to the continuously growing head tracking and eye tracking features that enhance your gameplay, maximize immersion and enrich your content and streams. We believe this is a game changer (literally), as you can take advantage of a device that is in your pocket, instead of buying extra hardware. We wanted to create a product that would then eliminate this entry barrier that streamers and gamers are experiencing today. Currently Eyeware Beam is a public beta that is temporarily free. A paid version will be released in the coming months with improved and new features. We are likely to keep a limited version of the app for free. Please share with us your feedback so we can keep improving the app! ❔ This is how it works: We have developed a unique and patent-pending technology that uses computer vision, AI, and also 3D cameras (like Apple’s front-facing TrueDepth cameras) for remote and accurate eye and head tracking. For this reason, Eyeware Beam is currently only compatible with iOS devices having a TrueDepth cam (those supporting Face ID). The tracking functionality is running on your iOS device when the Eyeware Beam app is open, whereas a software counterpart needs to be installed in your PC and, once paired with the device, a user is ready to stream their gaze or play simulator games that support head tracking. πŸ”₯ The app is useful for: - simulator gamers who use head movement as an input in the game, - influencers who want to differentiate themselves while creating reaction videos, - gamers who want to improve their gameplay by recording their gaze into replays using OBS, - gamers who want to teach others through sharing their own gameplay insights overlaid with the eye tracking bubble and, - streamers who want to engage better with their audience by sharing where they are looking at. πŸ‘€ You can use Beam to: - share your eye gaze and create more engaging content on your stream - experience a deeper feeling of immersion in simulation games with head tracking - use the eye tracking bubble as an overlay with OBS to record your gameplay and to afterwards analyze or share it with your community to help them get better πŸ–₯️ πŸ’» Games it works with: - for head tracking: 150+ games that supports an Open Track or Free Track integration - for eye tracking: any game or content type displayed on your Windows PC screen πŸ‘‰ You can use the public beta version for free: - AppStore link: https://apps.apple.com/us/app/ey... - Community Forum link: https://community.eyeware.tech/
Ken Savage
Congratulations on the launch. What are some of the most common uses for this app? Also how are people able to take the data that the app collects and apply it to their project?
Kenneth Funes
@kensavage hi! You can think of content creators who'd want to make their content more interesting by sharing their eye gaze (e.g. the eye tracking challenge) or gamers who play simulator games (European Truck Sim, American Truck Sim, Microsoft Flight Simulator) and what to use their head movement to control the in-game camera. You can also think of gamers who want to record their gameplay with the eye gaze bubble turned on and analyze it after to improve the way they play.
Serban Mogos
@kensavage Regarding data collection, Beam does not collect any eye tracking data or other private data from its users. However, we will be very soon launching a separate product designed with that goal in mind that would allow UX researchers, academic researchers, or app developers to access the eye tracking data for studies or other use cases. Anyone interested in that can let us know here - https://beam.eyeware.tech/develo... - and we will be in touch with news soon. Do you have a project in mind that would benefit from eye tracking data?
Oana-Maria Pop
Very excited to see you guys progressing! Was reading from @serbanmogos that you will launch a separate product that allows UX researchers, academic researchers, or app developers to access the eye tracking data for studies or other use cases. This to me is super powerful. I know we also talked about applications in health. As a non-gamer, those are the ones I'm mostly interested in.
Bastjan Prenaj
@serbanmogos @oana_maria_pop Hi Oana-Maria! Yes, the research fields you mentioned will likely be some of the first ones for us to support. I personally look forward to devs that want to build an accessibility application or health screening application based on Beam. For anyone interested, please head over to our devs page and don't be shy ;) https://beam.eyeware.tech/develo...
Serban Mogos
@oana_maria_pop Thank you Oana for the feedback! Indeed, there will be more announcements coming soon on making quality eye tracking data available for research studies and other applications. We are also welcoming developers that are interested to build various application on top of Beam, including for accessibility and healthcare.
Kenneth Funes
Hi @oana_maria_pop Just letting you know that we have now launched our SDK. The API is available in early access. Hoping that's useful for you. Please also feel free to spread the word to friends and colleagues https://beam.eyeware.tech/develo...
Akatsuki Katsumi
Does it work in Elite Dangerous?
Bastjan Prenaj
@_davehdez Hi David! (corrected answer) Yes, the head tracking does work with Elite Dangerous. We enable head tracking in 150+ games that support an Open Track or Free Track integration. Here a non-exhaustive list: https://en.wikipedia.org/wiki/Li... The eye tracking is currently simply an overlay (e.g. to enhance your streaming content) and can be used as such for any game or content in general.
Kenneth Funes
@_davehdez sure thing. We have a short version tutorial and a longer version tutorial on how to set up head tracking in simulator games. Depending on how fine you wanna tune your head tracking and immersion experience, please check out the options we've described here https://community.eyeware.tech/t...
Igor Zalutski
Damn. Such a cool concept. One of those "how come this wasn't done before". Thats basically AR without the bulky headset!
Kenneth Funes
@igorzij love your comment, man! Thanks for the appreciation you're showing! There are a few solid reasons for which this wasn't possible until now, but we're not gonna dive into that. You can imagine we're super hyped to be able to bring this to the market! Have you tried it?
Igor Zalutski
@kenneth_funes i'm on the android side - any plans to support the green robot anytime soon?)
Kenneth Funes
@igorzij Gotcha! We definitely have that on the roadmap. We don't have a precise point in time we can share. Also some good news have recently surfaced regarding the adoption and integration of high-quality 3D cameras in Android devices.
Kenneth Funes
@igorzij we just saw this press release for MWC and we're happy about these near future developments. From now on it's gonna be a matter of adoption. At least that's what we hope of course. https://pmdtec.com/en/company/ne...
Jorrel S
Amazing! I love the democratization of this technology. Keep it up!
Bastjan Prenaj
@jorrel_s Thanks Jorrel! That's right. Making head and eye tracking reliable with consumer hardware will hopefully open up solutions in many more fields beyond gaming and streaming, such as accessibility and at-home health screening.
Andra Lazar
This sounds very cool for marketing purposes, too. Is there a way for the app to be used as a marketing research tool?
Bastjan Prenaj
@andra_lazar1 Hi Andra! Yes, there are quite a few use cases where turning your iPhone into an eye tracker will open up new opportunities in research. Make sure to subscribe to our Eyeware newsletter (eyeware.tech) to get informed about our upcoming product releases.
Kenneth Funes
@andra_lazar1 you can find the newsletter subscription form at the bottom of Eyeware's home page https://eyeware.tech/. Let us know if there are any use cases that you would like to specifically approach.
Md Rakibil Saimon
Nice
Kenneth Funes
@rakibulsaimon Thanks! Glad you like it!
Manash Karmakar
Amazing
Kenneth Funes
@manash_karmakar Thanks! Great to hear you think that!
Nightmare_se
I am currently using this product in my live streams on Twitch which is my main platform. I also use it when live streaming on occasion to YouTube and Glimesh as well. Having previous experience using other head and eye tracking hardware and software like TrackIR and Tobii I was interested and intrigued from the start when approached by a member of Eyeware in my live stream. I started by using it a little offline. Experimenting with the different settings and features until I introduced it into a few streams. Immediately my community was curious as I was solely using the TrackIR which they were used to seeing. Now after some further development and some improvement updates I am using Eyeware Beam full time. I can't wait to see how this product evolves, improves and develops.
Yukari Yakumo
Amazon! it looks helpful for me !
Bastjan Prenaj
@yukariyakumo450 Glad to hear Yukari.
Robinson Michael
This is cool!!
Bastjan Prenaj
@robinson_michael1 Thanks! Please make sure to subscribe to our newsletter for the latest updates too.
Simple Funny Studio
very cool! Surprised me!
Caramel Hitaco
Calok sebagai panggilan warga di tempat untuk sambal yang dibuat dari udang kecil. Sambal ini mempunyai cita-rasa asin dan pedas renyah yang begitu nikmat. https://menu-rumahan.com/ Umumnya calok dihidangkan bertepatan dengan ikan asal atau ikan salai. Kombinasi dari ikan salai dengan sambal calok itu membuat cita-rasa yang begitu nikmat di lidah.
David Dennison
Can't download the desktop app. Says the specified account is disabled. Looks like your Azure account got disabled? Lol?
Bastjan Prenaj
@daviddennison1 Hi David, could you please try again? Sorry for the inconvenience.