Captions for iOS

Captions for iOS

Live Captions & Translation in real-time

1 follower

Get Live Captions and Translation in real-time for all audio played on your iPhone or iPad
Captions for iOS gallery image
Captions for iOS gallery image
Captions for iOS gallery image
Launch tags:iOSiPadApple
Launch Team
Anima - OnBrand Vibe Coding
Design-aware AI for modern product teams.
Promoted

What do you think? …

Marcel Braun
Hi, I'm a 13-year-old that makes iOS apps. I was sitting in the bus when I noticed that I had forgot my headphones but there was this one video somebody sent me that I wanted to watch. Then the idea came into my head: "What if I could make an app that transcribes the audio of the phone in real-time?" So that's what I did. Why does the app cost money? I have an old Mac Mini that can barely handle Xcode, the tool that is used to make iOS apps and I hope I can one day replace it with a newer one.
Stijn
@marcel1 The app looks awesome! What Speech to Text service are you using?
Marcel Braun
@stijn_d3sign Thank you! I'm using Apple's Speech Recognition API as it's fast and integrated nicely in iOS. I would like to use Google's Cloud Speech to Text but sadly it's too expensive.
Isaac Moore
@marcel1 Great job, genius idea!
Marcel Braun
@iamramsey Thanks!
Marcel Braun
@stijn_d3sign @greg_edmiston The app uses Apple's Speech to Text API and Google Translate API. While Apple's STT API is free, Google Translate API costs money so translation sadly costs a few dollars. If somebody knows a free alternative to Google Translate API, please be sure to let me know.
Jake Mor
@marcel1 This is really great! I started making apps when I was 15 and I've been hooked ever since. Nice to see a young programmer making strides. I like how you're looping together ReplayKit and the Speech framework — VERY creative. I hope you're going to WWDC as a scholar. The atmosphere there is simply incredible, you'll be in heaven. I did it a few years ago as a college student and my experience was over the top. Please reach out if you ever want to talk iOS, swift or app design!
Marcel Braun
@jakemor Really big thank you for your comment! Developing apps is fun and a way to express creativity I think. Sadly I can't apply for a WWDC scholarship until I'm 16 as this is the age requirement for people from Europe. I would absolutely love to go though. I'll be sure to talk to you if something comes up. Also, do you know how to save a video from ReplayKit's sample buffers? I've been trying but I can't get AVAssetWriter working.
Jake Mor
Jake Mor
@marcel1 @giridharvc7 make sure you give it a unique filename, I suggest using the current timestamp
Marcel Braun
@giridharvc7 @jakemor I think I copied everything but the initialization is maybe wrong. https://gist.github.com/thatmarc... I probably made a dumb mistake
Jake Mor
@giridharvc7 @marcel1 what error are you getting?
William Hu
Heyy @marcel1, if you're interested, I can redesign your app for free ahaha (seriously)
Marcel Braun
@williamhutech Hey, if you have an idea for a new design feel free to send it to me on Twitter (twitter.com/thatmarcelbraun) ;)
William Hu
@marcel1 Sure~ I’ll work on it after my final year exams 🤣
Marcel Braun
@williamhutech Good Luck!
Lee Chambers
?makers I've download and set up as per instructions but once I start to broadcast, how do I actually see the captions. I've tried launching a YouTube video but don't see anything. Thanks.
Marcel Braun
@nickatloot Thanks! I‘ll try what I can
Denis Shershnev
Great work @marcel1 ! Good luck to you!
Marcel Braun
@eulerr Thanks! I‘ll try my best
Mark McCammon
I purchased this app but I don't understand step 2. Can you please elaborate
Marcel Braun
@mark_mccammon Hi, thanks for your purchase and comment. The app uses iOS' broadcast feature that forwards all audio played on your iOS device to the app. To activate it, make sure the recording toggle is in your control centre as mentioned in step 1 by going into the iOS settings, control centre, customise controls and click the plus icon on screen recording so it appears in the upper list. Then, swipe up to open the control centre and if you have an iPhone 6s (Plus), 7 (Plus), 8 (Plus), X or Xs Max, press hard (make a 3d touch) on the recording toggle (the icon with the circle outline containing a dot) or if you have another iOS device, long press the toggle for a menu to come up (see https://tmdev.pw/8fd3e). Then, select Captions and "Start Broadcast" and you should be good to go.