Launching today
Opposable
Computer use for phones to give your AI thumbs
41 followers
Computer use for phones to give your AI thumbs
41 followers
Opposable lets Claude Code, Codex or any MCP agent see, tap and type on a real iPhone or Android phone, in every app you're signed into. Common tasks run on the phone with no model at all, payments wait for your tap, and iPhones work through Bluetooth or a tiny USB stick.
the line that catches my eye is "payments wait for your tap." that only works if the agent itself can reliably tell a payment screen from a non-payment screen, and phone UIs don't always make that obvious, a P2P transfer, an in-app purchase inside a game, topping up a gift card balance can all look like a plain confirm button with no special styling. is that detection a hardcoded list of known payment apps and flows, or something more general, and what's the failure mode when it meets an app it doesn't recognize, does it default to pausing for a tap or default to proceeding
@galdayan yo! all good questions! it’s not a list of known apps; every action the agent takes goes through a check on the phone before it happens, whether it be from claude, chatgpt, claude code or our own on-device agent. it looks at the whole screen instead of just the button - if there’s an amount with a currency, a total, a balance, a card number or a payment sheet on screen, or the app moves money (banks, wallets, stores, games with in-app purchases), then any confirming tap waits for you, whatever the button says. slide-to-pay and hitting enter on a form get the same treatment.
when it’s unsure it asks and you get an approve/deny on the phone, the agent waits, and the decision goes in a log. being asked once too often is a bit annoying, money moving without you is way worse, so right now leaning towards asking.
not perfect ofc but anything that looks even a bit like money stops and waits for you, at least for now!
@erik_markk that threshold-based reading (amount, currency, balance, card number) makes sense for most banking apps, but what about things that don't carry a currency symbol at all - crypto wallet transfers priced in tokens, loyalty points, in-game currency you bought with real money once and now just spend. those move real value without tripping any of the signals you listed. do you treat "this app has ever touched money" as sticky once detected, or does it re-evaluate screen by screen and risk missing the second case