GitHub radar
Control your iPhone with your AI agent!
Phone Harness allows Claude Code or Codex to interact with a physical iPhone, using macOS’s iPhone Mirroring (screen sharing) without requiring a jailbreak or Xcode. It uses OCR to read the phone’s display and emulates user input by tapping, typing, and scrolling.
Phone Harness is a straightforward Python interface to a Claude Code or Codex agent that leverages native macOS iPhone Mirroring (screen sharing), built into macOS Sequoia, to control a real iPhone. Phone Harness screenshots the mirrored window using screencapture, extracts the text and element coordinates via Apple Vision OCR, and injects simulated touch, swipe, and keyboard inputs at the OS level. No jailbreak required! No WebDriverAgent! No Xcode!
Why a vibe-coder should care
Instead of telling your agent what to see on the screen, simply instruct it to take action like opening an app, filling out a form, or manipulating an iOS UI. It will create any necessary helper functions on the fly to manipulate the existing UI.
▌ More finds