Your iPhone, Controlled by an AI Agent

A tiny tool with a big idea

Somewhere in Málaga right now, someone is probably copying data by hand from their phone into a spreadsheet. It doesn't have to be that way.

A developer named Shawn Pana just released a small tool called phone-harness. The idea is simple: your Mac can already mirror your iPhone screen — Apple added that in a recent macOS update. Shawn's tool lets an AI agent see that mirrored screen and actually interact with it. Tap buttons. Scroll through apps. Type text. Take a screenshot to check what happened. Then do it again.

No jailbreaking your phone. No special developer account. Just your Mac, your iPhone, and a mirror.

Why this matters for a real business

Think about any task that lives inside a mobile app and can't easily be done from a computer — checking a supplier's portal, managing a booking platform that only has a phone app, or pulling numbers from an app that doesn't export to anything. Today, a human does that by hand. Tomorrow, an AI agent could do it while you sleep.

It's early. This is the kind of thing that breaks occasionally and needs someone watching over it. But the direction is clear: the gap between "AI can do things on a computer" and "AI can do things on a phone" just got a lot smaller.

If you have a repetitive mobile task that you've accepted as just part of life, it might be worth a second look.

Words worth knowing

AI agent — An AI that doesn't just answer questions, but actually does things: clicks, fills forms, navigates apps, sends messages.

iPhone Mirroring — A built-in Apple feature (macOS Sequoia) that shows your iPhone screen on your Mac and lets you use it with your mouse and keyboard.

Open source — The recipe is public. Anyone can read it, use it, or improve it. Usually free.

OCR — "Optical Character Recognition." A way for software to read text from an image, like how your phone can read a receipt.