Gemini Can Now Use Your Mac for You, but There's a Catch
On November 19, Google announced one of the biggest updates yet to the Gemini app for Mac: computer use. In plain terms, Gemini can now work your Mac for you. You describe a task, and Gemini does the clicking, typing, opening menus and filling out forms, across your desktop apps, your local files and the web.
How It Works
You start a prompt with "@Computer use" and describe what you want done. Gemini then works in a separate background window, so your own cursor stays free, and you can follow along through a live preview right inside the chat. You stay in control: you choose which apps Gemini can access, you can pause it at any time, and Gemini asks for your approval before key actions.
Who Can Get It
This is where it gets less exciting for some of us. Computer use is not free. You need a paid Google AI plan, either AI Plus, Pro or Ultra, with AI Plus starting at $4.99 a month. It's rolling out gradually, in English, in the US only, for personal Google accounts of people 18 and over. You also need an Apple silicon Mac running macOS Sequoia 15.0 or later. The Gemini app itself is still free to download, it's just this feature that sits behind the paywall.
Why It Matters for Blind Users
For those of us using VoiceOver, an AI that can do multi-step tasks on the Mac could be a real game changer. Think of all the inaccessible buttons, confusing web forms and long chains of clicks we deal with every day. Handing that off to an assistant sounds like a dream.
The big open question is accessibility. The live preview is a visual window, and nobody has really tested yet how well VoiceOver can follow what Gemini is doing, or how accessible those approval prompts are. Reviews so far are mostly based on Google's announcement rather than real hands-on use.
I'm Testing It
That's exactly what my new series, Gemini at the Wheel, is about. Part 0 is already up on Blind Sanity and explains why I'm handing my Mac to AI. Part 1, on downloading and installing the Gemini app with VoiceOver, is coming soon. I'll report back honestly on what works, what doesn't, and whether it's worth paying for.
Have You Tried It?
Have you tried Gemini computer use yet? Leave a comment below or contact me and tell me how it went.
Comments