News

Google Let Gemini Click Through Mac Apps in a Side Window and Left You the Last Click

Google launched computer use in the Gemini Mac app on November 19. It clicks through local files, desktop apps and the web in a side window. US English, Apple Silicon, Google AI Plus Pro or Ultra.

Google just taught Gemini to use a Mac the way a person does: click, type, open menus, fill forms. Then it parked that work in a side window so your cursor stays yours.

On November 19, Google said computer use is live in the Gemini app for Mac. You describe a multi-step job across local files, desktop apps, and the web. Gemini navigates the menus, types the fields, and clicks through the screens. It runs in an isolated background window with a live preview in the chat. The main screen and the pointer stay free, which is the point: you can keep typing, designing, or taking a call while it works.

You pick which apps it can touch. You watch every step. You can pause. Google says you approve key actions before they happen. Product manager Michael Friedman put it in those terms: Gemini handles the clicking, typing, menus, and forms; you keep the last say.

English, paid, Apple Silicon

The rollout is narrower than the marketing screenshot. Computer use is in English, in the United States, for personal Google accounts 18 and older on Google AI Plus, Pro, or Ultra. It needs an Apple Silicon Mac running macOS Sequoia 15.0 or later. Download is at gemini.google/mac.

The examples Google offered are the chores people already hate. Batch color-grade photos or set up 3D scenes. Pull weights, dimensions, and addresses out of local PDFs and drop them into a shipping quote. Grab metrics and screenshots from live dashboards and build a Google Slides deck. Look at clothing photos in a folder, research prices, and stage resale listings.

That is not a chatbot answering a question. It is an agent with a mouse.

The window is the product

Google is selling the isolation as a safety story and as a convenience story at once. A live preview in chat means you can see the clicks without handing over the display. App-by-app permission means Gemini is not supposed to get the whole disk because you opened the app. The timing lands next to Apple's move to tighten full disk access for AI agents on Mac, a fight Techpresso covered when the first restrictions landed.

Gemini 4 Neon, the cheaper mid-tier model Google shipped the same week, is the other half of that pitch: enough model to drive a workflow, at a price that makes leaving it running in a side window feel cheap. Computer use does not name which Gemini 4 snapshot sits behind the clicks.

The risk is the same one every computer-use demo hides. A wrong click in the wrong app looks, from the live preview, like progress. Google's answer is the pause button and the approval step. The feature is built around that pause, and only for people already paying for Gemini on a recent Mac in the US.

Some offers on this page may be paid placements or contain affiliate links.

Subscribe to Techpresso

Free daily newsletter, read in 5 minutes.

Subscribe free