Gemini Can Now Click and Type for You on Mac

Google began rolling out computer use to Gemini for Mac on November 19. It lets Gemini click, type, and navigate menus on your behalf, so one request can span local files, desktop apps, and websites. Gemini works in a separate background window, with a live preview in your chat, while your screen and cursor stay free for whatever you’re doing, according to TechCrunch.

Of all Google’s examples, the shipping form is the one that got me. Google suggests having Gemini pull addresses, weights, and dimensions from local PDFs and put them into an online shipping quote form. Anyone who’s lost their place copying a row of measurements can see the appeal. Google also suggests pulling metrics and screenshots from online dashboards into a Google Slides presentation, as 9to5Google reports.

How to start a task and keep an eye on it

The rollout starts in English in the U.S. and requires the Gemini Mac app plus a Google AI Plus, Pro, or Ultra subscription, according to TechCrunch. The app requires an Apple silicon Mac, and the eligible plans start at $4.99 a month, reports MacRumors.

To start a task, add @Computer use to your prompt. You choose which apps Gemini can use, and you can stop it with one click. Google says Gemini pauses for logins and payments and asks for confirmation before sensitive actions, according to 9to5Google.

The timing is interesting if you’ve ever stared at a Mac permission prompt wondering how much access you’re about to grant. Apple is preparing new restrictions for apps that request full disk access, and a preview of the settings appeared in the macOS 27.3 beta, reports The Verge. Apple’s upcoming controls include options to limit access to specific apps and folders and an indicator for when one app is controlling another, according to MacRumors.

Gemini’s chat history settings are changing, too

Google is also rolling out separate controls for saved chat history and model training. If you want to pick up a conversation later, you can leave history on and opt out of training under Activity in Gemini’s settings. The training opt-out applies to future interactions, according to Ars Technica.

There’s a separate change for people who turn history off. Google’s updated privacy notice says it will keep future chats for around two months to respond to users, process feedback, and help protect users and the public. The in-app setting still said 72 hours when Gizmodo reported the change on November 17.

The first thing I’d want to see is how Gemini handles a whole batch of files when one of them breaks the pattern. Can it spot the odd one out and ask what to do with it? That’s the kind of judgment call that would make the live preview worth watching.

Comments

About Zippy

Zippy is a co-streamer on the Noobenheim Twitch channel, and starter of this fair site. He also is a lifelong gamer starting with Atari and the original GameBoy.

Check Also

Ubisoft Is Cutting 166 Jobs Across Its Montréal and Québec City Studios

Ubisoft confirmed 166 job cuts across Montréal and Québec City, two studios that worked on Assassin’s Creed Shadows. The company’s statement left individual projects unnamed.

Leave a Reply

Your email address will not be published. Required fields are marked *