Key Info

Google has introduced computer use in the Gemini app for Mac, allowing Gemini to carry out tasks across folders, apps, and the web in a live background window while the user retains control of the screen and cursor. The feature is rolling out in the U.S. in English to Google AI Plus, Pro, and Ultra subscribers.

Highlights

  • Gemini can click, scroll, and type inside a background window while the user keeps using the screen and cursor.
  • Tasks can span local folders, installed apps, and the web.
  • A demo shows Gemini turning a quick sketch into a rigged 3D model in Blender.
  • Availability is limited to the U.S. in English, for Google AI Plus, Pro, and Ultra subscribers on the Gemini app for Mac.
  • The Gemini app for Mac can be downloaded, with further details in Google's blog post.