Google is rolling out an update to the Gemini app for macOS that adds system-wide voice input and optional “screen-aware” capabilities. With the update, users can activate Gemini voice controls from any application by long-pressing the Mac’s Function (Fn) key. Google describes an “intelligent dictation” mode that turns natural speech into text at the cursor, including correcting mid-sentence and removing filler words such as “ums” and “ahs.” The feature is described as being turned on by default, and Google says users can then “create, edit, and summarise” content while speaking, without needing to open a separate chat window or copy text between apps.
In addition to dictation, Google introduces an opt-in mode that can use what is visible on the Mac’s screen to handle more complex requests. In reporting across outlets, the feature is described as enabling Gemini to interpret highlighted or selected on-screen items—such as text, documents, files, or images—to edit or summarize content directly in the app the user is working in. Some sources also mention generating and editing images when screen-aware mode is enabled. The update is currently rolling out globally for English-language Gemini users, with additional languages planned.
