Gemini Live Widely Rolling Out Camera & Screen Sharing On Pixel 9, S25 Series

After starting in March, Google is now officially rolling out camera and screen sharing in Gemini Live for Android to the Pixel 9 and Galaxy S25 series.

To date, Gemini’s conversational mode has only accepted voice, image, PDF, or YouTube video input. Thanks to Project Astra, Gemini Live can now see what’s on your screen. Upon sharing your display, you can navigate and scroll to something and ask questions about it. 

One way to quickly access this is by launching the Gemini overlay and tapping the new “Share screen with Live” chip. Android will make users confirm that they want to share their entire screen with the Google app, which powers Gemini. (The “Share one app” option has been disabled.)

There’s a call-style notification that shows a live count next to the time in the status bar. Clicking that pill opens the fullscreen Gemini Live experience. You also get a blue/purple Gemini waveform at the bottom of the screen. There’s a subtle vibration before Gemini Live starts responding to your query.

Another way to launch is by opening Gemini Live as you normally would and hitting the screen share button. A small redesign shrinks the circular buttons into smaller pills. 

Meanwhile, you can share your rear camera feed with Gemini Live to have a conversation about what you’re seeing in the real world. A live preview will take up most of the screen, while you can switch to the front-facing camera from the bottom-right corner of the viewfinder.

Google notes how: “For better results, capture objects with steady movements.” There’s also a “To interrupt Gemini, tap or start talking” reminder. The screen has to be active for Gemini Live to receive video.

Google first teased Project Astra — DeepMind’s goal to build a “universal AI agent that is helpful in everyday life.” — last May at I/O 2024. New features made possible by Gemini 2.0 were detailed that December, while Google talked about it again in January at the Galaxy S25 launch.

As of today, Google is bringing these Astra-powered Live capabilities to “more people, starting with all Gemini app users on Pixel 9 (officially, it’s a one-feature Pixel Drop) and Samsung Galaxy S25 devices.” Force stop the Gemini/Google app to get it.

It will “soon” be available to all Gemini Advanced subscribers ($19.99 per month Google One AI Premium) on Android devices.

Add 9to5Google to your Google News feed.