Sign in to your Android Police account
Summary
- Gemini Live’s screen-sharing and camera capabilities are now free for all Android users.
- Easily share your screen or camera feed with Gemini Live, which can analyze whatever is on your screen or directly in front of your camera.
- This concept was originally shown off as part of Project Astra at Google I/O 2024.
Project Astra is slowly but surely becoming a thing. Google showed off this concept at I/O 2024. In the clip, a woman scanned her Pixel phone around her office and the Gemini AI on her phone pointed out all the things it saw, including the location of her office. It was cool, and now the powerful screen and camera capabilities in the clip are here. And free.
Related
What is Google’s Gemini Live?
Google’s new voice assistant
Gemini Live’s screen-sharing and camera capabilities are now rolling out to all Android users (via 9to5Google). These were previously locked behind a paywall, and only some Gemini Advanced users had access. But now, Google says it is removing the paywall entirely.
Ask Gemini about your screen or camera feed
Source: 9to5Google
It’s easy to share what’s on your screen or camera. When you launch Gemini Live, a chip will pop up with the new “Share screen with Live” option. You’ll then see a small counter in the status bar if you confirm, and a new phone-call notification. You can scroll through websites or apps while talking to Gemini, and end the session at any point via the notification shade.
You’ll need to use Gemini Live in fullscreen to use the new camera features. Once you open Gemini, you’ll see a camera icon to the left of the microphone. Tapping it opens a live viewfinder with the option to flip between different lenses. Keep your movements steady for the best results, and keep your display active during use or Gemini Live will turn off.
There are even real-time haptic vibrations with the new Gemini features to make the entire experience feel more responsive.
Gemini keeps growing
Gemini can already analyze images, PDFs, and even YouTube videos. Now, thanks to this latest update, it can analyze whatever is on your screen, or directly in front of you. Want to know what kind of plant you’re looking at? Point your phone’s camera at it and ask Gemini .
Best of all, this is free for all users. It will take a few weeks to roll out to all devices, so if you don’t see it yet, keep an eye out. It should reach all Android phones and tablets by the end of the month.
