Google AI Mode And Lens Are Working On Its Own Conversational ‘Live’ Camera Mode

Last month, AI Mode gained Google Lens integration (as depicted above) to power multimodal search. Google is now working on “Live for AI Mode.”

About APK Insight: In this “APK Insight” post, we’ve decompiled the latest version of an application that Google uploaded to the Play Store. When we decompile these files (called APKs, in the case of Android apps), we’re able to see various lines of code within that hint at possible future features. Keep in mind that Google may or may not ever ship these features, and our interpretation of what they are may be imperfect. We’ll try to enable those that are closer to being finished, however, to show you how they’ll look in case that they do ship. With that in mind, read on.

In essence, it appears that Google Search is getting an equivalent Gemini Live-Project Astra capability. The difference, however, appears to be a focus on searching rather than providing personal assistance.

Strings in the latest Google app beta (version 16.17) explain how: “With Live, you can have a real-time voice conversation with AI Mode to find exactly what you’re looking for. Tap the mute button to mute the microphone, tap close to exit.

From the usual disclaimer, we get the official name: “Live for AI Mode is experimental and can make mistakes.”

Live requires AI Mode

Notably, Google is building this Live capability into Google Lens:

Start speaking to search
To start searching and hear results, raise the volume on your device
Tap to interrupt response playback.
”It’s not possible to ask a follow up question. Your next question will start a new search.”

Like Gemini Live, there’s a reminder to increase your volume and the ability to interrupt responses. There will also be a control notification while this is active: