Google has introduced real-time AI features to its Gemini system, expanding its ability to interpret live smartphone screens and camera feeds instantly. These new capabilities, part of Google's ongoing AI advancements, will initially be available to select Google One AI Premium subscribers.
A key highlight of this update is Gemini’s live video feature, which enables the AI to analyze a smartphone camera feed in real time and provide instant insights and answers. This enhancement builds on Google’s earlier ‘Project Astra’ demo, bringing interactive, AI-powered conversations to everyday users.
Additionally, users can now engage in dynamic back-and-forth conversations with Gemini based on the content displayed on their screens. A recent demo by a Reddit user showcased the ‘Share screen with Live’ feature, which allows Gemini to process and respond to on-screen information through an overlay function.
Google has confirmed that these features will be rolled out first to Gemini Advanced subscribers under the Google One AI Premium Plan, with Pixel and Galaxy S25 users among the first to gain access.
Beyond real-time AI video, Google is also launching 'Canvas', a tool aimed at helping users refine documents, edit code, and develop prototypes seamlessly. This feature streamlines workflows for web apps, Python scripts, and other digital projects by offering instant AI-assisted refinements.
Another major addition is ‘Audio Overview’, a tool that transforms documents, slides, and research reports into podcast-style AI discussions. This feature is designed to make complex information more engaging and accessible by presenting it in a conversational format between two AI-generated hosts.
With these enhancements, Google continues to push the boundaries of AI-powered user experiences, making Gemini a more interactive, real-time assistant for both everyday users and professionals.