Google has initiated the deployment of novel artificial intelligence functionalities within Gemini Live, enabling it to perceive and analyse content displayed on your screen or captured through your smartphone camera, subsequently providing real-time responses to inquiries pertaining to either input source, as confirmed by Google spokesperson Alex Joseph. This development transpires nearly a year subsequent to Google’s initial demonstration of the “Project Astra” technology, which underpins these advanced capabilities.
Read: OpenAI imposes image generation limits amidst high demand
A user on the social media platform Reddit reported the appearance of this feature on their Xiaomi mobile device, as initially highlighted by 9to5Google. Subsequently, the same user disseminated a video showcasing Gemini’s newly implemented screen-reading proficiency. This functionality represents one of the two key features that Google had previously announced in early March, stating its intention to “start rolling out to Gemini Advanced Subscribers as part of the Google One AI Premium plan” later in the same month.
The second Astra-derived capability currently being rolled out is live video interpretation, which facilitates Gemini’s analysis of the real-time video feed from your smartphone camera and its ability to answer questions about the visual content. In a demonstration video published by Google earlier this month, a user employed this feature to solicit Gemini’s assistance in selecting a suitable paint colour for their recently glazed pottery.
See also

Google’s progressive rollout of these features serves as a contemporary illustration of the company’s significant lead in the realm of AI assistants, particularly as Amazon gears up for the limited early access debut of its Alexa Plus upgrade and Apple experiences delays in the rollout of its upgraded Siri. Both Amazon and Apple are expected to introduce functionalities analogous to those currently being enabled by Astra. Concurrently, while Samsung maintains its Bixby assistant, Gemini has been established as the default assistant on its mobile devices.
Crédito: Link de origem