Photo credit: www.androidcentral.com
What you need to know
Google has announced its plan to enhance AI Mode on Google Search by integrating Gemini’s multimodal features, significantly expanding the platform’s ability to address more complex queries seamlessly. This new capability is set to roll out to an increasing number of “Labs” users within the United States.
According to a recent announcement from Google, the integration of Gemini represents a significant upgrade for AI Mode, taking advantage of the advanced features of Google Lens.
Google expressed that this updated experience combines the robust visual search capabilities of Google Lens with a tailored application of Gemini. This innovation enables users to ask detailed questions about visual elements they encounter, directly interacting with the platform through images.
Those granted access to AI Mode will be able to take pictures or record videos and pose intricate inquiries about the visuals presented. For example, users can engage in exploratory discussions or address multifaceted tasks, such as comparing products, seeking guidance on procedures, or organizing travel plans, as noted in the company’s statement.
(Image credit: Google)
The advancement stems from Gemini’s capability to process multiple modalities. Google elaborated that once AI Mode is activated, it can interpret various aspects of a scene depicted in an image, including colors, materials, shapes, and relationships between different objects. An illustrative example given by the company shows that AI Mode can identify book titles, deduce themes, and recommend similar, well-rated titles for users.
Emphasizing its technical sophistication, AI Mode employs a “query fan-out” approach similar to both text-based search and AI interactions, allowing it to generate multiple queries that pertain to the overall image as well as the individual items within it. Notably, this mode will be accessible via both mobile and desktop searches, although it remains to be clarified whether the Lens feature will have the same level of access, given that demonstrations primarily utilized mobile devices.
(Image credit: Google)
It’s worth mentioning that Google initiated tests for AI Mode only last month and has garnered positive responses from users who subscribe to Google One AI Premium, who have reported that the AI Mode delivers swift and thorough answers to intricate and nuanced inquiries, often providing more detailed information than traditional Google searches.
Finally, Google highlighted its commitment to continuously refine AI Mode using feedback from its user base in “Labs.” The new AI Mode is currently available on both Android and iOS platforms through the Google app for subscribers of Google One AI Premium.
Source
www.androidcentral.com