Google has launched a new 'Search Live' feature in the US, powered by Gemini AI. Users can ask questions using voice input and receive real-time answers.
Google Search Live: Google has taken a significant step towards making its search experience more intelligent and interactive for its users. The company has launched a new feature, 'Search Live,' within its Google app's AI mode. Currently, it's a limited rollout in the United States. Notably, this new feature is based on a custom version of Gemini and offers advanced voice input support. This allows users to search using voice instead of text, ask follow-up questions, and receive relevant answers and website links on the screen.
What is Google Search Live?
Search Live is a new feature powered by Google's Gemini AI technology, taking voice-based interaction to a new level. Previously, Google Search involved typing a question and viewing the results. Now, voice is integrated into the process. You speak, and the AI responds instantly – in a conversational manner.
This feature is available in the Google app on both Android and iOS platforms. Users will see a new waveform icon below the search bar; tapping it opens the full-screen Search Live interface. Two options are available: Mute and Transcript. Mute displays answers in text format only, while Transcript records the entire conversation.
What can this AI feature do?
- Voice Interaction: Users can directly ask questions to the AI using their voice and receive immediate answers, similar to Google Assistant. Follow-up questions are also supported, creating a natural conversational experience.
- Smart Text Replies and Link Sharing: When an answer is provided, links to relevant websites are displayed on the same screen, allowing users to access more detailed information.
- Background Operation Capability: Google ensures that Search Live continues to function in the background even if the user switches to another app, allowing the conversation to continue.
- AI Mode History: A history of all conversations is saved in the 'AI Mode History' section, enabling users to review previous questions and answers.
Using Gemini AI
The 'Search Live' feature is based on a custom version of Gemini, specifically developed to enhance Google Search's intelligence. This feature uses query fan-out technology. When a user asks a question, this technology scans the web for related and reliable sources to generate a comprehensive answer.
Helpful for Multitasking
A key feature is that Search Live continues to operate in the background even after closing the Google app. Users can minimize the app, and their conversation with the AI assistant will continue. Furthermore, users can access their past conversations in the AI Mode History.
What is Query Fan-Out Technology?
This technology provides Google Gemini AI with enhanced intelligence. When a user asks a question, Google 'fans out' that single question to various websites, data sources, and potential answers, compiling this information to provide the user with the most useful and relevant response.
This differs from the older search experience, where users had to choose from the top 10 results. Now, the AI understands the user's need and provides the answer directly.
Future Camera-Based Interaction
Google states that it will add more advanced features in the coming months. For example, users will be able to point their phone's camera at an object and ask questions about it. For instance, if you take a picture of a plant and ask, "What is this?", the Search Live AI mode will provide the correct answer.
Currently Limited to the US
This feature is currently available in the US as an opt-in experiment under Search Labs. Only users registered with Search Labs can test this feature. Google has not yet announced plans to roll it out to other countries.