In addition to presenting the new Google TV Streamer, Google has taken the opportunity to give us a heads up on what’s coming to the future. Apply Gemini models to Nest cameras, the smart homespeakers, and the Assistant.
Google’s idea is that Nest cameras accurately describe what they see so that you can ask specific questions later when referring to the activity, such as “Have the children done their homework?” or “Did the postman come to deliver a package when I wasn’t there?”
The cameras of the future understand what they see
Nest cameras are set to see the most mind-blowing improvements with the introduction of Gemini. Google has announced that improvements to Gemini’s multimodal models for processing video, images, and text will eventually enable them to understand more broadly what they see and hearhighlighting the most important thing.
Google gives us an example: instead of detecting movements, people or faces, in the future the camera will describe the specific action in detail like “the dog is digging in the garden.” Nest’s eye will see everything that’s happening in your home, with the advantage that you can later do specific searches in the Google Home app when reviewing the camera activity. Some possible searches indicated by Google are the following:
Did the children leave their bikes at the entrance?
Did the delivery truck pass by today?
Did my dog get close to the cookies?
Gemini will also be seen in the google home script editorwhere it will help you program the perfect automation without you having to write a single line of code. Gemini will try to suggest an automation that meets your request, taking into account the capabilities of the smart devices you have at home.
Additionally, on Nest smart speakers, Google Assistant will have new voices which will allow the interaction to be more like a conversation. Gemini will allow said assistant to understand you better, converse naturally and return to the topic or ask other related questions easily.
Half mind-blowing, half dystopian, the union of Gemini, Home and Nest will come little by little, with a trial for a limited number of Nest Aware subscribers at the end of the year. Nest Aware is the subscription for Nest cameras and devices that adds more intelligence and video storage for 6 euros per month.