Google’s AI can extract details from the user’s emails and photos to generate responses

New York.– Google announced this Wednesday that it will allow its artificial intelligence (AI), Gemini, to connect with Gmail, Google Photos, the user’s search history and YouTube so that it can give “exceptionally useful” answers. Meanwhile, with this new function called “Personal Intelligence,” the chatbot can “reason” from the information in the user’s Google account and extract details from an email or a photo without the user having to specifically request that it extract information from the applications they are interested in. In a statement released today, Josh Woodward – Vice President of the Gemini application, Google Labs and AI Studio – highlighted that Gemini is not directly trained with the user’s Gmail inbox or Google Photos library, although it is trained with “limited information” such as “specific prompts in Gemini and the model’s responses.”

You may be interested in:Apple partners with Google to integrate Gemini models into its AI functions

Personal Intelligence is an optional function, and if activated, the user will be able to decide which applications to connect to Gemini.  Woodward noted that this new feature gives “excellent advice for books, programs, clothing, and travel”.

The Beta Version

Google executive also detailed several examples of how he has used the tool: “Two weeks ago we needed new tires for our 2019 Honda minivan. While in line at the repair shop, I realized I didn’t know the tire size. I asked Gemini.” «Nowadays, any chatbot can find these tire specifications, but Gemini went further. It suggested different options: one for daily driving and another for adverse weather conditions, referencing our family road trips to Oklahoma that it found on Google Photos,» he said. «Then, he neatly extracted the qualifications and prices of each one. When I got to the counter, I needed our registration. Instead of looking for it or losing my place in line to go back to the parking lot, I asked Gemini. It extracted the seven-digit number from a photo in Photos and also helped me identify the specific model of the van by searching in Gmail. Just like that, we were ready», details Woodward.

You can also read: Google launches an AI tool in Gmail that summarizes email threads

Google will launch Personal Intelligence initially in beta, only in the United States, for “eligible” subscribers of Google AI Pro and AI Ultra, and only for personal Google accounts and not for business accounts, according to Woodward. In the future, the company plans to extend Personal Intelligence to more countries and to the free version of Gemini and AI Mode.

“We have tested this beta version of Personal Intelligence exhaustively to minimize errors, but we have not eliminated them. You may find inaccurate answers or over-personalization, where the model establishes connections between unrelated topics,” Woodward warns in the statement.