Google announced at the Made By Google event that Gemini is now the official assistant for Android. This revamped generative AI can integrate information from Google apps, read the device’s screen to identify information and perform increasingly complex tasks on the phone.
During the event, Google also introduced the new Pixel 9 line of cell phones. While Android 15 wasn’t announced, the conference showcased numerous advancements in AI integration within the operating system. Canaltech highlights these key developments.
Gemini integrated apps
Google is set to enhance Gemini’s integration with other Google apps, introducing new extensions for Keep, Tasks, and other utilities within the operating system. This integration allows users to ask the chatbot to perform tasks like creating a map on Google Maps, retrieving information from Gmail, or updating a Keep list with simple commands such as “add coffee to my shopping list.” Additionally, a forthcoming Calendar extension will enable prompt adjustments based on daily events.
Gemini’s capabilities extend to understanding what’s displayed on the phone’s screen. Users can open the assistant window and overlay it on the active app to gain more information or context. The AI can also generate images that can be easily dragged into Google Messages or Gmail. These new features align with similar advancements by Apple’s Apple Intelligence, which revamped Siri to recognize screen content.
Mobile Privacy
Google emphasizes that its AI assistant prioritizes the privacy and protection of sensitive information. Users must grant permission for Google to integrate their personal data with the chatbot technology. However, all data processing is done internally on the device via the Gemini Nano model, ensuring that information isn’t stored on external servers or third-party platforms.
Additionally, Google notes the widespread presence of AI across various Android devices, including high-end smartphones, foldables, and other market-available devices, with support for over 45 languages. According to Sameer Samat, Android’s vice president of Product Management, Gemini boasts the highest availability on devices worldwide.
Gemini Live will chat with you
Google has introduced a new AI mode named Gemini Live. Inspired by the movie *Her*, this mode allows the assistant to engage in real-time, uninterrupted conversations without needing to use hands. Initially, Gemini Live offered 10 voice models, surpassing the 5 models available in ChatGPT, and is currently only available in English. This feature is part of the paid Gemini Advanced package on Google One.