Google brings Gemini and other accessibility tools across Android devices

nandika.iyerravi@futurenet.com (Nandika Ravi)
2025-05-15 12:00:00
www.androidcentral.com

What you need to know

Google is enhancing Android with AI-powered accessibility features, including improved TalkBack with image and screen questioning.
New “Expressive Captions” will use AI to provide real-time captions across apps, conveying not just words but also the speaker’s tone and emotions.
Developers now have access to Google’s open-source Project Euphonia repository to build and personalize speech recognition tools for diverse speech patterns.
This new version of Expressive Captions is rolling out in English in the U.S., U.K., Canada, and Australia for devices running Android 15 and above.

Each year, Google announces a slew a features for Global Accessibility Awareness Day (GAAD) and this year isn’t any different. Today (May 15), Google announced that it is rolling out new updates to its products across Android and Chrome, and adding new resources for developers who building speech recognition tools.

Google is highlighting how it’s integrating Gemini and AI into its accessibility features to improve usability for users with low vision or hearing.

Google brings Gemini powered updates for GAAD — (Image credit: Google)

Google is expanding its existing TalkBack option with the ability for people to ask questions and get responses related to the image that they were sent or are viewing. That means the next time a friend texts you a photo of their new guitar, users can get a description of the image and ask follow-up questions about the make and color, or even what else is in the image.

Taking it a step further with AI, Google says users can not only get descriptions of the image, but also the entire screen they’re viewing. For instance, “if you’re shopping for the latest sales on your favorite shopping app, you can ask Gemini about the material of an item or if a discount is available,” the tech giant explained.

Google is launching a much-needed feature called Expressive Captions, which helps the listener gauge the mood and emotion of the video. The tech giant states that phones will be able to provide real-time captions for anything with sound across apps.

It uses AI to not only capture what someone says, but more importantly, how they say it. For instance, if you’re watching an intense game and the commentator is calling out an “amaaazing shot,” or when the video message is not “no” but a “nooooo.”

This AI-powered feature will be able to identify sounds that are dragging out words, to give you accurate captions. It can also spot when people are whistling or clearing their throats, making captions less redundant.

Expressive captions on Google

(Image credit: Google)

This new version of Expressive Captions is rolling out in English in the U.S., U.K., Canada, and Australia for devices running Android 15 and above.

Lastly, Google is taking steps to continue to make its digital platform more accessible and inclusive. It is giving developers access to its open-source repository from Project Euphonia (How AI improves products for people with impaired speech).

By opening up its resources, developers around the world will be able to personalize audio tools for research ,which could help train their models for diverse speech patterns, Google explained.

Source Link

Keep your phone secure and easily accessible in your car with the Miracase Phone Holder for Your Car! This Amazon Best Seller is designed for easy installation and holds your phone firmly in place, ensuring a safe and convenient driving experience.

With a 4.3/5-star rating from 29,710 reviews, it’s a top choice for drivers! Plus, over 10,000 units sold in the past month! Get it now for just $15.99 on Amazon.

Start your free Amazon Prime trial
today and unlock unlimited streaming and more!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!

BITCOIN

Bitcoin Logo