Google is prepping Gemini to take action inside of apps

November 22, 2024
2,548 Views

Google released the first Android 16 developer preview earlier this week and keen-eyed observers are already uncovering interesting tidbits, including one that hints about a much more useful future for Google’s AI assistant. In Android Authority, Mishaal Rahman writes about a mysterious new API in Android 16 called “app functions,” which appears to give Gemini Assistant agentic-like abilities to take action in apps. It sounds awfully similar to the upgraded “app intents” Apple supports in iOS 18, and it’s exactly the kind of thing that could make AI assistants much more useful than they are in their current state.

A page on Google’s developer site describes an app function as “a specific piece of functionality that an app offers to the system. These functionalities can be integrated into various system features.” Really clears things up. But Rahman points to a specific example buried in the documentation that sheds some more light. It details how an app developer could use app functions to expose certain actions to the system — in this case, ordering food. With this function available to Gemini, you might be able to place an order with your neighborhood Thai restaurant without having to open the DoorDash app. Kinda neat.

Apple’s working on a similar approach to a smarter assistant. One of its promises for the smarter Siri we’ll supposedly get in iOS 18 is that it will be able to take action in apps for you. By updating its app intents framework, Apple has created a way for developers to expose “order food”-type functions to Siri. According to rumors, we probably won’t see that update until spring of 2025, though.

“Doing things for you” was kind of the whole promise of smart assistants from the beginning, but that hasn’t started materializing until very recently. Gemini can access information in certain apps with your permission, but currently it’s mostly limited to searching things like Gmail and Google Maps. And Siri’s biggest update in iOS 18 so far added a ChatGPT extension so you can ask more complicated questions, but it still falls short on “taking action.” Now, both platforms appear to be laying the groundwork for better assistants — and 2025 could be a very interesting year for AI on smartphones.

Source link

You may be interested

Stop using generative AI as a search engine
Technology
shares3,806 views
Technology
shares3,806 views

Stop using generative AI as a search engine

new admin - Dec 05, 2024

How many presidents have pardoned their relatives? It turns out this is a tricky question to answer.Following Hunter Biden’s pardon…

7.0 magnitude earthquake hits off Northern California coast, tsunami warning issued
Top Stories
shares3,471 views
Top Stories
shares3,471 views

7.0 magnitude earthquake hits off Northern California coast, tsunami warning issued

new admin - Dec 05, 2024

CBS News Bay Area Live HUMBOLDT COUNTY – A large earthquake struck off the coast of Humboldt County on Thursday…

Chipotle set to raise prices by 2% due to inflation
Business
shares2,770 views
Business
shares2,770 views

Chipotle set to raise prices by 2% due to inflation

new admin - Dec 05, 2024

[ad_1] IE 11 is not supported. For an optimal experience visit our site on another browser.Now PlayingChipotle set to raise…