Apple Intelligence 2.0: 10 methods Apple can get its AI again heading in the right direction

When Apple Intelligence launched final 12 months, Apple promised us that its AI system would revolutionize how we use our gadgets. Sadly, this previous 12 months has been way more middling than miraculous for Apple’s AI, with the platform failing to impress within the methods we had been hoping.

Meaning there are numerous methods Apple Intelligence might be improved sooner or later. From improved automation to extra highly effective enhancing instruments and past, Apple’s AI basis opens up a world of prospects for bringing new good instruments to our Apple gadgets. Listed here are 10 of the highest options we’d like to see within the subsequent model of Apple Intelligence.

Apple Intelligence 2.0: Quick enhancements

Picture technology

Apple’s Picture Playground app is a enjoyable solution to rapidly create quirky photographs, however it’s nonetheless very restricted and rudimentary, particularly while you evaluate it to rival AI mills similar to Secure Diffusion and GPT-4o Picture Technology.

For starters, Apple wants to repair these persistent bugbears that appear to afflict nearly all AI mills, issues like freakishly inaccurate palms and ft. However the enhancements must transcend that if Picture Playground is to realize traction. We’d like much more management and suppleness over the photographs it whips up. Meaning with the ability to import new technology fashions and types, the flexibility to work with totally different facet ratios, alter the relative power of every immediate, and extra. 

It’s uncertain Apple will give us the flexibility to make phot-realistic photographs, however there may be nonetheless loads Picture Playground can do to reinforce its generated artwork. For instance, the current OpenAI GPT-4o mannequin replace allowed customers to attract photographs within the type of a Studio Ghibli Japanese animation movie. It was a viral sensation when it launched and precisely the form of factor Picture Playground must get some buzz.

Foundry

Picture enhancing

Talking of photographs, Apple has introduced a number of AI picture enhancing instruments to our gadgets, but these will also be vastly improved. Within the first model of Apple Intelligence, we are able to take away distractions in images utilizing Apple Intelligence’s Clear Up device, for instance, however having the choice to add components to your photos could be a enjoyable additional. This might lengthen to refining present elements of your photographs, similar to changing one sort of tree with one other in a panorama.

We’d additionally wish to get the facility to take away one thing from one picture and add it to a different. Or to summon Siri and use pure language to make edits. Think about how a lot trouble you would save by merely saying, “Hey Siri, change this sky to a thunderous rainstorm.”

Foundry

Apple Intelligence 2.0: Foundational upgrades

Pure language search

One of many key concepts behind synthetic intelligence is that it’ll simplify your day-to-day life. So why isn’t Apple Intelligence superb at doing that? One key manner it might enhance is by including extra pure language capabilities.

This might be actually efficient if it was added to issues like Highlight search or the Messages app. We must always have the ability to open Highlight or Siri and ask, “Present me images I took between August 3 and 5.” Proper now, that doesn’t work. Highlight brings up photographs, positive, however solely people who include the textual content you typed. With a bit sprinkling of Apple Intelligence, these searches might be way more helpful.

Foundry

Apple LLM

One of many extra obvious examples of Apple intelligence’s ineptitude is Siri’s integration with ChatGPT, which has the unlucky impact of instantly evaluating Apple’s AI engine with a much more superior system. The comparability will not be precisely flattering to Apple’s toddler AI efforts.

What we actually want is for Apple to launch its personal LLM to compete with the likes of ChatGPT. For one factor, this could inject much more energy into Apple Intelligence’s engines and permit it to face toe-to-toe with the trade’s finest platforms. For an additional, it will higher protect your privateness, since you would keep within the Apple intelligence sphere with out venturing off into less-secure cloud-based alternate options. With an Apple LLM behind the wheel, there could be no want to modify to different AI instruments, which might preserve your workflow easy and uninterrupted.

Rumors have urged that this type of Apple-backed LLM is within the works, however we don’t know when it’d arrive. When it will definitely does drop, it might be the jump-start Apple Intelligence must preserve tempo with its rivals.

Shortcuts

Apple’s Shortcuts app is likely one of the finest instruments out there in your iPhone, but I’d wager most individuals have by no means even opened it. A part of the issue is that Apple solely covers essentially the most primary of duties, so that you’re by yourself if you wish to run extra advanced workflows.

It is a place the place Apple Intelligence might step in to fill the hole. If AI was built-in into Shortcuts in order that you would merely inform it what you wish to do, Shortcuts would immediately go from an underused utility to top-of-the-line iPhone options ever. As one of many predominant tenets of Apple intelligence, Shortcuts might counsel easy time-saving shortcuts all through the day like Siri strategies, and switch your iPhone into a real digital assistant.

Foundry

Well being and health

Well being and health monitoring has been considered one of Apple’s priorities lately, with the Apple Watch main the best way. There’s numerous well being knowledge stashed on our gadgets, and there are many ways in which Apple’s AI might assist enhance well being and health with out compromising privateness. There are already rumors that Apple is engaged on an AI “coach” to interpret the information collected by your gadgets and provide you with a extra full image of your well being.

Such a platform might present itself in optimized exercises with Apple Intelligence crunching your health numbers after which constructing a customized exercise plan primarily based in your wants. Or specialised HIIT exercises, Pilates, weight coaching, or no matter it thinks it’s worthwhile to take your health to the following degree.

Apple

Apple Intelligence 2.0: New options

Movies

Apple Intelligence is already getting used to edit photographs on our iPhones, however what if it might apply its abilities to movies as effectively? The iPhone is already one of many high video telephones round and AI might take it to the following degree.

Maybe that may imply creating a listing of urged edits for any challenge you feed into it. Or the facility to take away distractions from movies in the identical manner you may at the moment do with photographs. Maybe even automated shade grading and audio mixing might be added.

In fact, Apple will likely be very cautious about treading on video enhancing – in any case, it in all probability doesn’t wish to indicate it’s coming after the inventive industries after the Crush! advert fiasco – however a number of helpful instruments for beginner editors to play with on their iPhones could be a welcome addition.

Notes

One of many ways in which Apple tried to display Apple Intelligence’s energy at WWDC 2024 was by means of transcribing audio within the Notes app. Sadly, that is neither a groundbreaking characteristic nor one which’s even on par with rival AI platforms. It would work effectively for easy voice memos, however something with multiple speaker rapidly turns into a jumbled mess.

There’s a fast manner Apple can repair this by educating Apple Intelligence learn how to mechanically label audio system—in any case, companies similar to Otter and the tiny impartial MacWhisper app have been doing it for years.

Apple

Maps 

Over time, Apple Maps has improved a lot that many iPhone customers now want it over Google Maps. However as an alternative of Apple operating a victory lap, Apple can use AI to reinforce Maps even additional.

In the meanwhile, you may search Apple Maps for issues like eating places and retailers close to you. However I would like greater than that – I would like to have the ability to ask Apple Maps for “the perfect eating places close to me” and solely see the highest-rated ones. Or seek for eateries that serve meals with particular substances (that is at the moment very hit-and-miss). Or discover out the place the perfect viewpoints are in my metropolis (once more, that is unreliable). Apple Maps struggles with that proper now, however maybe Apple Intelligence would assist it get there.

Apple Intelligence also can assist with instructions. Siri is already fairly good at getting us from Level A to Level B, however as with a lot of Siri’s present options, it’s nonetheless disappointingly restricted to locations and addresses. Apple Intelligence might step in right here to make it extra highly effective. For instance, you would ask Siri to “get me dwelling utilizing essentially the most eco-friendly route,” or “create a round strolling route within the countryside close to me.” Weaving extra AI into the combo may make these requests extra achievable for Apple’s digital assistant.

Apple

Residence

Apple is closely rumored to be getting in on the good dwelling act with a brand new HomePad hub system reportedly launching later this 12 months and early subsequent, and Apple Intelligence will nearly actually tackle a central function in the way you work together with it. However

You may sooner or later use Apple Intelligence to investigate the related gadgets in your good dwelling to work out how you would lower your expenses on electrical energy payments or cut back your carbon footprint. And with rumors swirling that Apple is engaged on a sequence of good dwelling hubs, it’s attainable that these capabilities will seem on the horizon sooner relatively than later.