IOS 18 Unveiled: Exploring New AI Features for iPhone Owners and Anticipating Upcoming Innovations | Tech Insights

Kerry Wan/ZDNET

At its “Glowtime” iPhone event last week, Apple confirmed that its AI-powered Apple Intelligence won’t be arriving until October . Though some people have been able to test a few upcoming features via the developer betas of iOS/iPadOS 18.1 and MacOS Sequoia 15.1, most Apple users will have to wait a few more weeks.

Also: Every iPhone model that can receive Apple’s iOS 18 update (and which ones won’t)

Even then, you’ll need the right type of device. On the iPhone side, that means an iPhone 15 Pro , iPhone 15 Pro Max , iPhone 16 , iPhone 16 Plus , iPhone 16 Pro , or an iPhone 16 Pro Max . iPad owners will need an iPad Pro or iPad Air with an M1 chip and later. And on the Mac end, you’ll need a MacBook Air , MacBook Pro , iMac , Mac mini , or Mac Studio with an M1 or later or a Mac Pro M2 Ultra.

Further, Apple Intelligence is going to be a work in progress. Yes, several of the core AI tricks will pop up in October. But others won’t arrive until later this year or next year. For example, iOS/iPadOS 18.2 will reportedly launch in December with additional AI features.

Also: I went hands-on with Apple’s standard iPhone 16 and didn’t envy the Pro models at all

Around the world, Apple Intelligence will first launch in US English and then expand to localized English in Australia, Canada, New Zealand, South Africa, and the UK in December. Support for more languages, such as Chinese, French, Japanese, and Spanish, will roll out next year.

For now, here are the new AI-powered skills you can expect next month with iOS 18.1 , iPadOS 18.1 , and MacOS Sequoia 15.1 .

Disclaimer: This post includes affiliate links

If you click on a link and make a purchase, I may receive a commission at no extra cost to you.

1. Writing tools

Jason Hiner/ZDNET

Using Apple Intelligence, you’ll be able to fine-tune your writing in Mail, Notes, Pages, and any supported third-party app. Like other AI-powered editing tools, Apple Intelligence will be able to rewrite, proofread, and summarize your text.

2. Photo features

Apple Intelligence will tap into your photos for a few different tricks. You’ll be able to create movies out of photos in your library just by typing a description of what you want to see, much like you would for a chatbot prompt . Using natural language, you’ll be able to search for specific photos and even find certain moments in a video.

The new Clean Up tool will help you remove distracting or unwanted elements in a photo while leaving everything else intact.

3. Audio transcriptions

Using the Notes and Phone apps, you’ll be able to record, transcribe, and summarize a call and other types of audio. When you start recording, the feature notifies everyone that the call is being recorded. Once the call ends, Apple Intelligence will not only transcribe it but summarize all its key points.

Newsletters

ZDNET Tech Today

ZDNET’s Tech Today newsletter is a daily briefing of the newest, most talked about stories, five days a week.

Subscribe

See all

4. Notification assistance

Instead of having to read all the notifications that appear on your screen, you’ll be able to browse through AI-generated summaries of them. Plus, a new Focus mode will display only the notifications that need your immediate attention.

5. Mail assistance

To help you get through your emails, Apple Intelligence will try to understand their content and identify those that are time-sensitive. Any emails that fit the criteria will be treated as priority messages. Instead of just previewing the first few lines of an email, AI will summarize the key details.

Also: The iPhone 16 is undeniably great hardware - but you should still probably skip it

Plus, a new Smart Reply feature will offer suggestions for quick replies and ensure that all the questions in a response have been addressed.

Click here

6. Siri improvements

Jason Hiner/ZDNET

iPhone users who have suffered the many faults and foibles of Siri are undoubtedly hoping for major improvements to the voice assistant. With Apple Intelligence, Apple promises that Siri will become more “natural, flexible, and deeply integrated” into the system.

On the visual front, Siri’s familiar orb will be replaced by a glowing light that wraps around the end of the screen when you trigger the assistant on an iPhone or iPad or in CarPlay. Mac users will be able to place Siri anywhere on the screen so it’s readily available.

Also: The 7 best iOS 18 features that will make updating your iPhone worthwhile

Beyond using your voice to chat with Siri, you’ll also be able to type your requests or questions. You can even switch between text and voice as you interact with Siri. The voice assistant will be able to follow and understand your words even if you make a mistake or stumble. Futher, Siri will be packed with knowledge about Apple’s many devices, so it will be able to help you find and use all the features and settings on your iPhone, iPad, or Mac – like an on-device Genius helper.

Those are a fair number of AI-powered features and upgrades, but Apple Intelligence has more in store for the months and years ahead.

What will come later

Image playground

Using the AI-powered Image Playground , you’ll be able to generate images based on a description, suggestions, or even a person from one of your photos. You can then tweak the style and make other changes based on how you plan to use or share the image.

Image wand

The image wand will attempt to turn rough sketches into full images. When you circle an empty area on a virtual canvas or other screen, the image wand will generate an image based on the surrounding area.

Genmoji

You’ll be able to create new emojis on-demand by entering a description or selecting a photo of you or another person. In response, the AI will generate a more accurate and lively kind of emoji.

More Siri tricks

Down the road, Apple will release more enhancements for Siri. The assistant is due to get onscreen awareness, which means it will be able to react based on your current screen and information. You’ll also be able to access the expertise of ChatGPT through Siri -- securely, with your consent – to perform more complex AI-related tasks.

Also: Every iPhone model that will be updated to Apple’s iOS 18 (and which ones won’t)

The big question, though, is not so much when the new AI features will arrive but how well they will work. Compared to the likes of Google, Microsoft, and OpenAI, Apple is behind in the AI arena and has much catching up to do. Plus, those of us who’ve been frustrated with Siri are expecting meaningful improvements to the voice assistant. If Apple can pull off its AI efforts and truly make a difference for its users, then the wait will have been worth it.

Artificial Intelligence

How I used ChatGPT to scan 170k lines of code in seconds and save me hours of detective work

6 ways to write better ChatGPT prompts - and get the results you want faster

6 digital twin building blocks businesses need - and how AI fits in

Google’s Gems are a gentle introduction to AI prompt engineering

• How I used ChatGPT to scan 170k lines of code in seconds and save me hours of detective work
• 6 ways to write better ChatGPT prompts - and get the results you want faster
• 6 digital twin building blocks businesses need - and how AI fits in
• Google’s Gems are a gentle introduction to AI prompt engineering

Also read: