Mobile menu toggle

Visual Intelligence

Visual Intelligence
Using your iPhone camera to look up stuff is called Visual Intelligence.

Apple Visual Intelligence is an AI-powered feature that lets your iPhone understand what its camera sees.

Point the camera at an object, place, sign, product or document and Visual Intelligence can provide useful information, answer questions, translate text, summarize what’s on the screen or help you take action based on what you’re looking at. It can also combine information from Apple Intelligence with third-party services to provide more detailed answers.

The feature is designed to turn the iPhone’s camera into a visual search tool, making it possible to learn more about the world around you simply by pointing your phone at it.

Read Cult of Mac’s latest posts on Visual Intelligence:

Visual Intelligence ads may be coming to your iPhone with iOS 27

By

A picture showing Apple's Visual Intelligence feature used in a story about ads coming to the tool.
Visual Intelligence ads could soon appear when you point your iPhone’s camera at something you want to buy.
Image: Apple

Visual Intelligence ads could be headed for your iPhone. Code buried in iOS 27 suggests Apple is exploring a new way to slip sponsored results into its camera-based search tool.

The change won’t have Apple selling the ad slots directly. Instead, search providers like Google may supply sponsored images. And these could sit right on top of the results Visual Intelligence already shows you.

Apple’s camera AirPods leak early — but they’re many months away

By

A picture of AirPods used in a story about AirPods with camera coming in 2027.
A leaked macOS 26.7 RC build revealed Apple’s camera-equipped AirPods in action, but the product may not launch until 2027.
Photo: Cult of Mac

That video of AirPods with cameras built in? Cool. But don’t expect to buy them anytime soon. Despite a leak that made AirPods with cameras look imminent, Apple is still holding the product for 2027. This year’s iPhone event won’t be the moment they show up.

If you were hoping to buy AI-powered earbuds alongside your next iPhone, you’ll have to wait. And that’s actually the more interesting story here: what almost shipped this year, and why it didn’t.

AirPods with cameras are real, and Apple just showed how they’ll work

By

AirPods with cameras are real! Hello AirPods Ultra?
Apple accidentally revealed AirPods with cameras in macOS 26.7 RC.
Screenshot: Apple

A video file found in the new macOS 26.7 release candidate code gives us our first look at Apple’s upcoming AirPods with built-in infrared cameras. The video shows the AirPods Pro working in tandem with Visual Intelligence to let you save information about objects you see in the real world.

In the short demo, a man holds up a book so the AirPods’ cameras can identify its title. He then asks Siri to save it for later, showing how the IR cameras could give Apple’s earbuds a better understanding of the world around you.

AirPods Ultra could beat Apple’s smart glasses to market

By

A picture of AirPods used in a story about the much rumored AirPods Ultra.
Code buried in iOS 27 beta points to AirPods Ultra, not smart glasses, as Apple's next camera-equipped wearable.
Photo: Unsplash

Apple’s smart glasses may be waiting, but AirPods Ultra may just be confirmed. Buried in iOS 27’s beta code is a mystery wearable that reads images from two cameras, located on each side of your head. And Apple’s own sample data has it identifying the Eiffel Tower and a coffee mug.

If you’ve ever wanted Siri to actually see what you’re looking at instead of just hearing you describe it, this could be it. Apple is reportedly working on just that, and the newly spotted code hints at how close it might be, and which product, AirPods or glasses, is likely to land first.

Beyond Siri: New Apple Intelligence features to expect at WWDC26

By

New Apple Intelligence features beyond Siri
Apple Intelligence and Visual Intelligence should get a jolt of new features at WWDC26.
AI image: Google Gemini/Cult of Mac

Apple WWDC26:Everybody expects Apple’s Siri voice assistant to get a big AI-powered makeover Monday at WWDC26. But there’s more to the picture, in that Apple Intelligence and Visual Intelligence will see a bunch of separate new features, too, according to rumors rounded up in a new report Friday.

Detailed iOS 27 renders show Siri’s big makeover

By

Apple Siri logo under construction
Apple is hard at work creating the new Siri.
AI image: Apple/ChatGPT/Cult of Mac

Apple WWDC26:As Apple prepares what could be its most consequential software release in years with iOS 27 at WWDC26, we get our first real glimpse at what an overhauled Siri and other Apple Intelligence features may look like, courtesy of Bloomberg. It mocked up a bunch of illustrations in a new report Thursday.

iOS 27 could add Siri camera mode and expanded visual AI

By

iOS 27: Customizable camera app and rebuilt Siri
iOS 27 could support an upgraded Camera app with a Siri camera mode plus an overall overhaul of the voice assistant.
Photo: Chat GPT/Cult of Mac

Apple will put artificial intelligence front and center in the iPhone camera with a dedicated Siri camera mode coming in iOS 27, according to a new report. The move signals the company’s push to make on-device AI feel less like a hidden feature and more like a core part of the iPhone experience.

How Apple’s Visual Intelligence could change everything

By

iPhone 16 using Visual Intelligence
The iPhone's Visual Intelligence feature is a sign of things to come.
Photo: Apple

Apple CEO Tim Cook has a well-established habit of dropping subtle hints about where the company is headed. This time, the dropped breadcrumbs all point toward Visual Intelligence. And the impression they leave is of a company preparing to reshape how humans interact with the world around them.

Look things up with your iPhone’s camera using Visual Intelligence

By

Looking up a computer mouse using the camera with Visual Intelligence, captioned, “Look It Up With The Camera”
Search for products and get information with Visual Intelligence.
Image: D. Griffin Jones/Cult of Mac

Apple’s new Visual Intelligence feature provides a quick way to find information just by pointing an iPhone 16’s camera at an object in the real world. Then you can ask ChatGPT to explain what you’re looking at, do a reverse image search to find products and look things up visually, get information on a business as you walk down the street, quickly add events to your calendar and identify plants and animals.

With the release of iOS 18.4, Apple added the capability to use Visual Intelligence on iPhone 15 Pro models. Here’s how it works.

Everything new in iOS 18.4 [Out now]

By

Everything New in iOS 18.4
This one is the emoji update.
Image: D. Griffin Jones/Cult of Mac

iOS 18.4, which Apple released Monday, brings several significant new features to iPhones. It is one of the biggest updates to the operating system since the initial public release of iOS 18 in September 2024.

Among other things, the update will also introduce a key Apple Intelligence feature that Apple showcased at WWDC24. Keep reading to learn about all the new features in iOS 18.4 — or watch our video. (Apple also released iPadOS 18.4, macOS Sequoia 15.4 and visionOS 2.4, which include similar upgrades, on Monday.)

5 iOS 18.4 features I am excited about

By

It's time to get excited about new features coming soon in iOS 18.4.
It's time to get excited about new features coming soon in iOS 18.4.
Logo/Graphics: Apple/Rajesh Pandey/CultOfMac

iOS 18.4 will be one of Apple’s biggest updates to iOS 18 since the operating system’s public release last September. It will pack plenty of changes and improvements, like a Vision Pro app, Apple News+ Food and new emoji.

That all sounds great, but these are the five iOS 18.4 features that I am most excited about.

Apple’s AI-powered Visual Intelligence tool heads for iPhone 15 Pro

By

iPhone 16 using Visual Intelligence
Visual Intelligance transforms real-world objects into digital data.
Photo: Apple

Visual Intelligence, which previously was reserved for the iPhone 16 models, will reportedly reach the two iPhone 15 Pro variants in the near future.

Realistically, there was no reason why the artificial intelligence feature shouldn’t have been added to Apple’s 2023 models with the debut of iOS 18. In fact, with the growing demand for AI-powered productivity tools, many users are looking for ways to AI take notes efficiently to enhance their workflow.

Everything new in iOS 18.3

By

Everything new in iOS 18.3
Your iPhone is gaining some new features.
Photo: Rajesh Pandey/Cult of Mac

After more than a month of beta testing, Apple released iOS 18.3 to the public Monday. Unlike the last two point updates, iOS 18.3 is light on big additions. However, it brings minor new features and some usability improvements. Check them all out below.

Everything new in iOS 18.2: Apple Intelligence upgrades and more

By

Everything New in iOS 18.2
A bunch of Apple Intelligence features — and, more excitingly, sudoku.
Image: D. Griffin Jones/Cult of Mac

iOS 18.2 drops a huge number of new features onto the iPhone. The second major iOS 18 update, available now, expands the capabilities of Apple Intelligence — and adds plenty of goodies for everyone else, too.

Keep reading or watch our video on the new features awaiting iPhone owners in iOS 18.2.

iOS 18.2 won’t launch as soon as hoped [Updated again]

By

iOS 18.2 mockup
The iOS 18.2 release date is soon — just not as soon as had been rumored.
AI image: ChatGPT

A rumor from early November said the iOS 18.2 launch day would be the week of December 2, but that’s now impossible. There are steps that must take place before the operating system can be introduced, and not all of them have happened yet.

The release will probably be in the second week of December. Right now, the earliest likely date is December 10, though December 11 is looking increasingly likely.

Whenever the launch finally happens, it’ll usher in some of the most-anticipated new Apple Intelligence features, including Genmoji, the Image Playground and more.

Update: The much-anticipated release candidates for iOS 18.2, iPadOS 18.2 and macOS Sequoia 15.2 went out December 5, which means Apple Intelligence phase 2 will likely launch December 12.

Hands-on with Image Playground, Visual Intelligence and ChatGPT in iOS 18.2

By

Image Playground & ChatGPT
A bunch of the most-anticipated features come in iOS 18.2.
Image: D. Griffin Jones/Cult of Mac

iOS 18.2 brings exciting new Apple Intelligence features like Image Playground, Genmoji, Visual Intelligence and ChatGPT integration. These flashy new tools let users create images and custom emoji, look up information using the iPhone’s camera and tap into one of the hottest AI chatbots around.

How well do they work? Keep reading or watch our hands-on video to see iOS 18.2’s new Apple Intelligence features in action.

Apple introduces new Visual Intelligence lookup for iPhone 16

By

iPhone 16 using Visual Intelligence
The iPhone's Visual Intelligence feature is a sign of things to come.
Photo: Apple

Apple It's Glowtime Event:Visual Intelligence is a new Apple Intelligence feature that lets you get information on things around you, add events to your calendar from a poster, look up products and more. The iPhone 16 lineup’s new Camera Control feature, makes this powerful functionality instantly available at the press of a button.

After showcasing previously announced Apple Intelligence features, Craig Federighi, Apple’s senior vice president of software engineering, introduced Visual Intelligence during Monday’s “It’s Glowtime” event.

“We wanted to give you the ability to instantly learn about everything you see,” said Federighi.

Visual Intelligence will be available on all iPhone 16 models.