I tried out Apple Intelligence's 'ability to ask AI for details about what is captured by the camera' and 'eraser magic-like feature that can erase unwanted objects in images'
On Monday, March 31, 2025, iOS 18.4, iPadOS 18.4, and macOS Sequoia 15.4 were released, and the Japanese version of Apple's AI assistant Apple Intelligence is now available on iPhones, iPads, and Macs. We have summarized how to use the features of Apple Intelligence, such as the ability to ask AI for details about objects captured by the camera and the ability to remove unnecessary objects from images.
Apple Intelligence features now available in Japanese - Apple (Japan)
At the time of writing, the seven iPhone models that can use Apple Intelligence are the iPhone 16, iPhone 16 Plus, iPhone 16 Pro, iPhone 16 Pro Max, iPhone 16e, iPhone 15 Pro, and iPhone 15 Pro Max. Apple Intelligence includes a variety of functions, including the 'writing tool' that uses AI to process text, and the image generation app 'Playground.' You can find out how to use it in the following article.
Finally, Apple Intelligence supports Japanese, and the 'function to rewrite rough text for business use' and 'image generation function' are now available on the iPhone, so I tried using them - GIGAZINE
This time, we will actually try out the following features: 'Ask AI for details about what is captured by the camera,' 'Remove unwanted objects from an image,' 'Double-tap the bottom of the screen to launch Siri,' and 'Have ChatGPT answer questions that are difficult for Siri to answer instead.'
◆ 'Visual Intelligence' allows you to ask AI for details about what is captured on camera
Apple Intelligence includes 'Visual Intelligence,' which allows you to ask AI for details about the subject captured by the camera. For iPhone 16 series models except for the iPhone 16e, you can launch Visual Intelligence by pressing and holding the camera control on the side of the device. For iPhone 16e and iPhone 15 Pro/15 Pro Max, you can customize the action button or lock screen to place Visual Intelligence, or launch Visual Intelligence from the Control Center.
Once you launch Visual Intelligence, point the camera at the object you want to know more about. For example, I'll ask the AI for details about
Place iCEO in the camera frame and tap 'Ask a Question' at the bottom left of the screen.
Type 'What is this?' and tap the arrow button on the right.
ChatGPT then told me, 'This is probably a stuffed toy modeled after Steve Jobs.' It couldn't guess the name of the product, but it seemed to recognize that it looked like Steve Jobs based on the glasses and clothing.
Next, I take a photo of the mirrorless single-lens camera ' LUMIX DC-GH7 ' and ask, 'What macro lens can be used with this camera?'
He told me about three types of real macro lenses.
◆ 'Clean up' to remove unnecessary objects from the image
'Cleanup' allows you to easily and naturally remove unwanted objects from your images. To use Cleanup, open the image you want to edit in the Photos app and tap the Edit button at the bottom of the screen.
Tap 'Clean up' at the bottom right.
Please wait a few seconds as preparation begins.
The object that can be removed will be automatically filled in yellow. Tap the yellow area.
The object then disappeared. However, it did not disappear completely, and a black shadow remained.
In the cleanup, you can remove objects other than those automatically detected by tracing them with your finger. Try tracing the black shadow area with your finger to surround it.
The shadow has disappeared. Once the cleanup is complete, you can save it by clicking the check button in the upper right corner of the screen.
By moving the slider on the image below left and right, you can compare 'before cleanup (left)' and 'after cleanup (right)'.
◆Tap the bottom of the screen to launch Siri and ask ChatGPT a question
In iOS 18.4, you can now launch Siri by double-tapping the bottom center of the screen.
If you double-tap the bottom center of the screen to activate Siri, you can input using the keyboard instead of voice, as shown below.
You can also ask ChatGPT a question that Siri can't answer. Try typing 'Why does the taste of milk change with the seasons?' and tap the arrow button on the right.
When the message 'Use ChatGPT?' appears at the top of the screen, tap 'Use ChatGPT.'
ChatGPT's answer was displayed.
In addition, 'visionOS 2.4' will be released on Monday, March 31, 2025, and Apple Intelligence will be available on Apple Vision Pro.
Apple Intelligence available on Apple Vision Pro starting today with visionOS 2.4 - Apple (UK)
https://www.apple.com/jp/newsroom/2025/03/apple-intelligence-comes-to-apple-vision-pro-today-with-visionos-2-4/
However, some features of Apple Intelligence are struggling to develop, and the release of 'AI-enhanced Siri,' which was touted as one of the flagship features of Apple Intelligence, has been delayed until 2026.
Apple confirms that the release of Apple Intelligence's 'evolved Siri' has been delayed to 2026 - GIGAZINE
Related Posts:
