visionOS 2.4 Now with Apple Intelligence and Spatial Experiences for Apple Vision Pro

Apple Intelligence visionOS 2 4 Writing Tools
Share This

visionOS 2.4, Image/Apple

Today Apple introduced visionOS 2.4 which introduces powerful Apple Vision Pro Apple Intelligence features and a new Spatial Gallery app. New Apple Intelligence features enable users to communicate, write, and be expressive on Apple Vision Pro and integrates privacy in AI. visionOS 2.4 introduces an iPhone Apple Vision Pro app for users to explore new content and apps, and Guest User Vision Pro experience sharing. visionOS 2.4 is now available as a free software update for Apple Vision Pro.

Apple Intelligence on Apple Vision Pro

With Apple Intelligence, users can rewrite, proofread, and summarize text using Writing Tools:

With Rewrite, users can adjust the tone of their text to make it more friendly, professional, or concise, or specify the change they’d like to make using Describe Your Change. Proofread checks grammar, word choice, and sentence structure, and provides suggested edits. Users can also select text and have it recapped in several formats with Summarize. With Compose, users can ask ChatGPT to generate content for anything they are writing about…

Create interesting and fun images with Image Playground derived from themes, costumes, accessories, and places. Users can experiment and create images resembling family member or friends from photos and add text descriptions.

Unique Genmoji’s can be created via the emoji keyboard by simply typing or speaking a description of the prospective emoji. These newly created emojis can then be used like other emojis.

Apple Intelligence improves natural language image or video search in the Photos app by simply describing the image or video. Another interesting feature is the ability to create a Memory Movie based on a users description:

Using language and image understanding, Apple Intelligence will pick out photos and videos based on a user’s description, craft a storyline with chapters based on themes identified from the photos, and arrange them into a movie with its own narrative arc.

Smart Reply in Messages and Mail provides suggestions for a quick response and support for Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in Notification Center, and Notification Summaries round out visionOS 2.4 capabilities.

Spatial Gallery with Curated Spatial Content

Spatial Gallery is a new app allowing users to expand creative and visionary experiences:

A new app for Apple Vision Pro, features spatial photos, spatial videos, and panoramas curated by Apple, and gives users a window to captivating and powerful moments spanning art, culture, entertainment, lifestyle, nature, sports, and travel, with new content released regularly.

Advances in Guest User

With visionOS 2.4 user can share Apple Vision Pro experiences with their nearby iPhone or iPad. Users can determine which apps can be shared with guests from their iPhone.

Apple Vision Pro App for iPhone

Apple Vision Pro app for iPhone allows users to find “new spatial experiences, queue apps and games to download, easily find tips, and quickly access information about their Vision Pro, all from their iPhone.”

Availability

  • visionOS 2.4 is available today as a free software update for Apple Vision Pro.
  • Apple Intelligence will be available in beta on Apple Vision Pro with visionOS 2.4.
  • The Apple Vision Pro app for iPhone will be available with iOS 18.4.
  • The Spatial Gallery app will be installed with visionOS 2.4 for users in Australia, Canada, France, Germany, Hong Kong, Japan, Korea, Singapore, Taiwan, the UAE, the UK, and the U.S.