Cover of this issue

In this issue, we share the Airbnb - AR/VR Animation Concept built by Aurélien Salomon UX .

Publication preface

Hi, long time no see! I am Siqi, the editor-in-chief of XReality.Zone!

After organizing the Let’s visionOS 2024 Global Creator Conference this spring, we fully felt the enthusiasm of the entire ecosystem for spatial computing. Let’s revisit the grand scene of the event through the following short video.

It is not difficult to notice that after this event, the XReality.Zone entered a short period of rest, and our XR World Weekly and visionOS teaching content have stopped updating. However, now I can happily announce to you - We are back!

Yes, the XReality.Zone is back!

During this seemingly “rest” period, we communicated with many domestic and foreign developers and enterprises (the number may far exceed your imagination). You may see many people on the Internet saying that this device is too bulky, the interaction is too poor, and the sales of this thing are too low. These information always give you a feeling that spatial computing is about to fail. However, through our actual observation, we believe that the exploration of developers and enterprises in this area is far beyond everyone’s imagination, and these changes have practical significance and imagination.

Just like the one-month period after the official release of Apple Vision Pro in China, although the media criticized the market in various ways, Chinese internet giants have come forward one after another to show their own work. This is like saying no with words, but still being honest with the body.

At the same time, the exploration of AVP in the community is also showing an increasingly diverse trend. For example, two community projects that I have recently paid attention to:

• BunnyVisionPro: Bimanual Dexterous Teleoperation with Real-Time Retargeting using Vi

• VisionProTeleop: VisionOS App + Python Library to stream head / wrist / finge

To be honest, when I saw these two projects, the first thing that came to my mind was the touching boxing match between Zeus and Adam in Real Steel , as well as some of the world settings in this movie, such as the new electronic sports project of “robot boxing match”.

These seemingly unattainable things may already be slowly developing and evolving around you and me.

I want to say, the future has arrived, would you like to join us on the road?

Table of Contents

Activity

• Qualcomm Snapdragon Spaces XR Technology National Tour Salon · Beijing Station

News

• In the second half of the year, you can see more immersive videos on Apple Vision Pro

• Apple Vision Pro now has a new virtual environment to view

• You can now replace Persona’s background

Idea

• Playing games with gestures, maybe we can be more creative

Code

• visionOS 2 30 Days

Video

• How to Make a Bubble in VisionOS: Reality Composer Pro Shader Graph Tutorial

App

• Meshy.ai

Job

• ILLUSION Tech: front-end development, Content cybertribe operations, operations development, 3D content designer

Activity

Qualcomm Snapdragon Spaces XR Technology National Tour Salon · Beijing Station

Keywords: Qualcomm, Snapdragon Spaces XR

On August 3, 2024 , the first stop of Qualcomm Snapdragon Spaces Technology National Tour Salon will be opened in Beijing . This XR technology sharing meeting is jointly organized by Shenmu Technology and China Electronics Cloud, and has received strong support from Beijing Zhongguancun Entrepreneurship Street Technology Service Co., Ltd.

This technology salon will bring together many XR industry leaders and innovators, focusing on sharing XR innovative application cases, bringing the latest XR technology sharing and solutions to developers. The event is divided into the morning XR application sharing session and the afternoon technology practice session and electronic cloud metaverse closed-door exchange meeting . You will have the opportunity to learn about the most cutting-edge XR technology applications and gain valuable industry insights.

💡 Tips:

Those who fill in the questionnaire from the registration entrance, remember to select “XReality.Zone” in the channel , send the screenshot of the selected channel and completed questionnaire to the “XReality.Zone” official account background, and you can get a small gift - Minority gift three-piece set 😉 .

News

In the second half of the year, you can see more immersive videos on Apple Vision Pro

Key words: Apple Vision Pro, immersive video

Finally, the Apple Vision Pro we bought can have more “exclusive” content! 😆

In this official Apple article , Apple announced that more immersive videos will exclusively land on Apple Vision Pro in the second half of the year . These videos include:

Release time	Episode name	Highlight	Preview image
Published	Boundless Episode 1: Hot Air Balloons	Take a hot air balloon ride and overlook the strange landforms of Cappadocia, Turkey
This fall	Boundless Episode 2: Arctic Surfing	Go to the area inside the Arctic Circle and search for the giant waves	🈚️
This fall	Wild Life Episode 2: Elephants	Elephant orphanages in Kenya
This fall	Elevated	Fly over volcanoes, climb over waterfalls, and discover the unknown natural wonders of Hawaii, the world’s longest island chain
This fall	Submerged	Against the backdrop of World War II, the audience will board a submarine and witness how the crew survived after being hit by a torpedo
This fall	2024 NBA All-Star Weekend	Watch the Rookie Game, Slam Dunk Contest, the first-ever NBA vs. WNBA 3-Point Challenge Stephen V.S. Sabrina, and the All-Star Game
Later this year	The Weeknd Immersive Performance	Immersive experience of Apple Music Award winner and artist with 7 diamond sales certifications
Later this year	Red Bull: Big-Wave Surfing	Witness surfing masters trying to conquer towering waves on the Tiahup coast in Tahiti

It can be seen that all these immersive videos are “big scenes” from the setting, which is very consistent with the characteristics of immersive videos.

Apple Vision Pro now has a new virtual environment to view

Keywords: Apple Vision Pro, Environment

In the latest visionOS 2 beta 4, Apple has finally put together the final piece of the puzzle for the virtual environment of the system: Lake Vrangla. With this, all the pieces of the virtual environment puzzle are finally completed.

Compared to the previous Mount Hood, this Lake Vrangla has a misty effect and is very suitable for watching horror movies: P

You can now replace Persona’s background

Keywords: Persona, Apple Vision Pro

Outside of FaceTime, if we obtain the front-facing camera of Apple Vision Pro, what we get is a Persona video stream with a background. However, we cannot replace the background of this video stream.

In the recent visionOS 2 beta 4, we can see that in the settings, we can now modify the background of Persona in scenes other than FaceTime. In addition to the background of the virtual environment, users can also set it with photos themselves (more and more like Zoom and other meeting software).

Idea

Playing games with gestures, maybe we can be more creative

Keywords: games, gestures

If we use gestures to operate RPG games, how should we design gestures? Perhaps, Gabriele Romagnoli ‘s idea of using fingers to operate small people can give us some ideas:

A similar scene also appeared in a movie called Her :

Code

visionOS 2 30 Days

Keywords: visionOS, 30 Days

He’s here, he’s here. After receiving 2k Stars for visionOS 30 Days last year, our old friend Satoshi This year, he has started updating his 2.0 version - visionOS 2 30 Days . The entire project has reached Day 2. If you have also borrowed Satoshi’s code in the development of visionOS last year, then continue to give this project a Star 🤩

Video

How to Make a Bubble in VisionOS: Reality Composer Pro Shader Graph Tutorial

Keywords: visionOS, RealityComposerPro

If you’ve played Blackbox , the famous game on the Apple Vision Pro, you’ll be fascinated by the variety of real bubbles.

In this video from Sarang Borude , he shows us how to use Reality Composer Pro’s Shader Graph to generate realistic bubbles.

App

Meshy.ai

Keywords: Generated Model,

Meshy.ai is an AI tool that can quickly generate models through text and images. Recently, Meshy also launched their Apple Vision Pro version . In the current version, we can quickly browse the models accumulated by the community on Meshy and zoom and move them in the form of volumes in Apple Vision Pro:

Job

ILLUSION Tech: front-end development, Content cybertribe operations, operations development, 3D content designer

ILLUSION Tech is a technology company focusing on the XR field. ” Seasons ” is the first Apple Vision Pro application under ILLUSION, which has been recommended by Apple several times since its launch.

The company is developing a space content creation tool to promote the emergence of more high-quality space content.

Currently, the company is recruiting positions.

If you are interested in the above positions, please send your resume to [email protected].

Contributors of this issue

SpatialOnee

SwiftSiqi