XR World Weekly 022
Deep and high quality, keep you ahead of the curve in the XR world
Cover of this issue
In this issue, we share the Airbnb - AR/VR Animation Concept built by Aurélien Salomon UX .
Publication preface
Hi, long time no see! I am Siqi, the editor-in-chief of XReality.Zone!
After organizing the Let’s visionOS 2024 Global Creator Conference this spring, we fully felt the enthusiasm of the entire ecosystem for spatial computing. Let’s revisit the grand scene of the event through the following short video.
It is not difficult to notice that after this event, the XReality.Zone entered a short period of rest, and our XR World Weekly and visionOS teaching content have stopped updating. However, now I can happily announce to you - We are back!
Yes, the XReality.Zone is back!
During this seemingly “rest” period, we communicated with many domestic and foreign developers and enterprises (the number may far exceed your imagination). You may see many people on the Internet saying that this device is too bulky, the interaction is too poor, and the sales of this thing are too low. These information always give you a feeling that spatial computing is about to fail. However, through our actual observation, we believe that the exploration of developers and enterprises in this area is far beyond everyone’s imagination, and these changes have practical significance and imagination.
Just like the one-month period after the official release of Apple Vision Pro in China, although the media criticized the market in various ways, Chinese internet giants have come forward one after another to show their own work. This is like saying no with words, but still being honest with the body.
At the same time, the exploration of AVP in the community is also showing an increasingly diverse trend. For example, two community projects that I have recently paid attention to:
-
BunnyVisionPro: Bimanual Dexterous Teleoperation with Real-Time Retargeting using Vi
-
VisionProTeleop: VisionOS App + Python Library to stream head / wrist / finge
To be honest, when I saw these two projects, the first thing that came to my mind was the touching boxing match between Zeus and Adam in Real Steel , as well as some of the world settings in this movie, such as the new electronic sports project of “robot boxing match”.
These seemingly unattainable things may already be slowly developing and evolving around you and me.
I want to say, the future has arrived, would you like to join us on the road?
Table of Contents
Activity
- Qualcomm Snapdragon Spaces XR Technology National Tour Salon · Beijing Station
News
-
In the second half of the year, you can see more immersive videos on Apple Vision Pro
-
Apple Vision Pro now has a new virtual environment to view
-
You can now replace Persona’s background
Idea
- Playing games with gestures, maybe we can be more creative
Code
- visionOS 2 30 Days
Video
- How to Make a Bubble in VisionOS: Reality Composer Pro Shader Graph Tutorial
App
- Meshy.ai
Job
- ILLUSION Tech: front-end development, Content cybertribe operations, operations development, 3D content designer
Activity
Qualcomm Snapdragon Spaces XR Technology National Tour Salon · Beijing Station
Keywords: Qualcomm, Snapdragon Spaces XR
On August 3, 2024 , the first stop of Qualcomm Snapdragon Spaces Technology National Tour Salon will be opened in Beijing . This XR technology sharing meeting is jointly organized by Shenmu Technology and China Electronics Cloud, and has received strong support from Beijing Zhongguancun Entrepreneurship Street Technology Service Co., Ltd.
This technology salon will bring together many XR industry leaders and innovators, focusing on sharing XR innovative application cases, bringing the latest XR technology sharing and solutions to developers. The event is divided into the morning XR application sharing session and the afternoon technology practice session and electronic cloud metaverse closed-door exchange meeting . You will have the opportunity to learn about the most cutting-edge XR technology applications and gain valuable industry insights.
💡 Tips:
Those who fill in the questionnaire from the registration entrance, remember to select “XReality.Zone” in the channel , send the screenshot of the selected channel and completed questionnaire to the “XReality.Zone” official account background, and you can get a small gift - Minority gift three-piece set 😉 .
News
In the second half of the year, you can see more immersive videos on Apple Vision Pro
Key words: Apple Vision Pro, immersive video
Finally, the Apple Vision Pro we bought can have more “exclusive” content! 😆
In this official Apple article , Apple announced that more immersive videos will exclusively land on Apple Vision Pro in the second half of the year . These videos include:
Release time | Episode name | Highlight | Preview image |
---|---|---|---|
Published | Boundless Episode 1: Hot Air Balloons | Take a hot air balloon ride and overlook the strange landforms of Cappadocia, Turkey | |
This fall | Boundless Episode 2: Arctic Surfing | Go to the area inside the Arctic Circle and search for the giant waves | 🈚️ |
This fall | Wild Life Episode 2: Elephants | Elephant orphanages in Kenya | |
This fall | Elevated | Fly over volcanoes, climb over waterfalls, and discover the unknown natural wonders of Hawaii, the world’s longest island chain | |
This fall | Submerged | Against the backdrop of World War II, the audience will board a submarine and witness how the crew survived after being hit by a torpedo | |
This fall | 2024 NBA All-Star Weekend | Watch the Rookie Game, Slam Dunk Contest, the first-ever NBA vs. WNBA 3-Point Challenge Stephen V.S. Sabrina, and the All-Star Game | |
Later this year | The Weeknd Immersive Performance | Immersive experience of Apple Music Award winner and artist with 7 diamond sales certifications | |
Later this year | Red Bull: Big-Wave Surfing | Witness surfing masters trying to conquer towering waves on the Tiahup coast in Tahiti |
It can be seen that all these immersive videos are “big scenes” from the setting, which is very consistent with the characteristics of immersive videos.
Apple Vision Pro now has a new virtual environment to view
Keywords: Apple Vision Pro, Environment
In the latest visionOS 2 beta 4, Apple has finally put together the final piece of the puzzle for the virtual environment of the system: Lake Vrangla. With this, all the pieces of the virtual environment puzzle are finally completed.
Compared to the previous Mount Hood, this Lake Vrangla has a misty effect and is very suitable for watching horror movies: P
You can now replace Persona’s background
Keywords: Persona, Apple Vision Pro
Outside of FaceTime, if we obtain the front-facing camera of Apple Vision Pro, what we get is a Persona video stream with a background. However, we cannot replace the background of this video stream.
In the recent visionOS 2 beta 4, we can see that in the settings, we can now modify the background of Persona in scenes other than FaceTime. In addition to the background of the virtual environment, users can also set it with photos themselves (more and more like Zoom and other meeting software).
Idea
Playing games with gestures, maybe we can be more creative
Keywords: games, gestures
If we use gestures to operate RPG games, how should we design gestures? Perhaps, Gabriele Romagnoli ‘s idea of using fingers to operate small people can give us some ideas:
A similar scene also appeared in a movie called Her :
Code
visionOS 2 30 Days
Keywords: visionOS, 30 Days
He’s here, he’s here. After receiving 2k Stars for visionOS 30 Days last year, our old friend Satoshi This year, he has started updating his 2.0 version - visionOS 2 30 Days . The entire project has reached Day 2. If you have also borrowed Satoshi’s code in the development of visionOS last year, then continue to give this project a Star 🤩
Video
How to Make a Bubble in VisionOS: Reality Composer Pro Shader Graph Tutorial
Keywords: visionOS, RealityComposerPro
If you’ve played Blackbox , the famous game on the Apple Vision Pro, you’ll be fascinated by the variety of real bubbles.
In this video from Sarang Borude , he shows us how to use Reality Composer Pro’s Shader Graph to generate realistic bubbles.
App
Meshy.ai
Keywords: Generated Model,
Meshy.ai is an AI tool that can quickly generate models through text and images. Recently, Meshy also launched their Apple Vision Pro version . In the current version, we can quickly browse the models accumulated by the community on Meshy and zoom and move them in the form of volumes in Apple Vision Pro:
Job
ILLUSION Tech: front-end development, Content cybertribe operations, operations development, 3D content designer
ILLUSION Tech is a technology company focusing on the XR field. ” Seasons ” is the first Apple Vision Pro application under ILLUSION, which has been recommended by Apple several times since its launch.
The company is developing a space content creation tool to promote the emergence of more high-quality space content.
Currently, the company is recruiting positions.
Job title | Job requirements | Base | Recruitment type |
---|---|---|---|
Front-end development | SwiftUI expert, familiar with native AR frameworks such as ARKit and RealityKit, and familiar with third-party AR frameworks such as Unity ARFoundation | Shenzhen | Social recruitment, campus recruitment |
Content cybertribe operations | Work experience in content sharing products, experience in operating overseas media such as Twitter and Reddit, and able to use English for daily conversations | Shenzhen | Social recruitment |
Operations development | 1. Responsible for the overall cloud service structure of the product to ensure high availability, high security, and low cost 2. Responsible for building DevOps R & D operation and maintenance pipeline 3. Responsible for building product Big Data Analysis capability Bonus points: Experience with AWS and Cloudflare | Shenzhen | Social recruitment, campus recruitment |
3D content designer | Experience in using tools such as Composer, Unity, and Unreal, as well as Shader design experience. Follow the latest developments in the AR industry and have a personal understanding of experience design. | Shenzhen | Social recruitment |
If you are interested in the above positions, please send your resume to [email protected].
Contributors of this issue
推荐阅读
- XR World Weekly 008
- XR World Weekly 029 - Hurry up and update to the new system.
- XR World Weekly 030 - The greatest significance of Orion released at the Connect conference is to give people hope
- XR World Weekly 031 - Friend, do you believe in light?
- XR World Weekly 028 - visionOS 2 will be officially released on September 16.
- XR World Weekly 006
- XR World Weekly 026 - Black Myth: Wukong has completed the journey to obtain Buddhist scriptures, but Meta may not have