NVIDIA streaming technology ignites the Apple Vision Pro ecosystem: 4K resolution, 120Hz refresh rate gaze point streaming

IT之家 March 18 news: Tech media 9to5Mac yesterday (March 17) published a blog post, saying that at this week’s GTC2026 event held in San Jose, the United States, NVIDIA announced a collaboration with Apple. After upgrading the Vision Pro headset to the visionOS 26.4 system update, users can get CloudXR 6.0 technical support.

CloudXR 6.0 technology precisely meets the three non-negotiable requirements enterprises have for extended reality (XR): 4K-level high-fidelity visual effects, real-time response speed, and a fully immersive experience.

CloudXR 6.0 supports devices to achieve foveated streaming (Foveated Streaming) with 4K resolution and a 120Hz refresh rate for the gaze point, without being tethered to a PC via cables.

IT之家 note: Foveated streaming is an image processing technology that uses “good steel on the blade.” The headset tracks your eyes to see where you’re looking, rendering the area at the center of your field of view with extremely high clarity, while the edge regions you see with peripheral vision are rendered with reduced image quality. This saves both compute power and bandwidth, while also ensuring that the place you’re looking at is always the highest quality.

In addition, the system will track the user’s gaze landing point in real time, and intelligently optimize the rendering resolution of that area. This reduces transmission latency while ensuring ultimate picture quality.

The two sides have jointly developed the first software development kit (SDK) that supports sharing user gaze point data. Under the premise of strictly protecting user privacy through encrypted connections, it greatly expands the potential of spatial computing.

At the same time, NVIDIA also released cross-platform Xcode templates. With these, developers can achieve “develop once, deploy everywhere,” easily covering applications across the iPhone, iPad, and Vision Pro platforms.

Industrial manufacturing and automotive design are the first areas to benefit from this technology dividend. The “Immersive for Autodesk VRED” app jointly built by Innoactive and Autodesk will officially launch on the App Store this spring. With cloud or local computing power from NVIDIA RTX graphics cards, the app supports full native streaming.

After designers at automakers such as BMW, Kia, Rivian, and Volvo put on Vision Pro, they can review massive 3D models with ray tracing effects at a 1:1 scale.

Besides the automotive industry, the application scenarios for this technology are rapidly extending into more dimensions. Foxconn is currently using this technology to build a visualization roaming system for factory workshops, and data center company Switch is also developing remote management solutions based on digital twin technology. Exploration in the healthcare field is also underway in parallel.

In the high-end gaming market, “X-Plane12,” hailed as the “most advanced flight simulator in the world,” as well as the professional racing simulation game “iRacing,” will also come to visionOS with CloudXR technology, bringing players an outstanding immersive experience.