Apple Vision Pro: Hardware Overview, Spatial Design Principles, and Application Scenarios

Apple introduced its first head‑mounted display, Vision Pro, at WWDC23. The device runs the world‑first spatial operating system VisionOS and supports multiple input modalities such as hand gestures, eye tracking, and voice. Vision Pro was opened for developer kits in July 2023 and launched in the US on February 2, 2024. The author attended the Apple Vision Pro developer lab in Shanghai and tested the NetEase Cloud Music app on both the simulator and the real device.

Key hardware components include a curved 3‑D glass front with an aluminum frame, a high‑resolution dual‑eye micro‑OLED display (over 23 million pixels per eye), an array of cameras and sensors delivering more than 1 billion pixels per second, precise head‑ and hand‑tracking, spatial audio speakers, a breathable 3‑D‑knitted headband, a magnetic light‑shield, a digital crown for mode switching, top buttons for capturing spatial media, and an external battery providing 2–3 hours of runtime. Two chips power the system: the M2 chip runs VisionOS and advanced computer‑vision algorithms, while the R1 chip processes sensor data and streams images to the display within 12 ms (8× faster than a blink).

Spatial design concepts are built around three core constructs in VisionOS:

Windows – SwiftUI‑based 2‑D containers that can host 3‑D content.

Volumes – 3‑D containers rendered with RealityKit or Unity, enabling depth and shared‑space experiences.

Spaces – Shared or full spaces that determine how apps are arranged in the user's environment.

The design principles emphasized by Apple include maintaining familiarity (reusing familiar UI elements), human‑centered ergonomics, leveraging depth and scale, creating immersive experiences, and preserving platform authenticity.

MR core technologies are compared:

Video See‑Through (VST) – captures the real world with cameras and composites virtual content (used by Vision Pro, Meta Quest‑3). Advantages: richer virtual world, but higher hardware cost and latency.

Optic See‑Through (OST) – uses a transparent optical combiner to overlay virtual objects onto the real world (used by Microsoft HoloLens‑2). Advantages: true AR experience, lighter form factor, but limited performance due to current optical constraints.

A detailed table contrasts brightness, real‑world resolution, latency, focal planes, occlusion, FOV, virtual‑real matching, and registration between VST and OST.

Privacy and security are addressed through Optic ID, an iris‑based authentication stored only on‑device, and by processing camera and sensor data locally, ensuring that eye‑tracking and environment data are never sent to Apple servers.

The article also explores speculative application scenarios for the Cloud Music app in Vision Pro, such as a virtual vinyl record wall, a multi‑window DJ console, immersive concert spaces, and environment‑driven music experiences.

Reference links to Apple developer documentation, VisionOS compatibility guides, and various technical articles are provided for further reading.