Vocabulary

A brief reference glossary of terms used in this document. Terms are listed in approximate first-appearance order.

  • Immersive media. The multidisciplinary field of media forms that combine technology, art, and human experience to produce environments people inhabit, manipulate, and learn inside.
  • XR (Extended Reality). The collective term for Virtual Reality, Augmented Reality, and Mixed Reality.
  • VR (Virtual Reality). Fully immersive computer-generated environments that displace the participant's perception of the physical world.
  • AR (Augmented Reality). Digital content overlaid on the physical world, viewed through smartphones, tablets, head-worn devices, or projection systems.
  • MR (Mixed Reality). The merger of physical and digital so participants interact with both at once.
  • Spatial computing. The integrative theme combining XR technologies, sensing, and rendering to deliver context-aware immersive experiences. Apple's marketing usage of the term overlaps with the broader technical meaning.
  • The Metaverse. The multi-participant immersive medium taken as a whole. Treated as a proper noun in this document.
  • Multi-participant. Preferred term for the person inhabiting an immersive experience where the experience is embodied or shared. Replaces user in participatory contexts.
  • Participant. Singular form of multi-participant.
  • OpenXR. The cross-vendor runtime specification multi-vendor head-worn devices target. Stewarded by the Khronos Group.
  • WebXR. The web API for delivering immersive experiences through web browsers. Stewarded by the W3C.
  • glTF. A compact, portable, efficient 3D file format. Stewarded by the Khronos Group.
  • OpenUSD. The open specification for Universal Scene Description, originated at Pixar and stewarded by the Alliance for OpenUSD (AOUSD), a Linux Foundation project founded in 2023.
  • USDZ. Apple's compressed package format that wraps USD content. A packaging layer on top of USD, not a separate specification.
  • WebGPU. The next-generation web graphics API providing direct GPU access in the browser.
  • WebAssembly (Wasm). A binary instruction format for near-native performance execution in browsers.
  • Volumetric video. Photo-realistic 3D captures of people and objects viewable from any angle.
  • Volumetric capture. The production process (camera arrays around the subject) that produces volumetric video.
  • Gaussian splatting. A 3D scene representation using collections of 3D Gaussian primitives, supporting real-time rendering at high frame rates. Matured to production-ready status in the 2024-to-2026 window.
  • NeRF (Neural Radiance Field). A neural-network-based 3D scene representation, useful for novel-view synthesis from photographic input. Substantially eclipsed by Gaussian splatting in production contexts requiring real-time rendering.
  • Spatial anchor. A digital reference point that ties digital content to a specific physical location.
  • Geopose. Precise positioning and orientation of objects in a geospatial coordinate frame.
  • Passthrough. A head-worn device's display of the physical environment captured through outward-facing cameras, supporting MR experiences.
  • Haptics. Technologies that produce physical sensations to register digital interactions on the body.
  • Foveated rendering. A rendering technique that allocates GPU resources to the area the participant is actually looking at, using eye tracking to reduce total compute load.
  • Gaze-and-pinch. An interaction primitive (popularized by Apple's Vision Pro) combining eye-gaze target selection with a thumb-and-index-finger pinch gesture as a confirming action.
  • Object-based audio. Audio formats (Dolby Atmos, MPEG-H Audio) that treat audio elements as discrete objects with position and properties, supporting spatial audio playback.
  • Avatar. Digital representation of a participant in a virtual environment.
  • Biometric psychography. A category, named by Brittan Heller in 2020, for the inference of psychological state and disposition from biometric and behavioral data generated in immersive contexts.
  • IPM (Immersive Public Media). A category name used in other Academy material to describe public-interest immersive media. The acronym is used by the Academy in some other materials; this document refers to the category as public-interest immersive media in the field-survey sense.