The ESA XR Team is a group of the European Space Agency dedicated to Extended Realities (XR) that aims to:
- facilitate knowledge transfer
- foster cross-collaborations
- generate strategic outcomes
- streamline developments
- inspire Europe
The ESA XR Team is a group of the European Space Agency dedicated to Extended Realities (XR) that aims to:
ESA has already executed +80 activities and initiatives on XR topics. More details can be found in Nebula Public Library or by contacting xr@esa.int.
| Year | Short Name | Full Name | Description | Use Case |
|---|---|---|---|---|
| 2008 | PVAITV | Portable Virtual AIT Visualizer | Development of an AR system to support AIT/AIV operations using an HMD and IR tracking system, tested in ESTEC test center clean room | Operations Support |
| 2008 | MISSIVE | Multi-Purpose ISS Interactive Virtual Environment | VR platform for ISS used for outreach and dissemination | Outreach |
| 2008 | WEAR | Wearable Augmented Reality | First AR application used in Space (ISS) using an ad-hoc ODF procedure and model-based tracking | Operations Support |
| 2010 | 3D-PAT | 3D Procedure Authoring Tool | Extension of NASA PAT tool to author 3D animated procedures, based on Rapid-Author from Cortona3D, used for ISS procedures | Training |
| 2012 | GEV | God’s Eye View | VR environment showing ISS and ATV docking phase, used for PR purposes and qualified for deployment at ATV-CC | Outreach |
| 2013 | DECLARE | Augmented Reality enabled Collaboration | Remote real-time assistance for operations, tested in Erasmus User Center Columbus mock-up, using Unity and Meta HMD | Operations Support |
| 2014 | EdcAR | Engineering Data in Cross-Platform AR | AR Procedure viewer/Executor application with IoT capabilities, developed in Hololens | Training |
| 2017 | HORUS | Holographic Wearable Display for Manual Assembly | Use of holographic technology in AR HMDs to produce virtual objects at the right distance, reducing visual fatigue | Operations Support |
| 2017 | MARVIN AR | Telemetry and Traverse simulation of a small rover in AR | AR application displaying rover telemetry to EVA astronaut, using Vuforia object tracking and Hololens | Operations Support |
| 2017 | VORTEX | Virtual Reality for Lunar Exploration | VR project representing lunar south pole surface for early depiction, science preparation, future operations, and training | Training |
| 2017 | SOLEUS | Space Countermeasure with a lower-leg orthosis | Countermeasure with a portable active lower-leg orthosis combined with Virtual Reality visuaization. | Training |
| 2018 | LSR AR | Complementary AR training system for LSR | AR device enhancing Life Support Rack crew training, tested at EAC, using markers and CAD-based solutions | Training |
| 2018 | MOBIPV | Mobile Procedure Viewer | Modular network enabled application for an operator to use as an interactive electronic technical manual (IETM) browser | Operations Support |
| 2018 | NGV | Norut GeoViz | General purpose geospatial-enabled 3D globe displaying EO imagery, 3D models, point clouds, and elevation data | Digital Twin & Simulation |
| 2018 | VIPER | Visualization of Industry Processes in Enhanced Reality | Advanced industrial instruction manuals using AR with a mobile app, automating creation and offering interactive presentations | Operations Support |
| 2018 | JIVE | Joint Investigation for Virtual Reality Education | VR initiative in collaboration with NASA to complement classical robotics training for astronauts | Training |
| 2019 | VR/AR Kickstart | Virtual and Augmented Reality Kick-Start | Support for companies developing VR/AR applications using satellite data, offering funding, technical guidance, and commercial support | Digital Twin & Simulation |
| 2019 | GATEWAY4U | Remote virtual collaborative environment for Design Evaluation | VR tool using Unreal Engine, to simulate and improve LUNAR module design, tested with ESA astronauts | Training |
| 2019 | PANGAEA VR | Collaborative VR Tool to support PANGAEA training | VR representation of Lanzarote analogue site for collaborative teaching, integrating point-clouds data and portable deployment | Training |
| 2019 | AR-IoT | AR Surface exploration tool for geological support | AR-IoT tool allows astronauts hands-free geological inspections with data logging, photodocumentation, site mapping, verbal notes, and suit diagnostics | Digital Twin & Simulation |
| 2019 | HLPV | Hololens procedure viewer | AR application using CAD recognition to support procedure viewing. | Operations Support |
| 2019 | ARCE | Augmented Reality for Concurrent Engineering activities | Development of an interactive collaborative AR application for multidisciplinary design teams, tested in concurrent engineering design exercise | Digital Twin & Simulation |
| 2019 | VREVA | Astronaut training with Virtual Reality for Extravehicular Activities | VR for EVA focused on a teaching tool to familiarize the user to EVA in terms of tools, suits, protocols... to complement NBF (Neutral Buyocy Facility) training | Training |
| 2020 | EXOSUIT | Virtual Presence for Astronaut Training using VR and Exoskeleton | Usage of exoskeleton with VR to enhance Virtual Presence while doing EVA training, simulating motion restriction and haptic feedback | Training |
| 2020 | VR OBT | Virtual Reality On-Board Training | Technology demonstration for effective ways to deliver on-board training to astronauts through virtual reality | Training |
| 2020 | VR EXERCISE | Enhance crew training on CEVIS via VR | VR enhancement for CEVIS exercise on ISS, providing city or landscape views | Training |
| 2020 | PILOTE | VR neuroscience experiment applied to remote robotics | VR experiment for remote robotics neuroscience, enhancing operator control and decision-making | Operations Support |
| 2020 | VARIAS | Virtual and Augmented Reality for Industry and Space | Extension of VIPER tool for VR training on crew operations, supporting procedure generation | Training |
| 2020 | VIRWAIT | Virtual Workplace for AIT | Extending AROGAN to support AIT/AIV via sensor placement, config tracking, CAD updates, and remote access. | Operations Support |
| 2020 | V0GUE | Zero-G simulator inside photorealistic ISS Model | Model and simulation of navigation in Zero Gravity using VR for astronaut IVA training. | Training |
| 2021 | MSR Surface VR | Represent MSR landing surroundings in VR | VR reconstruction of Perseverance rover surroundings, supporting outreach and science, with real-time terrain model updates | Training |
| 2021 | Robotics Gesture Control | Demonstrate usefulness of multimodality | Prove usage of gesture and voice commanding system for robot control, comparing performance and user friendliness | Operations Support |
| 2021 | ARVR4GS | AR/VR for Ground Station maintenance and Telescopes | AR/VR support for remote maintenance tasks in Ground Stations and Telescopes, reducing physical presence requirement | Operations Support |
| 2021 | ARVR4MO | AR/VR supported Mission Operations | Specification of scenarios for AR/VR adoption in spacecraft operations, identifying meaningful application areas | Operations Support |
| 2021 | ARVRAI | AI aided AR/VR applications and VR aided ML | AI techniques optimizing data feed into AR/VR/MR environments, enhancing visual precision and user experience | Digital Twin & Simulation |
| 2021 | ARVR4S2P | AR/VR for Space Safety Programme | Visualization of Space Safety Programme data using AR/VR, providing immersive experience and contextualizing results | Operations Support |
| 2021 | DTUP | Digital Twin Urban Pilot | Digital Twin of Frascati and ESRIN site, enriched with data sources for urban mobility and city planning | Digital Twin & Simulation |
| 2022 | X-ARM | Force-Feedback Device to Train Future Astronauts with XR | Combination of force-feedback and XR for astronaut training, increasing TRL of exoskeleton prototypes | Training |
| 2022 | DT PHILAB | Digital Twin Philab | Digital Twin of Philab building, fully explorable in VR | Digital Twin & Simulation |
| 2022 | LIGHTFIELD | Lightfield-enhanced immersive teleoperation system | Integration of lightfield data into XR environment for immersive teleoperation | Training |
| 2022 | VIOLA | Virtually Increased Operational space for Lunar rover simulations | Rover simulation space using augmented reality, continuing simulation virtually beyond physical boundaries | Digital Twin & Simulation |
| 2022 | MARA | Medical Augmented Reality Assistant | AR application supporting astronauts during medical procedures, focusing on ECG and extending to multiple procedures | Training |
| 2022 | SCIFLEET MUSEUM | VR of the science fleet spacecraft models in a virtual museum | VR visualization of science fleet spacecraft models in a museum-like setup | Outreach |
| 2022 | COSMOWEATHER | Space weather XR visualization | XR tool to visualize complex space-weather phenomena from the Sun to Earth in immersive, expert- and public-friendly formats | Operations Support |
| 2023 | MUSE | Modular User-centred Spaceflight Experience | Virtual spaceflight experience onboard conceptual spacecraft Human Inspirator, studying spacecraft design and situational awareness | Outreach |
| 2023 | VETRA | Virtual Environment Training for Robotic Arms | VR training simulator for KUKA robotic arm, exploring suitability of Godot game engine for VR | Training |
| 2023 | GUARDIANS OF EARTH | VR and MR representation of the HERA mission | VR experience of Hera’s mission, accessible to anyone with VR devices, featuring narration by Brian May | Outreach |
| 2023 | GRAVITAS | Gateway Review And Virtual Interior Tool for Astronaut Systems | VR/MR environment for Lunar Gateway interior design, addressing ergonomics, habitability, and safety | Digital Twin & Simulation |
| 2024 | LARS Sim | LARS Sim | XR simulation infrastructure in the cloud for multi-variable optimizations | Digital Twin & Simulation |
| 2024 | EXPOSE EL3 | eXPerience Operations Simulation Environment | VR for lunar surface operations, mapping telemetry directly into VR simulation | Digital Twin & Simulation |
| 2024 | IMMERSEON | Immersive Visualization and Metaverse for EO | VR experience for flood modeling, integrating explainable AI capabilities | Operations Support |
| 2025 | ESA XR PLUGIN | ESA Extended Realities Plugin | General purpose XR framework for Unreal Engine to streamline development efforts | Outreach |
| 2025 | LUNA XR | Luna Analogue in Extended Reality | Digital Twin of the Luna Analogue, used for astronaut training | Training |
| 2025 | ISDE | Immersive space design environment | XR prototype enabling intuitive collaboration, model editing, and visualization for early-phase mission design | Digital Twin & Simulation |
Enables experts to guide astronauts or operators in real time with Mixed Reality overlays and annotations.
Makes complex space concepts immersive and interactive, improving learning and retention.
Allows immersive views of spacecraft missions, and data models for better comprehension
Simulates space environments to test hardware/software under realistic conditions.
Engages the public via gamified space missions and environments.
Enhances control and awareness by immersing operators in the environment of the robot
Provides Mixed Reality guided repairs and diagnostics in complex space facilities.
Visualizes real-time solar activity for better forecasting and awareness
Immersive 3D views of satellite data for improved analysis and decision-making.
Supports real-time, immersive teamwork on spacecraft and mission systems design.
Simulates Extravehicular Activities for training and planning with realistic environmental interactions
Provides safe, repeatable environments to train operators in robotic manipulation.
Simulates medical emergencies and procedures in microgravity conditions.
XR can guide complex spacecraft Assembly Integration and Testing / Verification.
Enhances situational awareness with 3D mission visualizations and crew status.
Enables self-paced, immersive learning modules for astronauts in-flight.
Visual tools help simulate and validate mission steps and contingencies.
Offers immersive environments for exploring concepts, analyzing data, and simulating experiments across disciplines.
Makes space science accessible to the public via immersive exhibits and experiences.
The following table presents XR features that advance the state of the art, helping European companies and organizations focus their efforts and avoid redundancy.
| Priority | ||||||
|---|---|---|---|---|---|---|
| Category | Feature | Description | Digital Twin & Simulation | Operations Support | Training | Outreach |
| Interaction | Digital Twin Integration* | Real-time XR interaction with spacecraft or hardware digital twins | High | High | Medium | Low |
| Input Devices* | Monitoring and Orchestrator of multiple stimuli (multimodal) in XR | Low | Low | High | Low | |
| Object localization | Detection and tracking of objects for automatic verification in MR | Medium | Medium | High | Low | |
| Virtual Presence | Merging multiple sensors and actuators for enhanced immersion | Medium | Medium | High | Medium | |
| Accurate Physics | Deterministic, accurate simulations in real-time in XR | High | Low | Medium | Low | |
| Accessibility | Ensuring XR is accessible for all, including for those with disabilities | Low | Low | Medium | High | |
| Interfaces | Finding new ways to interact and engage with content in XR | Medium | High | Medium | Medium | |
| Adaptive learning | A set of tools to obtain learning analytics and customize training in XR | Low | Low | High | Low | |
| Infrastructure | XR hardware for Space* | Mature XR headsets for use in microgravity or planetary environments | Low | High | High | High |
| AI World Generation | AI-powered world generation for immersive XR creation | High | High | High | High | |
| Internet of Things | Framework to connect XR with other devices, sensors or databases | Medium | High | Medium | Low | |
| Cloud rendering | Stream visuals from remote servers, reducing processing demands locally | Medium | Medium | Medium | Medium | |
| Cross-platform | Solution to easily port XR applications to desktop or mobile and vice versa | Medium | Medium | Medium | High | |
| Connectivity and Security | Use communication and data encryption standards to connect in XR | High | High | High | High | |
| Standardization | Advanced Procedures | Harmonised format, AI-powered authoring and visualization of procedures | Low | Medium | High | Medium |
| Robotic-XR standards | Full integration with ROS for teleoperation of robots in XR | Medium | High | Medium | Low | |
*These features have been pushed in current ESA funding programmes
The ESA XR Plugin is an optional tool designed to streamline efforts, avoid redundancies, and enable a deeper focus on advancing state-of-the-art XR solutions for space applications.
This plugin proposes a modular, building-blocks solution made for Unreal Engine 5.5 that allows organizations and independent creators to contribute.
The architecture uses common Characters for both users and instructors, featuring interchangeable components:
Different ways to navigate in Space environments.
Collaboration among multiple users in the same virtual environment for the Metaverse.
Advanced Sessions Plugin.
Recording and visualization of past exercises in XR, allowing users to review sessions and correct mistakes.
Organizing, reading, writing, and maintaining files to handle data efficiently.
Taking text, voice, and multimedia notes during runtime.
Local LLM models enable interaction with an assistant within XR experiences.
Everyone is invited to participate in the ESA XR Plugin by creating submodules. Contributors will be able to publish their developments while retaining their own Intellectual Property and Commercialization Rights. Development ideas can be found in the Tech Needs Section. For more information: xr@esa.int
The plugin can be found, along with installation and documentation guidelines, in the following repository:
ESA XR Plugin (Coming soon)ESA aims to inspire educators and students by making space concepts engaging and accessible. Discover the following XR experiences available for download:
Virtual Reality experience of a spacecraft launch and re-entry, offering a firsthand feel of microgravity.
DownloadDisclaimer: For inspiration only; not scientifically intended. Developed by ESA Spaceship and ESA XR Lab.
📅 Posted August 2025
Experience the epic journey of the Hera satellite probe in an immersive virtual and mixed reality adventure.
Developed by DIVE for ESA.
📅 Posted August 2025Programmes can make use of the ESA XR Plugin described in the Developers section. Students are invited to contribute by providing components to the open framework.
More information about ESA funding programmes can be found here: Business with ESA.
The following applications can be accessed by contacting ESA directly.
Step into the digital twin of the LUNA Facility and real Moon terrains from heightmaps.
Developed by DLR and ESA XR Lab.
📅 Posted August 2025
ESA XR Strategy 2025