Going Virtual – Working Smarter & Harder
Augmented reality (AR) and virtual reality (VR) are rapidly evolving technologies that can be applied to a range of use cases and industries – helping engineers to become more efficient and better communicators during iterative engineering tasks.
A GSTP funded activity investigated how the capabilities of AR and VR could be leveraged to improve the remote maintenance and support of ground station equipment and telescopes. ESA’s Tracking Station Network – ESTRACK – is a global system of ground stations, providing vital communication between all space assets and the European Space Operations Centre (ESOC). These ground stations are distributed globally, often in remote, hard to reach places, where it can be difficult to perform the mission specific maintenance and updates.
Using a conventional, commercial off-the-shelf (COTS) tablet and an AR headset, a proof-of-concept prototype was developed. Here, a local on-site operator can work together with a remote expert, following live instructions through AR/VR tablets or hand’s free, in-situ digital platform, where drawings and descriptions are available within the engineer’s field of view. AR is effective is superimposing digital information onto the physical world. VR, by comparison, creates a more, fully immersive, computer-generated environment. The remote expert can interact with the local on-site operator’s environment digitally; highlighting specific objects, points of interest and annotating them if needed. Additionally, explanatory three-dimensional models, instruction manuals, task lists and procedures are available and displayed through the headset’s optical see-through.
The protype successfully demonstrated how both AR and VR can be used to support the remote inspection and maintenance of ground stations and telescope operations. The technology readiness level of the prototype was successfully raised to 5 (breadboard validation in a relevant environment). Validation occurred at the Ground Segment Reference Facility (ESOC GSRF). The next step is to deploy and test the protype technology in a specific ground station or telescope facility, and eventually operational deployment.
A similar solution could also be used for telemedicine and/or in the automotive and aeronautical industry, where the set-up and/or maintenance of expensive, complex and remote hardware is involved. Additional space-based user cases could include, for example, remote research stations, spacecraft validation test and astronaut crew support.
Contract 4000136086 closed in 2022. The activity was performed by Terma Deutschland GmbH (DE) and Fraunhofer IGD (DE). The results were presented at the ESA Technology Sharing Day in 2023.