Could Extended Reality reshape the future of flight training?
Full Flight Simulators (FFS) are an effective training tool for business jet pilots. But with the emergence of new technologies, the potential of simulator training stands at a turning point, writes Christian Theuermann, member of the executive board at AXIS Flight Simulation.
Extended Reality (XR) is the umbrella term which refers to Augmented (AR), Virtual (VR) and Mixed Reality (MR), with each variation offering access to an immersive environment that combines or mirrors the physical world. The application of XR within flight training promises to increase efficiency and offer new ways to learn.
XR works to extend the pilot’s reality, offering a level of immersion beyond traditional flight simulation methods. Each digital avenue provides unique advantages and can be employed to improve different aspects of flight training.
For example, AR can be used to overlay computer-generated information onto the user’s real-world environment, enhancing their perception by adding digital elements. An AR system could project critical flight data, navigation information or pre-flight checklists onto the pilot’s field of view through a transparent display in the cockpit. This aids real-time decision-making without obstructing the trainees’ surroundings.
Alternatively, VR can create a completely immersive, computer-generated environment that users can interact with, using a headset or goggles. When used in flight training, VR places the pilot inside a fully virtual cockpit, providing a 360-degree view and a sense of presence. This technology allows realistic training scenarios to be conducted in a safe environment, such as emergency procedures or navigating adverse weather conditions.
MR combines elements of AR and VR, allowing users to interact with both real-world and virtual environments simultaneously. In MR-based flight simulation, the avionics and the cockpit are real, but digital enhancements like weather effects or other virtual elements are seamlessly integrated. This technology offers a balance between the tangible aspects of the real world and the immersive possibilities of virtual environments.
XR in pilot training
While FFS represent the cornerstone of pilot training, XR has potential to address some of the challenges of FFS training. For example, XR enables remote training that can be carried out in pilots’ homes, expanding access to high-fidelity simulations without the need to travel to a specialised centre.
AXIS Flight Simulation launched its own VR solution earlier this year. The Virtual Cockpit Procedure and Walkaround Trainer (VPT) leverages VR technologies to deliver an advanced and flexible training solution. Using hand and eye-tracking capabilities, trainees can interact with the system naturally and intuitively. The VPT can be used as a standalone tool or integrated into existing training processes, making it adaptable to different stages of pilot development.
Portable systems, such as the VPT, supports tasks like system familiarisation, ground operations, flight procedures and emergency scenarios with minimal hardware requirements. By using VR headsets, pilots can engage in immersive experiences that replicate the intricacies of pre-flight checks, emergency protocols and maintenance procedures without need for a physical aircraft or simulator.
VR setups are more portable and adaptable than FFS, allowing trainees to practice specialised scenario-based training in various environments and settings. The ability to practice in this way means pilots can attend in-person sessions with more practice and knowledge before moving forward in their FFS programme, increasing training efficiency.
Training for the future
The emergence of Electric Vertical Take-off and Landing (eVTOL) aircraft presents new challenges and opportunities for pilot training. These innovative aircraft designs require specialised training simulators capable of replicating their unique flight characteristics and operational environments. XR technologies offer a versatile platform for simulating eVTOL operations, providing pilots with hands-on experience in handling these next-generation aircraft.
By immersing pilots in realistic scenarios, XR-based training could support pilots with understanding the intricacies of eVTOL flight, including vertical take-offs, transitions between vertical and horizontal flight and variable lift systems. This targeted training approach would prepare pilots to safely and effectively operate eVTOL aircraft, contributing to the successful integration of this transformative technology into the aviation ecosystem.
The AI potential
Developing Artificial Intelligence (AI) technologies holds further promise for flight training. AI algorithms can analyse data collected from XR simulations to provide personalised feedback and detailed insights into pilot performance, including strengths and areas that may require improvement. This data-driven approach enables continuous improvement and optimisation of training programmes, ultimately enhancing pilot proficiency and safety. Looking ahead, the integration of AI into XR platforms will further augment the training experience, unlocking new opportunities for innovation and optimisation.
AXIS’ VPT comes with a built-in AI instructor that provides real-time support by answering questions about aircraft systems and controls, demonstrating how AI can augment XR-based training. By offering real-time guidance and leveraging interactive elements, the AI assistant improves the learning experience and ensures that pilots are equipped with detailed and accessible knowledge.
Regulatory frameworks
EASA awarded the first certificate for a VR flight training device in 2021. While this marked a significant step towards integrating immersive technologies, more regulation is required before XR can be widely applied to flight simulation training.
That said, the development of eVTOLs presents a distinct opportunity for immersive training methods. The UK government recently pledged to facilitate the launch of passenger-carrying, piloted eVTOL air services in 2026. As operators start to gain certification and demand for specialised pilots increases over the coming years, it’s likely that we will start to see immersive technologies introduced to enable faster training for these new vehicle types.
As XR technologies continue to evolve, we can expect further advancements in hardware capabilities, software algorithms and training methodologies. Embracing XR and fostering collaboration across the industry will provide a catalyst towards more efficient, inclusive and safe training practices.
