We are thrilled to announce a groundbreaking four-year collaboration with the German Army. Partnering with Wehrtechnische Dienststelle 91 (WTD 91), this initiative aims to revolutionize XR military training by incorporating advanced artificial intelligence (AI) technologies. This includes developing stand-alone AI modules to support service personnel in the field. By leveraging AI, the collaboration seeks to enhance training efficiency, realism, and human resource optimization.
Over the next four years, HGXR will use its expertise to integrate AI-driven solutions for the various aspects of military training to create a holistic, realistic training experience. The focus will be on the implementation and use of advanced behaviors from Non-Player Characters (NPC) and Large Language Models (LLM). In the future, AI will control complex action sequences, generate dynamic training scenarios and realistically represent conversation facilitation with NPCs via AI chatbots. In addition, AI will be used to simulate coordinated group behavior, making training scenarios possible that were previously difficult to represent – and in a resource-efficient manner.
The most important aspects of the project include
• Development of an AI behavior editor for the creation and management of NPC actions
• Introduction of situational AI-supported facial expressions and gestures
• Combining of scripted and AI-driven behaviors for a comprehensive training experience
• Analysis and integration of LLM for communication with NPCs
• Conversation with NPCs via AI chatbots, including the handling of dynamic threat scenarios, such as dealing with suicide bombers on a verbal and non-verbal level
The project will be continuously evaluated through user feedback from military and security personnel and expert workshops to ensure that the AI-driven training modules are in line with the training objectives. This iterative process will help refine and optimize AI capabilities to meet requirements.
This innovative technology is not only being developed for military use but will also be used in police and security training in the future. The aim is to create truly interactive AI modules that can adapt to different training needs and scenarios to ensure continuous improvement and adaptation to the training objectives of the military, police and security forces.
The project’s final stage will see the development of AI modules that can also operate independently of the virtual action trainer. These autonomous solutions are intended to support soldiers in their operational tasks and in training, for example by helping them to make decisions or providing situation assessments during deployment. Additionally, logistical and resource-intensive processes can also be optimized in the future thanks to AI. The potential applications of this technology are far-reaching and varied.
Leif Petersen, CEO of HOLOGATE, is enthusiastic about the future: “The renewed cooperation with the German Army is a significant milestone. The integration of AI enables us not only to create realistic and immersive XR training scenarios, but also to develop standalone, interoperable solutions that are greatly beneficial to service personnel in their professional lives. This strategic partnership is an essential step towards an efficient and sustainable training experience that fully utilizes modern technology.”
