SE | Human Systems Integration

The Human Systems Integration (SE) department focuses on ensuring reliable behavior in socio-technical systems in which people, technology, and processes interact cooperatively. This is particularly important for safety-critical tasks in military and civil applications.

The reliable realization of complex tasks is often challenging. The department therefore develops methods of advanced systems engineering and ergonomics to improve the interaction between users and systems through interdisciplinary collaboration. The goal is to iteratively work through all development phases, from requirements to a verifiable demonstrator.

The results of the research work increase the maturity levels of the system technology and are integrated as a neutral basis into important development decisions. Close coordination with customers and relevant stakeholders ensures that the solutions developed meet practical requirements.

The research groups “Cooperative Motion and System Control” (KBS) and “Ergonomics in Advanced Systems Engineering” (EASE) focus on the following research areas, among others.
 

Cooperative system control and crewed-uncrewed teaming

The control of mobile systems (e.g., vehicles, aircraft, rail vehicles, underwater vehicles, unmanned ground and air systems) is subject to continuous technical developments. Due to automation and artificial intelligence, control tasks are increasingly transferred to so-called assistance systems and technical components. The time saved can be used by humans to perform additional tasks or to control several systems and system networks simultaneously, especially in the context of multi-domain operations (MDO). One focus of research is the system-ergonomic design of interaction and cooperation between all components in the socio-technical system in order to achieve reliable system behavior.
 

Ergonomic design of safety-critical systems, workstations, and products

The research focuses on ergonomic design in safety-critical systems, workplaces, and products. The entire process is supported, from the determination of requirements to demonstrators, testing, and commissioning. Ergonomic design combines knowledge about human work with goals such as efficiency, controllability, survivability, productivity, regulatory requirements, and reliability. This applies to various areas, such as workplaces in armored vehicle combat compartments, control stations, or in production. The right selection and application of ergonomic methods and an open design space that takes technical, organizational, and personal aspects into account are crucial for success.
 

Immersion in interactive systems through tangible XR and haptic interaction

Realistic representation of sensory impressions in interactive systems is important for the immersion and authenticity of information and environments. This applies to practical applications such as remote control of robots or training for critical situations in XR. Another area of application is flexible development environments in which design options are explored.

The research focuses on the development of flexible forms of presentation for haptic sensations in technologies such as VR, AR, and MR or other human-machine interfaces. Examples include the creation of "rough" tactile sensations for spatial boundaries in the Rapid Prototyping Hub and movement sensations via the Motion Platform. Another focus is the development of a haptic component that makes weights and forces perceptible without physical objects. For example, users can experience lifting a virtual 10 kg box without having to hold a real box.
 

Intuitive and safe interaction design for modern workplaces for teleoperated systems

Teleoperated systems enable safe and effective interaction between operators and machines, allowing personnel to be deployed efficiently and complex tasks to be mastered in hazardous or difficult-to-access environments. They can be used in various domains, such as unmanned truck convoys or unmanned aerial systems.

An important research focus of Human Systems Integration is the development of user-friendly interfaces that enable intuitive control. The aim is to promote situational awareness among operators and reduce their cognitive load. This includes ergonomic controls and the use of technologies such as AR or VR to present complex information in a clear and understandable way.
 

Development of physiological measurement systems for real-time applications in ergonomics and human-technology interaction

The use of ergonomic analysis methods helps to identify and evaluate hazards and stresses for humans. These methods thus support ergonomic design. However, a lot of time is often spent on analysis, leaving less time for design. The department's research focuses on the partial automation of data collection and processing in ergonomic analysis through the use of sensors. This enables more accurate and comprehensive data collection, which in turn allows more complex evaluation models to be used. For example, the compression load on the L5/S1 intervertebral disc can be calculated in real time without the need for time-consuming calibration. This is particularly helpful in workplaces with manual loads.
 

Knowledge transfer for working methods and techniques in the field of ergonomics and product and system development

Research here focuses on the sustainable integration of ergonomic knowledge into work processes. This includes workplace design and product development, from rough concepts and the definition of requirements to verification and continuous improvement. Effective concepts are created and tested in pilot projects. There are no limits to the application of ergonomic knowledge. This ranges from innovation partnerships and the development of AI-supported ergonomics agents to simple checklists and manuals for companies.

Infrastructure

  • Exploroscope
  • Motion Dynamics Lab
  • Unmanned platforms for interaction development
  • Rapid Prototyping Hub – development workshop and prototyping
  • Measurement technology for evaluating ergonomics, primarily for mobile use        
  • Demonstrators for
    • gaze-based classification with unmanned systems (GaBaCo)
    • the design of visual aids for driving in road traffic with camera monitor systems (MESiKa)         
    • the guidance of highly automated convoys (EKOHOK)
    • the design of augmented reality in land vehicles of the German Armed Forces and NATO (ESAR)

 

Official bodies/networks

  • NATO Applied Vehicle Technology Research Task Group (AVT-IST RTG) 398: "Development of a STANREC for Augmented Reality in Land Platforms"
  • NATO Applied Vehicle Technology Research Task Group (AVT-MSG-HFM RTG) 401: "Augmented Reality in Land Operations: Balancing Risks and Chances in Technical and Human Systems Challenges"
  • NATO Applied Vehicle Technology Research Task Group (AVT RTG) 380: "Ground Vehicle Ride Quality Testing and Analysis with Complex Terrain"
  • NATO Applied Vehicle Technology Research Task Group (AVT RTG) 435: "End-to-End Ride Quality Cooperative Demonstration of Technology (CDT)"
  • DIN Standards Committee Ergonomics (NA) 023-00-01 GA "General ergonomics principles"
  • DIN Standards Committee Ergonomics (NA) 023-00-03 GA "Anthropometry and biomechanics"
  • Scientific Committee EAWS »Ergonomic Assessment Worksheet« der MTM ASSOCIATION e. V.

 

Courses

  • RWTH Aachen University, Methods for Applied Industrial Engineering and Ergonomics (Master) – Lecturer: Dr. Christopher Brandl
  • RWTH Aachen University, Ergonomics and Human-Machine Systems (Master) – Lecturer: Dr. Christopher Brandl
  • RWTH International Academy und RWTH Business School, Digital Work: Challenges and Solutions (for international masters course) – Lecturer: Dr. Christopher Brandl
  • University of Applied Sciences Bonn-Rhein-Sieg, "Preparation of written work" (for bachelor's degree program in business psychology) – Lecturer: Dr. Alina Schmitz-Hübsch
  • University of Applied Sciences Bonn-Rhein-Sieg, guest lecture "Human-centered design of interactive systems" in the lecture on work and organizational psychology, Prof. Dr. Patrizia Ianiro-Dahm (for bachelor's degree program in business psychology) – Lecturer: Dr. Alina Schmitz-Hübsch
  • CCG Seminars: Human AI Teaming & System Ergonomics for system critical Human-Machine Systems

 

Collaboration

RWTH Aachen University, Institute of Industrial Engineering and Ergonomics (IAW)

 

 

Research Labs

© Fraunhofer FKIE

Exploroscope

The Exploroscope is the creative hotspot of Human Systems Integration! This laboratory combines and explores state-of-the-art technologies such as AR, VR, and AI. Research focuses on new interaction solutions between soldiers and (highly automated) systems within organizations, as well as specific interfaces between soldiers and technical systems (platforms, combat zones, etc.). Whether for development or prototyping, applied innovation is a top priority at the Exploroscope!

© Fraunhofer FKIE

Motion Dynamics Lab

The Motion Dynamics Lab is the place for innovative simulator studies in dynamic environments. Here, interaction concepts and interfaces between soldiers and technical systems are designed and evaluated in motion. Static evaluations of soldier-machine interfaces that are used in practice in moving environments, such as in vehicles, are only partially meaningful in certain situations – this is exactly where the Motion Lab comes in.

© Fraunhofer FKIE

Unmanned platforms for interaction development

Human Systems Integration uses robotics as a valuable tool, providing creative test environments for developing innovative interfaces for land-based and unmanned systems. For this purpose, SE works together with the Cognitive Mobile Systems (CMS) department, using the outdoor robotics facility operated by CMS at the site. Thus, robotics helps shape the future of soldier-machine interfaces for land-based platforms and unmanned systems of all kinds! 

© Fraunhofer FKIE

Rapid Prototyping Hub – Development workshop and prototype creation

At the in-house development workshop, ideas are quickly turned into prototypes, enabling the effective and efficient implementation of customized solutions. Whether the idea comes from a sketch on a napkin, a creative brainstorming session, or an already advanced project, the right solution for every challenge is developed here.

 

Better visibility in protected vehicles

The Bundeswehr operates a wide range of complex land vehicles that place high demands on their drivers. The project »Vision support and driving assistance for protected vehicles (SiFaU)« explores concepts for ergonomically validated technical driving assistance and vision systems as well as remote control assistance and automation systems.

 

Automated driving in military platoons

An essential quality of partially and highly automated vehicles is that the driver and the automation cooperate closely and that the driver is always able to resume control in any automation level. The project »Highly automated platooning of ground vehicles (StrAsRob)« illustrates this concept. 

 

Cooperative & Highly Automated Convoy Driving

Automated truck driving in the form of automated convoys is on the verge of series development. In the project “Exploration of cooperative, highly automated convoy management” (EKOHOK), various systems were tested and compared with regard to their automation. A new user interface for guiding the convoy was also developed and evaluated together with the German Armed Forces.