Abstract

Over the past years, several augmented reality features have been developed to make Remote Tower Operations more cost-efficient and user-friendly. In the context of a national research project (The paper reports results gained in the project “INVIDEON” (FKZ 20 V1505A) sponsored by the Luftfahrtforschungsprogramm (LuFo) of the Federal Ministry of Transport and Digital Infrastructure Germany.), augmented reality based on visual spectrum (VS) and infrared (IR) fusion and as well as on optical tracking is a study objective. Having both VS and IR information available at any time is expected to enable more efficient air traffic control, even at restricted visibility conditions. Integrating VS and IR in one video panorama should also decrease head-down times and therefore increase situation awareness and reduce workload. The integration of two different sensors will be realized by overlaying VS/IR combined with adapted input devices and optical tracking methods. Developing a good concept for the integration of VS/IR and testing it in an exploratory manner can only be achieved with the help of system experts and rapid prototyping methods in simulation environments. During three workshops, human factors specialists, project partners and seven air traffic controllers worked out a prototype that was gradually improved over time and helped to generate a first concept. Firstly, this paper addresses the challenges of VS/IR fusion, manual PTZ following (as a precursor for optical tracking) and adapted input devices. Secondly, it presents the construction process of a prototype in an explorative manner, based on a user-centered approach and implemented in a simulation environment. Finally, it summarizes and presents the results from the workshops and throughout the construction process. Document type: Part of book or chapter of book

Abstract

Due to driver assistance systems and the trend of industry towards automated driving, the hands and feet of the driver in a vehicle require less intervention, becoming even idle. Recent gesture recognition focuses on hand interaction. This paper provides feet gesture interaction. Many gesture recognition systems rely on computing intensive video systems, causing privacy concerns. Furthermore, these systems require a line of sight and therefore a visible interior design integration. Our system proves that invisibly integrated capacitive proximity sensors can do this as well. They do not cause privacy issues and can be integrated under non-conductive materials. Therefore, there is no impact on the design of the visible interior. Our proposed solution distinguishes between four feet gestures. There is no limitation to feet movement. Further, we prove the functionality of the system in an evaluation with six participants, using a prototypical mock-up of a vehicle legroom. %This project contributes to the basis of driver feet gesture recognition pointing to further applications and more comprehensive investigations.