PhD defense of Axel ROQUES

Axel ROQUES

Multimodal analysis of the behavior of operators of complex human-machine interfaces

Summary

The aim of this thesis was to complement subjective methods of assessing human behavior with more objective approaches based on the collection and analysis of behavioral data. To that end, two data sets derived from participants’ behavior when interacting with a flight simulator were analyzed.

In the first part of the manuscript, various neurophysiological aspects of interest to the field of aeronautics were addressed. The head movements of pilots were quantified and compared to those experienced in natural activities. Next, a simple mental workload model was built using machine learning to track this important cognitive state during flights. Finally, the assessment of the strategy implemented by the pilots to control their aircraft revealed a simplification of the aircraft’s theoretical capabilities, raising the question of potential human cognitive limitations when faced with a complex machine.

In the second and third parts of the manuscript, two data representation methods were developed to analyze human behavior in greater depth. Firstly, symbolic data representation methods encode time series into a sequence of symbols. Algorithms for pattern matching, anomaly detection, and association rules mining were then applied to this representation in order, for example, to monitor the proper acquisition of aeronautical procedures. Secondly, dictionary representation methods encode time series using parts of a signal, repeated at different positions. An extension of this technique was proposed to focus on the concept of perceptual-motor style in gait and electrocardiography signals.

Supervision

• M. Matthieu MONTES, Professeur, Cnam, superviseur
• M. Nicolas VAYATIS, Professeur, ENS Paris-Saclay, superviseur
• M. Pierre-Paul VIDAL, Professeur, Université Paris Cité, superviseur

Members of the jury

• Mme Sophie ACHARD, Directrice de recherche, Université Grenoble Alpes, rapportrice
• Mme Christine ASSAIANTE, Directrice de recherche, Aix-Marseille Université, rapportrice
• Mme Julie JOSSE, Directrice de recherche, INRIA Montpellier, examinatrice
• Mme Marion TROUSSELARD, Professeure, IRBA, examinatrice
• M. Yannick JAMES, Ingénieur, Thales AVS T&S, membre invité

Publications