Mid-air Gesture Recognition by Ultra-Wide Band Radar Echoes

Sluÿters, Arthur
(2023) EICS 2022 - The 14th SIGCHI Symposium on Engineering Interactive Computing Systems — Location: Sophia-Antipolis (21.June.2022)

Files

Slu_ters_DocCon_EICS2022.pdf
  • Open Access
  • Adobe PDF
  • 3.11 MB
Download

Details

Authors
  • Sluÿters, Arthurorcid-logoUCLouvain
    Author
Abstract
Microwave radar sensors in human-computer interaction promote several advantages over wearable and image-based sensors, such as privacy preservation, high reliability regardless of the ambient and lighting conditions, and larger field of view. However, the raw signals produced by such radars are high-dimension and very complex to process and interpret for gesture recognition. For these reasons, machine learning techniques have been mainly used for gesture recognition, but require a significant amount of gesture templates for training and calibration that are specific for each radar. To address these challenges in the context of mid-air gesture interaction, we introduce a data processing pipeline for hand gesture recognition adopting a model-based approach that combines full-wave electromagnetic modeling and inversion. Thanks to this model, gesture recognition is reduced to handling two dimensions: the hand-radar distance and the relative dielectric permittivity, which depends on the hand only (e.g., size, surface, electric properties, orientation). We are developing a software environment that accommodates the significant stages of our pipeline towards final gesture recognition. We already tested it on a dataset of 16 gesture classes with 5 templates per class recorded with the Walabot, a lightweight, off-the-shelf array radar. We are now studying how user-defined radar gestures resulting from gesture elicitation studies could be properly recognized or not by our gesture recognition engine.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Sluÿters, A. (2023). Mid-air Gesture Recognition by Ultra-Wide Band Radar Echoes. EICS 2022 - The 14th SIGCHI Symposium on Engineering Interactive Computing Systems, Sophia-Antipolis. https://hdl.handle.net/2078.5/267973