To consistently compare gesture recognizers under identical conditions, a systematic procedure for comparative testing should investigate how the number of templates, the number of sampling points, the number of fingers, and their configuration with other hand parameters such as hand joints, palm, and fingertips impact performance. This paper defines a systematic procedure for comparing recognizers using a series of test definitions, i.e. an ordered list of test cases with controlled variables common to all test cases. For each test case, its accuracy is measured by the recognition rate and its responsiveness by the execution time. This procedure is applied to six state-of-the-art template-based gesture recognizers on SHREC2019, a gesture dataset that contains simple and complex hand gestures tested and is largely used in the literature for competition in a user-independent scenario, and on Jackknife-lm, another challenging dataset. The results of the procedure identify the configurations in which each recognizer is the most accurate or the fastest.
Ousmer, M., Sluÿters, A., Magrofuoco, N., Roselli, P., & Vanderdonckt, J. (2022). A Systematic Procedure for Comparing Template-Based Gesture Recognizers. In M. Kurosu (ed.), Proceedings of the 24th International Conference on Human-Computer Interaction (Late Breaking Papers. Multimodality in Advanced Interaction Environments, p. p. 1-20). Springer. https://doi.org/10.1007/978-3-031-17618-0_13