Fusion engines are fundamental components of multimodal inter-active systems, to interpret input streams whose meaning can vary according to the context, task, user and time. Other surveys have considered multimodal interactive systems; we focus more closely on the design, specification, construction and evaluation of fusion engines. We first introduce some terminology and set out the major challenges that fusion engines propose to solve. A history of past work in the field of fusion engines is then presented using the BRETAM model. These approaches to fusion are then classified. The classification considers the types of application, the fusion principles and the temporal aspects. Finally, the challenges for future work in the field of fusion engines are set out. These include software frameworks, quantitative evaluation, machine learning and adaptation.
Affiliations
Louvain School of ManagementOperations and Information
Citations
APA
Chicago
FWB
Lalanne, D., Nigay, L., Palanque, P., Vanderdonckt, J., Robinson, P., & Ladry, J.-F. (2009). Fusion Engines for Input Multimodal Interfaces: a Survey. Proceedings of 2009 ACM International Conference on Multimodal interfaces ICMI-MLMI′2009, p. 153-160. https://doi.org/10.1145/1647314.1647343