A fusion framework for multimodal interactive applications
(2009) ACM Int. Conf. on Multimodal Interfaces ICMI-MLMI′2009 — Location: Cambridge (2.November.2011)
Files
Mendonca-ICMI2009.pdf
Open Access - Adobe PDF
- 630.32 KB
Details
- Authors
- Abstract
- This research aims to propose a multi-modal fusion framework for high-level data fusion between two or more modalities. It takes as input low level features extracted from different system devices, analyses and identifies intrinsic meanings in these data. Extracted meanings are mutually compared to identify complementarities, ambiguities and inconsistencies to better understand the user intention when interacting with the system. The whole fusion life cycle will be described and evaluated in an office environment scenario, where two co-workers interact by voice and movements, which might show their intentions. The fusion in this case is focusing on combining modalities for capturing a context to enhance the user experience.
- Affiliations
Louvain School of Management Operations and Information Louvain School of Management Operations and Information
Citations
Mendonça Filho, H., Lawson, J.-Y., Vybornova, O., Macq, B., & Vanderdonckt, J. (2009). A fusion framework for multimodal interactive applications. Proc. of ACM Int. Conf. on Multimodal Interfaces ICMI-MLMI′2009, p. 161-168. https://doi.org/10.1145/1647314.1647344