(en) This paper describes an interaction technique wherein web pages are parsed so as to automatically generate a virtual reality scene composed of “hapgets” (haptically-enhanced widget), a three dimensional widget providing a behavior that is analogous to its original web behavior but that is enhanced with capabilities for haptic feedback. In this interaction technique, haptic and virtual modalities are combined together in order to enhance user experiences for multiple users: a normal sighted person is able to normally interact with the virtual reality scene by direct manipulation, a blind person is able to interact with the virtual reality scene by sensing and acting on the hapgets, a person having a small visual impairment benefits from the haptic feedback to reinforce the visual channel. A small toolkit of hapgets is described and used in some examples. Each hapget is also specified in UsiXML, a XML-compliant User Interface Description Language that supports model-driven engineering of user interfaces. In this way, any Usi-XML-compatible user interface can be rendered thanks to any traditional user interface interpreter as well as through HaptiXML, a special rendering engine that has been developed for this purpose
Affiliations
Louvain School of ManagementOperations and Information
Kaklanis, N., Gonzalez Calleros, J. M., Vanderdonckt, J., & Tzovaras, D. (2008). Hapgets, Towards Haptically-enhanced widgets Based on a User Interface Description Language. Proc. of Workshop on Multimodal Interaction Through Haptic Feedback MITH’2008. Published. Proc. of Workshop on Multimodal Interaction Through Haptic Feedback MITH’2008, Napoli. https://hdl.handle.net/2078.5/274646