Multimodal Interaction

"What's this?": Understanding User Interaction Behaviour with Multimodal Input Information Retrieval System
Human communication relies on integrated multimodal channels to facilitate rich information exchange. Building on this foundation, …
Silang Wang, Daniel (Danny) Hyeongcheol Kim, Nuwan Janaka, Kun Yue, Hoang-Long Nguyen, Shengdong Zhao, Haiming Liu, Khanh-Duy Le
Cite DOI
SelfIE: Self-Initiated Explorable Instructions Towards Enhanced User Experience
Given the widespread use of procedural instructions with non-linear access (situational information retrieval), there has been a …
Daniel (Danny) Hyeongcheol Kim, Katherine Fennedy, Georgia Zhang, Can Liu, Shengdong Zhao
PDF Cite Project DOI
SelfIE: Self-Initiated Explorable Instructions Towards Enhanced User Experience
LiveSnippets: Voice-based Live Authoring of Multimedia Articles about Experiences
We transform traditional experience writing into in-situ voicebased multimedia authoring. Documenting experiences digitally in blogs …
Daniel (Danny) Hyeongcheol Kim, Shengdong Zhao, Can Liu, Kotaro Hara
PDF Cite Project DOI
LiveSnippets: Voice-based Live Authoring of Multimedia Articles about Experiences