SelfIE

Flexible access to instructional materials via voice- and gesture-based interactions
(under the review of IJHCI as of 2023.09.11)

Abstract
Given the widespread use of procedural instructions with non-linear access (situational information retrieval), there has been a proposal to accommodate both linear and non-linear usage in instructional design. However, it has received inadequate scholarly attention, leading to limited exploration. This paper introduces Self-Initiated Explorable (SelfIE) instructions, a new design concept aiming at enabling users to navigate instructions flexibly by blending linear and non-linear access according to individual needs and situations during tasks. Using a Wizard-of-Oz protocol, we initially embodied SelfIE instructions within a toy-block assembly context and compared it with baseline instructions offering linear-only access (N=21). Results show a 71% increase in user preferences due to its ease of reflecting individual differences, empirically supporting the prior proposal. Besides, our observations identify three strategies for flexible access and suggest the potential of enhancing the user experience by considering cognitive processes and implementing flexible access in a wearable configuration. Following the design phase, we translated the WoZ-based design embodiment as working prototypes on the tablet and OHMD to assess usability and compare user experience between the two configurations (N=8). Our data yields valuable insights into managing the trade-offs between the two configurations, thereby facilitating more effective flexible access development.

Working Prototype

SelfIE Design Process and User Study


Primary author
Hyeongcheol Kim, National University of Singapore | hckim0911@gmail.com

Role : Initial Ideation, Interaction/Workflow Design, Design Embodiment, Iterative Design Improvement, Prototyping, User Test Design and Conduction, Data Analysis, Paper Writing, Video Creation

Co-authors
Katherine Fennedy, National University of Singapore | katherine.fennedy@gmail.com
Georgia Zhang, National University of Singapore | jiayi.zhang@u.nus.edu
Can Liu, City University of Hong Kong | canliu@cityu.edu.hk
Shengdong Zhao, City University of Hong Kong | shengdong.zhao@cityu.edu.hk

BIBTEX

@article{kim2024selfie, title={SelfIE: Self-Initiated Explorable Instructions Towards Enhanced User Experience}, author={Kim, Hyeongcheol and Fennedy, Katherine and Zhang, Georgia and Liu, Can and Zhao, Shengdong}, journal={arXiv preprint arXiv:2407.08501}, year={2024} }

Daniel (Danny) Hyeongcheol Kim
Daniel (Danny) Hyeongcheol Kim
Human Computer Interaction (HCI) Researcher

PhD in HCI research field, currently working in Synteraction Lab as a visiting researcher

Related