Multimodal elevator interaction
Touch, gaze, and multilingual voice control for everyday infrastructure.
- Authors
- Ramanand & Yogesh Kumar Meena
- Publication
- IndiaHCI 2025 · ACM
- Evaluation
- 30 healthy participants
The interaction problem
Traditional touch-only controls can present barriers in some contexts. This work explores alternative input channels for floor selection, door control and emergency operations.
Two prototypes
The digital prototype combines touch, gaze and voice in Hindi, Gujarati and English. The edge-computing hardware prototype uses multilingual voice control. This distinction matters when interpreting the capabilities of each system.
Evaluation & findings
The published study involved 30 healthy participants, with 10 participants in each language. Touch enabled the fastest interaction, while gaze and voice offered alternative input channels.
The paper reports system-usability and workload assessments. These results do not establish usability for people with motor impairments, who were not the evaluated participant group.
Read the institutional abstract →Limitations & next steps
Reported issues include cross-language speech misinterpretation and gaze shifts away from intended controls. Broader accessibility studies and real-world deployment remain directions for further work.
I’m interested in collaboration with infrastructure partners and researchers working on accessible public systems.
ramanand.k@iitgn.ac.inRelated outputs
Design and Evaluation of a Multimodal Elevator System with Gaze and Multilingual Voice Controls. Ramanand, Yogesh Kumar Meena. IndiaHCI 2025, pp. 118–130.
System and Method of Multimodal Elevator Control. Yogesh Kumar Meena, Ramanand. Indian Patent Application No. 202521122791, 2025. Filed.