Multimodal Elevator System — Gaze + Multilingual Voice
An elevator interface combining touch, multilingual voice (Hindi, Gujarati, English),
and eye tracking — usable both hands-on and touch-free, which lowers hygiene barriers and helps
users with motor impairments. Built as digital and edge-based hardware prototypes supporting floor selection, door
control, and emergency operations; a 30-participant study showed strong usability and improved
robustness, using modality fusion to resolve ambiguous inputs. Published at
IndiaHCI '25;
extensions are open to funding and industry partners.
HCIEye TrackingASREmbedded