Magic Gaze: Enabling Seamless Control of IoT Devices Through Eye Tracking
Type
conference contribution
Date Issued
2026-06-01
Author(s)
Abstract
Hands-free control offers natural and intuitive interaction with devices, particularly in scenarios where traditional input methods are impractical. We introduce an extensible framework that integrates eye tracking, object detection, and gesture recognition to study intended and unintended interactions with Internet of Things (IoT) devices. To develop our framework, we conducted a structured experiment with 9 participants, focusing on identifying natural and intuitive interaction behaviors in different situations. The results showed that users intuitively combined gaze- and head-based gestures, showing the potential of head/gaze combinations as input mechanisms, specifically for directional movements. On this basis, we propose a system for hands-free interaction and control of IoT devices with intuitive gaze- and head-based gestures. We report on our promising findings as well as on limitations with respect to accurately distinguishing intention in real-world conditions. All our code1 is publicly available, ensuring the reproducibility and extension of our findings.
HSG Classification
contribution to scientific community
Refereed
Yes
Subject(s)
Division(s)
File(s)![Thumbnail Image]()
open.access
Name
2026_Bektas_etal_MagicGazeETRA26.pdf
Size
1.19 MB
Format
Adobe PDF
Checksum (MD5)
a2d760c5580768cc15802f745c020b4c