Human Computer Interaction

Intelligent Surgical Microscope

Head-mounted eye tracking offers remarkable opportunities for research and applications regarding pervasive health monitoring, mental state inference, and human computer interaction in dynamic scenarios. Although a plethora of software for the acquisition of eye-tracking data exists, they often exhibit critical issues when pervasive eye tracking is considered, e.g., closed source, costly eye tracker hardware dependencies, and requiring a human supervisor for calibration. In this paper, we introduce EyeRecToo, an open-source software for real-time pervasive head-mounted eye-tracking. Out of the box, EyeRecToo offers multiple real-time state-of-the-art pupil detection and gaze estimation methods, which can be easily replaced by user implemented algorithms if desired. A novel calibration method that allows users to calibrate the system without the assistance of a human supervisor is also integrated. Moreover, this software supports multiple head-mounted eye-tracking hardware, records eye and scene videos, and stores pupil and gaze information, which are also available as a real-time stream. Thus, EyeRecToo serves as a framework to quickly enable pervasive eye-tracking research and applications.

Video Tutorial

Download

Publications

2017

Towards Intelligent Surgical Microscopes: Surgeons Gaze and Instrument Tracking

Shahram Eivazi, Wolfgang Fuhl, and Enkelejda Kasneci. Proceedings of the 22st International Conference on Intelligent User Interfaces, IUI 2017. ACM, 2017.

PDF BIB

Towards automatic skill evaluation in microsurgery

Shahram Eivazi, Michael Slupina, Wolfgang Fuhl, Hoorieh Afkari, Ahmad Hafez, and Enkelejda Kasneci. Proceedings of the 22st International Conference on Intelligent User Interfaces, IUI 2017. ACM, 2017.

PDF BIB