Human Computer Interaction

Dr. Thiago Santini

Photo of

University of Tübingen
Dpt. of Computer Science
Human-Computer Interaction
Sand 14
72076 Tübingen
Germany

Telefax
+49 - (0) 70 71 - 29 - 50 62
E-Mail
tcsantini.tuebingen@gmail.com
Office
Office hours
on appointment

Publications on Google Scholar

Profile on Linkedin

Research Interests

Eye Tracking

  • Automatic classification of eye movements
  • Open-source eye-tracking software
  • Pupil detection and tracking methods
  • Calibration / Gaze estimation methods
  • Algorithms for the analysis and visualization of eye tracking data

Embedded Systems / Computer Architecture and Organization

  • Radiation effects
  • Operating systems
  • Cache memories
  • Networks-on-chip
  • Multi/manycore architectures
  • Parallel programming

Publications

Encodji: Encoding Gaze Data Into Emoji Space for an Amusing Scanpath Classification Approach ;)

by Wolfgang Fuhl, Efe Bozkir, Benedikt Hosp, Nora Castner, David Geisler, Thiago C., and Enkelejda Kasneci

In Eye Tracking Research and Applications, 2019.

[PDF] [BIB]

Learn More

Improving Real-Time CNN-Based Pupil Detection Through Domain-Specific Data Augmentation

by S. Eivazi, T. Santini, A. Keshavarzi, T. C. Kübler, and A. Mazzei

In Proceedings of the 2019 ACM Symposium on Eye Tracking Research & Applications (ETRA) – To Appear, 2019.

[PDF] [BIB]

Learn More

Get a Grip: Slippage-Robust and Glint-Free Gaze Estimation for Real-Time Pervasive Head-Mounted Eye Tracking

by T. Santini, D. Niehorster, and E. Kasneci

In Proceedings of the 2019 ACM Symposium on Eye Tracking Research & Applications (ETRA), 2019.

[BIB]

Learn More

Eye-Hand Behavior in Human-Robot Shared Manipulation

by R. M., T. Santini, T. C. Kübler, E. Kasneci, S. Srinivasa, and H. Admoni

In Proceedings of the 13th Annual ACM/IEEE International Conference on Human Robot Interaction, 2018.

[BIB]

Learn More

The Art of Pervasive Eye Tracking: Unconstrained Eye Tracking in the Austrian Gallery Belvedere

by T. Santini, H. Brinkmann, L. Reistätter, H. Leder, R. Rosenberg, W. Rosenstiel, and E. Kasneci

In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA): Adjunct publication – PETMEI 2018, 2018.

[BIB]

Learn More

PuReST: Robust Pupil Tracking for Real-Time Pervasive Eye Tracking

by T. Santini, W. Fuhl, and E. Kasneci

In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA), 2018.

[PDF] [BIB]

Learn More

CBF:Circular binary features for robust and real-time pupil center detection

by W. Fuhl, D. Geisler, T. Santini, T. Appel, W. Rosenstiel, and E. Kasneci

In ACM Symposium on Eye Tracking Research & Applications, 2018.

[PDF] [BIB]

Learn More

An Inconspicuous and Modular Head-Mounted Eye Tracker

by S. Eivazi, T. Kübler, T. Santini, and E. Kasneci

In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA) , 2018.

[BIB]

Learn More

Automatic generation of saliency-based areas of interest

by W. Fuhl, T. Kübler, T. Santini, and E. Kasneci

In Symposium on Vision, Modeling and Visualization (VMV), 2018.

[PDF] [BIB]

Learn More

Saliency Sandbox: Bottom-Up Saliency Framework

by D. Geisler, W. Fuhl, T. Santini, and E. Kasneci

In 12th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017), 2017.

[PDF] [BIB]

Learn More

EyeRecToo: Open-Source Software for Real-Time Pervasive Head-Mounted Eye-Tracking

by T. Santini, W. Fuhl, D. Geisler, and E. Kasneci

In 12th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017), 2017.

[PDF] [BIB]

Learn More

EyeLad: Remote Eye Tracking Image Labeling Tool

by W. Fuhl, T. Santini, D. Geisler, T. C. Kübler, and E. Kasneci

In 12th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017), 2017.

[PDF] [BIB]

Learn More

Fast and Robust Eyelid Outline and Aperture Detection in Real-World Scenarios

by W. Fuhl, T. Santini, and E. Kasneci

In IEEE Winter Conference on Applications of Computer Vision (WACV 2017), 2017.

[PDF] [BIB]

Learn More

Effectiveness of Software-Based Hardening for Radiation-Induced Soft Errors in Real-Time Operating Systems

by T. Santini, C. Borchert, C. Dietrich, H. Schirmeier, M. Hoffmann, O. Spinczyk, D. Lohmann, F. R., and P. Rech

In Proceedings of the 30th International Conference on Architecture of Computing Systems - ARCS, 2017.

[BIB]

Learn More

CalibMe: Fast and Unsupervised Eye Tracker Calibration for Gaze-Based Pervasive Human-Computer Interaction

by T. Santini, W. Fuhl, and E. Kasneci

In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017.

[PDF] [BIB]

Learn More

Automatic Mapping of Remote Crowd Gaze to Stimuli in the Classroom

by T. Santini, T. C. Kübler, L. Draghetti, P. Gerjets, W. Wagner, U. Trautwein, and E. Kasneci

In Eye Tracking Enhanced Learning (ETEL2017), 2017.

[BIB]

Learn More

EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking

by T. Santini, W. Fuhl, T. C. Kübler, and E. Kasneci

In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) 3: VISAPP: 386–391, 2016.

[PDF] [BIB]

Learn More

Evaluating the Radiation Reliability of Dependability-Oriented Real-Time Operating Systems

by T. Santini, C. Borchert, C. Dietrich, H. Schirmeier, M. Hoffmann, O. Spinczyk, D. Lohmann, F. R., and P. Rech

In The 12th Workshop on Silicon Errors in Logic - System Effects, 2016.

[BIB]

Learn More

ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environments

by W. Fuhl, T. Santini, T. C. Kübler, and E. Kasneci

In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA), pages 123–130, 2016.

[PDF] [BIB]

Learn More

Bayesian Identification of Fixations, Saccades, and Smooth Pursuits

by T. Santini, W. Fuhl, T. C. Kübler, and E. Kasneci

In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA), pages 163–170, 2016.

[PDF] [BIB]

Learn More

Reliability Analysis of Operating Systems and Software Stack for Embedded Systems

by T. Santini, L. Carro, F. R., and P. Rech

In IEEE Transactions on Nuclear Science 63(4): 2225-2232, 2016.

[BIB]

Learn More

Eyes Wide Open? Eyelid Location and Eye Aperture Estimation for Pervasive Eye Tracking in Real-World Scenarios

by W. Fuhl, T. Santini, D. Geisler, T. C. Kübler, W. Rosenstiel, and E. Kasneci

In ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication – PETMEI 2016, 2016.

[PDF] [BIB]

Learn More

Brightness- and Motion-Based Blink Detection for Head-Mounted Eye Trackers

by T. Appel, T. Santini, and E. Kasneci

In ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication – PETMEI 2016, 2016.

[PDF] [BIB]

Learn More

Non-Intrusive Practitioner Pupil Detection for Unmodified Microscope Oculars

by W. Fuhl, T. Santini, C. Reichert, D. Claus, A. Herkommer, H. Bahmani, K. Rifai, S. Wahl, and E. Kasneci

In Elsevier Computers in Biology and Medicine 79: 36-44, 2016.

[PDF] [BIB]

Learn More

Evaluation of State-of-the-Art Pupil Detection Algorithms on Remote Eye Images

by W. Fuhl, D. Geisler, T. Santini, and E. Kasneci

In ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication – PETMEI 2016, 2016.

[PDF] [BIB]

Learn More

Reliability Analysis of Operating Systems for Embedded System-on-Chips

by T. Santini, L. Carro, F. R., and P. Rech

In Proceedings of the Conference on Radiation and Effects on Components and Systems (RADECS), 2015.

[BIB]

Learn More

Exploiting Cache Conflicts to Reduce Radiation Sensitivity of Operating Systems on Embedded Systems

by T. Santini, P. Rech, L. Carro, and F. R.

In Proceedings of the International Conference on Compilers, Architectures and Synthesis of Embedded Systems (CASES), 2015.

[BIB]

Learn More

Evaluation of Failure Masking Across the Software Stack

by T. Santini, P. Rech, A. Sartor, U. B., L. Carro, and F. R.

In Proceedings of the 4th Workshop on Manufacturable and Dependable Multicore Architectures at Nanoscale (MEDIAN), 2015.

[BIB]

Learn More

Research

Eye Movements Identification

Learn More

EyeRecToo

Head-mounted eye tracking offers remarkable opportunities for research and applications regarding pervasive health monitoring, mental state inference, and human computer interaction in dynamic scenarios. Although a plethora of software for the acquisition of eye-tracking data exists, they often exhibit critical issues when pervasive eye tracking is considered, e.g., closed source, costly eye tracker hardware dependencies, and requiring a human supervisor for calibration. In this paper, we introduce EyeRecToo, an open-source software for real-time pervasive head-mounted eye-tracking. Out of the box, EyeRecToo offers multiple real-time state-of-the-art pupil detection and gaze estimation methods, which can be easily replaced by user implemented algorithms if desired. A novel calibration method that allows users to calibrate the system without the assistance of a human supervisor is also integrated. Moreover, this software supports multiple head-mounted eye-tracking hardware, records eye and scene videos, and stores pupil and gaze information, which are also available as a real-time stream. Thus, EyeRecToo serves as a framework to quickly enable pervasive eye-tracking research and applications.

Learn More

Robust Pupil Detection and Gaze Estimation

The reliable estimation of the pupil position in eye images is perhaps the most important prerequisite in gaze-based HMI applications. While there are many approaches that enable accurate pupil tracking under laboratory conditions, tracking the pupil in real-world images is highly challenging due to changes in illumination, reflections on glasses or on the eyeball, off-axis camera position, contact lenses, and many more.

Learn More

Teaching

Course Term
Advanced Topics in Perception Engineering Summer 2017
Basispraktikum Technische Informatik Winter 2019
Basispraktikum Technische Informatik Summer 2018
Computational Models of Visual Attention Summer 2016
Eye Movements and Visual Perception Winter 2016
Eye Movements and Visual Perception Winter 2017
Technische Anwendungen der Informatik: Hard- und Software aktueller Eye-Tracking-Systeme Summer 2017
Technische Anwendungen der Informatik: Hard- und Software aktueller Eye-Tracking-Systeme Summer 2016
Seminar: Advanced Topics in Perception Engineering Summer 2019