Human Computer Interaction

Dr. Thiago Santini

Photo of

University of Tübingen
Dpt. of Computer Science
Human-Computer Interaction
Sand 14
72076 Tübingen
Germany

Telefax
+49 - (0) 70 71 - 29 - 50 62
E-Mail
tcsantini.tuebingen@gmail.com
Office
Sand 14, C205a
Office hours
on appointment

Publications on Google Scholar

Profile on Linkedin

Research Interests

Eye Tracking

  • Automatic classification of eye movements
  • Open-source eye-tracking software
  • Pupil detection and tracking methods
  • Calibration / Gaze estimation methods
  • Algorithms for the analysis and visualization of eye tracking data

Embedded Systems / Computer Architecture and Organization

  • Radiation effects
  • Operating systems
  • Cache memories
  • Networks-on-chip
  • Multi/manycore architectures
  • Parallel programming

Publications

2020

Distilling Location Proposals of Unknown Objects Through Gaze Information for Human-Robot Interaction

Daniel Weber, Thiago Santini, Andreas Zell, and Enkelejda Kasneci. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2020.

PDF BIB

The display makes a difference: A mobile eye tracking study on the perception of art before and after a museum’s rearrangement

L. Reitstätter, H. Brinkmann, T. Santini, E. Specker, Z. Dare, F. Bakondi, A. Miscená, E. Kasneci, H. Leder, and R. Rosenberg. Peer-reviewed publication, 2020.

PDF BIB

2019

Encodji: Encoding Gaze Data Into Emoji Space for an Amusing Scanpath Classification Approach ;)

Wolfgang Fuhl, Efe Bozkir, Benedikt Hosp, Nora Castner, David Geisler, Thiago C., and Enkelejda Kasneci. Eye Tracking Research and Applications, 2019.

PDF BIB

Improving Real-Time CNN-Based Pupil Detection Through Domain-Specific Data Augmentation

S. Eivazi, T. Santini, A. Keshavarzi, T. C. Kübler, and A. Mazzei. Proceedings of the 2019 ACM Symposium on Eye Tracking Research & Applications (ETRA) – To Appear, 2019.

PDF BIB

Get a Grip: Slippage-Robust and Glint-Free Gaze Estimation for Real-Time Pervasive Head-Mounted Eye Tracking

T. Santini, D. Niehorster, and E. Kasneci. Proceedings of the 2019 ACM Symposium on Eye Tracking Research & Applications (ETRA), 2019.

BIB

2018

Eye-Hand Behavior in Human-Robot Shared Manipulation

R. M., T. Santini, T. C. Kübler, E. Kasneci, S. Srinivasa, and H. Admoni. Proceedings of the 13th Annual ACM/IEEE International Conference on Human Robot Interaction, 2018.

BIB

The Art of Pervasive Eye Tracking: Unconstrained Eye Tracking in the Austrian Gallery Belvedere

T. Santini, H. Brinkmann, L. Reistätter, H. Leder, R. Rosenberg, W. Rosenstiel, and E. Kasneci. Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA): Adjunct publication – PETMEI 2018, 2018.

BIB

PuReST: Robust Pupil Tracking for Real-Time Pervasive Eye Tracking

T. Santini, W. Fuhl, and E. Kasneci. Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA), 2018.

PDF BIB

CBF:Circular binary features for robust and real-time pupil center detection

W. Fuhl, D. Geisler, T. Santini, T. Appel, W. Rosenstiel, and E. Kasneci. ACM Symposium on Eye Tracking Research & Applications, 2018.

PDF BIB

An Inconspicuous and Modular Head-Mounted Eye Tracker

S. Eivazi, T. Kübler, T. Santini, and E. Kasneci. Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (ETRA) , 2018.

BIB

Automatic generation of saliency-based areas of interest

W. Fuhl, T. Kübler, T. Santini, and E. Kasneci. Symposium on Vision, Modeling and Visualization (VMV), 2018.

PDF BIB

2017

Saliency Sandbox: Bottom-Up Saliency Framework

D. Geisler, W. Fuhl, T. Santini, and E. Kasneci. 12th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017), 2017.

PDF BIB

EyeRecToo: Open-Source Software for Real-Time Pervasive Head-Mounted Eye-Tracking

T. Santini, W. Fuhl, D. Geisler, and E. Kasneci. 12th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017), 2017.

PDF BIB

EyeLad: Remote Eye Tracking Image Labeling Tool

W. Fuhl, T. Santini, D. Geisler, T. C. Kübler, and E. Kasneci. 12th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2017), 2017.

PDF BIB

Fast and Robust Eyelid Outline and Aperture Detection in Real-World Scenarios

W. Fuhl, T. Santini, and E. Kasneci. IEEE Winter Conference on Applications of Computer Vision (WACV 2017), 2017.

PDF BIB

Effectiveness of Software-Based Hardening for Radiation-Induced Soft Errors in Real-Time Operating Systems

T. Santini, C. Borchert, C. Dietrich, H. Schirmeier, M. Hoffmann, O. Spinczyk, D. Lohmann, F. R., and P. Rech. Proceedings of the 30th International Conference on Architecture of Computing Systems - ARCS, 2017.

BIB

CalibMe: Fast and Unsupervised Eye Tracker Calibration for Gaze-Based Pervasive Human-Computer Interaction

T. Santini, W. Fuhl, and E. Kasneci. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017.

PDF BIB

Automatic Mapping of Remote Crowd Gaze to Stimuli in the Classroom

T. Santini, T. C. Kübler, L. Draghetti, P. Gerjets, W. Wagner, U. Trautwein, and E. Kasneci. Eye Tracking Enhanced Learning (ETEL2017), 2017.

BIB

2016

EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking

T. Santini, W. Fuhl, T. C. Kübler, and E. Kasneci. Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) 3: VISAPP: 386–391, 2016.

PDF BIB

Evaluating the Radiation Reliability of Dependability-Oriented Real-Time Operating Systems

T. Santini, C. Borchert, C. Dietrich, H. Schirmeier, M. Hoffmann, O. Spinczyk, D. Lohmann, F. R., and P. Rech. The 12th Workshop on Silicon Errors in Logic - System Effects, 2016.

BIB

ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environments

W. Fuhl, T. Santini, T. C. Kübler, and E. Kasneci. Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA), pages 123–130, 2016.

PDF BIB

Bayesian Identification of Fixations, Saccades, and Smooth Pursuits

T. Santini, W. Fuhl, T. C. Kübler, and E. Kasneci. Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA), pages 163–170, 2016.

PDF BIB

Reliability Analysis of Operating Systems and Software Stack for Embedded Systems

T. Santini, L. Carro, F. R., and P. Rech. IEEE Transactions on Nuclear Science 63(4): 2225-2232, 2016.

BIB

Eyes Wide Open? Eyelid Location and Eye Aperture Estimation for Pervasive Eye Tracking in Real-World Scenarios

W. Fuhl, T. Santini, D. Geisler, T. C. Kübler, W. Rosenstiel, and E. Kasneci. ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication – PETMEI 2016, 2016.

PDF BIB

Brightness- and Motion-Based Blink Detection for Head-Mounted Eye Trackers

T. Appel, T. Santini, and E. Kasneci. ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication – PETMEI 2016, 2016.

PDF BIB

Non-Intrusive Practitioner Pupil Detection for Unmodified Microscope Oculars

W. Fuhl, T. Santini, C. Reichert, D. Claus, A. Herkommer, H. Bahmani, K. Rifai, S. Wahl, and E. Kasneci. Elsevier Computers in Biology and Medicine 79: 36-44, 2016.

PDF BIB

Evaluation of State-of-the-Art Pupil Detection Algorithms on Remote Eye Images

W. Fuhl, D. Geisler, T. Santini, and E. Kasneci. ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication – PETMEI 2016, 2016.

PDF BIB

2015

Reliability Analysis of Operating Systems for Embedded System-on-Chips

T. Santini, L. Carro, F. R., and P. Rech. Proceedings of the Conference on Radiation and Effects on Components and Systems (RADECS), 2015.

BIB

Exploiting Cache Conflicts to Reduce Radiation Sensitivity of Operating Systems on Embedded Systems

T. Santini, P. Rech, L. Carro, and F. R.. Proceedings of the International Conference on Compilers, Architectures and Synthesis of Embedded Systems (CASES), 2015.

BIB

Evaluation of Failure Masking Across the Software Stack

T. Santini, P. Rech, A. Sartor, U. B., L. Carro, and F. R.. Proceedings of the 4th Workshop on Manufacturable and Dependable Multicore Architectures at Nanoscale (MEDIAN), 2015.

BIB

Teaching

Course Term
Advanced Topics in Perception Engineering
Basispraktikum Technische Informatik
Basispraktikum Technische Informatik
Computational Models of Visual Attention
Eye Movements and Visual Perception
Eye Movements and Visual Perception
Technische Anwendungen der Informatik: Hard- und Software aktueller Eye-Tracking-Systeme
Technische Anwendungen der Informatik: Hard- und Software aktueller Eye-Tracking-Systeme
Seminar: Advanced Topics in Perception Engineering

Research

Eye Movements Identification

Approaches for segmentation and synthesis of eye-tracking data using different neural networks and machine learning approaches.

Learn More

EyeRecToo

In this paper, we introduce EyeRecToo, an open-source software for real-time pervasive head-mounted eye-tracking. Out of the box, EyeRecToo offers multiple real-time state-of-the-art pupil detection and gaze estimation methods, which can be easily replaced by user implemented algorithms if desired. A novel calibration method that allows users to calibrate the system without the assistance of a human supervisor is also integrated.

Learn More

Robust Pupil Detection and Gaze Estimation

The reliable estimation of the pupil position in eye images is perhaps the most important prerequisite in gaze-based HMI applications. While there are many approaches that enable accurate pupil tracking under laboratory conditions, tracking the pupil in real-world images is highly challenging due to changes in illumination, reflections on glasses or on the eyeball, off-axis camera position, contact lenses, and many more.

Learn More