Dr. Thiago Santini

Photo of

University of Tübingen
Dpt. of Computer Science
Human-Computer Interaction
Sand 14
72076 Tübingen
Germany

Telefax
+49 - (0) 70 71 - 29 - 50 62
E-Mail
tcsantini.tuebingen@gmail.com
Office
Sand 14, C205a
Office hours
on appointment

Publications on Google Scholar

Profile on Linkedin

Research Interests

Eye Tracking

  • Automatic classification of eye movements
  • Open-source eye-tracking software
  • Pupil detection and tracking methods
  • Calibration / Gaze estimation methods
  • Algorithms for the analysis and visualization of eye tracking data

Embedded Systems / Computer Architecture and Organization

  • Radiation effects
  • Operating systems
  • Cache memories
  • Networks-on-chip
  • Multi/manycore architectures
  • Parallel programming

Publications

Distilling Location Proposals of Unknown Objects Through Gaze Information for Human-Robot Interaction

2020

by Daniel Weber, Thiago Santini, Andreas Zell, and Enkelejda Kasneci

PDF BIB

The display makes a difference: A mobile eye tracking study on the perception of art before and after a museum’s rearrangement

jun, 2020

by L. Reitstätter, H. Brinkmann, T. Santini, E. Specker, Z. Dare, F. Bakondi, A. Miscená, E. Kasneci, H. Leder, and R. Rosenberg

PDF BIB

Encodji: Encoding Gaze Data Into Emoji Space for an Amusing Scanpath Classification Approach ;)

2019

by Wolfgang Fuhl, Efe Bozkir, Benedikt Hosp, Nora Castner, David Geisler, Thiago C., and Enkelejda Kasneci

PDF BIB

Improving Real-Time CNN-Based Pupil Detection Through Domain-Specific Data Augmentation

jun, 2019

by S. Eivazi, T. Santini, A. Keshavarzi, T. C. Kübler, and A. Mazzei

PDF BIB

Get a Grip: Slippage-Robust and Glint-Free Gaze Estimation for Real-Time Pervasive Head-Mounted Eye Tracking

jun, 2019

by T. Santini, D. Niehorster, and E. Kasneci

BIB

Eye-Hand Behavior in Human-Robot Shared Manipulation

mar, 2018

by R. M., T. Santini, T. C. Kübler, E. Kasneci, S. Srinivasa, and H. Admoni

BIB

The Art of Pervasive Eye Tracking: Unconstrained Eye Tracking in the Austrian Gallery Belvedere

jun, 2018

by T. Santini, H. Brinkmann, L. Reistätter, H. Leder, R. Rosenberg, W. Rosenstiel, and E. Kasneci

BIB

PuReST: Robust Pupil Tracking for Real-Time Pervasive Eye Tracking

jun, 2018

by T. Santini, W. Fuhl, and E. Kasneci

PDF BIB

CBF:Circular binary features for robust and real-time pupil center detection

jun, 2018

by W. Fuhl, D. Geisler, T. Santini, T. Appel, W. Rosenstiel, and E. Kasneci

PDF BIB

An Inconspicuous and Modular Head-Mounted Eye Tracker

jun, 2018

by S. Eivazi, T. Kübler, T. Santini, and E. Kasneci

BIB

Automatic generation of saliency-based areas of interest

sep, 2018

by W. Fuhl, T. Kübler, T. Santini, and E. Kasneci

PDF BIB

Saliency Sandbox: Bottom-Up Saliency Framework

feb, 2017

by D. Geisler, W. Fuhl, T. Santini, and E. Kasneci

PDF BIB

EyeRecToo: Open-Source Software for Real-Time Pervasive Head-Mounted Eye-Tracking

feb, 2017

by T. Santini, W. Fuhl, D. Geisler, and E. Kasneci

PDF BIB

EyeLad: Remote Eye Tracking Image Labeling Tool

feb, 2017

by W. Fuhl, T. Santini, D. Geisler, T. C. Kübler, and E. Kasneci

PDF BIB

Fast and Robust Eyelid Outline and Aperture Detection in Real-World Scenarios

mar, 2017

by W. Fuhl, T. Santini, and E. Kasneci

PDF BIB

Effectiveness of Software-Based Hardening for Radiation-Induced Soft Errors in Real-Time Operating Systems

apr, 2017

by T. Santini, C. Borchert, C. Dietrich, H. Schirmeier, M. Hoffmann, O. Spinczyk, D. Lohmann, F. R., and P. Rech

BIB

CalibMe: Fast and Unsupervised Eye Tracker Calibration for Gaze-Based Pervasive Human-Computer Interaction

may, 2017

by T. Santini, W. Fuhl, and E. Kasneci

PDF BIB

Automatic Mapping of Remote Crowd Gaze to Stimuli in the Classroom

sep, 2017

by T. Santini, T. C. Kübler, L. Draghetti, P. Gerjets, W. Wagner, U. Trautwein, and E. Kasneci

BIB

EyeRec: An Open-source Data Acquisition Software for Head-mounted Eye-tracking

feb, 2016

by T. Santini, W. Fuhl, T. C. Kübler, and E. Kasneci

PDF BIB

Evaluating the Radiation Reliability of Dependability-Oriented Real-Time Operating Systems

mar, 2016

by T. Santini, C. Borchert, C. Dietrich, H. Schirmeier, M. Hoffmann, O. Spinczyk, D. Lohmann, F. R., and P. Rech

BIB

ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environments

mar, 2016

by W. Fuhl, T. Santini, T. C. Kübler, and E. Kasneci

PDF BIB

Bayesian Identification of Fixations, Saccades, and Smooth Pursuits

mar, 2016

by T. Santini, W. Fuhl, T. C. Kübler, and E. Kasneci

PDF BIB

Reliability Analysis of Operating Systems and Software Stack for Embedded Systems

aug, 2016

by T. Santini, L. Carro, F. R., and P. Rech

BIB

Eyes Wide Open? Eyelid Location and Eye Aperture Estimation for Pervasive Eye Tracking in Real-World Scenarios

sep, 2016

by W. Fuhl, T. Santini, D. Geisler, T. C. Kübler, W. Rosenstiel, and E. Kasneci

PDF BIB

Brightness- and Motion-Based Blink Detection for Head-Mounted Eye Trackers

sep, 2016

by T. Appel, T. Santini, and E. Kasneci

PDF BIB

Non-Intrusive Practitioner Pupil Detection for Unmodified Microscope Oculars

dec, 2016

by W. Fuhl, T. Santini, C. Reichert, D. Claus, A. Herkommer, H. Bahmani, K. Rifai, S. Wahl, and E. Kasneci

PDF BIB

Evaluation of State-of-the-Art Pupil Detection Algorithms on Remote Eye Images

sep, 2016

by W. Fuhl, D. Geisler, T. Santini, and E. Kasneci

PDF BIB

Reliability Analysis of Operating Systems for Embedded System-on-Chips

2015

by T. Santini, L. Carro, F. R., and P. Rech

BIB

Exploiting Cache Conflicts to Reduce Radiation Sensitivity of Operating Systems on Embedded Systems

2015

by T. Santini, P. Rech, L. Carro, and F. R.

BIB

Evaluation of Failure Masking Across the Software Stack

2015

by T. Santini, P. Rech, A. Sartor, U. B., L. Carro, and F. R.

BIB

Research

Eye Movements Identification

In this paper, we use fully convolutional neural networks for the semantic segmentation of eye tracking data. We also use these networks for reconstruction, and in conjunction with a variational auto-encoder to generate eye movement data. The first improvement of our approach is that no input window is necessary, due to the use of fully convolutional networks and therefore any input size can be processed directly. The second improvement is that the used and generated data is raw eye tracking data (position X, Y and time) without preprocessing. This is achieved by pre-initializing the filters in the first layer and by building the input tensor along the z axis. We evaluated our approach on three publicly available datasets and compare the results to the state of the art.

Learn More

EyeRecToo

Head-mounted eye tracking offers remarkable opportunities for research and applications regarding pervasive health monitoring, mental state inference, and human computer interaction in dynamic scenarios. Although a plethora of software for the acquisition of eye-tracking data exists, they often exhibit critical issues when pervasive eye tracking is considered, e.g., closed source, costly eye tracker hardware dependencies, and requiring a human supervisor for calibration. In this paper, we introduce EyeRecToo, an open-source software for real-time pervasive head-mounted eye-tracking. Out of the box, EyeRecToo offers multiple real-time state-of-the-art pupil detection and gaze estimation methods, which can be easily replaced by user implemented algorithms if desired. A novel calibration method that allows users to calibrate the system without the assistance of a human supervisor is also integrated. Moreover, this software supports multiple head-mounted eye-tracking hardware, records eye and scene videos, and stores pupil and gaze information, which are also available as a real-time stream. Thus, EyeRecToo serves as a framework to quickly enable pervasive eye-tracking research and applications.

Learn More

Robust Pupil Detection and Gaze Estimation

The reliable estimation of the pupil position in eye images is perhaps the most important prerequisite in gaze-based HMI applications. While there are many approaches that enable accurate pupil tracking under laboratory conditions, tracking the pupil in real-world images is highly challenging due to changes in illumination, reflections on glasses or on the eyeball, off-axis camera position, contact lenses, and many more.

Learn More

Teaching

Course Term
Advanced Topics in Perception Engineering
Basispraktikum Technische Informatik
Basispraktikum Technische Informatik
Computational Models of Visual Attention
Eye Movements and Visual Perception
Eye Movements and Visual Perception
Technische Anwendungen der Informatik: Hard- und Software aktueller Eye-Tracking-Systeme
Technische Anwendungen der Informatik: Hard- und Software aktueller Eye-Tracking-Systeme
Seminar: Advanced Topics in Perception Engineering

News