Eye Tracking

Follow this topic Ask about this topic

Eye tracking uses cameras and other sensors to estimate gaze direction and characterize movements such as fixations and saccades, revealing how people explore visual information. Methods include geometric pupil-and-glint models, appearance-based deep learning, temporal sequence models, and calibration or synthetic-data techniques for adapting systems to users and devices. Applications range from reading, visual search, and clinical assessment to driving, robotics, and interactive displays. A central challenge is making systems accurate beyond controlled settings, where lighting, motion, device placement, and individual differences increase error and calibration demands; behavioral or clinical conclusions also require careful validation.

Latest papers

61 papers5 papers in the last four weeks, down 29% on the four weeks before. 0.0% of all new papers.

Low Latency Gaze Tracking via Latent Optical Sensing
May 18, 2026Yidan Zheng, Matheus Souza, Kaizhang Kang +3Gaze Estimation Eye Tracking
King Abdullah University of Science and Technology (KAUST)
Visual Search Patterns in 3D Pancreatic Imaging: An Eye Tracking Study
May 13, 2026Anna Anikina, Leila Khaertdinova, Trine Balschmidt +63D Medical Imaging Eye Tracking
Department of Computer Science, University of Copenhagen, Denmark · Department of Radiology, Herlev Hospital, Denmark · Department of Radiology, University of Iowa, United States
Establishing Robust Retinal Eye Tracking: A Weakly Supervised Algorithmic Framework
May 9, 2026Bo Wen, Dillon Lohr, Yatong An +8Gaze Estimation Eye Tracking
Meta Reality Labs · Independent Researcher · University of California, San Diego
PicoEyes: Unified Gaze Estimation Framework for Mixed Reality with a Large-Scale Multi-View Dataset
May 8, 2026Fuxin Duan, Hui WangGaze Estimation Mixed Reality
Pico, Bytedance
Enhancing Eye Movement Biometrics for User Authentication via Continuous Gaze Offset Score Fusion
May 7, 2026Hashim Aziz, Mehedi Hasan Raju, Oleg V. KomogortsevBiometric Identification Eye Tracking
Texas State University · San Marcos, Texas, USA
Assessing Cognitive Effort in L2 Idiomatic Processing: An Eye-Tracking Dataset
May 6, 2026Eduardo Santos, Juliana Carvalho, César Rennó-CostaEye Tracking Computational Psycholinguistics
Federal University of Rio Grande do Norte (UFRN), Brazil
Raising the Ceiling: Better Empirical Fixation Densities for Saliency Benchmarking
May 5, 2026Susmit Agrawal, Jannis Hollman, Matthias KümmererBenchmark Design Eye Tracking
Tübingen AI Center, University of Tübingen, Germany
Modeling Subjective Urban Perception with Human Gaze
May 1, 2026Lin Che, Xi Wang, Marc Pollefeys +3Eye Tracking
ETH Zurich Switzerland
Sure About That Line? Approaching Confidence-Based, Real-Time Line Assignment in Reading Gaze Data
Apr 27, 2026Franziska Kaltenberger, Wei-Ling Chen, Enkeleda Thaqi +1Eye Tracking
Technical University Munich, Germany · Munich Center for Machine Learning (MCML), Germany
An Affordable, Wearable Stereo-Eye-Tracking Platform
Apr 27, 2026Alexander Zimmer, Yasmeen Abdrabou, Enkelejda KasneciWearable Sensing Eye Tracking
Human-Centered Technologies for Learning, Technical University of Munich, Munich, Germany
EyeBrain: Left and Right Brain Lateralization Activity Classification Through Pupil Diameter and Fixation Duration
Apr 26, 2026Ko Watanabe, Pooja Pol, Nicolas Großmann +2Neural Decoding Eye Tracking
RPTU Kaiserslautern-Landau & DFKI GmbH, Germany · DFKI GmbH, Germany · RPTU Kaiserslautern-Landau, Germany +1
Fixation Sequences as Time Series: A Topological Approach to Dyslexia Detection
Apr 23, 2026Marius Huber, David R. Reich, Lena A. JägerTime Series Classification Eye Tracking
Department of Computational Linguistics, University of Zürich, Switzerland
Leveraging Vision-Language Models to Detect Attention in Educational Videos
Apr 20, 2026Gabriel Becquet, Sébastien Lallé, Vanda Luengo +1VLM Evaluation Educational Technology
LIP6, CNRS, SU · Sorbonne University, CNRS, LIP6 & PHENIX, F-75005 Paris, France · CNRS, LIP6, SU +2
Lazy or Efficient? Towards Accessible Eye-Tracking Event Detection Using LLMs
Apr 14, 2026Dongyang Guo, Yasmeen Abdrabou, Enkelejda KasneciEye Tracking
Technical University of Munich, Munich, Germany · Munich Center for Machine Learning (MCML), Munich, Germany · Munich Center for Machine Learning (MCML), Germany
GazeVaLM: A Multi-Observer Eye-Tracking Benchmark for Evaluating Clinical Realism in AI-Generated X-Rays
Apr 13, 2026David Wong, Zeynep Isik, Bin Wang +22Medical Image Benchmarks VLM Evaluation
Northwestern University, Evanston, IL, United States · Northwestern University, Evanston, IL, USA · Université Sorbonne Paris Nord, Paris, France +5
What They Saw, Not Just Where They Looked: Semantic Scanpath Similarity via VLMs and NLP metric
Apr 9, 2026Mohamed Amine Kerkouri, Marouane Tliba, Bin Wang +3Eye Tracking
F-Initiatives, France · IULM, Italy
A Synthetic Eye Movement Dataset for Script Reading Detection: Real Trajectory Replay on a 3D Simulator
Apr 7, 2026Kidus Zewde, Yuchen Zhou, Dennis Ng +6Synthetic Data Generation Eye Tracking
Rapidly deploying on-device eye tracking by distilling visual foundation models
Apr 2, 2026Cheng Jiang, Jogendra Kundu, David Colmenares +4Gaze Estimation Vision Foundation Model Adaptation
Meta Reality Labs, USA
Night Eyes: A Reproducible Framework for Constellation-Based Corneal Reflection Matching
Apr 2, 2026Virmarie Maquiling, Yasmeen Abdrabou, Enkelejda KasneciEye Tracking Gaze Estimation
Human-Centered Technologies for Learning, Technical University of Munich Munich, Germany · Munich Center for Machine Learning (MCML) Munich, Germany
Beyond Scanpaths: Graph-Based Gaze Simulation in Dynamic Scenes
Mar 30, 2026Luke Palmer, Petar Palasek, Hazem AbdelkawyGaze Forecasting Visual Attention
GlimpseML · Toyota Motor Europe
Polarization-Based Eye Tracking with Personalized Siamese Architectures
Mar 26, 2026Beyza Kalkanli, Tom Bu, Mahsa Shakeri +4Eye Tracking Gaze Estimation
Meta, Reality Labs, Redmond, WA 98052, USA · Meta, Reality Labs, Burlingame, CA 94010, USA
HiFiGaze: Improving Eye Tracking Accuracy Using Screen Content Knowledge
Mar 20, 2026Taejun Kim, Vimal Mollyn, Riku Arakawa +1Gaze Estimation Eye Tracking
Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA
Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modeling
Mar 14, 2026Viet Dung Nguyen, Mobina Ghorbaninejad, Chengyi Ma +5Eye Tracking Event-Based Vision
Rochester Institute of Technology · Meta Reality Labs
Deployment-Oriented Session-wise Meta-Calibration for Landmark-Based Webcam Gaze Tracking
Mar 12, 2026Chenkai ZhangGaze Estimation Eye Tracking
Independent Researcher, Wenzhou, Zhejiang 325000, China
Thinking with Gaze: Sequential Eye-Tracking as Visual Reasoning Supervision for Medical VLMs
Mar 5, 2026Yiwei Li, Yifan Zhou, Huaqin Zhao +6Radiology VLMs Medical VLMs
School of Computing, University of Georgia · Massachusetts General Hospital, Harvard Medical School · Department of Biomedical Engineering, New Jersey Institute of Technology
Evaluating Visual Prompts with Eye-Tracking Data for MLLM-Based Human Activity Recognition
Feb 27, 2026Jae Young Choi, Seon Gyeom Kim, Hyungjun Yoon +7Human Activity Recognition Multimodal Large Language Models
KAIST · Adobe Research
Eye-Tracking-while-Reading: A Living Survey of Datasets with Open Library Support
Feb 23, 2026Deborah N. Jakobi, David R. Reich, Paul Prasse +3Eye Tracking
Department of Computational Linguistics, University of Zurich. · Department of Computer Science, University of Potsdam. · Department of Informatics, University of Zurich.
Debiasing Central Fixation Confounds Reveals a Peripheral "Sweet Spot" for Human-like Scanpaths in Hard-Attention Vision
Feb 16, 2026Pengcheng Pan, Yonekura Shogo, Yasuo KuniyoshVisual Attention Eye Tracking
Department of Mechano-Informatics, The University of Tokyo
HAGI++: Head-Assisted Gaze Imputation and Generation
Nov 4, 2025Chuhan Jiao, Zhiming Hu, Andreas BullingGaze Estimation Time Series Imputation
University of Stuttgart, Germany · The Hong Kong University of Science and Technology (Guangzhou), China
Where Do Humans Look When Demonstrating to Robots? Human Gaze Behavior in Pick-and-Place Tasks Across Demonstration Devices
Jun 6, 2025Yutaro Ishida, Takamitsu Matsubara, Takayuki Kanai +2Eye Tracking Imitation Learning
Toyota Motor Corporation, Japan. · Nara Institute of Science and Technology, Japan.

May 18, 2026J/K move · Enter open · S save

Low Latency Gaze Tracking via Latent Optical Sensing

Yidan Zheng, Matheus Souza, Kaizhang Kang, Qiang Fu+2

King Abdullah University of Science and Technology (KAUST)

Gaze Estimation Eye Tracking

Open paper AskPDF arXiv

We present a real-time gaze tracking system that directly acquires task-relevant latent features using a fully passive optical encoder. Instead of forming and processing full-resolution images, our approach leverages a microlens array with a co-designed binary chromium mask to perform spatially multiplexed optical encoding, producing a compact set of measurements sufficient for gaze estimation. By integrating sensing and feature extraction in the optical domain, the proposed system eliminates the need for high-bandwidth image readout and substantially reduces computational overhead. The encoded measurements are captured by a 4 x 4 phototransistor array and mapped to gaze direction using a lightweight neural network. Our proof-of-concept prototype enables an end-to-end sensing-to-inference latency of 3.4 ms, outperforming published research systems. We demonstrate the effectiveness of our approach on both simulated and real-world data, achieving competitive gaze estimation accuracy while significantly reducing end-to-end latency compared to conventional camera-based pipelines. The proposed system establishes a new operating point in the accuracy-latency-compute trade-off for latency- and resource-constrained gaze tracking. This work highlights the potential of task-driven optical sensing for ultra-low-latency, computationally efficient human-computer interaction systems.