02/04/2026
Eye Tracking System and how to use it with Meta Quest Pro. 👀
In our project, we used Meta OVREyeGaze to detect the player’s gaze direction. Eye tracking itself provides information about where the user is looking, but it doesn’t directly indicate which specific object in the scene they are focusing on.
To address this, we combined gaze direction with a raycasting approach. Based on the user’s forward gaze vector, we cast a ray into the scene to determine whether the player is looking at an interactive object.
This method aligns with Meta’s official documentation: OVREyeGaze provides gaze data that can be used to select scene elements via a ray.
Eye Tracking Workflow
The system operates in the following sequence:
• OVREyeGaze retrieves the user’s gaze direction
• A raycast is triggered based on the forward gaze vector
• The raycast checks whether the player is looking at an interactive object
• Once a hit is detected, the corresponding object logic is executed