Apple recently released its IOS 18 update, which includes new accessibility features, including advanced eye-tracking technology that will enable users with physical disabilities to control their iPad or iPhone with their eyes. The technology is enabled by artificial intelligence and is anticipated to revolutionize accessibility. But the true potential use cases for eye-tracking technology is far more robust.
To learn more about the latest in eye-tracking technology and what we can expect in the near future, Digital Journal sat eye-to-eye with Adam Gross, CEO of HarmonEyes, an innovative eye-tracking software company that is working with software application developers and hardware manufacturers to maximize the capabilities of all eye-tracking sensors.
Digital Journal: What exactly is “eye-tracking technology” and what does it do?
Adam Gross: Eye-tracking technology refers to sensors that track the movement of the eyes and measure characteristics such as gaze direction, fixation points, blink rate, and pupil dilation. The technology has been around for over a century, with the first attempts to measure eye movements taking place in the late 1800s. Over a century ago, Edmund Huey built a device that could track eye movement during the reading process. This first eye tracker was very intrusive, as readers had to wear a type of contact lens with a small hole for the pupil.
DJ: How are modern eye trackers different?
Gross: Modern eye trackers allow for non-intrusive tracking by utilizing camera-based image processing to track the eyes by detecting features like the pupil, corneal reflection, and iris. Over the past two decades, as many devices have embedded high-end cameras, eye-tracking sensors have become smaller, more accurate and affordable. Applications have expanded from specialized fields like assistive communication, medical devices, and medical research into broader uses in human-computer interaction, marketing research and more. Recently, thanks to AI, these sensors can measure and predict a person’s current state, encompassing attention, health, and performance. With camera-based devices expected to reach billions by the end of 2025, the opportunity to bring additional capabilities to this objective and accurate sensors technology means it’s beginning to feel like party time for eye-tracking technology.
DJ: Where is the technology currently being deployed?
Gross: With eye-tracking hardware becoming micro-sized and affordable, it is now capable of being deployed in almost any environment. This includes VR/AR headsets, PCs, computer monitors, phones and tablets, automobiles and cockpits, and more. Even webcams, which became ubiquitous during the pandemic, can be turned into eye-tracking sensors. Eye-tracking sensors will soon be everywhere that individuals go during daily life – not just limited to a doctor’s office or a lab.
DJ: What are the primary objectives or use cases for deploying eye-tracking technology?
Gross: There are more use cases than we can probably count. One current usage, as we’re seeing with the latest Apple IOS update, is accessibility – helping someone navigate technology with just their eyes. But the technology is now able to also measure the user’s future state. The ability to predict when you will reach a high level of fatigue or cognitive load (an indicator for stress and anxiety). Knowing ahead of time allows for the delivery of interventions/corrective actions to prevent adverse performance issues from occurring in the first place.
DJ: What are some additional use cases and benefits of predictive eye-tracking technology?
Gross: The primary benefit of these state-of-the-art advancements means that technology can now adapt to a person instead of a person having to adapt to the technology. In education, for example. HarmonEyes can use eye-tracking to identify in real-time if a student is comprehending reading content. Instant feedback can then prompt the student to re-read passages they did not fully understand, improving reading and learning. This can be done not only in the classroom setting, but also in professional training settings, whether in-person or online. In another example, a gamer using a VR headset may be unaware that they are about to experience simulation sickness. But our technology can predict high levels of motion sickness ahead of time and alter the application interface to prevent that from happening.
DJ: How are you able to predict someone’s future state by measuring just their eyes?
Gross: Our parent company, RightEye, spent over a decade building the necessary datasets, algorithms, and expertise to develop accurate AI-driven eye-tracking models. RightEye has assembled the world’s largest eye-tracking database, with over 11 million unique records across diverse demographics and over 130 user states. This massive database trains our machine learning, deep learning and AI models to achieve unparalleled accuracy in modeling human user states, visual behavior, and attention. This database is also available for others to train their own models.
DJ: Are there any privacy concerns related to eye-tracking technology deployment?
Gross: The AI solutions are at the edge and run locally on device without transmitting data externally. Our commitment to privacy means we never record, collect, or store any personal user or eye-tracking data.
DJ: So, what’s next for HarmonEyes?
Gross: With over a decade of focused effort, HarmonEyes is ready to deliver highly valuable, accurate and affordable eye-tracking solutions to the masses. We are currently expanding our licensing model to software application developers, hardware manufacturers in several markets including training, gaming, healthcare, education, driving, aviation and more.
