New iOS 18 to feature groundbreaking eye tracking technology

Apple has announced that the latest version of the operating system for iPhones and iPads will allow for device control using eye movements. How does the Eye Tracking feature work, and when will it be available to users?

The manufacturer of iPhones and iPads, Apple, announced on May 15th a list of new features that will come with the update of device operating systems to version iOS 18. The most impressive feature is Eye Tracking, which will allow control of applications using eye movements tracked by the front camera of the devices.

On the apple.com website, the tech giant wrote: "Eye Tracking works across all iPadOS and iOS apps and does not require additional hardware or accessories. With Eye Tracking, users can navigate app elements and use Dwell Control to activate any element, accessing additional functions such as physical buttons, swipes, and other gestures solely with their eyes." It involves the camera recording how long our gaze stays (dwells) on a particular point on the screen.

An interesting aspect is the company’s use of the term Eye Tracking as a proprietary name. Eye tracking technology has existed since the early 20th century when the first mechanical devices were created by psychologists conducting attention studies. Psychological and marketing studies on eye tracking over the computer screen have been conducted since the 1980s. This method is used to determine, among other things, the best places to position ads on the screen.

Apple explained the project's intent and addressed any potential concerns about the security of data collected using the Eye Tracking technology. It wrote: "Designed with users with physical disabilities in mind, Eye Tracking uses the front camera for setup and calibration within seconds, and with machine learning, all data used for configuring and controlling this feature is securely stored on the device and is not shared with Apple."

Eye Tracking is not the only enhancement planned in iOS 18. For users who are deaf or hard of hearing, Apple offers Music Haptics - a new way to experience music on the iPhone. Shortcuts will allow users to perform tasks by issuing personalised sounds. Motion Cues are intended to reduce motion sickness when using an iPhone or iPad in a moving vehicle. Apple will release iOS 18 shortly after the iPhone 16 launch in September 2024.