Mice can be replaced with eyes
A scientist from Stanford University, Manu Kumar ( Manu Kumar ) has developed a software platform that, with the necessary equipment, will be able to give any PC user the opportunity to abandon the usual mouse and control the cursor that previously belonged to it with his eyes.
Earlier, Kumar created a similar device that allowed people with limited mobility to work comfortably with PC graphical interfaces using a glance. The point on the screen, at which the person is currently looking, was tracked there with the help of a high-resolution camera and a special software package. Actions that should occur after clicking the mouse buttons were performed after a certain number of blinks, when the look is fixed on a button or, for example, a link.
The current development of Manu was the development of his first brainchild and is intended for all users. A distinctive feature is the replacement of blinks with more comfortable keyboard key presses. The EyePoint package works in conjunction with the Stanford-developed eye tracking system with a camera that captures the pulses of infrared diodes reflected from the lens. The size of the hardware is quite small and it can fit in the PC monitor, like a regular webcam for video communications.
')
The most difficult, according to Kumar, was to create algorithms that could, in 100% of cases, correctly recognize a person’s view on the fine details of the interface. The main problem here is that our eyes are almost never in the same place - even when we look closely, seemingly at one point, the pupil is constantly trembling, shifting the focus within a certain cone.
In addition, the scientist wanted to make communication with the computer through the interface he developed as natural as possible, because during prolonged work it is unacceptable for the user to constantly worry about whether he looks at the button correctly. To do this, Manu used the work of his colleagues in the GUIDe project (you can see its logo in the illustration) and a century of experience in studying the behavior of the human eye, which has already been more or less studied and described in detail.
This project was at the same time the subject of Kumar’s doctoral thesis, which he conducted under the guidance of Professor Terry Winograd.
Earlier, Kumar created a similar device that allowed people with limited mobility to work comfortably with PC graphical interfaces using a glance. The point on the screen, at which the person is currently looking, was tracked there with the help of a high-resolution camera and a special software package. Actions that should occur after clicking the mouse buttons were performed after a certain number of blinks, when the look is fixed on a button or, for example, a link.
The current development of Manu was the development of his first brainchild and is intended for all users. A distinctive feature is the replacement of blinks with more comfortable keyboard key presses. The EyePoint package works in conjunction with the Stanford-developed eye tracking system with a camera that captures the pulses of infrared diodes reflected from the lens. The size of the hardware is quite small and it can fit in the PC monitor, like a regular webcam for video communications.
')
The most difficult, according to Kumar, was to create algorithms that could, in 100% of cases, correctly recognize a person’s view on the fine details of the interface. The main problem here is that our eyes are almost never in the same place - even when we look closely, seemingly at one point, the pupil is constantly trembling, shifting the focus within a certain cone.
In addition, the scientist wanted to make communication with the computer through the interface he developed as natural as possible, because during prolonged work it is unacceptable for the user to constantly worry about whether he looks at the button correctly. To do this, Manu used the work of his colleagues in the GUIDe project (you can see its logo in the illustration) and a century of experience in studying the behavior of the human eye, which has already been more or less studied and described in detail.
This project was at the same time the subject of Kumar’s doctoral thesis, which he conducted under the guidance of Professor Terry Winograd.
Source: https://habr.com/ru/post/3856/
All Articles