Microsoft patents gestures to control the smartphone in the car

A few days ago, an application was filed with the United States Patent and Trademark Office (all authors are from Microsoft Research) " INTERACTING WITH A MOBILE DEVICE WITHIN A VEHICLE USING GESTURES ", the purpose of which is to obtain a patent for a gesture system with which you can manage your mobile device while in the car. Interestingly, as far as can be understood, this is really about a smartphone, and not about a Kinect-like device as such. There are no prescriptions for commercial use of a patent in real cars yet.

Structurally, the system for determining gestures looks like this - on the dashboard a mobile device is fixed by camera to the driver:


')
As a result, it turns out to be possible to give commands to smartphone as follows, as indicated in the picture in the title of the post. For example, to confirm some action, it is enough for the driver to show the thumb to the smartphone, to decrease the volume - to hold the finger to the lips (“shhh!”), And in order to make the track louder - to hold the palm to the ear, as older people do when hear something. To make a call, it is enough to imitate the gesture of presenting an imaginary phone to your ear.

It is easy to see that all gestures are natural and there is no need to study them in any way. In this case, the voice control system is also implied as being present in the car, and it is likely that their operation in symbiosis is assumed.

[ Source ]