The near future of mobile devices: face recognition and augmented reality

Over the past few years, the appearance of smartphones has not changed much. They became thinner, more productive and more functional. Over time, almost all models have become similar to each other, their functionality is also close, if we talk about devices in an equal price category. What is waiting for phones in the future, what will change and how?

In principle, it is difficult to predict any changes in the hardware, especially those related to the speed of the phone. As for the functionality, it is also quite difficult to predict something here. It is safe to say that nothing new in the near future "will not grow." But one tendency can be traced explicitly - these are qualitative changes of such an important element as the camera, as well as the associated hardware and software components.

And this is not about building up megapixels - there is no special point in this anymore. First of all, we are talking about how the camera can help us in everyday life. Now many applications are tied to it. For example, there are programs that help you understand whether you are buying good or bad wine right now in a store. Or those that scan a departure barcode with further tracking analysis. The translation of the restaurant menu into the native language on the fly is not unusual.
')
In the future, augmented reality will probably play a big role. For example, using a camera, you can place a virtual coffee table in the middle of a real room and see how it will look indoors. Or check which color of the parquet will suit the new wallpaper.

In addition, we can assume that applications for mobile devices will soon learn how to scan three-dimensional objects. The same Apple corporation announced a whole range of new smartphones, including a premium model, which is able to scan 3D objects, including the owner's face. The same can be done by a bundle of camera + application Samsung Note 8. Not for nothing in some models of devices is not one camera lens, but two.

“2018 will be the year when the camera of the phone makes a qualitative leap in its development,” a Qualcomm spokesman said. Other experts agree with him who believe that in the near future we will be able to actively use the possibilities of augmented reality. Already there are many toys that are based on augmented reality. But this is not only a game, augmented reality can be very useful in solving a wide range of tasks in industry, science and military affairs. Yes, and in everyday life augmented reality may well be useful.

Face scan

The last few years, manufacturers have actively embedded fingerprint scanners into their phones. In many cases, users liked all of this, since touching the sensor made it possible to turn on the phone or confirm the execution of a function. But now, most likely, it will be used not a fingerprint, but a “face print”. In the sense that the phone will scan the face of the person who is looking at the display, and if that person is on the list of allowed users, the phone will be unlocked.



Again, one of the first to introduce this feature into their devices is Apple. Perhaps due to the fact that the company acquired PrimeSense , a company that had previously developed sensors for Microsoft Kinect, in 2013.

How does all this work? Can be explained by the example of Spectra, a system from Qualcomm.

Part of this system is a module that generates infrared radiation. And not just like that, the sensor emits rays that fall on various points of the user's face. The sensor senses feedback and responds accordingly. Well, for example, evaluates the removal of a person’s face from a tap or the shape of various parts of a face. Phone software can make a three-dimensional map of the face, which will fall into the base, about the same way as it happens with fingerprints. Usually we are talking about creating a mathematical model of the object being analyzed, and not about the fact that, in fact, the photo will be stored somewhere in the phone’s memory. From the point of view of information security, the last case is carelessness, which will untie the hands of hackers of all stripes.

As for the identification of a specific person, this is not so difficult to do, since the faces of all people, even twins, are unique. Moreover, since the new systems will work with three-dimensional objects, tricks like using photographs of people (remember the first part of the Terminator, when did the robot incinerate a photo instead of a real person?). The impression of the face can still be (although in order to say something definite about it, an analysis is needed). But the photo - no.

Augmented Reality

3D cameras can be the key to the further development of augmented reality technology. Now many developers are creating applications of this kind. The heads of technology corporations claim that the prospects for augmented reality are vast. This fall Apple will release the final release of iOS 11, which will support ARKit. This means that developers can easily create applications of augmented reality.

ARKit uses motion sensors and a camera phone, including an accelerometer and a gyroscope. Thanks to this, the user can not only see the objects of virtual reality on the phone display, but also interact with them.


Above is an example of using augmented reality to see how virtual furniture will look in the corner of a real room. And not only chairs - any room can be furnished with furniture, change doors, change the color of the stent.

It’s not for nothing that Microsoft is developing its HoloLens glasses, having advanced very far with this project. Facebook announced the Camera Effects Platform , an environment for developers who deal with augmented reality applications. Google is also not lagging behind with its ARCore , a set of tools for Android developers.

---