Knock and open you: smartphones will learn to recognize fingers, nails and knuckles

Now the possibilities of interaction with phones are quite limited, but imagine the possibility of calling various functions on your smartphone, depending on whether you use your finger, fingernail or finger joint. Sounds good? And this is practically an existing technology. Chris Harrison of Carnegie Mellon University modified the Samsung Galaxy S III and now it can distinguish between touching fingers, nails and knuckles.



The modified smartphone is equipped with a small vibration sensor, which is associated with Harrison's proprietary application called FingerSense, which is tied to a microphone and picks up sounds. Comparing vibrations and acoustic data, the smartphone can now, for example, tap it on an object to select it, and when tapped with a knuckle, open the context menu, as we do with the right mouse button.
')
“Now the big problem with touchscreens is that they are very primitive about the capabilities of our fingers,” he says.

Harrison founded the company Qeexo for the sale of technology and said that it can be added to any smartphone. He is currently negotiating with major manufacturers for its implementation in smartphones entering the market. He writes like this: “real magic in software, in artificial intelligence that lives in the heart of your phone.”