Fujitsu development allows you to work with a sheet of paper, as with a touch screen
Fujitsu created a prototype of a natural interface that recognizes gestures and touches using a normal webcam. The computer vision system tracks the contours of the fingers and their height above the working surface. Thanks to this, it is possible to “select” fragments of text and images in a paper document with your finger in the same way as it is done on touchscreen devices. Selected fragments are instantly scanned and projected onto the work surface, after which they can be moved and scaled using gestures and touches. Unlike Kinect or interactive whiteboards, no special sensors, sensors or markers are required.
The prototype works in real time and confidently tracks the movement of fingers at a speed of up to 30 cm per second. In addition, it works not only with flat sheets of paper, but also, for example, with an open book - the algorithm is able to align images of curved pages. In addition to working with paper documents, you can completely manipulate virtual objects, such as 3D models.
')
Fujitsu expects that the technology will be able to bring to commercial use in the next year.