VRD + Leap Motion = Augmented Reality

Earlier, I gave you a review of the prototype VRD helmet .

That time I quickly got bored with Leap Motion when using it on a regular computer.



In this article I want to share my impressions of using Leap Motion with VRD virtual reality helmet:





Gesture controller was installed on the helmet, similar to Oculus Rift VR and this is what came out of it ...



')

VRD + Leap Motion

The device itself and the helmet today look like this:







In the future, I plan to print a holder for Leap Motion on a 3D printer, like an Oculus VR.



So, download the necessary drivers and applications for the demonstration from the official site of Oculus and Leap Motion and proceed.

Here it should be noted that in my case not all applications were launched, in some things nothing happened or gestures did not work, in others the image was not formed in full screen.



However, here is a brief overview of the applications I tested:

Oculus Passthrough - give me a hand!

This is perhaps the simplest application that allows you to display your digitized virtual hands, combining them with a real image. The first impression is “Wow, now I have virtual hands, they are real!”. You can simply move your fingers, try a different movement of the hands and arms. Actually and everything, for the first demonstration and dating will come down.

Shiled VR

This application, as can be seen in the image, is a version of 3D Tetris, adapted to use Leap Motion and Oculus Rift.

I honestly had difficulty in capturing and manipulating objects. Either he slowed down the computer and did not have time to process gestures, or the version of the application was simply flawed. It should be noted that in the normal version of this application (without the support of Oulus Rift) I managed it easier.

Fragmental 3d

Immediately after the launch, a wall is built in front of you, which must be destroyed by hand. At the same time, the wall shatters into cubes and they can be manipulated, thrown back, as if you are in zero gravity.

Laser VR

Here you will see a picture of meteorites flying through your room, rubies and other utensils. With your hands, you can make an energy shield so that all these objects do not crash into you or emit laser beams, like lightning, to destroy objects. Impressive and delays for 5-10 minutes. At this time, your household with bewilderment watching you randomly waving your hands in the air, dodging invisible power ...

Plasma ball

Here is a plasma ball with which you can interact with your hands. The most interesting thing is that you can even feel the heat emitted by the ball if you put your hands directly near the ball and turn on your imagination a little. I do not know what the effect is, but sometimes it really seemed to me that it was warm. Apparently, the brain begins to “think out” and generate the corresponding sensations.

Small video:

Total

Technologies of virtual and augmented reality is a really interesting and promising direction.

Even in essence, such simple demo applications can cause unusual sensations and experience of interacting with virtual reality.

The recent announcement of Microsoft HoloLens, in my opinion, confirms the fact that large technology companies are paying attention to this area and even more so make a bet on it. I think that these technologies will receive due development in the next couple of years.



My experience and achievements of the VRD project suggest that in Russia it is possible and necessary to start producing devices of virtual and augmented reality.

In this regard, dear readers of the habrahabr and geektimes community, I would like to make a small survey.

PS: the project is developing at its own expense, but to increase the pace, you need help from the community, a grant or an investment.