Monetization of Oculus Rift and Leap motion in quests in reality
Anyone who dreamed about the Matrix clenches his fists when he sees “ready business” ads on avito - people sell oculus rift to show demos in shopping centers. We understand your pain, brother. You can not do it this way.
We are on the verge of great change. We do not know exactly how, but our world will change a lot. It is criminal not to try to use the potential of virtual reality to the maximum.
')
I already wrote about our experience of using the Oculus Rift in quests in reality. We were the first in Russia to make an independent entertainment product with virtual reality glasses. Cyberpunk opened in St. Petersburg in May, and there is still no product on the Russian market that is similar to ours.
Since then, we have changed points from DK1 to DK2, updated virtual reality itself several times, adding special effects and even added a live cat to it.
About technology
In the production of quests in reality, we initially relied on advanced technology. Developments that are full of media headlines, but which have not yet been implemented in large quantities - are being used here. In addition to Oculus Rift, this is leap motion (gesture control), the MindWave neural interface (thought power control).
This path is thorny, and we will share with you the experience, if suddenly you wondered whether to throw away a computer mouse, watching a movie like this.
It would seem that here it is - gesture control of a computer.
However, despite the fact that Hewlett Packard already sells laptops with built-in leap motion, the tool itself is far from ideal. In demos under leap motion, actions with unpredictable results look best (disperse a swarm of randomly flying moths). The mini-games work well, where the palm practically does not move, the fingers are not involved, and you, changing the position of the palm, say, indicate the direction of the airplane's flight.
In demos with more subtle actions (take an object with two fingers, press a small button with one finger) - sooner or later there always comes a stage when you just wave your hands to get at least some reaction. The level of irritation quickly reaches the limit.
Forget about using gestures with your fingers.
You show two fingers, and you see - one, your fingers tremble unnaturally, the objects you touch also tremble, the hand turns inside out or disappears, and if you hold it with an edge to the leap motion - anything can happen. These are the most frequent problems, and you cannot avoid them unless you write a super filter.
In addition, the leap is sensitive to light.
What can be implemented?
In practice, swipe (palm movement) to the right and left, circular motion and compression of the palm into a fist work adequately. (However, regular gestures can not use at all and write your detector.) In addition, you can determine the location of the hand and assign different actions to different zones. Those. the hand touches the door handle, and the door is already animated.
Another interesting topic is the visualization of the hands themselves. You can use ready-made hands, for example, skeletal, you can draw your own. And you can shoot through the camera real - see video. Although there are some nuances here.
Based on this experience, we are currently developing "Cyberpunk 2.0", a new version of our quest in reality. In it, we completely remake the scenario of adventures in virtual reality and add leap motion.
Something with leap motion we have already launched for commercial use. In our new quest “Lynch Court”, made based on David Lynch's film production, players need to master telekinesis, moving certain objects with the help of passes with their hands.
Initially, we made this decision with Kinect, and here leap motion shows its main advantage. The position of the hand, he tracks at times better. Although one has to sacrifice space (leap sees no farther than half a meter, and Kinect sees the whole room), there are far fewer false positives.
Yes, and do not think that the purpose of this article is to criticize the leap, we just write what is really done at the moment, and what will happen in the future, we, like you, are looking forward to. Yes, and we are not the only “fake”, because you can make hands in virtual reality in other ways. But more about that some other time.
PS By the way, we accept offers of cooperation from Moscow and other cities of Mother Russia and will gladly help you to make your own virtual quest.
We are on the verge of great change. We do not know exactly how, but our world will change a lot. It is criminal not to try to use the potential of virtual reality to the maximum.
')
I already wrote about our experience of using the Oculus Rift in quests in reality. We were the first in Russia to make an independent entertainment product with virtual reality glasses. Cyberpunk opened in St. Petersburg in May, and there is still no product on the Russian market that is similar to ours.
Since then, we have changed points from DK1 to DK2, updated virtual reality itself several times, adding special effects and even added a live cat to it.
About technology
In the production of quests in reality, we initially relied on advanced technology. Developments that are full of media headlines, but which have not yet been implemented in large quantities - are being used here. In addition to Oculus Rift, this is leap motion (gesture control), the MindWave neural interface (thought power control).
This path is thorny, and we will share with you the experience, if suddenly you wondered whether to throw away a computer mouse, watching a movie like this.
It would seem that here it is - gesture control of a computer.
However, despite the fact that Hewlett Packard already sells laptops with built-in leap motion, the tool itself is far from ideal. In demos under leap motion, actions with unpredictable results look best (disperse a swarm of randomly flying moths). The mini-games work well, where the palm practically does not move, the fingers are not involved, and you, changing the position of the palm, say, indicate the direction of the airplane's flight.
In demos with more subtle actions (take an object with two fingers, press a small button with one finger) - sooner or later there always comes a stage when you just wave your hands to get at least some reaction. The level of irritation quickly reaches the limit.
Forget about using gestures with your fingers.
You show two fingers, and you see - one, your fingers tremble unnaturally, the objects you touch also tremble, the hand turns inside out or disappears, and if you hold it with an edge to the leap motion - anything can happen. These are the most frequent problems, and you cannot avoid them unless you write a super filter.
In addition, the leap is sensitive to light.
What can be implemented?
In practice, swipe (palm movement) to the right and left, circular motion and compression of the palm into a fist work adequately. (However, regular gestures can not use at all and write your detector.) In addition, you can determine the location of the hand and assign different actions to different zones. Those. the hand touches the door handle, and the door is already animated.
Another interesting topic is the visualization of the hands themselves. You can use ready-made hands, for example, skeletal, you can draw your own. And you can shoot through the camera real - see video. Although there are some nuances here.
Based on this experience, we are currently developing "Cyberpunk 2.0", a new version of our quest in reality. In it, we completely remake the scenario of adventures in virtual reality and add leap motion.
Something with leap motion we have already launched for commercial use. In our new quest “Lynch Court”, made based on David Lynch's film production, players need to master telekinesis, moving certain objects with the help of passes with their hands.
Initially, we made this decision with Kinect, and here leap motion shows its main advantage. The position of the hand, he tracks at times better. Although one has to sacrifice space (leap sees no farther than half a meter, and Kinect sees the whole room), there are far fewer false positives.
Yes, and do not think that the purpose of this article is to criticize the leap, we just write what is really done at the moment, and what will happen in the future, we, like you, are looking forward to. Yes, and we are not the only “fake”, because you can make hands in virtual reality in other ways. But more about that some other time.
PS By the way, we accept offers of cooperation from Moscow and other cities of Mother Russia and will gladly help you to make your own virtual quest.
Source: https://habr.com/ru/post/244397/
All Articles