📜 ⬆️ ⬇️

Virtual studio and motion capture using Htc Vive

Hello to all! One day, I caught fire with one idea: What will happen if we try to combine video creation and Virtual Reality, namely, transmit motion, to a virtual character and in the future to be able to record videos. As a result, the development of this concept has been going on for the third month already. I am a self-taught programmer, I started everything without any experience in this area, but good, the Internet is full of information for all occasions. Everything is done on Unity, using C #.

Here is a small showcase from what has already happened:

image

Your movements are transmitted to the virtual character.

But the problem is that Vive allows you to get only 3 points in space, namely: 1 head, and 2 hands. For the solution, inverse kinematics is used, which completes the movements of the rest of the body. Therefore, now the avatar is “dragged” behind these three points. In fact, a small fee, for a limited number of parameters:
')
image

Also, you can use any 3d characters with a humanoid skeleton:

image

So, with the capture of movement everything is clear, let's move on to the creative part. As a result, you have at your disposal a virtual studio, with which you can and should interact. You can arrange the cameras, lights, scenery, and prepare for further shooting:

image

Interaction with the camera:

image

Moving in virtual space, implemented using the joystick on the controller. No teleports!

I think this is enough, I really wanted to share this idea with others.
It is sincerely curious to hear who thinks about this concept.
If interested, then I can write more about everything. Also, write ideas, criticism, notes, I will be glad to read and talk.

Thank you for your attention, I apologize for the errors. Have a nice day, everyone!

Upd: This is how the player himself sees, from the first person:
image

Source: https://habr.com/ru/post/326690/


All Articles