Immersive (360 ° video) - a brief overview of modern technology
A recent publication on one of the most popular websites of Runet prompted me to make a small overview of the current state of the technology of the so-called immersive (“3D”, 360 ° 360) video. For those who, perhaps, have never seen anything like this , in a nutshell it can be described as Google Street View , only video is used instead of static photos.
Immersive video - video recording of a real place / event, providing simultaneous shooting of the image in all directions (with coverage up to 90..96% of the conventional sphere around the camera, except for its stand). When playing, it allows the viewer to control (with the mouse, using the touch-screen or turning the head when using special glasses) the direction of observation, the degree of approximation, and the speed of the display [ Wikipedia ] .
Easier and faster to understand it, of course, with examples: 1 , 2 , 3 (do not forget to work with the mouse :)
Where it can be useful: mapping and geo-prospecting, video surveillance and training / training of the military, tourist photography and so on. attractions, real estate and other objects for sale, advertising, shooting of historical events and TV programs, as well as, quite possibly, a completely new format of feature films. If the technology goes to the masses and becomes more or less affordable financially, of course, just for fun :)
')
A search on the network allowed us to discover several projects that are actively involved in development in this area. This, in particular:
Immersive Media ( formerly in Habré) is an American company created in 1994, the first immersive video was shot in 1995. In 2004, the first spherical fully digital video camera (Dodeca System) was developed. Since 2006, they have been developing the GeoImmersive City Collect project - a video analogue of Google Street View for major cities in the USA and Canada (for some reason, however, I haven’t found a site with these videos themselves). Gone IPO traded on the market. For a while, StreetView supplied photo data for Google, but then the tracks of the companies seemed to diverge.
A key IM product is the Dodeca 2360 camera. In short: dodecahedron with 11 lenses, shoots video at 30 fps (24001200 pixels / frame); weighs ~ 11.34 kg and can be installed on various vehicles, as well as by means of a special frame to hang on the back (including parachutists , surfers , etc.). The video can be supplemented with metadata (for example, GPS-coordinates filming).
Although IM itself is no longer engaged in shooting for Google, the latter uses exactly Dodeca 2360 cameras. They cost, apparently , a lot - $ 45,000, plus each mile of finished video costs $ 125-700 more (and only in the USA it’s already done) . least 50 thousand miles).
It is natural that the company developed its flash player to display its videos; provides an SDK for embedding video into third-party applications (there are interfaces for C ++, C #, ActiveX, XPCOM).
It develops the IM GIS Viewer application (see below), which allows you to simultaneously watch immersive video and observe the location of the camera on the map, as well as tools for marking points, saving frames, and so on. A good video description of this application can be seen here .
And finally, there are quite a lot of examples of immersive video, for example, under water , base jumping , roller coaster and so on.
Another company I managed to find was yellowBird . This one is much younger and smaller, was founded by Marc Groothelm and Rafaël Redczus in March 2009.
A 6-lens camera that generates up to 1200 Mbps of data is used, with a stereo microphone recording sound at 96 kHz. It is also very small and can be installed on vehicles or worn by humans .
At the moment, allegedly used primarily for shooting various festivals, but in principle can be used for other needs mentioned above. Actually, the network has only one example of their work, just “festival”.
In general, the idea seems to be "lying on the surface", and the technologies necessary for its implementation are quite accessible, therefore it is quite likely that there are other initiatives in this direction.
Other interesting topics:
* It is known that the US military uses this technology to train its soldiers (by the way, glasses for BP are used there and control is possible with head turns) - video .
*
For those who can't afford the Dodeca 2360, there are already lower cost options, for example, LadyBug2 (8 Sony 1/3 "CCD cameras with 0.8 megapixels covering 75% of the space; 1024x768 image at 30 fps via IEEE-1394b interface) Worth about $ 10,000 (used to sell here for $ 7,500 :)
* 360videoblog.blogspot.com - a fresh (from June 2009) blog about 360 ° videos.
Immersive video - video recording of a real place / event, providing simultaneous shooting of the image in all directions (with coverage up to 90..96% of the conventional sphere around the camera, except for its stand). When playing, it allows the viewer to control (with the mouse, using the touch-screen or turning the head when using special glasses) the direction of observation, the degree of approximation, and the speed of the display [ Wikipedia ] .
Easier and faster to understand it, of course, with examples: 1 , 2 , 3 (do not forget to work with the mouse :)
Where it can be useful: mapping and geo-prospecting, video surveillance and training / training of the military, tourist photography and so on. attractions, real estate and other objects for sale, advertising, shooting of historical events and TV programs, as well as, quite possibly, a completely new format of feature films. If the technology goes to the masses and becomes more or less affordable financially, of course, just for fun :)
')
A search on the network allowed us to discover several projects that are actively involved in development in this area. This, in particular:
Immersive Media ( formerly in Habré) is an American company created in 1994, the first immersive video was shot in 1995. In 2004, the first spherical fully digital video camera (Dodeca System) was developed. Since 2006, they have been developing the GeoImmersive City Collect project - a video analogue of Google Street View for major cities in the USA and Canada (for some reason, however, I haven’t found a site with these videos themselves). Gone IPO traded on the market. For a while, StreetView supplied photo data for Google, but then the tracks of the companies seemed to diverge.
A key IM product is the Dodeca 2360 camera. In short: dodecahedron with 11 lenses, shoots video at 30 fps (24001200 pixels / frame); weighs ~ 11.34 kg and can be installed on various vehicles, as well as by means of a special frame to hang on the back (including parachutists , surfers , etc.). The video can be supplemented with metadata (for example, GPS-coordinates filming).
Although IM itself is no longer engaged in shooting for Google, the latter uses exactly Dodeca 2360 cameras. They cost, apparently , a lot - $ 45,000, plus each mile of finished video costs $ 125-700 more (and only in the USA it’s already done) . least 50 thousand miles).
It is natural that the company developed its flash player to display its videos; provides an SDK for embedding video into third-party applications (there are interfaces for C ++, C #, ActiveX, XPCOM).
It develops the IM GIS Viewer application (see below), which allows you to simultaneously watch immersive video and observe the location of the camera on the map, as well as tools for marking points, saving frames, and so on. A good video description of this application can be seen here .
And finally, there are quite a lot of examples of immersive video, for example, under water , base jumping , roller coaster and so on.
Another company I managed to find was yellowBird . This one is much younger and smaller, was founded by Marc Groothelm and Rafaël Redczus in March 2009.
A 6-lens camera that generates up to 1200 Mbps of data is used, with a stereo microphone recording sound at 96 kHz. It is also very small and can be installed on vehicles or worn by humans .
At the moment, allegedly used primarily for shooting various festivals, but in principle can be used for other needs mentioned above. Actually, the network has only one example of their work, just “festival”.
In general, the idea seems to be "lying on the surface", and the technologies necessary for its implementation are quite accessible, therefore it is quite likely that there are other initiatives in this direction.
Other interesting topics:
* It is known that the US military uses this technology to train its soldiers (by the way, glasses for BP are used there and control is possible with head turns) - video .
*
For those who can't afford the Dodeca 2360, there are already lower cost options, for example, LadyBug2 (8 Sony 1/3 "CCD cameras with 0.8 megapixels covering 75% of the space; 1024x768 image at 30 fps via IEEE-1394b interface) Worth about $ 10,000 (used to sell here for $ 7,500 :)
* 360videoblog.blogspot.com - a fresh (from June 2009) blog about 360 ° videos.
Source: https://habr.com/ru/post/66031/
All Articles