Sync video or use multiple cameras

Problem: Now many have photo and video equipment. Looking through the next amateur recording from the concert, I was not happy with its quality. And shooting from the hands is terrible. Artists fall out of the frame. But from time to time there are still dozens of fireflies, video cameras, cell phones, cameras and even tablets. So I thought why not use this potential.

The result should be a video in which the goal (the artist) does not fall out of the frame. The cameras will switch as soon as the target is gone. The highest possible quality is maintained. Improving quality due to excess information.

geopositioning

Now many vehicles are equipped with GPS and you can also mark the news on vKontakte on the map. We collect all the videos that coincide in time and coordinates with the event in one heap.
')

synchronization

The camera angles are different, but the sound is about the same, it has points of support. We use the same technique that Yandex uses to search for identical tracks and align the time in the tracks.

video analysis

After the audio sync, it's time to compare the picture. By analyzing the sync frames, the main goal (artist) is determined. As soon as the target drops out of the frame, the camera switches to the nearest camera where the target is still in the frame. You can also calculate the "extra" objects in the frame and delete them using a picture from another stream.

photo analysis

Photos usually have higher resolution than video. By searching for the most similar frame, we determine the time and position of the photo.

3D video

Since the video and photos are taken from a different angle, we calculate the coordinates, color and trajectory of the points.

Result

As a result, we get a 3D scene that can be viewed from any angle within camera angles.

That's all. I throw the idea into free access. I hope YouTube, Contact or someone else who works with a custom video will embody the idea. It would be very interesting to see the results.