Remove extra people from the video

Specialists from the Institute of Informatics of the Max Planck Society have developed a technology for the qualitative removal of unnecessary people from a video taken with a moving camera. Such special effects were previously used only in Hollywood, but in the future, the corresponding software will be available for any computer or smartphone.



The program analyzes the sequence of video frames and calculates the pixels of a static background. After that, it changes the pixels in the frames with an unnecessary object, borrowing the background from other frames. Tellingly, the program competently copes with the restoration of both shadows and reflections, as on mirror floors.
')


Scientific work describing the technology was presented at the European Conference on Computer Vision ECCV 2012. The new method is much more effective than previous developments. For example, a similar technology is used to delete objects in the Google Street View service (for privacy reasons), but the new method works much better. Comparison with one of the previous developments shown in the illustrations.





Like the year-old Remove program, this technology can be used not only to edit videos, but also to remove unnecessary people in photos. The Remove program required the camera to take a dozen frames from a static position, from which all moving pixels are automatically removed - and the resulting photo with static objects is generated. The new technology is able to calculate the background even from a moving camera, as shown in the demo.