Future of Photoshop: Content-aware fill
What Photoshop is coming in prepares us - most likely in CS5, but maybe a little later. The video is in English, but, in principle, everything should be clear. Do you want to erase a tree so that nobody will notice No problem, a couple of clicks. No more clone tool. Want to draw a panorama to the corners? There are no problems, the same couple of clicks and empty places were drawn by themselves. Actually, the continuation of the development of ideas PatchMatch .
The most impressive things after 2:50 and until the end of the video. For the ignorant in English - the work goes with one layer and the objects (tree, road, empty pieces in the panorama) are deleted (painted over and drawn) by Photoshop in automatic mode.
')
More examples and about technology - under the cut
If, however, it is not clear in English, then the essence is quite simple. PatchMatch searches randomly in the photo for pieces that could be inserted into the “hole”, so that their edges match the texture with what needs to be filled in - and inserts them. Then the edges turned out to be new - the algorithm again looks for a piece of the photo that could be glued to the edge. Plus, all this is added color correction, most likely. And so on until the whole "hole" will not be sketched.
About PatchMatch algorithm:
There are more examples in the work (most likely, in Photoshop itself it will not be in this form):
Publication about the algorithm (PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing - SIGGRAPH 2009 - PDF).
Explanation of how this works (English):
Another example (hair removal from photos on film):
UPDATE . In the comments of Habrachelovek meerkat drew attention to the resynthesizer - a free plugin for GIMP - which does the same, but is available today.
Personally, I was somehow not impressed by the results of resynthesizera:
Guess where the place that I erased resynthesizer'om. As always - you need to check in person ...
Yoi Haji
view from Habra
The most impressive things after 2:50 and until the end of the video. For the ignorant in English - the work goes with one layer and the objects (tree, road, empty pieces in the panorama) are deleted (painted over and drawn) by Photoshop in automatic mode.
')
More examples and about technology - under the cut
If, however, it is not clear in English, then the essence is quite simple. PatchMatch searches randomly in the photo for pieces that could be inserted into the “hole”, so that their edges match the texture with what needs to be filled in - and inserts them. Then the edges turned out to be new - the algorithm again looks for a piece of the photo that could be glued to the edge. Plus, all this is added color correction, most likely. And so on until the whole "hole" will not be sketched.
About PatchMatch algorithm:
There are more examples in the work (most likely, in Photoshop itself it will not be in this form):
Publication about the algorithm (PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing - SIGGRAPH 2009 - PDF).
Explanation of how this works (English):
Another example (hair removal from photos on film):
resynthesizer
UPDATE . In the comments of Habrachelovek meerkat drew attention to the resynthesizer - a free plugin for GIMP - which does the same, but is available today.
Personally, I was somehow not impressed by the results of resynthesizera:
Guess where the place that I erased resynthesizer'om. As always - you need to check in person ...
Yoi Haji
view from Habra
Source: https://habr.com/ru/post/88873/
All Articles