DARPA robots learn cooking via YouTube videos

For modern computer systems, it is not a problem to recognize a physical object or calculate some parameters of such an object. In addition, computers are very easy to "learn" - just enter a new program, and the system already "knows kung fu."

However, self-learning computers are not yet so common, and empirical learning of computer systems is rarely at all. Agency DARPA recently introduced a new project , the purpose of which is to teach robots something new by demonstrating how-to videos from YouTube. Looking ahead, let's say that the developers have succeeded.

So, in DARPA they were able to create robots that were able to learn on culinary videos on YouTube, then using the information obtained to prepare new dishes. More specifically, experts from the University of Maryland worked on the project, and DARPA funded this program. The program itself is called Mathematics of Sensing, Exploitation and Execution (MSEE) .
')
As for the results of the project, they are very interesting. So, watching the video, the robots could recognize the kitchen accessory from the video, select it from a number of tools laid out on the table, and use this tool. In this case, the robots used the kitchen "tools" correctly - they did exactly what was shown in the video.

Another achievement of the project is the ability of robots to accumulate information obtained during training, as well as the ability to share this information with other systems. According to the developers, the achievements of the project allow us to say with confidence that it is possible to train computer systems not only by creating new programs, there are other methods.