Personal robot at Cornell University can predict the actions of people
The robots that are created in the laboratory of robotics at Cornell University, are a little like the frightening creatures of the gloomy genius of Boston Dynamics and many other laboratories developing military robots. These are personal robots - assistants, waiters, nurses. Their duties are to keep order in the rooms, to bring and carry items, to serve during meals. For such robots, it is important to be able to sensitively detect people's intentions in order to be close at the right moment and vice versa, not to get in the way when they are not needed. They are taught to predict what a person will do in the next few seconds. Maybe he needs help opening the door. Or maybe hold something. Or pour tea into a deserted cup. And all this without pressing buttons, without special gestures and voice commands.
The robot perceives the world through a three-dimensional camera Microsoft Kinect. The basis for predicting human actions is a set of movements previously seen and recognized by the robot. In addition, the robot is familiar with the objects of the environment and their purpose. He knows what a chair, a book, a cup, a refrigerator, knows how a person interacts with these objects.
Models of movements and human activities are quite general, so that the robot can predict the movements of people of different ages and build. With a probability of 82%, he guesses what a person will do in a second, 71% in three seconds and 52% in 10 seconds. Prediction of actions has a useful side effect - when this algorithm works in conjunction with the recognition algorithm of a person’s current movements, the recognition efficiency increases.
')
Based on his experience and sensor data, the robot builds a “heat map” of probable human movement trajectories and decides what needs to be done to help or not to interfere with it. One of two recent scientific papers on the prediction of human actions has already been published ( PDF ), the second will be presented at conferences on machine learning and robotics, which will be held June 18-21 in Atlanta and June 24-28 in Berlin. There are some more interesting projects related to personal robotics on the laboratory's website .
PS: Among the sponsors of this peaceful project, in addition to the Alferd Sloan charity foundation and Microsoft, there are still military men. When you think about what will happen when such algorithms work in the brains of combat robots, it becomes a bit uncomfortable ...
The robot perceives the world through a three-dimensional camera Microsoft Kinect. The basis for predicting human actions is a set of movements previously seen and recognized by the robot. In addition, the robot is familiar with the objects of the environment and their purpose. He knows what a chair, a book, a cup, a refrigerator, knows how a person interacts with these objects.
Models of movements and human activities are quite general, so that the robot can predict the movements of people of different ages and build. With a probability of 82%, he guesses what a person will do in a second, 71% in three seconds and 52% in 10 seconds. Prediction of actions has a useful side effect - when this algorithm works in conjunction with the recognition algorithm of a person’s current movements, the recognition efficiency increases.
')
Based on his experience and sensor data, the robot builds a “heat map” of probable human movement trajectories and decides what needs to be done to help or not to interfere with it. One of two recent scientific papers on the prediction of human actions has already been published ( PDF ), the second will be presented at conferences on machine learning and robotics, which will be held June 18-21 in Atlanta and June 24-28 in Berlin. There are some more interesting projects related to personal robotics on the laboratory's website .
PS: Among the sponsors of this peaceful project, in addition to the Alferd Sloan charity foundation and Microsoft, there are still military men. When you think about what will happen when such algorithms work in the brains of combat robots, it becomes a bit uncomfortable ...
Source: https://habr.com/ru/post/181396/
All Articles