Welcome to the pages of the blog iCover ! Despite the skepticism of a certain part of intellectuals to such resources as Wikipedia, which in some cases has sufficiently strong reasons, in general, the value of this informational source accessible to all should nevertheless be considered positive. Of course, it would be rash to link a visit to Wikipedia or YouTube with some kind of scientific revelation, it’s more about access to information about quite trivial things that help us respond to current challenges and questions of our time. So, for example, a video on how to cook an omelet using the original recipe viewed on YouTube will allow us to quickly and effectively improve our culinary literacy without resorting to the need of tedious learning recipes from the cookbook. Why are we, actually?
The question is of interest: everything is fairly simple, clear and familiar to us, and how can we most effectively adapt the knowledge accumulated by mankind to the learning process of robots? It is clear that the value of the information provided by the PS to the robot in response to its “search query”: what is the algorithm for transferring a cup of tea from the kitchen to the living room? ... will be reduced to zero. In order to assimilate information, the machine needs a detailed answer, step-by-step instructions with specific actions and an understanding of the language. So in our example with a cup of tea you will need to provide information about the coordinates of the tea container, the method of capture, the place where it should be transported, etc. Of course, the example is intended to be simplified - in real life with a randomly changing environment, information acquires many different vector parameters and introductory. And here we see a certain problem: the specifics of many existing methods of teaching robotic complexes imposes some limitations on the effectiveness of such training.
Finding ways to create uniform algorithms and information sources for productive learning of robots becomes a powerful incentive to search for and develop new directions and ways of communicating special knowledge and gaining the required experience. Today we will touch upon two promising areas, working on which researchers have already managed to achieve certain positive results. ')
Learning Robots with YouTube
So, as we found out, those things that seem simple and natural to us (simple body movements, processing vegetables, working with a vacuum cleaner, cooking according to the usual recipes, etc.) for a robot that has not undergone special training are an unsolvable problem. The fact is that at this stage, robots, unlike humans, are not yet able to learn empirically, independently explore the world and relate the surrounding objects with certain qualities. Thus, today, at the dawn of robotics development, the robot still needs to be taught each elementary movement separately - how to open a refrigerator, how to take a container, how to open it, how to extract the contents.
The absence of such a valuable human quality as intuition and any skills of associative thinking and the learning process of robots, which is delaying in this regard, forced specialists to search and develop alternative techniques. Experts from the Institute of Advanced Computer Technologies (Maryland, USA) offered their answer to the question, using YouTube videos to speed up and improve the quality of education.
In this case, an increase in the effectiveness of the learning process is observed due to the simultaneous use of two channels of information identification — the recognition by artificial intelligence of actions performed by a person in a training video and the recognition of speech information by parsing the language. The learning process allows at any given time to associate specific words and phrases with the corresponding meanings and actions performed on the monitor screen.
According to the participants of the experiment, the use of the “two-channel” training method has already allowed us to demonstrate the level of accuracy of the tasks at 77%, with the material memorization rate of 76%. At the same time, the module recognizes objects with an accuracy of 93% and in the future will be able to identify more complex verbal commands with a high degree of accuracy.
Cloud learning
Robotics are familiar with the problems that their mechanical wards experience when developing algorithms for capturing objects of various shapes, weights, and sizes. Obvious problems robots have in cases where it is necessary to pick up or use objects for which they are unfamiliar. And here cloud technologies are indispensable. A team at Brown University, USA, led by Stephanie Tellex (Stefanie Tellex), is conducting an experiment to train the Baxter collaborative robot to capture objects and transfer their experience to fellow robots of the same model.
A robot that first encounters an object scans the latter with infrared sensors, which allows it to identify the shape of the object. And the next step is the choice of the approach that will be optimal when lifting an object of this shape. Such an algorithm works in most cases and turns out to be 75% more successful than capture attempts made under the standard protocol. But this is only the first step. At the next stage, the resulting positive “experience” is loaded into the cloud, which is essentially a database of already studied objects for all robots connected to it and a kind of analogue to the aforementioned Wikipedia.
Today, about 300 Baxter robots work in laboratories around the world. Experts estimate that if they all took part in the replenishment of the common cloud database, then every 11 days with a full load of the robotic community, the library could be supplemented with information about one million of the objects under study. Due to the fact that the basic platform can be improved, such an approach in the future can be a powerful incentive for the development of the whole community. So, for example, relatively recently, Baxter received a “soft grip”, allowing him to lift many objects without compromising their integrity.
The possibility of raising a variety of items without the risk of dropping and damaging them will in the long run allow us to consider new areas of application of such robots not only on assembly lines, but also in the infrastructure of warehouse complexes of various specificities. And this is only the beginning, and in the long term the possibilities of collective self-learning, which the cloud environment “Robopedia” (author’s term) will reveal, will most likely be used in practically any area of ​​robotics, from medicine to the service sector and fire fighting .
Positive examples that reveal the potential of the concept of cloud learning, today allow us to look optimistically at the future of this approach. Among such examples are the simplest ways of learning the recognition of photo libraries that help in identifying objects and whole sets of algorithms that allow you to transfer individual skills of a higher order. And to create an intelligent learning cloud today, experts at Brown, Stanford and Cornell University are actively working. At the present stage of research, the robotic system allows you to save and transfer information on symbols, syntax elements, shapes, tactile properties, and motor skills to a common information cloud.
The approach to learning using cloudy Robopedia appeared relatively recently. Until recently, the overwhelming majority of researchers viewed the learning process as isolated. The revision of the concept of training will allow specialists to focus on improving the algorithms of robots, while having free access to the full and relevant library of knowledge accumulated in the field at the moment. Dear readers, we are always happy to meet and wait for you on the pages of our blog. We are ready to continue to share with you the latest news, review materials and other publications, and we will try to do everything possible so that the time spent with us will be useful for you. And, of course, do not forget to subscribe to our headings . Our other articles and events