Created virtual tangible maps for the blind
Greek researchers have developed a new system that converts video into virtual, tangible maps for the blind. Three-dimensional maps use a force field to display walls and roads, which will allow people with impaired vision to better understand the layout of buildings and cities.
“Imagine that I am blind and I want to get to New York,” says Konstantinos Moustakas, principal investigator of the virtual cartography project and a graduate student at the University. Aristotle in Thessaloniki (Greece). - “I will need a map.”
Sometimes architects create three-dimensional models for the blind, but only one person can use such models at a time. Paper maps with road edges are not ideal, as they convey a small amount of information. With the Moustakas system, the digital version of the diorama can be accessed by people all over the world.
To create virtual dioramas, researchers first videotaped a sample of the architecture. Then each frame was processed using a special software written by the Moustakas team. With a change in camera angle, the software tracked each building and determined their shape and position. These data are further used to create a three-dimensional grid of the force field for each building. “Each point on the grid has an associated force value,” says Moustakas.
')
Two contact interfaces simulate a force field by pressing on a hand: it is a CyberGrasp glove that presses on each finger, and a Phantom Desktop that applies a single force to a hand with a stick. Moustakas says that this process partly resembles object recognition with the help of a cane.
Virtual, tangible maps, also known as tactile maps, have already been created before, but they used stereo films, which require special cameras to create. The Moustakas system works with the most ordinary video camera.
Moustakas also developed a system that converts images of traditional paper maps into three-dimensional city plans. Blind people drive their fingers or wand along in-depth roads on a virtual map, while street names are automatically voiced.
Moustakas tested both systems on 19 visually impaired people. During testing, it was proposed to identify the building on the virtual scene and walk from one place to another.
According to a study published in IEEE MultiMedia, people prefer to use virtual city maps for navigation in large areas, such as cities, and virtual dioramas for evaluating small groups of buildings. Moustakas is now working on the integration of these two systems.
via Scientific American
“Imagine that I am blind and I want to get to New York,” says Konstantinos Moustakas, principal investigator of the virtual cartography project and a graduate student at the University. Aristotle in Thessaloniki (Greece). - “I will need a map.”
Sometimes architects create three-dimensional models for the blind, but only one person can use such models at a time. Paper maps with road edges are not ideal, as they convey a small amount of information. With the Moustakas system, the digital version of the diorama can be accessed by people all over the world.
To create virtual dioramas, researchers first videotaped a sample of the architecture. Then each frame was processed using a special software written by the Moustakas team. With a change in camera angle, the software tracked each building and determined their shape and position. These data are further used to create a three-dimensional grid of the force field for each building. “Each point on the grid has an associated force value,” says Moustakas.
')
Two contact interfaces simulate a force field by pressing on a hand: it is a CyberGrasp glove that presses on each finger, and a Phantom Desktop that applies a single force to a hand with a stick. Moustakas says that this process partly resembles object recognition with the help of a cane.
Virtual, tangible maps, also known as tactile maps, have already been created before, but they used stereo films, which require special cameras to create. The Moustakas system works with the most ordinary video camera.
Moustakas also developed a system that converts images of traditional paper maps into three-dimensional city plans. Blind people drive their fingers or wand along in-depth roads on a virtual map, while street names are automatically voiced.
Moustakas tested both systems on 19 visually impaired people. During testing, it was proposed to identify the building on the virtual scene and walk from one place to another.
According to a study published in IEEE MultiMedia, people prefer to use virtual city maps for navigation in large areas, such as cities, and virtual dioramas for evaluating small groups of buildings. Moustakas is now working on the integration of these two systems.
via Scientific American
Source: https://habr.com/ru/post/6537/
All Articles