How to find out what kind of flowers to give to a girl, if only her head moves and she cannot speak?
Hello! I am Ivan Bakaidov. And now I will tell you how I help people with movement disorders and speech disorders. But first, a little about me:
AAS (Alternative Augmentation Communication) - means, ways, systems that help children and adults with serious problems in the development of verbal speech express themselves and better understand what is happening.
We have an extended day group at school. There I met the girl Lena, she sunk into my soul. Once I saw how she communicates with an assistant when she does exercises in mathematics (Lina had a folder with sheets, sheets were printed one digit from 0 to 9, on the desired digit Lina nodded) and decided to transfer this communication mechanism to code, replacing the assistant with a computer button.
')
Lina Author: Lesha Kostromin
Transferred The code was then able to write only on js, unfortunately. Therefore, the program looked funny. But it turned out! I brought this keyboard to Lina to class. After making some changes (switching to Node-webkit, adding the ability to create your own sets, that is, the teacher can interview the children in the classroom, giving them 4 options to choose from). I also created a game in Unity to teach this selection mechanism.
Several videos:
Heavy cases helped - super. But there are not such hard cases. For example, I used to communicate with people by pointing the letters on the paper keyboard with my finger. Very cheap device, but it has its drawbacks - for example, the interlocutor must follow the finger. Then I decided to create an Android application that uses the system TTS API . The application is very simple: the input field and the "Say" button, but, oddly enough, it helps a lot.
Then I thought and decided that just an application with two elements and one MainActivity.java is too simple. And he added the function of saving the spoken phrases in the database and displaying them in the listview under the input field, sorted by input frequency. But soon there were too many phrases and I added more categories. He talked and scattered in categories after conversation.
By that time, I completely forgot the KeyStore password, so I had to do a separate application: DisType Pro. By the way, with speechkit from Yandex, because the built-in TTS did not speak in a male voice. So now with the normal Internet I am a man, and offline - a girl. I hope Yandex will soon release the offline version of their super library.
There is a popular GoTalk device. A small device that records audio recordings on buttons where images can be inserted. But like all inva equipment, expensive (for example, the button for DisQwerty, which simply serves as the left mouse click, costs $ 100). I created an analog GoTalk for Android. A simple application that takes pictures from the DisTalk folder on a device card, builds a gridview out of them, and when pressed, says the file name. More pictures can be decomposed into folders (sets) and switch sets).
All programs are free, at least for the following reasons:
But development needs help:
My site: aacidov.ru
- I am 17 years old
- Cerebral palsy - my body muscles spontaneously contract ... Everything
- Illegible speech. Understand only mother, brother and classmate
- Node.js, Java, Android dev, Unity3d
- Served at the United Nations Human Rights Summit with a message on human rights with speech disorders and the importance of AAC
AAC
AAS (Alternative Augmentation Communication) - means, ways, systems that help children and adults with serious problems in the development of verbal speech express themselves and better understand what is happening.
How it all began. DisQwerty
We have an extended day group at school. There I met the girl Lena, she sunk into my soul. Once I saw how she communicates with an assistant when she does exercises in mathematics (Lina had a folder with sheets, sheets were printed one digit from 0 to 9, on the desired digit Lina nodded) and decided to transfer this communication mechanism to code, replacing the assistant with a computer button.
')
Lina Author: Lesha Kostromin
Transferred The code was then able to write only on js, unfortunately. Therefore, the program looked funny. But it turned out! I brought this keyboard to Lina to class. After making some changes (switching to Node-webkit, adding the ability to create your own sets, that is, the teacher can interview the children in the classroom, giving them 4 options to choose from). I also created a game in Unity to teach this selection mechanism.
Several videos:
| Sets even with pictures:
| Girl Sasha prints her first word in her life, she is 17 years old:
|
| DisCoin game:
| Playing DisCoin in the classroom:
|
Distype
Heavy cases helped - super. But there are not such hard cases. For example, I used to communicate with people by pointing the letters on the paper keyboard with my finger. Very cheap device, but it has its drawbacks - for example, the interlocutor must follow the finger. Then I decided to create an Android application that uses the system TTS API . The application is very simple: the input field and the "Say" button, but, oddly enough, it helps a lot.
Then I thought and decided that just an application with two elements and one MainActivity.java is too simple. And he added the function of saving the spoken phrases in the database and displaying them in the listview under the input field, sorted by input frequency. But soon there were too many phrases and I added more categories. He talked and scattered in categories after conversation.
By that time, I completely forgot the KeyStore password, so I had to do a separate application: DisType Pro. By the way, with speechkit from Yandex, because the built-in TTS did not speak in a male voice. So now with the normal Internet I am a man, and offline - a girl. I hope Yandex will soon release the offline version of their super library.
Still, not everyone can read and write DisTalk
There is a popular GoTalk device. A small device that records audio recordings on buttons where images can be inserted. But like all inva equipment, expensive (for example, the button for DisQwerty, which simply serves as the left mouse click, costs $ 100). I created an analog GoTalk for Android. A simple application that takes pictures from the DisTalk folder on a device card, builds a gridview out of them, and when pressed, says the file name. More pictures can be decomposed into folders (sets) and switch sets).
Help is needed
All programs are free, at least for the following reasons:
- Humanely
- Difficult registration of SP and taxes
- Will push away and so humiliated users
But development needs help:
- Transferring programs to iOS and Windows Phone
- The artist to create icons
- Help in creating a phrase storage service for DisType
- Lawyer
- Help with hardware
- Donate, because open source
My site: aacidov.ru
From moderator: this publication violates some of the rules of the site and in the Sandbox we usually immediately reject similar ones. But in this case they made an exception, added the publication and hope that there will be some caring people among Habr's users who will help the development of projects.
Ivan, you're great!
Source: https://habr.com/ru/post/308514/
All Articles