{"id":11786,"date":"2023-05-05T14:38:16","date_gmt":"2023-05-05T17:38:16","guid":{"rendered":"https:\/\/reatechbrasil.com.br.alluring-pink-stork.72-61-35-14.cpanel.site\/?p=11786"},"modified":"2023-05-05T14:39:26","modified_gmt":"2023-05-05T17:39:26","slug":"lip-reading-equipment-helps-people-with-speech-difficulties","status":"publish","type":"post","link":"https:\/\/reatechbrasil.com.br\/en\/equipamento-de-leitura-labial-ajuda-pessoas-com-dificuldades-de-fala\/","title":{"rendered":"Lip-reading equipment helps people with speech difficulties"},"content":{"rendered":"<h3 style=\"color: #505050; font-size: 10px; margin: 0!important;\">Scientists develop glasses that can read your lips without you having to emit a single sound<\/h3>\n<p>The art of lip reading has fascinated psychologists, computer scientists, and forensic experts. In most cases, experiments involve someone reading another person's lips or an artificial intelligence reading a human's lips via a phone app.<\/p>\n<p>But a different type of experiment is being developed in <a href=\"https:\/\/www.scifilab.org\/\" target=\"_blank\" rel=\"noreferrer noopener\">Laboratory of Intelligent Computer Interfaces for Future Interactions<\/a> (SciFi) from Cornell University.<\/p>\n<p>A team of scientists has developed a speech recognition system that can identify up to 31 English words. But EchoSpeech, as the system is called, is not an app\u2014it is a pair of seemingly normal glasses.<\/p>\n<p>Agreed <a href=\"https:\/\/ruidongzhang.com\/files\/papers\/EchoSpeech_authors_version.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">described in a report<\/a>, the glasses are capable of reading the user's own lips and helping those who cannot speak to perform basic tasks, such as unlocking the phone or asking Siri to turn up the TV volume without having to emit a single sound.<\/p>\n<p>The glasses are equipped with two microphones, two speakers, and a microcontroller so small that it practically blends in. Their operation seems like magic, but in reality, the technology used is sonar.<\/p>\n<p><iframe loading=\"lazy\" id=\"813929227\" title=\"EchoSpeech: AI-equipped eyeglasses can read silent speech\" src=\"https:\/\/www.youtube.com\/embed\/ZjucAwFqVqQ?enablejsapi=1&amp;origin=https%3A%2F%2Ffastcompanybrasil.com\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\" data-gtm-yt-inspected-36143287_40=\"true\" data-mce-fragment=\"1\"><\/iframe><\/p>\n<p>More than a thousand species use sonar to hunt and survive, like whales, which can send out sound pulses that reflect off objects in the water. The sounds return so the animal can process these echoes and build a mental image of its environment, including the size and distance of surrounding objects.<\/p>\n<p>EchoSpeech works in a similar way, except that the system does not rely on distance. It tracks how sound waves (inaudible to the human ear) travel across the face and how they hit various moving parts of the face.<\/p>\n<p>The process can be summarized into four main steps:<\/p>\n<p><strong>1.<\/strong> The small speakers (located on one side of the glasses) emit sound waves.<\/p>\n<p><strong>2.<\/strong> As the user pronounces various words, the sound waves travel across the face and strike various \u201carticulators,\u201d such as the lips, jaw, and cheeks.<\/p>\n<p><strong>3.<\/strong> The microphones (located on the other side of the glasses) collect these sound waves<\/p>\n<p><strong>4.<\/strong> The microcontroller processes them along with the device the glasses are paired with<\/p>\n<p>But how does the system know how to attribute a given word to a given facial movement? To do this, researchers used a form of artificial intelligence known as a deep learning algorithm, which teaches computers to process data in the same way the human brain does.<\/p>\n<p>\u201cIf you train enough, you can look at someone's mouth, without hearing any sound, and infer the content of their speech,\u201d says the lead author of the study, Ruidong Zhang.<\/p>\n<p>The team used a similar approach, except that instead of another human inferring the content of their speech, the team used a pre-trained artificial intelligence model to recognize certain words and match them with a corresponding \u201cecho profile\u201d of a person's face.<\/p>\n<p><strong>BEYOND ENGLISH<\/strong><\/p>\n<p>For now, EchoSpeech has the vocabulary of a child. It can recognize all 10 numerical digits. It can understand directions such as \u201cup,\u201d \u201cdown,\u201d \u201cleft,\u201d and \u201cright\u201d\u2014which, according to Zhang, could be used to draw lines in computer-aided design software. And it can activate voice assistants like Alexa, Google, or Siri, or connect to other Bluetooth-enabled devices.<\/p>\n<blockquote class=\"wp-block-quote\"><p>ECHOSPEECH TRACKS HOW SOUND WAVES TRAVEL ACROSS THE FACE AND HOW THEY HIT VARIOUS MOVING PARTS OF THE FACE.<\/p><\/blockquote>\n<p>Zhang says that increasing the system's vocabulary to 100 or 200 words should not pose any specific challenge with current AI. But any number above that would require a more advanced AI model, which would piggyback on existing speech recognition research.<\/p>\n<p>This is an important step, considering the team wants to pair the system with a voice synthesizer and help people who cannot speak vocalize sound more naturally and efficiently.<\/p>\n<p>For now, EchoSpeech is a prototype with an intriguing concept and tremendous potential to help people with disabilities, but the team does not expect it to be ready for use in the next five years. And it will only work for the English language.<\/p>\n<p>\u201cThe difficulty is that every language has different sounds,\u201d says Fran\u00e7ois Guimbreti\u00e8re, co-author of the study, who is French. Different sounds can mean different facial movements. But it also depends on the types of languages the AI model is trained on.<\/p>\n<p>\u201cThere is an effort to apply other languages as well, so that not all technology is geared toward English,\u201d says Guimbreti\u00e8re.<\/p>\n<p>SOURCE:<br \/>\n<a href=\"https:\/\/fastcompanybrasil.com\/co-design\/equipamento-de-leitura-labial-ajuda-pessoas-com-dificuldades-de-fala\/\" target=\"_blank\" rel=\"noopener\">Fast Company Brasil<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>Cientistas desenvolvem um \u00f3culos que pode ler seus l\u00e1bios sem que voc\u00ea tenha que emitir um \u00fanico som A arte da leitura labial tem fascinado psic\u00f3logos, cientistas da computa\u00e7\u00e3o e especialistas forenses. Na maioria dos casos, os experimentos envolvem algu\u00e9m lendo os l\u00e1bios de outra pessoa ou uma intelig\u00eancia artificial lendo os l\u00e1bios de um [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":11787,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_joinchat":[],"footnotes":""},"categories":[85,11],"tags":[],"class_list":["post-11786","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-85","category-canal-reatech"],"_links":{"self":[{"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/posts\/11786","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/comments?post=11786"}],"version-history":[{"count":1,"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/posts\/11786\/revisions"}],"predecessor-version":[{"id":11788,"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/posts\/11786\/revisions\/11788"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/media\/11787"}],"wp:attachment":[{"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/media?parent=11786"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/categories?post=11786"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/reatechbrasil.com.br\/en\/wp-json\/wp\/v2\/tags?post=11786"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}