GamesBeat

Speech recognition trial uses DS consoles to help children with hearing difficulties

Nintendo is helping to implement the use of speech recognition software in Japanese schools, in partnership with telecom company NTT. As part a project currently being trialed, speech can be captured from a classroom teacher, and relayed as text on a student’s DS handheld console.

Nintendo’s handheld console is no stranger to classrooms in Japan, with it already being used in educational settings for a variety of purposes. There are a broad range of educational titles available for the DS in the region, which focus on topics such as science, math, learning languages or even writing Kanji. This latest use of the console is unique though, in its attempt to improve accessibility in the classroom, for children with hearing or other learning difficulties.

In this trial project, which has just started in the Okinawa and Tottori Prefectures, teachers’ words are converted in to text, which is then saved to a cloud-based server. The text can then be sent to devices within the classroom, including DSi consoles, with children able to read along, while also keeping a record of the lesson to access later.

In March 2010, Mario creator Shigeru Miyamoto spoke of his desire to roll the DS system out to Japanese elementary and junior high schools. The relatively low cost of the console, together with the flexibility offered by its touchscreen, microphone and wireless capabilities, make it an ideal learning aid. Outside of the school system, the device has also been used by McDonalds in Japan, to train part time workers in its restaraunts, using tailor made software.

You can see a video of the voice recognition program in action below. Unless your Japanese is up to scratch though, you made need to go a few rounds with My Japanese Coach in order to fully understand it.


Screen Shot 2014-03-25 at 2.00.11 PMGamesBeat 2014 — VentureBeat’s sixth annual event on disruption in the video game market — is coming up on Sept 15-16 in San Francisco. Purchase your ticket now to save $200!
0 comments

GamesBeat is your source for gaming news and reviews. But it's also home to the best articles from gamers, developers, and other folks outside of the traditional press. Register or log in to join our community of writers. You can even make a few bucks publishing stories here! Learn more.

You are now an esteemed member of the GamesBeat community. That means you can comment on stories or post your own to GB Unfiltered (look for the "New Post" link by mousing over your name in the red bar up top). But first, why don't you fill out your via your ?

About GamesBeat