Now, a ‘Vocal Joystick’ that uses voice to surf the webNovember 14th, 2007 - 1:59 am ICT by admin
“I think there are several reasons why Vocal Joystick might be a better approach, or at least a viable alternative, to brain-computer interfaces,” Bilmes said.
Vocal Joystick detects sounds 100 times a second and instantaneously turns that sound into movement on the screen. Different vowel sounds dictate the direction: “ah,” “ee,” “aw” and “oo” and other sounds move the cursor one of eight directions. Users can transition smoothly from one vowel to another, and louder sounds make the cursor move faster. The sounds “k” and “ch” simulate clicking and releasing the mouse buttons.
Versions of Vocal Joystick exist for browsing the Web, drawing on a screen, controlling a cursor and playing a video game. A version also exists for operating a robotic arm, and Bilmes believes the technology could be used to control an electronic wheelchair. ocal Joystick requires only a microphone and a computer with a standard sound card. A version of the software can be used to control a robotic arm.A lot of people ask: ‘Why don’t you just use speech recognition?’ It would be very slow to move a cursor using discrete commands like ‘move right’ or ‘go faster.’ The voice, however, is able to do continuous commands quickly and easily,” Bilmes said.
The newest development, which will be presented this month at the Computers and Accessibility conference in Tempe, Arizona, uses Vocal Joystick to control a robotic arm. The pitch of the tone moves the arm up and down; other commands are unchanged. This is the first time that vocal commands have been used to control a three-dimensional object, Bilmes said.
One initial concern, he said, was whether people would feel self-conscious using the tool.
“But once you try it you immediately forget what you’re saying. I usually go to the New York Times’ Web site to test the system and then I get distracted and start reading the news. I forget that I’m using it, he said.esearchers have been testing the device with spinal cord injury patients at the University of Washington Medical Center.It’s a really exciting idea. I think it has tremendous potential,” said Kurt Johnson, a professor of rehabilitation medicine who is helping with the tests.
Bilmes said he hopes people will become more adept at using the system over time. Future research will incorporate more advanced controls that use more aspects of the human voice, such as repeated vocalizations, vibrato, degree of nasality and trills. (ANI)
- 1,000-day performance milestone reached by BrainGate system - Mar 25, 2011
- Patients reject robotic prosthetic arm because 'it's too easy' - Sep 24, 2010
- Robot arm boosts brain-controlled device's performance - Dec 15, 2010
- Delhi hospital conducts life-saving robotic surgeries - Apr 20, 2012
- Blind inventors make computers accessible for the visually challenged - Oct 06, 2010
- Bizarre female robo 'croons by copying human singer' - Oct 15, 2010
- Female robot can sing like a pop star - Oct 15, 2010
- Free software to help people with disabilities to use mouse easily - Apr 09, 2011
- NASA turns on humanoid robot in space station - Aug 23, 2011
- New brain computer interface for spinal cord injury patients introduced - Feb 18, 2011
- Mars rover to undergo 'brain transplant' - Aug 11, 2012
- Controlling computers with simple eye movements - Jul 13, 2012
- Tongue clicks could soon help paralysed people steer their wheelchairs - Dec 02, 2010
- Paralysed man successfully controls speech synthesiser with thought - Dec 16, 2009
- Now, a device that turns thoughts into sounds - Jan 01, 2010
Tags: associate professor, aw, computer interfaces, cursor, dictate, dimensional object, electrical engineering, go faster, initial concern, instantaneously, joystick, mouse buttons, move right, oo, robotic arm, self conscious, speech recognition, tempe arizona, three dimensional, vowel sounds