Thursday, November 8, 2012

Camera-to-sound app lets blind people 'see'

Joanna Carver, reporter

People who have lived in the dark from birth have now found they don't need their eyes to see. A new device developed by Amir Amedi from the Hebrew University of Jerusalem in Israel and colleagues is giving congenitally blind adults the ability to interpret visual information from sound.

In this video, you can watch people listen to sounds that illustrate an object or a facial expression, then describe what they are "seeing". The system can also be used to read by assigning sounds to letters.

A tiny camera is strapped to the user's head and connected to a computer or smartphone. An algorithm converts images to sound, providing a depiction of an object via headphones. Sound dips higher or lower to represent the surface of a shape, allowing the person to form a representation in their mind. It took about 70 hours of training for a blind person to learn to describe a range of images.

By monitoring the neural activity of blind people using the device, Amedi and his team found that even though the users weren't using their eyes, their visual cortex was activated by the soundscapes. This shows, for the first time, that specialised areas responsible for object recognition or reading can still be triggered later in life even if they have never been exposed to normal visual information.

The team now plans to improve the system by using music to represent colours, shapes and locations. They want to make the audio more pleasant, since participants got irritated by the current soundscapes after just a few hours of use.

If you enjoyed this post, watch another system that uses sound to allow blind people to locate objects.

Subscribe to New Scientist Magazine

Source: http://feeds.newscientist.com/c/749/f/10897/s/255772c3/l/0L0Snewscientist0N0Cblogs0Cnstv0C20A120C110Cseeing0Ewith0Esound0Bhtml0Dcmpid0FRSS0QNSNS0Q20A120EGLOBAL0Qonline0Enews/story01.htm

bcs championship game beyonce baby detroit auto show tebow broncos ben roethlisberger downton abbey season 2 2013 dodge dart

No comments:

Post a Comment