Sonar System Enables the Blind to “See”

Sonar System Enables the Blind to “See”

A “sonar vision” system that enables people who are blind from birth to perceive the shape of a face, a house or even words and letters, is being developed by a team at the Hebrew University of Jerusalem. Using this device, the researchers have shown that, in people that are blind from birth, the areas of the cerebral cortex normally devoted to reading become activated in response to stimulation. The results of this study, conducted in conjunction with researchers at the ICM Brain and Bone Marrow Institute Research Center (Inserm/UPMC/AP-HP) and NeuroSpin (CEA-Inserm), were published in Neuron on November 8.

Published on Monday 12 November 2012 | A “sonar vision” system that enables people who are blind from birth to perceive the shape of a face, a house or even words and letters, is being developed by a team at the Hebrew University of Jerusalem.

Last news

29 November 2012 Attosecond “lighthouses”: a simple method for generating isolated ultrashort pulses

29 November 2012 World AIDS Day: the CEA on the front line of research

28 October 2012 Hydrogen production: can cobalt be used to replace platinum?

24 October 2012 New survey of the sky to probe the mysteries of dark energy and dark matter

It is generally accepted that the visual cortex fails to develop normally in the congenitally blind, to such an extent that it can prove impossible to recover sight at a later point – even in cases where blindness can be corrected. In reality, the blind can indeed access a kind of vision, describe objects, and even identify written words and letters, using a “sensory substitution device” (SSD), which transforms images into sound.These are the results demonstrated in the study conducted at the Edmond and Lily Safra Neuroscience Center (Hebrew University of Jerusalem). The study was conceived by researchers at the Hebrew University, who carried out the experimental components, with scientific support from French cognitive neuroimaging specialists. The device consists in a small video camera embedded in a pair of eyeglasses, a laptop (or Smartphone) which transforms images into sounds, and stereo headphones to hear the sounds produced. For example, an oblique line is transformed into an increasingly high-pitched sound (or increasingly lower-pitched sound). The same principle is used to encode much more complex images in auditory form.Using this system, the blind can achieve greater “visual” acuity than that defined as blindness according to WHO criteria.After only 70 hours of specialized training, the blind are able to correctly classify images into different categories (faces, houses, etc.). They can also perceive other important information, such as where people are located in a room and certain facial expressions. They can even read words and letters (see videos at addition to the performance enabled by this sensory substitution system, the researchers at the Hebrew University wanted to understand what happens in the brain when a blind person learns to “see” through sound. To this end, they have developed a functional MRI study based on a specific paradigm. In particular, they have shown that the regions of the cortex normally devoted to visual perception, which seem to serve no apparent use in the blind, become highly activated in response to the “sonar vision” of faces, houses and words, etc.Not only is the visual cortex activated, it also demonstrates a “normal” functional selectivity of different categories of objects. Thus, in a sighted person, a very specific region of the visual cortex in the left hemisphere (known by the acronym VWFA), is known to become more activated when perceiving a string of letters than when perceiving any other kind of object. It is exactly this same region that is activated when a blind person reads letter using the “sonar vision” device.“The fact that this specialization for reading develops after just a few hours of training shows a remarkable degree of cerebral plasticity,” explained Stanislas Dehaene (NeuroSpin brain imaging center). These results back up the idea that that the so-called visual cortex is selective in analyzing the shape of objects, and can perform this function based on visual input (as is generally the case), but also, if necessary, based on auditory or tactile input.“These results suggest that it may be possible, with the right technology and rehabilitation, to ‘wake up’ certain areas of the brain and access certain aspects of the visual world, even after years, or even a lifetime of blindness,” concluded Laurent Cohen (ICM Research Center).


The visual word form area (VWFA) is selective for letters without visual experience

Blind VWFA letter selectivity exists even relative to complex stimuli such as faces

This selectivity can develop in the adult brain for a new sense used for reading

The VWFA shows amodal feature tolerance for linking letter shapes to phonology


Using a visual-to-auditory sensory-substitution algorithm, congenitally fully blind adults were taught to read and recognize complex images using “soundscapes”—sounds topographically representing images. fMRI was used to examine key questions regarding the visual word form area (VWFA): its selectivity for letters over other visual categories without visual experience, its feature tolerance for reading in a novel sensory modality, and its plasticity for scripts learned in adulthood. The blind activated the VWFA specifically and selectively during the processing of letter soundscapes relative to both textures and visually complex object categories and relative to mental imagery and semantic-content controls. Further, VWFA recruitment for reading soundscapes emerged after 2 hr of training in a blind adult on a novel script. Therefore, the VWFA shows category selectivity regardless of input sensory modality, visual experience, and long-term familiarity or expertise with the script. The VWFA may perform a flexible task-specific rather than sensory-specific computation, possibly linking letter shapes to phonology.

Researchers from the Hebrew University of Jerusalem have developed a device with which congenitally blind people will be able to see again to some extent. This “sonar vision” device transforms images into sound, enabling the blind to perceive visual information via the ear. Results of the conducted study using the technology were published in Neuron.

The sonar system can transform images into sounds by using a combination of a video camera embedded in a pair of eyeglasses, a laptop and headphones. Before being able to “see” with this device, a person will need about 70 hours of specialized training in identifying shapes transformed into sound. After this training the blind person may become very adept at perceiving information like where people are located in a room and even to read words and letters.

The research also showed that certain regions of the visual cortex become highly activated after perceiving the “sonar vision” of objects. Functional MRI testing even showed a similar functional selectivity of different categories of objects, compared with sighted people. These results point towards the idea that the visual cortex also analyses the shapes of objects through auditory or tactile input. This shows promise that blind people with the right technology and training might be able to perceive the visual properties of the environment through other senses than sight.

Source :

Related Posts Plugin for WordPress, Blogger...
Be Sociable, Share!

About the Author

has written 1822 posts on this blog.

  • Jane

    That is quite an amazing achievement!

Copyright © 2018 Medical Technology & Gadgets Blog All rights reserved.
Proudly powered by WordPress. Developed by Deluxe Themes