Future Prospects for Sensory Replacement and Sensory Substitution

With the enormous increases in computing power, the miniaturization of electronic devices (nanotechnology), the improvement of techniques for interfacing electronic devices with biological tissue, and increased understanding of the sensory pathways, the prospects are great for significant advances in sensory replacement in the coming years. Similarly, there is reason for great optimism in the area of sensory substitution. As we come to understand the higher level functioning of the brain through cognitive science and neuroscience research, we will know better how to map source information into the remaining intact senses. Perhaps even more important will be breakthroughs in technology and artificial intelligence. For example, the emergence of new sensing technologies, as yet unknown, just as the Global Positioning System was unknown several decades ago, will undoubtedly provide blind and deaf people with access to new types of information about the world around them. Also, the increasing power of computers and increasing sophistication of artificial intelligence software will mean that computers will be increasingly able to use this sensed information to build representations of the environment, which in turn can be used to inform and guide visually impaired people using synthesized speech and spatial displays. Similarly, improved speech recognition and speech understanding will eventually provide deaf people better communication with others who speak the same or even different languages. Ultimately, sensory replacement and sensory substitution may permit people with sensory impairments to perform many activities that are unimaginable today and to enjoy a wide range of experiences that they are currently denied.


Abravanel, E. 1971. Active detection of solid-shape information by touch and vision. Perception & Psychophysics, 10, 358-360.

Bach-y-Rita, P. 1967. Sensory plasticity: Applications to a vision substitution system. Acta Neurologica Scandanavica, 43, 417-426.

Bach-y-Rita, P. 1972. Brain mechanisms in sensory substitution. New York: Academic Press.

Bliss, J.C., M.H. Katcher, C.H. Rogers, and R.P. Shepard. 1970. Optical-to-tactile image conversion for the blind. IEEE Transactions on Man-Machine Systems, MMS-11, 58-65.

Brabyn, J.A. 1985. A review of mobility aids and means of assessment. In Electronic spatial sensing for the blind, D.H. Warren and E.R. Strelow, eds. Boston: Martinus Nijhoff.

Cohen, L.G., P. Celnik, A. Pascual-Leone, B. Corwell, L. Faiz, J. Dambrosia, M. Honda, N. Sadato, C. Gerloff, M.D. Catala, and M. Hallett, M. 1997. Functional relevance of cross-modal plasticity in blind humans. Nature, 389: 180-183.

Collins, C.C. 1985. On mobility aids for the blind. In Electronic spatial sensing for the blind, D.H. Warren and E.R. Strelow, eds. Boston: Martinus Nijhoff.

Crandall, W., W. Gerrey, and A. Alden. 1993. Remote signage and its implications to print-handicapped travelers. Proceedings: Rehabilitation Engineering Society of North America RESNA Annual Conference, Las Vegas, June 12-17, 1993, pp. 251-253.

Davidson, P.W., S. Abbott, and J. Gershenfeld. 1974. Influence of exploration time on haptic and visual matching of complex shape. Perception and Psychophysics, 15 : 539-543.

Driver, J., and C. Spence. 1999. Cross-modal links in spatial attention. In Attention, space, and action: Studies in cognitive neuroscience, G.W. Humphreys and J. Duncan, eds. New York: Oxford University Press.

Ernst, M.O. and M.S. Banks. 2002. Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415: 429 - 433.

Ernst, M.O., M.S. Banks, and H.H. Buelthoff. 2000. Touch can change visual slant perception. Nature Neuroscience 3: 69-73.

Golledge, R.G. 2002. Spatial cognition and converging technologies. This volume.

Harrison, J., and S. Baron-Cohen. 1997. Synaesthesia: An introduction. In Synaesthesia: Classic and contemporary readings, S. Baron-Cohen and J.E. Harrison eds. Malden, MA: Blackwell Publishers.

Heller, M.A., J.A. Calcaterra, S.L. Green, and L. Brown. 1999. Intersensory conflict between vision and touch: The response modality dominates when precise, attention-riveting judgments are required. Perception and Psychophysics 61: 1384-1398.

Humayun, M.S., and E.T. de Juan, Jr. 1998. Artificial vision. Eye 12: 605-607.

Jaffe, D.L. 1994. Evolution of mechanical fingerspelling hands for people who are deaf-blind. Journal of Rehabilitation Research and Development 3: 236-244.

Kay, L. 1985. Sensory aids to spatial perception for blind persons: Their design and evaluation. In Electronic spatial sensing for the blind, D.H. Warren and E.R. Strelow, eds. Boston: Martinus Nijhoff.

Keller, H. 1908. The world I live in. New York: The Century Co.

Klatzky, R.L., J.M. Loomis, S.J. Lederman, H. Wake, and N. Fujita. 1993. Haptic perception of objects and their depictions. Perception and Psychophysics 54 : 170-178.

Kurzweil, R. 1989. Beyond pattern recognition. Byte 14: 277.

Lakatos, S., and L.E. Marks. 1999. Haptic form perception: Relative salience of local and global features. Perception and Psychophysics 61: 895-908.

Loomis, J.M. 1990. A model of character recognition and legibility. Journal of Experimental Psychology: Human Perception and Performance 16: 106-120.

Loomis, J.M., R.G. Golledge, and R.L. Klatzky. 2001. GPS-based navigation systems for the visually impaired. In Fundamentals of wearable computers and augmented reality, W. Barfield and T. Caudell, eds. Mahwah, NJ: Lawrence Erlbaum Associates.

Loomis, J.M., R.L. Klatzky, and S.J. Lederman. 1991. Similarity of tactual and visual picture perception with limited field of view. Perception 20: 167-177.

Loomis, J.M., and S.J. Lederman. 1986. Tactual perception. In K. Boff, L. Kaufman, and J. Thomas (Eds.), Handbook of perception and human performance: Vol. 2. Cognitive processes and performance (pp. 31.131.41). New York: Wiley.

Loomis, J.M., Y. Lippa, R.L. Klatzky, and R.G. Golledge. 2002. Spatial updating of locations specified by 3-D sound and spatial language. J. of Experimental Psychology: Learning, Memory, and Cognition 28: 335-345.

Loughborough, W. 1979. Talking lights. Journal of Visual Impairment and Blindness 73: 243.

Martino, G., and L.E. Marks. 2000. Cross-modal interaction between vision and touch: The role of synesthetic correspondence. Perception 29: 745-754.

_. 2001. Synesthesia: Strong and weak. Current Directions in Psychological Science 10: 61-65.

Massaro, D.W., and M.M. Cohen. 2000. Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception. Journal of the Acoustical Society of America 108: 784-789.

Meijer, P.B.L. 1992. An experimental system for auditory image representations. IEEE Transactions on Biomedical Engineering 39: 112-121.

Neville, H.J., D. Bavelier, D. Corina, J. Rauschecker, A. Karni, A. Lalwani, A. Braun, V. Clark, P. Jezzard, and R. Turner. 1998. Cerebral organization for language in deaf and hearing subjects: Biological constraints and effects of experience. Neuroimaging of Human Brain Function, May 29-31, 1997, Irvine, CA. Proceedings of the National Academy of Sciences 95: 922-929.

Newell, F.N., M.O. Ernst, B.S. Tjan, and H.H. Buelthoff. 2001. Viewpoint dependence in visual and haptic object recognition. Psychological Science 12: 37-42.

Niparko, J.K. 2000. Cochlear implants: Principles and practices. Philadelphia: Lippincott Williams & Wilkins.

Normann, R.A. 1995. Visual neuroprosthetics: Functional vision for the blind. IEEE Engineering in Medicine and Biology Magazine 77-83.

Pavel, M., G. Sperling, T. Riedl, and A. Vanderbeek. 1987. Limits of visual communication: The effect of signal-to-noise ratio on the intelligibility of American Sign Language. Journal of the Optical Society of America, A 4: 2355-2365.

Reed, C.M., L.A. Delhorne, N.I. Durlach, and S.D. Fischer. 1990. A study of the tactual and visual reception of fingerspelling. Journal of Speech and Hearing Research 33: 786-797.

Reed, C.M., W.M. Rabinowitz, N.I. Durlach, L.A. Delhorne, L.D. Braida, J.C. Pemberton, B.D. Mulcahey, and D.L. Washington. 1992. Analytic study of the Tadoma method: Improving performance through the use of supplementary tactual displays. Journal of Speech and Hearing Research 35: 450-465.

Sadato, N., A. Pascual-Leone, J. Grafman, V. Ibanez, M-P Deiber, G. Dold, and M. Hallett. 1996. Activation of the primary visual cortex by Braille reading in blind subjects. Nature 380: 526-528.

Tan, H.Z., W.M. Rabinowitz, and N.I. Durlach. 1989. Analysis of a synthetic Tadoma system as a multidimensional tactile display. Journal of the Acoustical Society of America 86: 981-988.

Valvo, A. 1971. Sight restoration after long-term blindness: the problems and behavior patterns of visual rehabilitation, L L. Clark and Z.Z. Jastrzembska, eds.. New York, American Foundation for the Blind.

Waltzman, S.B., and N.L. Cohen. 2000. Cochlear implants. New York: Thieme.

Weisenberger, J.M., S.M. Broadstone, and F.A. Saunders. 1989. Evaluation of two multichannel tactile aids for the hearing impaired. Journal of the Acoustical .Society of America 86: 1764-1775.

Welch, R.B., and D.H. Warren. 1980. Immediate perceptual response to intersensory discrepancy. Psychological Bulletin 88: 638-667.

0 0

Post a comment