Summation of visual attributes in auditory‐visual crossmodal

Article


Jonas, C., Spiller, M. and Hibbard, Paul B. 2017. Summation of visual attributes in auditory‐visual crossmodal. Psychonomic Bulletin and Review. 24 (4), pp. 1104-1112. https://doi.org/10.3758/s13423-016-1215-2
AuthorsJonas, C., Spiller, M. and Hibbard, Paul B.
Abstract

Crossmodal correspondences are a feature of human perception in which two or
more sensory dimensions are linked together; for example, high‐pitched noises may be
more readily linked with small objects than large objects. However, no study yet has
systematically examined the interaction between different visual‐auditory crossmodal
correspondences. We investigated how the visual dimensions of luminance, saturation, size
and vertical position can influence decisions when matching particular visual stimuli with
high‐pitched or low‐pitched auditory stimuli. For multi‐dimensional stimuli, we found a
general pattern of summation of individual crossmodal correspondences, with some
exceptions that may be explained by Garner interference. These findings have applications
for the design of sensory substitution systems, which convert information from one sensory
modality to another.

Keywordsmultisensory perception; crossmodal correspondences; vision; hearing
JournalPsychonomic Bulletin and Review
Journal citation24 (4), pp. 1104-1112
ISSN1069-9384
1531-5320
Year2017
PublisherSpringer Verlag
Accepted author manuscript
License
Digital Object Identifier (DOI)https://doi.org/10.3758/s13423-016-1215-2
Web address (URL)https://doi.org/10.3758/s13423-016-1215-2
Publication dates
Online10 Jul 2017
Publication process dates
Deposited16 Jun 2017
Accepted01 Dec 2016
Accepted01 Dec 2016
Copyright informationThe final publication is available at Springer via http://dx.doi.org/10.3758/s13423-016-1215-2
Permalink -

https://repository.uel.ac.uk/item/84v22

Download files


Accepted author manuscript
jonas et al multi CMC manuscript revised no tracking (1).pdf
License: Springer Nature Terms of Use for accepted manuscripts of subscription articles, books and chapters

  • 160
    total views
  • 209
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Export as

Related outputs

Exploring the relationship between grapheme colour-picking consistency and mental imagery
Spiller, M., Harkry, Lee, McCullagh, Fintan, Thoma, V. and Jonas, C. 2019. Exploring the relationship between grapheme colour-picking consistency and mental imagery. Philosophical Transactions B: Biological Sciences. 374 (Art. 20190023). https://doi.org/10.1098/rstb.2019.0023
Introduction to the Special Issue on Individual Differences in Multisensory Perception: An Overview
Jonas, C., Spiller, M., Hibbard, Paul B. and Proulx, Michael J. 2017. Introduction to the Special Issue on Individual Differences in Multisensory Perception: An Overview. Multisensory Research. 30 (6), pp. 461-466. https://doi.org/10.1163/22134808-00002594
Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity
Asad, Jennah, Spiller, M. and Jonas, C. 2016. Auditory and Visual Crossmodal Correspondences With Haptically Perceived Liquid Viscosity. Multisensory Research. 29 (8), pp. 727-747. https://doi.org/10.1163/22134808-00002534
Migraine in Synesthetes and Nonsynesthetes: A Prevalence Study
Jonas, C. and Hibbard, P. B. 2015. Migraine in Synesthetes and Nonsynesthetes: A Prevalence Study. Perception. 0 (0), pp. 1-24.
Migraine in Synaesthetes and Non-Synaesthetes: A Prevalence Study
Jonas, C. and Hibbard, Paul B. 2015. Migraine in Synaesthetes and Non-Synaesthetes: A Prevalence Study. Perception. 44 (10), pp. 1179-1202.
Beyond visual imagery: How modality-specific is enhanced mental imagery in synesthesia?
Spiller, M., Jonas, Clare N., Simner, Julia and Jansari, Ashok 2015. Beyond visual imagery: How modality-specific is enhanced mental imagery in synesthesia? Consciousness and Cognition. 31, pp. 73-85.
Not all synesthetes are alike: spatial vs. visual dimensions of sequence-space synesthesia
Jonas, C. and Price, Mark C. 2014. Not all synesthetes are alike: spatial vs. visual dimensions of sequence-space synesthesia. Frontiers in Psychology. 5 (1171).
Synesthesia: an introduction
Banissy, Michael J., Jonas, C. and Cohen Kadosh, Roi 2014. Synesthesia: an introduction. Frontiers in Psychology. 5 (1414).
Number-space associations in synaesthesia are not influenced by finger-counting habits
Jonas, C. and Ward, Jamie 2014. Number-space associations in synaesthesia are not influenced by finger-counting habits. Journal of Cognitive Psychology.
Comparing implicit and synaesthetic number-space associations: visuospatial and verbal SNARC effects
Jonas, C., Spiller, M., Jansari, A. and Ward, Jamie 2013. Comparing implicit and synaesthetic number-space associations: visuospatial and verbal SNARC effects. Quarterly Journal of Experimental Psychology.
Mental imagery in synaesthesia
Spiller, M. 2009. Mental imagery in synaesthesia. PhD Thesis University of East London School of Psychology https://doi.org/10.15123/PUB.3092
Visual experience facilitates allocentric spatial representation
Pasqualotto, Achille, Spiller, M., Jansari, A. and Proulx, Michael J. 2012. Visual experience facilitates allocentric spatial representation. Behavioural Brain Research. 236 (1), pp. 175-179.