Audiovisual semantic congruency effect with onomatopoeia
Book chapter
Fidalgo, A., Takahashi, Kohshe, Murata, Aiko and Watanabe, Katsumi 2018. Audiovisual semantic congruency effect with onomatopoeia. in: Proceedings of 10th International Conference on Knowledge and Smart Technology (KST) 2018 IEEE. pp. 254 -259
Authors | Fidalgo, A., Takahashi, Kohshe, Murata, Aiko and Watanabe, Katsumi |
---|---|
Abstract | It has been reported that when a congruent natural sound precedes briefly presented visual stimuli, it promotes performance in psychophysics detection tasks. Onomatopoeias refer to words that phonetically mimic or suggest actual sounds. Onomatopoeic words are a form of sound symbolism and are frequently used in Japanese language. In this study, we examined whether the presentation of spoken Japanese onomatopoeia to Japanese native-speakers results in visual detection sensitivity changes. Results indicate that when onomatopoeias are presented 227 ms before a visual stimulus, they have a modulatory audiovisual effect. This effect is closer to the results observed with natural sounds than spoken words, with d’ being lower for onomatopoeias when compared with natural sounds. Such suggests that Japanese spoken onomatopoeias may be processed in a manner that is closer to natural sounds than spoken words and points to behavioral consequences of sound symbolism. |
Book title | Proceedings of 10th International Conference on Knowledge and Smart Technology (KST) 2018 |
Page range | 254 -259 |
Year | 2018 |
Publisher | IEEE |
Publication dates | |
Online | 09 Aug 2018 |
Publication process dates | |
Deposited | 15 Jan 2018 |
Accepted | 08 Dec 2017 |
Accepted | 08 Dec 2017 |
Event | IEEE 10th International Conference on Knowledge and Smart Technology (KST) 2018 |
ISBN | 978-1-5386-4015-9 |
978-1-5386-4016-6 | |
Digital Object Identifier (DOI) | https://doi.org/10.1109/KST.2018.8426115 |
Web address (URL) | https://doi.org/10.1109/KST.2018.8426115 |
Additional information | © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Accepted author manuscript |
https://repository.uel.ac.uk/item/84727
Download files
187
total views264
total downloads1
views this month0
downloads this month