TY - GEN
T1 - Audiovisual-Haptic Simultaneity Perception Across the Body for Multisensory Applications
AU - Lee, Jiwan
AU - Yun, Gyeore
AU - Choi, Seungmoon
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.
PY - 2025
Y1 - 2025
N2 - This paper explores human performance on simultaneity judgments between audiovisual and haptic stimuli across the body for use in future real-time haptic applications. Three representative body sites, the torso, fingertip, and foot, were stimulated with vibration, and a media clip was used as an audiovisual stimulus. The results showed that: (1) the timing delay that humans can tolerate in the audiovisual leading-haptic following case was 55 ms at the fingertip, 65 ms at the chest, and 45 ms at the foot, and these values were significantly different from each other, (2) the regression curves shifted toward the haptic-leading direction from the chest down to the foot, showing significantly different points of subjective synchrony (PSS) between the body sites but similar window widths of simultaneity, (3) the PSSs were obtained between 20 and 40 ms in the haptic leading-audiovisual following case, and (4) a significant asymmetry was observed in the curves between haptic-leading and audiovisual-leading stimuli, with a higher temporal sensitivity in the audiovisual-leading case. We expect our results can provide essential information for multisensory applications.
AB - This paper explores human performance on simultaneity judgments between audiovisual and haptic stimuli across the body for use in future real-time haptic applications. Three representative body sites, the torso, fingertip, and foot, were stimulated with vibration, and a media clip was used as an audiovisual stimulus. The results showed that: (1) the timing delay that humans can tolerate in the audiovisual leading-haptic following case was 55 ms at the fingertip, 65 ms at the chest, and 45 ms at the foot, and these values were significantly different from each other, (2) the regression curves shifted toward the haptic-leading direction from the chest down to the foot, showing significantly different points of subjective synchrony (PSS) between the body sites but similar window widths of simultaneity, (3) the PSSs were obtained between 20 and 40 ms in the haptic leading-audiovisual following case, and (4) a significant asymmetry was observed in the curves between haptic-leading and audiovisual-leading stimuli, with a higher temporal sensitivity in the audiovisual-leading case. We expect our results can provide essential information for multisensory applications.
KW - Multiple body sites
KW - Simultaneity judgment
KW - Temporal synchrony perception
KW - Vibrotactile feedback
KW - Viewing experiences
UR - https://www.scopus.com/pages/publications/85209351904
U2 - 10.1007/978-3-031-70058-3_4
DO - 10.1007/978-3-031-70058-3_4
M3 - Conference contribution
AN - SCOPUS:85209351904
SN - 9783031700576
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 43
EP - 55
BT - Haptics
A2 - Kajimoto, Hiroyuki
A2 - Lopes, Pedro
A2 - Pacchierotti, Claudio
A2 - Basdogan, Cagatay
A2 - Gori, Monica
A2 - Lemaire-Semail, Betty
A2 - Marchal, Maud
PB - Springer Science and Business Media Deutschland GmbH
T2 - 14th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2024
Y2 - 30 June 2024 through 3 July 2024
ER -