手势
判决
理解力
心理学
背景(考古学)
口语
语义学(计算机科学)
意义(存在)
语言学
沟通
计算机科学
自然语言处理
人工智能
程序设计语言
心理治疗师
古生物学
哲学
生物
作者
Aslı Özyürek,Roel M. Willems,Sotaro Kita,Peter Hagoort
标识
DOI:10.1162/jocn.2007.19.4.605
摘要
Abstract During language comprehension, listeners use the global semantic representation from previous sentence or discourse context to immediately integrate the meaning of each upcoming word into the unfolding message-level representation. Here we investigate whether communicative gestures that often spontaneously co-occur with speech are processed in a similar fashion and integrated to previous sentence context in the same way as lexical meaning. Event-related potentials were measured while subjects listened to spoken sentences with a critical verb (e.g., knock), which was accompanied by an iconic co-speech gesture (i.e., KNOCK). Verbal and/or gestural semantic content matched or mismatched the content of the preceding part of the sentence. Despite the difference in the modality and in the specificity of meaning conveyed by spoken words and gestures, the latency, amplitude, and topographical distribution of both word and gesture mismatches are found to be similar, indicating that the brain integrates both types of information simultaneously. This provides evidence for the claim that neural processing in language comprehension involves the simultaneous incorporation of information coming from a broader domain of cognition than only verbal semantics. The neural evidence for similar integration of information from speech and gesture emphasizes the tight interconnection between speech and co-speech gestures.
科研通智能强力驱动
Strongly Powered by AbleSci AI