语言模型
计算机科学
人类语言
自然语言处理
语言学
哲学
作者
Greta Tuckute,Aalok Sathe,Shashank Srikant,Maya Taliaferro,Mingye Wang,Martin Schrimpf,Kendrick Kay,Evelina Fedorenko
标识
DOI:10.1101/2023.04.16.537080
摘要
Transformer models such as GPT generate human-like language and are highly predictive of human brain responses to language. Here, using fMRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of brain response associated with each sentence. Then, we use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also noninvasively control neural activity in higher-level cortical areas, like the language network.
科研通智能强力驱动
Strongly Powered by AbleSci AI