Portuguese word embeddings for the oil and gas industry: Development and evaluation

自然语言处理 计算机科学 人工智能 葡萄牙语 文字嵌入 词汇 领域(数学分析) 背景(考古学) 数据科学 嵌入 语言学 地理 数学 数学分析 哲学 考古
作者
Diogo da Silva Magalhães Gomes,Fábio Corrêa Cordeiro,Bernardo Scapini Consoli,Nikolas Lacerda Santos,Viviane Pereira Moreira,Renata Vieira,Sílvia María Wanderley Moraes,Alexandre G. Evsukoff
出处
期刊:Computers in Industry [Elsevier BV]
卷期号:124: 103347-103347 被引量:9
标识
DOI:10.1016/j.compind.2020.103347
摘要

Over the last decades, oil and gas companies have been facing a continuous increase of data collected in unstructured textual format. New disruptive technologies, such as natural language processing and machine learning, present an unprecedented opportunity to extract a wealth of valuable information within these documents. Word embedding models are one of the most fundamental units of natural language processing, enabling machine learning algorithms to achieve great generalization capabilities by providing meaningful representations of words, being able to capture syntactic and semantic features based on their context. However, the oil and gas domain-specific vocabulary represents a challenge to those algorithms, in which words may assume a completely different meaning from a common understanding. The Brazilian pre-salt is an important exploratory frontier for the oil and gas industry, with increasing attractiveness for international investments in exploration and production projects, and most of its documentation is in Portuguese. Moreover, Portuguese is one of the largest languages in terms of number of native speakers. Nonetheless, despite the importance of the petroleum sector of Portuguese speaking countries, specialized public corpora in this domain are scarce. This work proposes PetroVec, a representative set of word embedding models for the specific domain of oil and gas in Portuguese. We gathered an extensive collection of domain-related documents from leading institutions to build a large specialized oil and gas corpus in Portuguese, comprising more than 85 million tokens. To provide an intrinsic evaluation, assessing how well the models can encode domain semantics from the text, we created a semantic relatedness test set, comprising 1,500 word pairs labeled by selected experts in geoscience and petroleum engineering from both academia and industry. In addition, we performed an extrinsic quantitative evaluation on a downstream task of named entity recognition in geoscience, plus a set of qualitative analyses, and conducted a comparative evaluation against a public general-domain embedding model. The obtained results suggest that our domain-specific models outperformed the general model on their ability to represent specialized terminology. To the best of our knowledge, this is the first attempt to generate and evaluate word embedding models for the oil and gas domain in Portuguese. Finally, all the resources developed by this work are made available for public use, including the pre-trained specialized models, corpora, and validation datasets.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
kiteshowbbs关注了科研通微信公众号
2秒前
kiteshowbbs关注了科研通微信公众号
2秒前
情怀的应助被parantal采纳,获得10
4秒前
parantal发布了新的文献求助10
4秒前
佳佳完成签到 ,获得积分10
6秒前
典雅的纸飞机完成签到 ,获得积分10
9秒前
Wang_miao完成签到 ,获得积分10
10秒前
顾宗恒完成签到 ,获得积分10
12秒前
xurui_s完成签到 ,获得积分10
17秒前
自然心情完成签到 ,获得积分10
18秒前
科研通AI6.2的应助被hy采纳,获得10
19秒前
20秒前
学生艺苑完成签到 ,获得积分10
21秒前
都美秋完成签到 ,获得积分10
21秒前
莫歌完成签到 ,获得积分10
21秒前
高大绮完成签到,获得积分10
22秒前
luoyukejing完成签到,获得积分10
23秒前
超级的愫完成签到,获得积分10
27秒前
shawn发布了新的文献求助10
27秒前
鹿小新完成签到 ,获得积分0
28秒前
魔术师完成签到 ,获得积分10
30秒前
hj完成签到,获得积分10
30秒前
xiaoleeyu完成签到,获得积分10
30秒前
冷静怜珊完成签到,获得积分10
31秒前
敏感的海雪完成签到,获得积分10
34秒前
sudaxyj完成签到,获得积分10
35秒前
XINGCHEN完成签到 ,获得积分10
35秒前
虾米米0918完成签到 ,获得积分10
36秒前
zjh123完成签到,获得积分10
37秒前
哈哈哈完成签到,获得积分10
38秒前
儒雅傲之完成签到,获得积分10
39秒前
LeoTsang完成签到 ,获得积分10
40秒前
孙淳完成签到,获得积分10
40秒前
future完成签到 ,获得积分10
41秒前
王继完成签到,获得积分10
43秒前
wwwwcom完成签到,获得积分10
43秒前
shawn完成签到,获得积分20
45秒前
胡思乱响完成签到,获得积分10
46秒前
Adrianlee完成签到,获得积分10
47秒前
张yc完成签到,获得积分10
47秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
plantTFDB 508
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8173347
求助须知:如何正确求助?哪些是违规求助? 9565632
关于积分的说明 21780648
捐赠科研通 7767505
什么是DOI,文献DOI怎么找? 3431542
关于科研通互助平台的介绍 2555841
邀请新用户注册赠送积分活动 2476749