结合预训练模型和语言知识库的文本匹配方法

针对文本匹配任务,该文提出一种大规模预训练模型融合外部语言知识库的方法。该方法在大规模预训练模型的基础上,通过生成基于WordNet的同义—反义词汇知识学习任务和词组—搭配知识学习任务引入外部语言学知识。进而,与MT-DNN多任务学习模型进行联合训练,以进一步提高模型性能。最后利用文本匹配标注数据进行微调。在MRPC和QQP两个公开数据集的实验结果显示,该方法可以在大规模预训练模型和微调的框架基础上,通过引入外部语言知识进行联合训练有效提升文本匹配性能。     

基于Python的油田生产资料预处理软件设计与应用

油田内部生产资料类型包括钻井、录井、测井、试油等多种类型。针对资料整理过程中存在的问题如:从原始资料库中下载的资料格式多样;不同石油软件所需加载的数据格式不同;已有资料预处理软件功能均较单一等,从编程语言优选、软件兼容性、软件功能集成化三个方面出发,选取Python语言进行软件设计,利用Python扩展性强的特点,设计出红番茄资料预处理软件,并在新疆油田进行试点,生产资料整理时间缩短至原耗时间的约33%。Python语言在油田生产中的应用可为具有相同问题的其他油田提供参考。     

Sign Language to Sentence Formation: A Real Time Solution for Deaf People

Communication is a basic need of every human being to exchange thoughts and interact with the society. Acute peoples usually confab through different spoken languages, whereas deaf people cannot do so. Therefore, the Sign Language (SL) is the communication medium of such people for their conversation and interaction with the society. The SL is expressed in terms of specific gesture for every word and a gesture is consisted in a sequence of performed signs. The acute people normally observe these signs to understand the difference between single and multiple gestures for singular and plural words respectively. The signs for singular words such as I, eat, drink, home are unalike the plural words as school, cars, players. A special training is required to gain the sufficient knowledge and practice so that people can differentiate and understand every gesture/sign appropriately. Innumerable researches have been performed to articulate the computer-based solution to understand the single gesture with the help of a single hand enumeration. The complete understanding of such communications are possible only with the help of this differentiation of gestures in computer-based solution of SL to cope with the real world environment. Hence, there is still a demand for specific environment to automate such a communication solution to interact with such type of special people. This research focuses on facilitating the deaf community by capturing the gestures in video format and then mapping and differentiating as single or multiple gestures used in words. Finally, these are converted into the respective words/sentences within a reasonable time. This provide a real time solution for the deaf people to communicate and interact with the society.     

Designer portfolio archetypes in design-intensive industries

ABSTRACT

The paper analyzes the designer portfolio configurations employed by firms, in design-intensive industries, to implement different product design strategies. Using the fuzzy set qualitative comparative analysis methodology, the paper explores how decorative lamps manufacturers, that first adopted the new LED technology, assembled their designer portfolios. The study shows that, in the early phases of LED lamps, four different designer portfolio archetypes were adopted by firms, two of them related to a product language divergence strategy and two to a product language convergence strategy: international design-star archetype, crowd design-innovator archetype, local ambassador archetype, international bridge archetype. These four archetypes are discussed, contributing to a better understanding of the relationship between product design strategies and designers’ management in design-intensive industries.     

Korean automatic spacing using pretrained transformer encoder and analysis

Automatic spacing in Korean is used to correct spacing units in a given input sentence. The demand for automatic spacing has been increasing owing to frequent incorrect spacing in recent media, such as the Internet and mobile networks. Therefore, herein, we propose a transformer encoder that reads a sentence bidirectionally and can be pretrained using an out-of-task corpus. Notably, our model exhibited the highest character accuracy (98.42%) among the existing automatic spacing models for Korean. We experimentally validated the effectiveness of bidirectional encoding and pretraining for automatic spacing in Korean. Moreover, we conclude that pretraining is more important than fine-tuning and data size.     

Modeling dynamic construction work template from existing scheduling records via sequential machine learning

Today, construction planning and scheduling is almost always performed manually, by experienced practitioners. The knowledge of those individuals is materialized, maintained, and propagated through master schedules and look-ahead plans. While historical project schedules are available, manually mining their embedded knowledge to create generic work templates for future projects or revising look-ahead schedules is very difficult, time-consuming and error-prone. The rigid work templates from prior research are also not scalable to cover the inter and intra-class variability in historical schedule activities. This paper aims at fulfilling these needs via a new method to automatically learn construction knowledge from historical project planning and scheduling records and digitize such knowledge in a flexible and generalizable data schema. Specifically, we present Dynamic Process Templates (DPTs) based on a novel vector representation for construction activities where the sequencing knowledge is modeled with generative Long Short-Term Memory Recurrent Neural Networks (LSTM-RNNs). Our machine learning models are exhaustively tested and validated on a diverse dataset of 32 schedules obtained from real-world projects. The experimental results show our method is capable of learning planning and sequencing knowledge at high accuracy across different projects. The benefits for automated project planning and scheduling, schedule quality control, and automated generation of project look-aheads are discussed in detail.     

基于语言模型的预训练技术研究综述

预训练技术当前在自然语言处理领域占有举足轻重的位置。尤其近两年提出的ELMo、GTP、BERT、XLNet、T5、GTP-3等预训练模型的成功,进一步将预训练技术推向了研究高潮。该文从语言模型、特征抽取器、上下文表征、词表征四个方面对现存的主要预训练技术进行了分析和分类,并分析了当前自然语言处理中的预训练技术面临的主要问题和发展趋势。     

基于区间犹豫模糊语言集的水资源多目标决策

以鄂北水资源配置工程为对象,研究大型调水工程背景下的多水源多目标优化配置。将鄂北地区水库分为充蓄水库、补偿水库与在线水库等3类,根据各类水库特点对鄂北水资源配置工程进行系统概化,建立以年缺水量最小和调水成本最低为目标函数的多水源多目标优化配置模型。采用权重系数法进行求解得到非劣解集。最后采用基于区间犹豫模糊语言与TOPSIS的多目标决策方法对各方案的缺水量与调水量作出评价并遴选出最优方案。研究结果表明:对鄂北水资源配置工程而言,缺水量与调水量的权重比为7∶3的方案综合评价最优,重视缺水的同时兼顾调水成本;基于区间犹豫模糊语言集与TOPSIS的水资源多目标决策方法经本文实例验证具有较高的稳定性与可行性。