A1 Journal article (refereed)
Multitask deep learning for native language identification (2020)

Habic, V., Semenov, A., & Pasiliao, E. L. (2020). Multitask deep learning for native language identification. Knowledge-Based Systems, 209, Article 106440. https://doi.org/10.1016/j.knosys.2020.106440

JYU authors or editors

Publication details

All authors or editors: Habic, Vuk; Semenov, Alexander; Pasiliao, Eduardo L.

Journal or series: Knowledge-Based Systems

ISSN: 0950-7051

eISSN: 1872-7409

Publication year: 2020

Volume: 209

Article number: 106440

Publisher: Elsevier BV

Publication country: Netherlands

Publication language: English

DOI: https://doi.org/10.1016/j.knosys.2020.106440

Publication open access: Not open

Publication channel open access:

Publication is parallel published (JYX): https://jyx.jyu.fi/handle/123456789/72022

Abstract

Identifying the native language of a person by their text written in English (L1 identification) plays an important role in such tasks as authorship profiling and identification. With the current proliferation of misinformation in social media, these methods are especially topical. Most studies in this field have focused on the development of supervised classification algorithms, that are trained on a single L1 dataset. Although multiple labeled datasets are available for L1 identification, they contain texts authored by speakers of different languages and do not completely overlap. Current approaches achieve high accuracy on available datasets, but this is attained by training an individual classifier for each dataset. Studies show that joint training of multiple classifiers on different datasets can result in sharing information between the classifiers, leading to an increase in the accuracy of both tasks. In this study, we develop a novel deep neural network (DNN) architecture for L1 classification; it is based on an adversarial multitask learning method that integrates shared knowledge from multiple L1 datasets. We propose several variants of the architecture and rigorously evaluate their performance on multiple datasets. Our results indicate the proposed multitask architecture is more efficient in terms of classification accuracy than previously proposed methods.

Keywords: natural language; mother tongue; English language; text mining; machine learning

Free keywords: multitask learning; text classification; natural language processing; deep learning

Contributing organizations

Related projects

Ministry reporting: Yes

Reporting Year: 2020

JUFO rating: 1