CX-ST-RNM at SemEval-2019 Task 3: Fusion of Recurrent Neural Networks Based on Contextualized and Static Word Representations for Contextual Emotion Detection

Michał Perełkiewicz

2019 W: Proceedings of the 13th International Workshop on Semantic Evaluation / Marianna Apidianaki, Saif M. Mohammad, Jonathan May, Ekaterina Shutowa, Aurelie Herbelot, Zhu Xiaodan; Minneapolis: Association for Computational Linguistics, s. 180-184

13th International Workshop on Semantic Evaluation. Minneapolis, 2019-06-06 - 2019-06-07

In this paper, I describe a fusion model combining contextualized and static word representations for approaching the EmoContext task in the SemEval 2019 competition. The model is based on two Recurrent Neural Networks, the first one is fed with a state-of-the-art ELMo deep contextualized word representation and the second one is fed with a static Word2Vec embedding augmented with 10-dimensional affective word feature vector. The proposed model is compared with two baseline models based on a static word representation and a contextualized word representation, separately. My approach achieved officially 0.7278 microaveraged F1 score on the test dataset, ranking 47th out of 165 participants.