Annobot: Platform for Annotating and Creating Datasets through Conversation with a Chatbot

Rafał Poświata, Michał Perełkiewicz

2020 W: Proceedings of the 28th International Conference on Computational Linguistics: System Demonstrations / Michal Ptaszynski, Bartosz Ziolko; Barcelona : International Committee on Computational Linguistics (ICCL), 2020, s. 75-79

The 28th International Conference on Computational Linguistics, Barcelona, 2020-12-08 - 2020-12-13

In this paper, we introduce Annobot: a platform for annotating and creating datasets through conversation with a chatbot. This natural form of interaction has allowed us to create a more accessible and flexible interface, especially for mobile devices. Our solution has a wide range of applications such as data labelling for binary, multi-class/label classification tasks, preparing data for regression problems, or creating sets for issues such as machine translation, question answering or text summarization. Additional features include pre-annotation, active sampling, online learning and real-time inter-annotator agreement. The system is integrated with the popular messaging platform: Facebook Messanger. Usability experiment showed the advantages of the proposed platform compared to other labelling tools. The source code of Annobot is available under the GNU LGPL license at https://github.com/rafalposwiata/annobot.

http://dx.doi.org/10.18653/v1/2020.coling-demos.14