Autores
Amjad - Maaz
Sidorov Grigori
Gelbukh Alexander
Título Overview of the shared task on fake news detection in urdu at FIRE 2020
Tipo Congreso
Sub-tipo Memoria
Descripción 12th Forum for Information Retrieval Evaluation, FIRE-WN 2020
Resumen This overview paper describes the first shared task on fake news detection in Urdu language. The task was posed as a binary classification task, in which the goal is to differentiate between real and fake news. We provided a dataset divided into 900 annotated news articles for training and 400 news articles for testing. The dataset contained news in five domains: (i) Health, (ii) Sports, (iii) Showbiz, (iv) Technology, and (v) Business. 42 teams from 6 different countries (India, China, Egypt, Germany, Pakistan, and the UK) registered for the task. 9 teams submitted their experimental results. The participants used various machine learning methods ranging from feature-based traditional machine learning to neural networks techniques. The best performing system achieved an F-score value of 0.90, showing that the BERT-based approach outperforms other machine learning techniques.
Observaciones CEUR Workshop Proceedings
Lugar Hyderabad
País India
No. de páginas 434-446
Vol. / Cap. v. 2826
Inicio 2020-12-16
Fin 2020-12-20
ISBN/ISSN