Crowdsourcing Under Data Poisoning Attacks: A Comparative Study - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2020

Crowdsourcing Under Data Poisoning Attacks: A Comparative Study

Farnaz Tahmasebian
  • Function : Author
  • PersonId : 1100411
Li Xiong
  • Function : Author
  • PersonId : 978083
Mani Sotoodeh
  • Function : Author
  • PersonId : 1100412
Vaidy Sunderam
  • Function : Author
  • PersonId : 978082


Crowdsourcing is a paradigm that provides a cost-effective solution for obtaining services or data from a large group of users. It is increasingly being used in modern society for data collection in domains such as image annotation or real-time traffic reports. A key component of these crowdsourcing applications is truth inference which aims to derive the true answer for a given task from the user-contributed data, e.g. the existence of objects in an image, or true traffic condition of a road. In addition to the variable quality of the contributed data, a potential challenge presented to crowdsourcing applications is data poisoning attacks where malicious users may intentionally and strategically report incorrect information in order to mislead the system to infer the wrong truth for all or a targeted set of tasks. In this paper, we propose a comprehensive data poisoning attack taxonomy for truth inference in crowdsourcing and systematically evaluate the state-of-the-art truth inference methods under various data poisoning attacks. We use several evaluation metrics to analyze the robustness or susceptibility of truth inference methods against various attacks, which sheds light on the resilience of existing methods and ultimately helps in building more robust truth inference methods in an open setting.
Fichier principal
Vignette du fichier
496047_1_En_18_Chapter.pdf (1.26 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03243634 , version 1 (31-05-2021)





Farnaz Tahmasebian, Li Xiong, Mani Sotoodeh, Vaidy Sunderam. Crowdsourcing Under Data Poisoning Attacks: A Comparative Study. 34th IFIP Annual Conference on Data and Applications Security and Privacy (DBSec), Jun 2020, Regensburg, Germany. pp.310-332, ⟨10.1007/978-3-030-49669-2_18⟩. ⟨hal-03243634⟩
35 View
14 Download



Gmail Facebook Twitter LinkedIn More