Transparency of CHI Research Artifacts: Results of a Self-Reported Survey - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2020

Transparency of CHI Research Artifacts: Results of a Self-Reported Survey

Résumé

Several fields of science are experiencing a "replication crisis" that has negatively impacted their credibility. Assessing the validity of a contribution via replicability of its experimental evidence and reproducibility of its analyses requires access to relevant study materials, data, and code. Failing to share them limits the ability to scrutinize or build-upon the research, ultimately hindering scientific progress. Understanding how the diverse research artifacts in HCI impact sharing can help produce informed recommendations for individual researchers and policy-makers in HCI. Therefore, we surveyed authors of CHI 2018–2019 papers, asking if they share their papers' research materials and data, how they share them, and why they do not. The results (N = 460/1356, 34% response rate) show that sharing is uncommon, partly due to misunderstandings about the purpose of sharing and reliable hosting. We conclude with recommendations for fostering open research practices. This paper and all data and materials are freely available at https://osf.io/csy8q

Domaines

Psychologie

Dates et versions

hal-02989964 , version 1 (05-11-2020)

Identifiants

Citer

Chatchavan Wacharamanotham, Lukas Eisenring, Steve Haroz, Florian Echtler. Transparency of CHI Research Artifacts: Results of a Self-Reported Survey. CHI Conference on Human Factors in Computing Systems, 2020, Event not held due to COVID, Unknown Region. ⟨10.31219/osf.io/3bu6t⟩. ⟨hal-02989964⟩
69 Consultations
0 Téléchargements

Altmetric

Partager

More