Metadata

Title: Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022
Category: general
UUID: 6eb88cf2b3d24ccc8ad7a8afe6a8ef10

Source URL: https://iris.unil.ch/entities/publication/8efa20b7-abc3-4001-93b7-5d4b91b916e9
Parent URL: https://wp.unil.ch/persuasivelab/2023/06/good-research-practices-grp/
Crawl Time: 2026-03-23T21:49:17+00:00

Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022

Source: https://iris.unil.ch/entities/publication/8efa20b7-abc3-4001-93b7-5d4b91b916e9 Parent: https://wp.unil.ch/persuasivelab/2023/06/good-research-practices-grp/

Titre

Changes in Research Ethics, Openness, and Transparency in Empirical Studies between CHI 2017 and CHI 2022

Type

article de conférence/colloque

Institution

UNIL/CHUV/Unisanté + institutions partenaires

Auteur(s)

Salehzadeh Niksirat, Kavous

Auteure/Auteur

Goswami, Lahari

Auteure/Auteur

S. B. Rao, Pooja

Auteure/Auteur

Tyler, James

Auteure/Auteur

Silacci, Alessandro

Auteure/Auteur

Aliyu, Sadiq

Auteure/Auteur

Aebli, Annika

Auteure/Auteur

Wacharamanotham, Chat

Auteure/Auteur

Cherubini, Mauro

Auteure/Auteur

Liens vers les personnes

Salehzadeh Niksirat, Kavous

Goswami, Lahari

Shikaripur Bheemasena Rao, Pooja

Liens vers les unités

Département des systèmes d'information

Maison d’édition

ACM

Titre du livre ou conférence/colloque

In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI'23)

Unité

CHI Conference on Human Factors in Computing Systems

Adresse

Hamburg, Germany

Statut éditorial

Publié

Date de publication

2023-04-23

Peer-reviewed

Oui

Langue

anglais

Résumé

In recent years, various initiatives from within and outside the HCI field have encouraged researchers to improve research ethics, openness, and transparency in their empirical research. We quantify how the CHI literature might have changed in these three aspects by analyzing samples of 118 CHI 2017 and 127 CHI 2022 papers---randomly drawn and stratified across conference sessions. We operationalized research ethics, openness, and transparency into 45 criteria and manually annotated the sampled papers. The results show that the CHI 2022 sample was better in 18 criteria, but in the rest of the criteria, it has no improvement. The most noticeable improvements were related to research transparency (10 out of 17 criteria). We also explored the possibility of assisting the verification process by developing a proof-of-concept screening system. We tested this tool with eight criteria. Six of them achieved high accuracy and F1 score. We discuss the implications for future research practices and education.\ This paper and all supplementary materials are freely available at https://doi.org/10.17605/osf.io/n25d6.

Sujets

PID Serval

serval:BIB_364ED171A347

DOI

10.1145/3544548.3580848