This repository contains a collection of screenshots of medical webpages compiled By Zimmerman and his peers [1]. These webpages belong to 4 different health topics. This collection was used to:
- Produce a set of expert annotations regarding credibility, following the annotation guidelines created by Fernández-Pichel et al. [2].
- Conduct a Prolific user study with 1,000 participants to provide a score of their perception of credibility in a 7-point Lickert scale.
- Conduct a data analysis process to determine the correlation between the expert annotated values and the crowdsourced ones.
The code and datasets are freely available for the scientific community to test and reuse.
References:
[1] S. Zimmerman, A. Thorpe, C. Fox, U. Kruschwitz, Privacy nudging in search: Investigating potential impacts, in: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval, 2019, pp. 283–287. [2] M. Fernández-Pichel, S. Meyer, M. Bink, A. Frummet, D. E. Losada, D. Elsweiler, Improving the reliability of health information credibility assessments, in: Proceedings of the 3rd Workshop on Reducing Online Misinformation through Credible Information Retrieval 2023 co-located with The 45th European Conference on Information Retrieval (ECIR 2023), 2023, pp. 43–50. URL: https://ceur-ws.org/Vol-3406/paper4_jot.pdf.