Reproducibility, Open Science, FAIR and Risk Of Bias in Educational Systematic Reviews: A systematic living meta-review of research standardsShow others and affiliations
2024 (English)In: META-REP 2024, the conference on meta-science and replicability in the social, behavioural, and cognitive sciences. October 28 to 31, 2024 in Munich, Germany, 2024Conference paper, Poster (with or without abstract) (Refereed)
Sustainable development
SDG 4: Ensure inclusive and equitable quality education and promote lifelong learning opportunities for all
Abstract [en]
This systematic living meta-review investigated the presence of open science practices (e.g., preregistration of protocols), reproducibility (e.g., describing searches and where exactly primary data is collected), and FAIR data adherence (findability, accessibility, interoperability, and reusability) in educational systematic reviews through the years 2019-2023. Additionally, we assessed the systematic reviews for adherence to MECCIR standards (Methodological Expectations of Campbell Collaboration Intervention Reviews; Wang et al., 2021), using the tool ROBIS (Risk of Bias in Systematic Reviews; Whiting et al., 2016).
Results show that very few systematic reviews could be assessed as low risk of bias, had preregistered a protocol, were possible to reproduce, and very few organized their data according to FAIR. There were however some reviews that adhered to the (much needed) rigorous standards and shared data that can be reused. This poster will address these issues further and discuss how the community can improve reproducibility practices.
Place, publisher, year, edition, pages
2024.
Keywords [en]
Meta-review, systematic review, risk of bias, FAIR, open science
National Category
Psychology Educational Sciences
Research subject
Social Sciences, Psychology
Identifiers
URN: urn:nbn:se:lnu:diva-133228OAI: oai:DiVA.org:lnu-133228DiVA, id: diva2:1910304
Conference
META-REP 2024, the conference on meta-science and replicability in the social, behavioural, and cognitive sciences. Munich, Germany, October 28 - 31, 2024
2024-11-042024-11-042025-04-30Bibliographically approved