Meta-Research Innovation Center Berlin

BIH QUEST Center for Transforming Biomedical Research

Charité – Universitätsmedizin Berlin

Who are we?

The Meta-Research Innovation Center Berlin (METRIC-Berlin), the European sister of The Meta-Research Innovation Center at Stanford (METRICS), was founded in January 2019 by Professor John Ioannidis with funding from the Stiftung Charité and the Einstein Foundation Berlin. We are hosted by the Quality, Ethics, Open Science, Translation Center (QUEST) of the Berlin Institute of Health (BIH) based at the Charité – Universitätsmedizin Berlin. Below you can meet our team, learn about our research, view our publications, find out about previous and upcoming talks, browse our various podcasts and blog posts, meet our funders and partners and get in touch.

your_img

Our team

John Ioannidis

Director

Tom Hardwicke

QUEST Visiting fellow

Sophia Crüwell

PhD Candidate

Our research

Whilst some scientists study rocks, insects, brains, or molecules, we study the process of science itself. This meta-research, or ‘research on research’, involves evaluating quality, bias, and efficiency during critical phases of the research cycle, including methods, reporting, reproducibility, evaluation, and incentives. We take an interdisciplinary approach that seeks to cross-fertilize ideas and resources between fields to most effectively maximise the quality and efficiency of the scientific endeavour. You can take a look at some of our publications to get a flavour of the work that we do.

Selected Publications

Tom Hardwicke, Steven Goodman (2020). How often do leading biomedical journals use statistical experts to evaluate statistical methods? The results of a survey.. MetaArXiv.

DOI PDF Data Materials Analysis Code Reproducible Container

Tom Hardwicke, Joshua Wallach, Mallory Kidwell, Theiss Bendixen, Sophia Crüwell, John Ioannidis (2020). An empirical assessment of transparency and reproducibility-related research practices in the social sciences (2014-2017). Royal Society Open Science.

DOI PDF Preprint Pre-registration Data Materials Analysis Code Reproducible Container

Tom Hardwicke, Robert Thibault, Jessica Kosie, Joshua Wallach, Mallory Kidwell, John Ioannidis (2020). Estimating the prevalance of transparency and reproducibility-related research practices in psychology (2014-2017). MetaArXiv.

DOI PDF Preprint Pre-registration Data Materials Analysis Code Reproducible Container

Tom Hardwicke, Stylianos Serghiou, Perrine Janiaud, Valentin Danchev, Sophia Crüwell, Steven Goodman, John Ioannidis (2020). Calibrating the scientific ecosystem through meta-research. Anuual Review of Statistics and its Application.

DOI PDF Preprint

Sophia Crüwell, Angelika Stefan, Nathan Evans (2019). Robust Standards in Cognitive Science. Computational Brain & Behavior.

DOI PDF

Tom Hardwicke, Michael Frank, Simine Vazire, Steven Goodman (2019). Should psychology journals adopt specialized statistical review?. Advances in Methods and Practices in Psychological Science.

DOI PDF Data Materials Analysis Code Reproducible Container

Tom Hardwicke, John Ioannidis (2018). Mapping the universe of registered reports. Nature Human Behaviour.

DOI PDF Preprint Data Materials Analysis Code Reproducible Container Commentary