About | Librarians Building Momentum for Reproducibility

In recent years the reproducibility of research has become a topic of increasing concern for researchers, funders, publishers, and the public. As many of the proposed fixes to reproducibility are key areas of academic librarianship, many librarians have been responding to these concerns with institutional services, professional development, and scholarship. The Librarians Building Momentum for Reproducible Research Virtual Conference seeks to bring these folks together for a half day of discussion, sharing, and inspiration. The conference will last 4-6 hours and include a keynote, a panel, presentations, lightning talks, and virtual breakout room activities.

Why did we choose a virtual format? As a quickly developing area that brings together disparate topics of librarianship, from systematic reviews to data management to scholarly communication and metrics, we believe that an open, free, virtual conference is the ideal format.

How does a virtual conference work? We will use Zoom as a video platform to talk to each other and present, Riot.im as a virtual meeting room for asking questions and sharing links and resources, and an online text editor (to be determined) to collaboratively take notes. The talks will be recorded and shared openly via an OSF instance along with the slides. The conference will be governed by a Code of Conduct enforced by the conference organizers.

You can join the conference via the link below: https://nyu.zoom.us/j/329599273. To call in by phone in the US: +1-646-558-8656 or +1-669-900-6833. International numbers available are available here: https://nyu.zoom.us/u/asJ1ww8kk. Webinar ID: 329 599 273.

You can follow along on Twitter as well with #ReproLibs.

Glossary of Terms

Reproducibility

"the ability of a researcher to duplicate the results of a prior study using the same materials and procedures as were used by the original investigator" (Bollen et al, 2015)

Bollen, K., Cacioppo, J., Kaplan, R., Krosnick, J. A., & Olds, J. L. (2015). Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science. Report of the Subcommittee on Replicability in Science Advisory Committee to the National Science Foundation Directorate for Social, Behavioral, and Economic Sciences.

Replication

"the ability of a researcher to duplicate the results of a prior study if the same procedures are followed but new data are collected." (Bollen et al, 2015)

Bollen, K., Cacioppo, J., Kaplan, R., Krosnick, J. A., & Olds, J. L. (2015). Social, Behavioral, and Economic Sciences Perspectives on Robust and Reliable Science. Report of the Subcommittee on Replicability in Science Advisory Committee to the National Science Foundation Directorate for Social, Behavioral, and Economic Sciences.

Questionable Research Practices (QRPs)

Research practices that may give "false impressions about the replicability of empirical results and misleading evidence about the size of an effect" (Schimmack, 2015). Some blame QRPs for causing the "reproducibility crisis." Examples of QRPs: p-hacking, underpowered studies, hypothesizing after results are known (HARKing), publication bias.

Bishop, D. (2019). Rein in the four horsemen of irreproducibility. Nature, 568(7753).

John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological science, 23(5), 524-532.

Schimmack, U. (2015) Questionable Research Practices: Definition, Detect, and Recommendations for Better Practices. Replicability-Index.

Metaresearch

Research on research!

Metascience is not a new topic, but it has been reinvigorated with the onset of the "reproducibility crisis." There was a Metascience Symposium at Stanford in 2019. .

Research misconduct

"fabrication, falsification, or plagiarism in proposing, performing, or reviewing research, or in reporting research results" (NIH, n.d.)