EDUCATIONAL CORNER

New Publications
Additional reads in June 2021
June 16, 2021

Nonreplicable publications are cited more than replicable ones Good research begins long before papers get written Why indirect contributions matter for…

Read More
Putting the Self in Self-Correction: Findings from the Loss-of-Confidence Project
June 16, 2021

Science is often perceived to be a self-correcting enterprise. In principle, the assessment of scientific claims is supposed to proceed in…

Read More
Creating clear and informative image-based figures for scientific publications
June 16, 2021

Scientists routinely use images to display data and images are a critical part of a scientific report or publication.However, many resources…

Read More
What is the optimum design for my animal experiment?
June 16, 2021

Within preclinical research, attention has focused on experimental design and how current practices can lead to poor reproducibility. There are numerous…

Read More
Meta-analysis of variation suggests that embracing variability improves both replicability and generalizability in preclinical research
June 16, 2021

The long-held belief that experimental standardization begets replicability has recently been challenged – based on the observation that the reduction of…

Read More
The MDAR Framework – a new tool for life sciences reporting
June 16, 2021

Incomplete or imprecise reporting of life sciences research contributes to challenges with reproducibility, replicability, and biomedical applications. For the last three…

Read More
EQIPD Quality System published
June 16, 2021

The manuscript “Introduction to the EQIPD quality system” was recently accepted by and published in eLife. This publication marks an important milestone…

Read More
Additional reads in March 2021
March 30, 2021

Science Forum: Improving preclinical studies through replications Assessment of transparency indicators across the biomedical literature: How open is open? Von Botswana…

Read More
Reactivation-dependent amnesia for contextual fear memories: Evidence for publication bias
March 30, 2021

Research on memory reconsolidation has been booming in the last two decades, with numerous high-impact publications reporting promising amnestic interventions in…

Read More
Taking a fresh look at FAIR for research software
March 30, 2021

Software is increasingly essential in most research, and much of this software is developed specifically for and during research. To make this…

Read More
Advancing science or advancing careers? Researchers’ opinions on success indicators
March 30, 2021

The way in which we assess researchers has been under the radar in the past few years. Critics argue that current…

Read More
Reproducible image handling and analysis
March 30, 2021

Image data are universal in life sciences research. Their proper handling is not. A significant proportion of image data in research…

Read More
An excess of positive results: Comparing the standard Psychology literature with Registered Reports
March 30, 2021

Selectively publishing ‘positive’ results distorts the available evidence for scientific claims. For the past decade, scientists from different fields have been…

Read More
ADDITIONAL READS IN DECEMBER 2020
December 18, 2020

Collaboration on the road to better preclinical research Research integrity: nine ways to move from talk to walk Compliance Services for…

Read More
How often do leading biomedical journals use statistical experts to evaluate statistical methods? The results of a survey
December 18, 2020

Scientific claims in biomedical research are typically derived from statistical analyses. However, misuse or misunderstanding of statistical procedures and results permeate…

Read More
Publication rate in preclinical research: a plea for preregistration
December 18, 2020

In biomedical research, limitations in the design and reporting of experiments are known to cause avoidable waste of time and resources….

Read More
Use of causal claims in observational studies: a research on research study
December 18, 2020

Many researchers remain tempted to draw causal conclusions from observational data despite acknowledging that mere association is not causation because causal…

Read More
Credibility of preprints: an interdisciplinary survey of researchers
December 18, 2020

Preprints increase accessibility and can speed scholarly communication if researchers view them as credible enough to read and use. Preprint services…

Read More
The “replication crisis” in the public eye: Germans’ awareness and perceptions of the (ir)reproducibility of scientific research
December 18, 2020

While 90% of scientists surveyed by Nature feel that there is a “reproducibility crisis” in science (Baker, 2016), and major media…

Read More
New publication co-authored by PAASP: Survey of Core Facilities shows the importance of communication and management for optimal research quality
December 18, 2020

PAASP and the Interdisciplinary Neurobehavioral Core (INBC) at the University of Heidelberg aim to establish a quality framework for Core Facilities…

Read More
PAASP publication in Nature Reviews Drug Discovery: Improving target assessment in biomedical research – the GOT-IT recommendations
December 18, 2020

The PAASP team has published an article in Nature Reviews Drug Discovery, together with research groups from the Fraunhofer IME-TMP and the…

Read More
Additional reads in October 2020
October 8, 2020

When antibodies mislead: the quest for validation Von Maus zu Mensch durch das Tal des Todes (in German) Researchers’ Perceptions of…

Read More
How the COVID-19 pandemic highlights the necessity of animal research
October 8, 2020

Recently, a petition was offered to the European Commission calling for an immediate ban on animal testing. Although a Europe-wide moratorium…

Read More
Ten simple rules on how to write a standard operating procedure
October 8, 2020

The long-term accessibility of research data is fundamental in the economy of the research production process. However, the availability of data…

Read More
Reproducibility in systems biology modelling
October 8, 2020

The reproducibility crisis has emerged as an important concern across many fields of science. Systems biology modelling, which involves mathematical representation…

Read More
PAASP Editorial in the Journal Temperature
October 8, 2020

Please following this LINK to our Editorial “Enhancing quality in preclinical data: Of hot science and cool quality”, which was just published in…

Read More
Reproducibility in systems biology modelling
August 25, 2020

A recent report by Tiwari et al. investigated the reproducibility rate in systems biology modelling by reproducing the mathematical representation of 455 kinetic…

Read More
Risk‐of‐bias VISualization (robvis): An R package and Shiny web app for visualizing risk‐of‐bias assessments
August 17, 2020

There is currently no generic tool for producing figures to display and explore the risk‐of‐bias assessments that routinely take place as…

Read More
Additional reads in August 2020
August 17, 2020

Five better ways to assess science $48 Billion Is Lost to Avoidable Experiment Expenditure Every Year Opinion: Surgisphere Fiasco Highlights Need…

Read More
Choice of y-axis can mislead readers
August 17, 2020

Biases at the level of study design, conduct, data analysis and reporting have been recognized as major contributing factors to poor…

Read More
Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence
August 17, 2020

For neuroscience and brain research to progress, it is critical to differentiate between experimental manipulations which have no effect and those…

Read More
Advancing science or advancing careers? Researchers’ opinions on success indicators
August 17, 2020

The way in which we assess researchers has been under the radar in the past few years. Critics argue that current…

Read More
Academic criteria for promotion and tenure in biomedical sciences faculties: cross-sectional analysis of international sample of universities
August 17, 2020

Understanding the variability of criteria and thresholds for promotion and tenure applied across institutions requires a systematic empirical assessment. Therefore, the…

Read More
Reproducibility of animal research in light of biological variation
August 17, 2020

Context-dependent biological variation presents a unique challenge to the reproducibility of results in experimental animal research, because organisms’ responses to experimental…

Read More
Additional reads in May 2020
May 28, 2020

SuperPlots: Communicating reproducibility and variability in cell biology Against pandemic research exceptionalism Pseudoscience and COVID-19 — we’ve had enough already Spin…

Read More
Octopus: The primary research record
May 28, 2020

Created in partnership with the UK Reproducibility Network, the Octopus platform is free to use and publishes all kinds of scientific…

Read More
Using Microsoft OneNote as an ELN
May 28, 2020

Electronic research data documentation can be achieved with either comprehensive software applications or “do-it-yourself” solutions. Whereas the first is often quite…

Read More
PLOS launches research data survey
May 28, 2020

PLOS has launched a major survey targeting researchers in North America and Europe: The goal is to deepen the understanding of…

Read More
Die Reproduzierbarkeitskrise: Bedrohung oder Chance für die Wissenschaft? (In German)
May 28, 2020

In this Editorial, published in Biologie in unserer Zeit, Martin C. Michel and Ralf Dahm discuss threats and opportunities related to…

Read More
Systematic review of guidelines for internal validity in the design, conduct and analysis of preclinical biomedical experiments involving laboratory animals
May 28, 2020

Several initiatives have set out to increase transparency and internal validity of preclinical studies. While many of the points raised in…

Read More
Variability in the analysis of a single neuroimaging dataset by many teams
May 28, 2020

To test the reproducibility and robustness of results obtained in the neuroimaging field, 70 independent teams of neuroimaging experts from across…

Read More
Commentary March 2020
March 31, 2020

Comment on Walsh et al. “The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility…

Read More
Additional reads in March 2020
March 31, 2020

Preregistration of exploratory research: Learning from the golden age of discovery What Research Institutions Can Do to Foster Research Integrity When…

Read More
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
March 31, 2020

Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to…

Read More
Research Culture: Framework for advancing rigorous research
March 31, 2020

There is a pressing need to increase the rigor of research in the life and biomedical sciences. To address this issue,…

Read More
Improving the trustworthiness, usefulness, and ethics of biomedical research through an innovative and comprehensive institutional initiative
March 31, 2020

The reproducibility crisis triggered worldwide initiatives to improve rigor, reproducibility, and transparency in biomedical research. There are many examples of scientists,…

Read More
Research Culture and Reproducibility
March 31, 2020

There is an ongoing debate regarding the robustness and credibility of published scientific research. In this article, the authors argue that…

Read More
No raw data, no science: another possible source of the reproducibility crisis
March 31, 2020

Inappropriate practices of science, such as HARKing, p-hacking, and selective reporting of positive results, have been suggested as causes of irreproducibility….

Read More
Coronavirus: The need for solid, robust data
March 31, 2020

Like everyone else we are with a great concern given the current coronavirus situation and the beginning of a global experiment:…

Read More
Additional READS in January 2020
February 1, 2020

Measuring Transparency and Reproducibility of Biomedical Articles Causal claims about correlations reduced in press releases following academic study of health news…

Read More
Is N-Hacking Ever OK? A simulation-based study
February 1, 2020

After an experiment has been completed and analyzed, a trend may be observed that is “not quite significant”. Sometimes in this…

Read More
Publishers’ Responsibilities in Promoting Data Quality and Reproducibility
February 1, 2020

Scholarly publishers can help to increase data quality and reproducible research by promoting transparency and openness. Increasing transparency can be achieved…

Read More
Rigor and Transparency Index, a new metric of quality for assessing biological and medical science methods.
February 1, 2020

The reproducibility crisis in science is a multifaceted problem involving practices and incentives, both in the laboratory and in publication.Using SciScore,…

Read More
New Author Guidelines for Displaying Data and Reporting Data Analysis and Statistical Methods in Experimental Biology
February 1, 2020

To improve the robustness and transparency of scientific reporting, the American Society for Pharmacology and Experimental Therapeutics (ASPET), with input from PAASP’s Martin…

Read More
ADDITIONAL READS December 2019
December 18, 2019

Why scientists need to be better at data visualization Statistical significance gives bias a free pass Petitions in scientific argumentation: Dissecting…

Read More
A consensus-based transparency checklist
December 18, 2019

Transparency of research processes is required not only for evaluating and reproducing results, but also for research synthesis and meta-analysis from…

Read More
Publication rates in animal research. Extent and characteristics of published and non-published animal studies followed up at two German university medical centres
December 18, 2019

Non-publication and publication bias in animal research are prominent topics in current debates on the “reproducibility crisis” and “failure rates in…

Read More
Be positive about negatives – recommendations for the publication of negative (or null) results.
December 18, 2019

PAASP’s Anton Bespalov together with Phil Skolnick (Opiant) and Thomas Steckler (Janssen) address the issue of negative data being rarely disclosed…

Read More
Additional reads November 2019
November 22, 2019

Fixing the Flaws in Animal Research No Crisis but No Time for Complacency Licence to publish will restore trust in science…

Read More
Off-target toxicity is a common mechanism of action of cancer drugs undergoing clinical trials
November 22, 2019

Use of high-quality tools is an essential element of Good Research Practice. Like for many other aspects, “high quality” is a…

Read More
Reproducible and Transparent Research Practices in Published Neurology Research
November 22, 2019

The objective of this study by Rauh et al. was to evaluate the nature and extent of reproducible and transparent research…

Read More
Four erroneous beliefs thwarting more trustworthy research
November 22, 2019

A range of problems currently undermines public trust in biomedical research. In this article, Mark Yarborough and colleagues discuss four erroneous…

Read More
Laboratory mice born to wild mice have natural microbiota and model human immune responses
November 22, 2019

Mice can be a valuable model for early biomedical research, but many of the drugs that demonstrate promising results in these…

Read More
New Handbook of Experimental Pharmacology focusing on Good Research Practice
November 22, 2019

The Handbook of Experimental Pharmacology is one of the most authoritative and influential book series in pharmacology. It provides critical and…

Read More
Additional reads August 2019
August 12, 2019

Road testing ARRIVE 2019 Rethinking impact factors: better ways to judge a journal A Waste of 1,000 Research Papers The p…

Read More
Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations
August 12, 2019

When issues associated with the current academic evaluation systems are discussed, the use – and potential misuse – of the JIF…

Read More
Outcome heterogeneity and bias in acute experimental spinal cord injury
August 12, 2019

In this meta-analysis and meta-regression, Ralf Watzlawick and colleagues determined the impact of study characteristics, methodologic and reporting bias, and the…

Read More
Good Practice for Conference Abstracts and Presentations: GPCAP
August 12, 2019

GPCAP provides recommendations on good submission and presentation practice for scientific and medical congresses. These recommendations cover conference abstracts, posters and…

Read More
The association between quality measures of medical university press releases and their corresponding news stories
August 12, 2019

One of the key sources of health-related and medical information are university press releases (PR). This study by Maike Winters et…

Read More
Knowledge and attitudes among life scientists towards reproducibility within journal articles
August 12, 2019

This study by EK Samota and RP Davey investigated the knowledge of researchers about issues related to data reproducibility as well…

Read More
3Rs missing: animal research without scientific value is unethical
August 12, 2019

The scientists in biomedical research are increasingly worried about the growing number of rules and regulations that they have to comply…

Read More
Failing Grade: 89% of Introduction-to-Psychology Textbooks That Define or Explain Statistical Significance Do So Incorrectly
August 12, 2019

Null-hypothesis significance testing (NHST) is commonly used in psychology and biomedical research areas. However, statisticians have long warned that researchers regularly…

Read More
A Multi-center Study on the Reproducibility of Drug-Response Assays in Mammalian Cell Lines
August 12, 2019

In the biomedical field, a significant proportion of preclinical research data sets are not robust enough to translate into successful clinical…

Read More
Updated review of electronic laboratory notebooks (ELNs) published by LabsExplorer
May 22, 2019

LabsExplorer has recently published an updated review on electronic lab notebooks. The first review was published in 2017 (LINK) giving a…

Read More
Searching for incentives to do better research
May 22, 2019

n a recent commentary, Dorothy Bishop has referred to “the four horsemen of the reproducibility apocalypse: publication bias, low statistical power, P-value…

Read More
To “p” or not to “p”
May 22, 2019

“A biologist and a statistician are in prison and, before being executed, are asked about their last wish. Statistician wants to…

Read More
Additional Read in may 2019
May 22, 2019

Unclog pipeline for new medicines Improving the way research is done: the UK Reproducibility Network Major medical journals don’t follow their…

Read More
FAIRsharing as a community approach to standards, repositories and policies
May 22, 2019

We say we need standards, but do we use them?The scientific community, funders and publishers endorse the concept that common data…

Read More
Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature
May 22, 2019

Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to…

Read More
Exact replication: Foundation of science or game of chance?
May 22, 2019

The replication of initial results is a critical part of the scientific process. In preclinical biomedical research, it is common practice…

Read More
Endogenous Enterobacteriaceae underlie variation in susceptibility to Salmonella infection
May 22, 2019

An important source of variation in animal experiments is the microbiome, but little is known about specific changes in the microbiota…

Read More
Replication Study: The microRNA miR-34a inhibits prostate cancer stem cells and metastasis by directly repressing CD44
March 13, 2019

The Reproducibility Project: Cancer Biology aims to replicate a number of landmark studies in the field of tumor biology published between 2010 –…

Read More
Additional Reads in March 2019
March 11, 2019

The reproducibility crisis in the age of digital medicine It’s not a replication crisis. It’s an innovation opportunity The Role of…

Read More
Meta-Research: Incidences of problematic cell lines are lower in papers that use RRIDs to identify cell lines
March 11, 2019

Scientific articles using cell lines, which are registered on the International Cell Line Authentication Committee (ICLAC) or the Cellosaurus database as…

Read More
Why we need to report more than ’Data were Analyzed by t-tests or ANOVA’
March 11, 2019

In this article,Weissgerber et al. present findings suggesting that scientific publications are often lacking sufficient information about the statistical methods used,…

Read More
A Reaction Norm Perspective on Reproducibility
March 11, 2019

When studying living organisms, scientists are faced with inherent biological variation which is distinct from random noise or measurement error and…

Read More
Visualization of Biomedical Data
March 11, 2019

The rapid increase in volume and complexity of biomedical data requires changes in research, communication, and clinical practices. This includes learning…

Read More
Max Planck Society ends Elsevier subscription
January 2, 2019

The Max Planck Society (MPS) is a German research organisation acting in many different research areas and consists of over 14.000…

Read More
Additional Reads in December 2018
December 20, 2018

Statistical pitfalls of personalized medicine How sure are you of your result? Put a number on it Design preclinical studies for…

Read More
To Read More Papers, or to Read Papers Better? A Crucial Point for the Reproducibility Crisis 
December 20, 2018

To Read More Papers, or to Read Papers Better? A Crucial Point for the Reproducibility Crisis  A huge number of new…

Read More
How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation
December 20, 2018

Reproducibility in preclinical research may be low because of the high prevalence of biases and of suboptimal research practices (such as…

Read More
Reproducible research practices, transparency, and open access data in the biomedical literature, 2015–2017
December 20, 2018

In this article, the authors analysed potential sources of bias in 149 randomly selected biomedical research papers published between 2015 and…

Read More
Digital tools and services to support research replicability and verifiability
December 20, 2018

Digital tools hold promise for improving replicability and verifiability of scientific research. In this paper, the availability and use of such…

Read More
Additional Reads in November 2018
November 17, 2018

Further commentaries, articles and blog posts worth reading: Meet Octopus, a new vision for scientific publishing Reboot undergraduate courses for reproducibility…

Read More
Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results
November 17, 2018

In this article, 29 independent research teams used the same data set to address the same research question: whether soccer referees…

Read More
Meta-analysis of amantadine efficacy for improving preclinical research reliability
November 17, 2018

While L-DOPA remines the gold standard symptomatic treatment for Parkinson’s disease (PD), its long-term use is often associated with motor fluctuations…

Read More
Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole
November 17, 2018

Today, the probability of successfully publishing negative/null results in biomedical research is lower than that for positive results. For instance, negative…

Read More
Open Science challenges, benefits and tips in early career and beyond
November 17, 2018

In well designed and adequately powered experiments null findings are often as informative as ‘positive’ results but the current incentive structure…

Read More
Replication Study: Intestinal inflammation targets cancer-inducing activity of the microbiota
November 17, 2018

As part of the Reproducibility Project: Cancer Biology, this report describes the attempt to replicate critical experiments from the paper “Intestinal…

Read More
Researcher Requests for Inappropriate Analysis and Reporting: A U.S. Survey of Consulting Biostatisticians
November 17, 2018

In this report, Wang and colleagues present the results of a national survey of nearly 400 consulting statisticians about requests from…

Read More