Generated by All in One SEO v4.9.2, this is an llms.txt file, used by LLMs to index the site.

# paasp network

Increase confidence in nonclinical science

## Sitemaps

- [XML Sitemap](https://paasp.net/sitemap.xml): Contains all public & indexable URLs for this website.

## Posts

- [EQIPD / PAASP Newsletter December 2025](https://paasp.net/paasp-newsletter-december-2025/) - The current issue of our newsletter is special as this is issue no. 50 and it marks the 10th anniversary of PAASP! Today we share with you not just updates on ongoing projects but also try to reflect on what we learned during the first ten years and how this informs our plans for the future: Ten years later: Are
- [March 3, 2020: Kick-Off Meeting - Quality Standards for In Vitro Research](https://paasp.net/march-3-2020-kick-off-meeting-quality-standards-for-in-vitro-research/) - Organized by the global Preclinical Data Forum, the meeting is aimed to start a discussion about developing specific quality guidelines and standards for in vitro research. One key question to be addressed at the meeting is whether quality recommendations, which are increasingly commonly acknowledged and followed in in vivo research, like blinding and randomization, should and can also be applied
- [NIH Needs Your Feedback on a DRAFT NIH Policy for Data Management and Sharing](https://paasp.net/nih-needs-your-feedback-on-a-draft-nih-policy-for-data-management-and-sharing/) - The draft policy requires all NIH-funded grantees to submit a Data Management and Sharing Plan outlining how researchers plan to manage scientific data, including when and where the scientific data will be preserved and shared.Let the NIH know what you think works and what doesn’t in the proposed policy by submitting your comments through the web-portal no later than
- [Most innovations are not advances: innovation + evaluation = progress](https://paasp.net/most-innovations-are-not-advances-innovation-evaluation-progress/) - A blog post by Paul Glasziou from January 2013 starts with this headline, which is very much in line with our thinking. Innovation is the cornerstone for progress in so many ways, but only the innovation that indeed proves to withstand rigorous testing will lead to lasting progress. Hence, evaluation should be seen as a
- [The Global Preclinical Data Forum announces the 2020 Negative Data Prize](https://paasp.net/the-global-preclinical-data-forum-announces-the-2020-negative-data-prize/) - The Global Preclinical Data Forum (GPDF), a partnership of Cohen Veterans Bioscience (CVB), a non-profit research biotech, and the European College of Neuropsychopharmacology (ECNP), is pleased to announce the opening of submissions for the 2020 Best Negative Data Prize competition. This prize, which was first launched in 2017, will be awarded to the researcher/research group
- [NIH Request for Information (RFI) aimed at enhancing rigor, transparency, and translatability to improve biomedical and behavioral research involving animal models](https://paasp.net/nih-request-for-information-rfi-aimed-at-enhancing-rigor-transparency-and-translatability-to-improve-biomedical-and-behavioral-research-involving-animal-models/) - Since several months, there is a Working Group of the Advisory Committee to the NIH Director (ACD) that is charged with assessing and making recommendations to enhance the reproducibility and rigor of animal research by improving experimental design, optimizing translational validity, enhancing training, and increasing the transparency of research studies involving animal models (LINK).The recording
- [Funding opportunities: Accelerating Publication of Parkinson’s Disease Replication Data](https://paasp.net/funding-opportunities-accelerating-publication-of-parkinsons-disease-replication-data/) - To address the bias toward the publication of novel positive results, The Michael J. Fox Foundation for Parkinson’s Research (MJFF) and the Journal of Parkinson’s Disease (JPD) invite researchers to “open their notebooks” and submit unpublished results from experiments that attempted to replicate previously published findings from other laboratories.By encouraging the rapid peer-review and publication
- [The Global Preclinical Data Forum, Cohen Veterans Bioscience and ECNP announced the Winner of the 2020 Best Negative Data Prize](https://paasp.net/the-global-preclinical-data-forum-cohen-veterans-bioscience-and-ecnp-announced-the-winner-of-the-2020-best-negative-data-prize/) - The Global Preclinical Data Forum (GPDF), a jointly sponsored U.S. and European initiative, funded by Cohen Veterans Bioscience (CVB) and the European College of Neuropsychopharmacology (ECNP), has announced the winner of the 2020 “Best Negative Data Prize”. The prize was awarded to the researcher or research group whose neuroscience study best exemplifies data where the
- [Guidelines for target validation published](https://paasp.net/guidelines-for-target-validation-published/) - The GOT-IT team, consisting of researchers from the Fraunhofer Institute, Charité and PAASP, announces the publication of their guidelines for target validation in Nature Reviews Drug Discovery today. The guidelines are also introduced on the GOT-IT project web page and are useful for any research team conducting translational research and ultimately aiming to develop a new drug. In addition, the
- [The Rigor and Transparency Index Quality Metric for Assessing Biological and Medical Science Methods](https://paasp.net/the-rigor-and-transparency-index-quality-metric-for-assessing-biological-and-medical-science-methods/) - Some causes for the problem of not being able to reproduce the work of others can be addressed when publishing scientific articles by the adherence to rigor and reproducibility criteria, implemented via checklists at various journals. Menke et al. developed an automated tool (SciScore) that evaluates research publications based on their adherence to key rigor
- [Negative Data Award 2021](https://paasp.net/negative-data-award-2021/) - Cohen Veterans Bioscience and ECNP announced on March 8th the "Negative Data Award 2021. Applicants are asked to submit a published article showing valid and robust experiments disproving unexpectedly a previous hypothesis. More information and the requirements how to submit a research article by April 30th can be found HERE.
- [Questionable data in neurodegeneration research: A coincidence?](https://paasp.net/questionable-data-in-neurodegeneration-research-a-coincidence/) - If you have not read the book “Doctored” by Charles Piller (here), you may want to have a look at the last few paragraphs of the Alzforum post (here). For whatever reason (if someone could explain to us, we would be very happy), most of such publicly known cases of questionable research originate from the neurodegeneration
- [The roots of education are bitter, but the fruit is sweet](https://paasp.net/the-roots-of-education-are-bitter-but-the-fruit-is-sweet/) - Thus spoke Aristotle … and so did we when launching the online course on Good Research Practice in summer 2025 that is based on numerous courses, workshops and seminars given by us and our colleagues to young scientists live and online since 2017. In Germany and other countries, and requested by learned societies, graduate schools
- [Research rigor: Balancing harms and benefits](https://paasp.net/research-rigor-balancing-harms-and-benefits/) - Can quality be harmful? As surprising as it may sound to some of us, there are many examples when more rigorous research practices are perceived as potentially harmful. For example, designing and executing a study with adequate protection against risks of bias may reduce our chances to get “positive” results that, in turn, reduces the chances
- [Campfire Session on Research Quality at ECNP 2025](https://paasp.net/campfire-session-on-research-quality-at-ecnp-2025-2/) - At the ECNP Congress in Amsterdam, Anton Bespalov and Arnoud Herremans (PAASP and Y47 Consultancy) gathered researchers around a campfire to reflect on a shared challenge: how to achieve reliable, robust, and reproducible data. In small groups, participants explored questions like What does good research quality mean to you? and What gets in the way? The conversations revealed that data quality is more
- ['Don't shoot the dog!'](https://paasp.net/dont-shoot-the-dog/) - Behavioral scientists know very well how to train humans and animals to perform a desired response and how to avoid behaviors that are not needed. Why do we then not ask behavioral scientists to help us develop strategies that will eliminate unwanted behaviors leading to research publications of low or uncertain quality and replace them
- [Glyphosate is back!](https://paasp.net/glyphosate-is-back/) - Glyphosate is a widely used broad-spectrum, nonselective herbicide. Over the years, we have followed the controversial discussions on its safety for humans (here is what Christoph wrote back in 2017). And there is a new turn in this story! In 2017, a lawsuit uncovered internal emails from chemical giant Monsanto suggesting its employees helped ghostwrite an influential paper
- [May the laughter help us!](https://paasp.net/may-the-laughter-help-us/) - In science, the most (in)famous dichotomy is created by p
- [The iRISE project: New labs established EQIPD Quality System](https://paasp.net/the-irise-project-new-labs-established-eqipd-quality-system/) - The iRISE project (Improving Reproducibility in Science), launched in September 2023 and funded by the European Union for three years, takes an integrated approach to understanding, investigating, and guiding strategies to address irreproducibility in research. Rather than focusing on a single cause or solution, the consortium looks at different points in the research process and examines how
- [Good Research Practice: Why not?](https://paasp.net/good-research-practice-why-not/) - This is indeed the central theme of the current newsletter and this has been the central theme in our discussions with numerous stakeholders over the past 10 years. We need evidence that quality matters (do you remember this video?). There are of course several excellent meta-research publications (e.g., here), but these are either not widely known or
- [Quality management initiatives: Economic perspective](https://paasp.net/quality-management-initiatives-economic-perspective/) - In July 2025, the U.S. FDA published a white paper on how strategic investments in quality management initiatives in the pharmaceutical sector have the potential to yield returns for companies and for public health (here). The primary focus of this white paper is on pharmaceutical companies and manufacturing. However, this perspective is also highly relevant
- [DRIVER: Design and reporting of in vitro experiments](https://paasp.net/driver-design-and-reporting-of-in-vitro-experiments/) - The RIVER project - originally standing for Reporting In Vitro Experiments Responsibly - was launched in order to improve reporting standards and transparency in in vitro research. The goal was to develop a clear set of recommendations that researchers could follow when reporting in vitro experiments, analogous to the ARRIVE guidelines used for animal studies.
- [Assessment of benefit of animal research](https://paasp.net/assessment-of-benefit-of-animal-research/) - Unless and until we have validated non-animal alternative methods available for routine use, the involvement of animals in research is required for scientific and health advances. This is one of the main benefits of applying adequate research rigor to design and conduct of experiments – i.e., not only saving but also making the best possible
- [Scientist.com: Supporting EQIPD](https://paasp.net/scientist-com-supporting-eqipd/) - Contributed by Matt McLoughlin (Senior Vice President | Compliance & Categories) As the industry-leading solution for scientific outsourcing, Scientist.com connects over 140 biopharmaceutical companies—including 25 of the top 30—with a global network of thousands of suppliers. A key pillar of our ecosystem is our commitment to data integrity and quality and we have expanded this via our
- [Valuable resource: Sex as a biological variable](https://paasp.net/valuable-resource-sex-as-a-biological-variable/) - Several years ago, we were part of an NIH-funded consortium that developed training materials to provide practical guidance to preclinical researchers on incorporating sex as a biological variable into their current and future research. Due to the organizational changes at Cohen Veterans Bioscience, these resources are now hosted by PAASP:
- [EQIPD Toolbox: Keeping Quality Resources Updated](https://paasp.net/eqipd-toolbox-keeping-quality-resources-updated/) - The Guarantors of EQIPD have recently formed several working groups to update and expand the EQIPD wiki, which offers a wide range of practical information and guidance on quality in research. Keeping this resource current is an important part of supporting better, more transparent research practice. In parallel, the EQIPD stakeholder group continues to grow. This
- [To ARRIVE or not: Ticking (wrong) boxes](https://paasp.net/to-arrive-or-not-ticking-wrong-boxes/) - Every now and then we read publications stating that experiments “were conducted according to ARRIVE guidelines”. In most cases, such statements suggest that authors may not be too familiar with what ARRIVE guidelines are. Would you not come to the same conclusion just by reading this paragraph below? If you do not know what ARRIVE guidelines are,
- [Announcement: Quality management workshop](https://paasp.net/announcement-quality-management-workshop/) - Organized by the EXCELSciOR project, GoEQIPD’s deputy René Bernard is conducting a full day Quality Management Workshop on January 29, 2026 at the University of Coimbra: Link to Excelsior-Workshop The aim of this hands-on event is to help academic researchers to turn “quality thinking” into an everyday practice. Through interactive exercises, process mapping, and real
- [Ten years later: Are we there yet?](https://paasp.net/ten-years-later-are-we-there-yet/) - PAASP was founded in November 2015 to provide services related to rigor in nonregulated biomedical research - with a mission to improve the probability of translating preclinical discoveries into safe and effective medications. PAASP was the first to start offering this service to academic and industry, public and private funders. And, we believe, PAASP may
- [What does the Net Present Value have to do with preclinical drug discovery research?](https://paasp.net/what-does-the-net-present-value-have-to-do-with-preclinical-drug-discovery-research/) - When looking for Investors in the Life Science sector, entrepreneurial scientists and start-up companies have to deal with an unavoidable questions: ‘What is actually the appropriate valuation of my idea or business?’ Venture capitalists may hesitate investing in biotechnology if bioentrepreneurs fail to provide or accept realistic estimates of the value of their technologies. One
- [Glyphosate and the importance of transparent reporting](https://paasp.net/glyphosate-and-the-importance-of-transparent-reporting/) - Glyphosate, or N-(phosphonomethyl)glycine, is a widely used broad-spectrum, nonselective herbicide that has been in use since 1974. Glyphosate effectively suppresses the growth of many species of trees, grasses, and weeds. It acts by interfering with the synthesis of the aromatic amino acids phenylalanine, tyrosine, and tryptophan, through the inhibition of the enzyme 5-enolpyruvylshikimate-3-phosphate synthase (EPSPS).
- [Why sex as a biological variable matters in preclinical research](https://paasp.net/why-sex-as-a-biological-variable-matters-in-preclinical-research/) - Treating sex as a biological variable means planning and reporting studies in a way that results are informative for both sexes. Preclinical work historically relied on single sex designs, which can conceal differences in disease mechanisms and treatment response. Funders now expect researchers to factor sex into design, analysis, and reporting, a shift exemplified by
- [Launching the Online Good Research Practice Course](https://paasp.net/launching-the-online-good-research-practice-course/) - “The roots of education are bitter, but the fruit is sweet.” — Aristotle Almost ten years after delivering our first in-person training, and following three years of continuous development and iterative testing, we are proud to announce the launch of the online Good Research Practice (GRP) course — now freely accessible to everyone in the scientific community. The
- ["Why not?" a presentation to the VICT3R consortium](https://paasp.net/why-not-a-presentation-to-the-vict3r-consortium/) - Anton Bespalov presented a webinar "Rigor in preclinical ​drug discovery research:​ Why not?​" for the VICT3R consortium. This webinar took a critical look at the origins and consequences of low rigor in preclinical studies and dived into practical barriers that prevent or slow down the adoption of essential practices like randomization and blinding. With experience
- [Campfire Session on Research Quality at ECNP 2025](https://paasp.net/campfire-session-on-research-quality-at-ecnp-2025/) - At the ECNP Congress in Amsterdam, Anton Bespalov and Arnoud Herremans (PAASP and Y47 Consultancy) gathered researchers around a campfire to reflect on a shared challenge: how to achieve reliable, robust, and reproducible data. In small groups, participants explored questions like What does good research quality mean to you? and What gets in the way? The conversations revealed that data quality is more
- [Presenting at the French Center for 3Rs](https://paasp.net/presenting-at-the-french-center-for-3rs/) - Björn Gerlach recently contributed to the webinar “Enhancing Quality in Preclinical Data – EQIPD”, hosted by the FC3R initiative. The session explored how the EQIPD Quality System provides a practical framework for improving transparency, reliability, and reproducibility in preclinical research. A central theme of the discussion was how structured quality practices also advance the 3Rs — by reducing unnecessary studies,
- [Improving Research Quality in Core Facilities](https://paasp.net/improving-research-quality-in-core-facilities/) - In September 2025, PAASP conducted a dedicated workshop in Italy designed to support Core Facility (CF) staff in strengthening research quality and integrity. Through interactive discussions, case studies, and practical exercises, participants were able to explore the specific challenges faced by CFs and learned how to apply EQIPD Quality System to their daily work. The
- [PAASP is now on Mastodon!](https://paasp.net/paasp-is-now-on-mastodon/) - We’re excited to join the Mastodon community. Follow us to explore and discuss topics around research reproducibility, preclinical quality, and translational science. We’ll share insights, resources, and reflections from our ongoing work to improve research practices across disciplines. 🔗 Link to Reproducibility Social
- [Workshop for the Network Italiano Core Facility](https://paasp.net/workshop-for-the-network-italiano-core-facility/)
- [Upcoming Webinar: Financing of biomedical innovation](https://paasp.net/upcoming-webinar-financing-of-biomedical-innovation/) - January, 31st, 2025 | Hosted by ECNP Preclinical Data Forum Network With recent high-profile misconduct cases—like that of Eliezer Masliah—raising concerns about research integrity, how can we ensure funding goes to the most reliable and robust projects? Join this exclusive webinar to learn how sponsors can separate solid science from shaky claims when financing biomedical innovation. Experts from GoEQIPD, CAMARADES, and PAASP will share practical strategies on:
- ["Publication of negative/null results discussed at NIH"](https://paasp.net/publication-of-negative-null-results-discussed-at-nih/) - NINDS Office of Research Quality has presented a proposal on how to address the publication bias. It can be watched HERE (starts at ~1:17): We were a bit surprised that preregistration was not discussed until a Q&A session (at ~1:53:17): On the one hand, we agree that preregistration always come with an extra effort and preregistered reports require
- ["The customer is king!" ](https://paasp.net/the-customer-is-king/) - Once during our vacation in Greece, our children asked for ice cream after having dinner. When the waiter was asked about ice cream, he ran to the neighboring ice cream stand and bought ice cream for us. Yes, there was no ice cream on the menu but the customer must be satisfied (and we indeed
- ["Hold your horses!"](https://paasp.net/hold-your-horses/) - Risk of Alzheimer’s disease nearly doubles in older adults with Covid-19! Like many of you, several weeks ago we have also been alerted by such headlines seen across multiple lay and semi-professional media (e.g., LINK). We have retrieved the original paper (LINK) that claimed to provide evidence and that indeed made a clear statement in the
- ["The Steal syndrome - or the FDA Modernization Act to end animal testing requirement passes U.S. Senate"](https://paasp.net/the-steal-syndrome-or-the-fda-modernization-act-to-end-animal-testing-requirement-passes-u-s-senate/) - On September 29, 2022, the U.S. Senate passed the FDA Modernization Act 2.0, S.5002, by unanimous consent. While it is unclear whether a companion bill introduced in the U.S. House of Representatives will successfully pass, allowing the legislation to become law, if enacted, this could curb animal testing in the coming years. One of the sponsors
- [Additional reads in November 2022](https://paasp.net/additional-reads-november-2022/) - Further commentaries, articles and blog posts worth reading: Without appropriate metadata, data-sharing mandates are pointless Research funders and the promotion of quality in research: From principles to practice Be Prospective, Not Retrospective: A Philosophy for Advancing Reproducibility in Modern Biological Research A proposal for data-sharing that discourages p-hacking Could machine learning fuel a reproducibility crisis
- [Observing Many Researchers Using the Same Data and Hypothesis Reveals a Hidden Universe of Uncertainty](https://paasp.net/observing-many-researchers-using-the-same-data-and-hypothesis-reveals-a-hidden-universe-of-uncertainty/) - Most discussions of reliability problems in science focus on systematic biases. In this article, Nate Breznau and colleagues broaden the lens to include conscious and unconscious decisions that researchers make during data analysis and that may lead to diverging results. The authors coordinated 161 researchers in 73 research teams and observed their research decisions as
- [AI-enabled image fraud in scientific publications](https://paasp.net/ai-enabled-image-fraud-in-scientific-publications/) - Destroying image integrity in scientific papers may result in serious consequences. Inappropriate duplication and fabrication of images are two common misconducts in this aspect. The rapid development of artificial-intelligence technology has brought to us promising image-generation models that can produce realistic fake images. In this article, Jinjin Gu and colleagues show that such advanced generative
- [Cell line authentication: a necessity for reproducible biomedical research](https://paasp.net/cell-line-authentication-a-necessity-for-reproducible-biomedical-research/) - Immortalized or continuous cell lines are invaluable tools in basic and preclinical research. However, the widespread use of misidentified cell lines is a serious threat to scientific reproducibility. Based on the experiences of mandatory cell line authentication at the International Journal of Cancer (IJC), Nicole Y Souren and colleagues provide an overview of the issues
- [Finding the best fit for improving reproducibility: reflections from the QUEST Center for Responsible Research](https://paasp.net/finding-the-best-fit-for-improving-reproducibility-reflections-from-the-quest-center-for-responsible-research/) - Increasing the reproducibility and trustworthiness of biomedical research requires engaging stakeholders from all levels in an institutional setting. The QUEST Center for Responsible Research aims to develop and implement new approaches to improve the culture and practice of research, tailored to the needs of these stakeholders. Natascha Drude and colleagues of the QUEST Center organised
- [Is the future of peer review automated? ](https://paasp.net/is-the-future-of-peer-review-automated/) - The rising rate of preprints and publications, combined with persistent inadequate reporting practices and problems with study design and execution, have strained the traditional peer review system. Automated screening tools could potentially enhance peer review by helping authors, journal editors, and reviewers to identify beneficial practices and common problems in preprints or submitted manuscripts. Tools
- [Designing and implementing a research integrity promotion plan: Recommendations for research funders](https://paasp.net/designing-and-implementing-a-research-integrity-promotion-plan-recommendations-for-research-funders/) - Various stakeholders in science have put research integrity high on their agenda. Among them, research funders are prominently placed to foster research integrity by requiring that the organizations and individual researchers they support make an explicit commitment to research integrity. Moreover, funders need to adopt appropriate research integrity practices themselves. To facilitate this, the authors
- [Citation counts and journal impact factors do not capture some indicators of research quality in the behavioural and brain sciences](https://paasp.net/citation-counts-and-journal-impact-factors-do-not-capture-some-indicators-of-research-quality-in-the-behavioural-and-brain-sciences/) - Citation data and journal impact factors are important components of faculty dossiers and figure prominently in both promotion decisions and assessments of a researcher’s broader societal impact. Although these metrics play a large role in high-stakes decisions, the evidence is mixed about whether they are strongly correlated with indicators of research quality. In this article,
- [Many researchers were not compliant with their published data sharing statement: mixed-methods study](https://paasp.net/many-researchers-were-not-compliant-with-their-published-data-sharing-statement-mixed-methods-study/) - The objective of the study was to analyze researchers’ compliance with their data availability statement (DAS) from manuscripts published in open-access journals with the mandatory DAS. To achieve this, Mirko Gabelica and colleagues collected all articles from 333 open-access journals published during January 2019 by BioMed Central. Of 3556 analyzed articles, 3416 contained the DAS.
- [Plea for a Simple But Radical Change in Scientific Publication: To Improve Openness, Reliability, and Reproducibility, Let’s Deposit and Validate Our Results before Writing Articles](https://paasp.net/plea-for-a-simple-but-radical-change-in-scientific-publication-to-improve-openness-reliability-and-reproducibility-lets-deposit-and-validate-our-results-before-writing-articles/) - In this article, Jean-Antoine Girault proposed a simple change in the way scientists publish their findings to improve reliability and reproducibility of scientific results: First, scientists deposit their positive or negative results in a database [“deposited results,” (DRs)], including detailed materials, methods, raw data, analysis, and processed results. The DRs are technically reviewed and validated
- [RRID for the EQIPD Quality System](https://paasp.net/rrid-for-the-eqipd-quality-system/) - The EQIPD Quality System has now an RRID from SciCrunch: SCR_022729. This is another step forward for providing possibilities for users to reference the quality system and embedding the system into the scientific landscape.
- [Considerations for implementing electronic laboratory notebooks in an academic research environment](https://paasp.net/considerations-for-implementing-electronic-laboratory-notebooks-in-an-academic-research-environment/) - Stuart Higgins and colleagues describe in this review article the use of electronic laboratory notebooks (ELN) from different perspectives. First, they analysed the ELN landscape by looking into the lifetime of 172 ELNs and found that the average lifetime of an ELN is around 7 years. Which doesn’t seem to be long considering that the
- [Blind spots on western blots: a meta-research study highlighting opportunities to improve figures and methods reporting](https://paasp.net/blind-spots-on-western-blots-a-meta-research-study-highlighting-opportunities-to-improve-figures-and-methods-reporting/) - Western blotting is a standard laboratory method used to detect proteins and assess their expression levels. Unfortunately, poor western blot image display practices and a lack of detailed methods reporting can limit a reader’s ability to evaluate or reproduce western blot results. While several groups have studied the prevalence of image manipulation or provided recommendations
- [Do multiple experimenters improve the reproducibility of animal studies?](https://paasp.net/do-multiple-experimenters-improve-the-reproducibility-of-animal-studies/) - In light of the reproducibility crisis, there is a growing awareness that the rigorous standardization of experimental conditions may contribute to poor reproducibility of animal studies. Instead, systematic heterogenization has been proposed as a tool to enhance reproducibility, but a real-life test across multiple independent laboratories is still pending. The aim of this published study
- [Testing the reproducibility and robustness of the cancer biology literature by robot](https://paasp.net/testing-the-reproducibility-and-robustness-of-the-cancer-biology-literature-by-robot/) - Scientific results should be reproducible and robust. However, when reproducibility is tested, it is often not found (often termed ’reproducibility crisis’), and it is one the most important issues facing biomedicine. This crisis would be solved if it were possible to automate reproducibility testing. In this article, Katherine Roper and colleagues describe the semi-automated testing
- [What has preclinical systematic review ever done for us?](https://paasp.net/what-has-preclinical-systematic-review-ever-done-for-us/) - Systematic reviews and meta-analyses deliver a crystallized understanding of the existing research data in any given space. However, grappling with the literature needed for such analyses is becoming increasingly difficult as the number of publications grows. In addition, the quality of much preclinical research and resulting publications is inadequate and questions the relevance and usefulness
- [Reanalysis: the forgotten sibling of reproducibility and replicability](https://paasp.net/reanalysis-the-forgotten-sibling-of-reproducibility-and-replicability/) - Ensuring reproducibility and replicability has been an issue in many scientific disciplines in the past decade. In this commentary, Matthew Faria and colleagues discuss another ‘R’ - reanalysis. Reanalysis is based on scientists/authors providing sufficient experimental description and data so that researchers can apply new analysis methods to provided data and may (or may not)
- [Preregistration of animal research protocols: development and 3-year overview of preclinicaltrials.eu](https://paasp.net/preregistration-of-animal-research-protocols-development-and-3-year-overview-of-preclinicaltrials-eu/) - Although commonly acknowledged and applied in clinical research since 2000, preregistration of animal studies is not yet the norm. In 2018 the authors launched the first dedicated, open, online register for animal study protocols: www.preclinicaltrials.eu. In this article, the author provide insight in the development of preclinicaltrials.eu (PCT) and evaluate its use during the first
- [Bringing microscopy images to the next level](https://paasp.net/bringing-microscopy-images-to-the-next-level/) - In this Nature Methods issue, the global microscopy community presented comprehensive efforts to improve reporting and reproducibility of microscopy images. Articles of this issue focused on approaches for reporting metadata, e.g. minimal reporting guidelines (REMBI: Recommended Metadata for Biological Images), and provide practical approaches on how to achieve this. Over 260 community members came together as
- [“Blinding in histopathology assessments - I see your point but…”](https://paasp.net/blinding-in-histopathology-assessments-i-see-your-point-but/) - We strongly believe that, in most cases, preclinical in vivo studies conducted without adequate protection against risks of bias (i.e., underpowered, without randomization, blinding, and pre-specified hypothesis and data analysis) are likely to generate results with little or no value irrespective of the financial, time and labor costs invested. Yet, we do agree that there are situations when judgement is
- [“Serial de-risking”: Quod licet Iovi non licet bovi?](https://paasp.net/serial-de-risking-quod-licet-iovi-non-licet-bovi/) - When it comes to novel therapies, positive data has justifiably more value than negative or null data. Indeed, positive data promises therapeutic benefit to patients in need and financial profit to those who advance such new therapy. Even with long drug development timelines, positive data even from early-stage clinical trials often has an immediate impact
- [Archimedes‘ fulcrum and the “reproducibility” debate](https://paasp.net/archimedes-fulcrum-and-the-reproducibility-debate/) - We like to cite Dorothy Bishop who wrote several years ago: “We know how to formulate and test hypotheses in controlled experiments. We can account for unwanted variation with statistical techniques. We appreciate the need to replicate observations. Yet many researchers persist in working in a way almost guaranteed not to deliver meaningful results (REF)".
- [EQIPD / PAASP Newsletter December 2024](https://paasp.net/eqipd-paasp-newsletter-december-2024/) - Dear Colleagues and Friends, Welcome to the PAASP / EQIPD newsletter issue no. 49! This issue includes: News: Good Research Practice online course Webinar: Financing of biomedical innovation: Learning to separate the wheat from the chaff Thinking aloud: Imagine … Upcoming symposium: Assessment of benefit of animal research Proposal: Intentional misconduct or too busy to
- [Intentional misconduct or too busy to oversee the lab? ](https://paasp.net/intentional-misconduct-or-too-busy-to-oversee-the-lab/) - The recent scientific misconduct in the laboratories of Eliezer Masliah is not the first such case and will unfortunately most likely not be the last one. From what was publicly disclosed, it is not clear to what extent (if at all) Dr. Masliah himself was aware of the misconduct and whether he directly contributed to
- [Webinar: Financing of biomedical innovation: Learning to separate the wheat from the chaff ](https://paasp.net/webinar-financing-of-biomedical-innovation-learning-to-separate-the-wheat-from-the-chaff/) - The misconduct case of Eliezer Masliah highlights once again existing challenges in allocating capital to projects with the most robust and reliable supporting data. Sponsors of biomedical innovation appear not to know how to identify biased research. Some areas of biomedical innovation may be particularly affected by investors betting on wrong horses. For example, we
- [Upcoming symposium: Assessment of benefit of animal research ](https://paasp.net/upcoming-symposium-assessment-of-benefit-of-animal-research/) - It is generally recognized that, to produce robust and reliable data, research must be protected against bias. There are various measures introduced, from training programs to reporting guidelines, to make sure that “exploratory” and “confirmatory” research output (Dirnagl 2020) can be recognized on the basis of information provided in scientific publications and other reports. However,
- [Update: EU-Funded Project at GoEQIPD is Progressing ](https://paasp.net/update-eu-funded-project-at-goeqipd-is-progressing/) - The Guarantors of EQIPD are involved in the EU-funded iRISE project (Improving Reproducibility in Science) and are conducting two studies on the EQIPD Quality System. The first study focuses on EQIPD-certified research units, where interviews and surveys will assess the impact of the quality system. The second study involves a survey within the broader research community. This
- [Commentary: What if … ](https://paasp.net/commentary-what-if/) - Several years ago we discussed potential scenarios related to the outcome of Cassava’s Phase 3 program. To remind our readers, concerns were repeatedly expressed over the quality of studies conducted by Cassava Sciences with its lead drug simufilam (here here). If these studies were to fail, we would have a telling example about the negative
- [Imagine...](https://paasp.net/imagine/) - … you go to a supermarket or a grocery store, buy everything you need, pay at the cashier’s but leave all your purchase in the store, come home, save the receipt for the end-of-the-month accounting and move on as if this is how it should be. In 2017-2021, PAASP was part of the EQIPD consortium
- [Good Research Practice in biomedical research](https://paasp.net/good-research-practice-in-biomedical-research/) - PAASP developed a unique online course on Good Research Practices. Beta testing is concluded and the updated course will be released soon. Please stay tuned! Course Description The course aims to teach students, postdocs and other early-career professionals a set of behaviors known as Good Research Practice that help us to: Design experiments that can
- [New series of EQIPD lectures](https://paasp.net/new-series-of-eqipd-lectures/) - EQIPD has prepared and recorded a series of lectures introducing its novel Quality System. In these presentations, project coordinator Professor Malcolm Macleod provides the background on why the EQIPD quality system is needed and for whom it is important. He also talks about the benefits of implementing such a system in a research lab. The first video:
- [EQIPD helps to define quality expectations for Industry-Academia collaborations](https://paasp.net/eqipd-helps-to-define-quality-expectations-for-industry-academia-collaborations/) - Sandrine Bongiovanni and Mathias Baumann (Novartis), Fiona Ducrey (Sanofi), Thomas Steckler and Anja Gilis (Janssen), Anton Bespalov (PAASP), Lee Monk (UCB), René Bernard (Charité) and Malcolm Macleod (University of Edinburg) worked together to develop a concise document which defines key expectations towards quality for collaborations between industry and academia.This document is free for use by
- [PREMOS - a new collaboration project involving EQIPD](https://paasp.net/premos-a-new-collaboration-project-involving-eqipd/) - In 2018, the EU has launched the European Brain Research Area (EBRA) project – a catalysing platform designed to coordinate brain research in Europe and to develop and support global initiatives in this area.In February 2021, EBRA introduced a new cluster activity - called PREMOS - to complement its efforts.Within PREMOS, team members from EQIPD will join
- [Presentation at the BioRN Lounge by Martin Michel](https://paasp.net/presentation-at-the-biorn-lounge-by-martin-michel/) - PAASP is a member of the science and industry cluster BioRN focusing on the Rhein-Neckar area. The cluster has a get-together with presentations every last Tuesday of the month and the kick-off of the BioRN Lounge in 2021 was made by PAASP’s Martin Michel. Martin talked about research rigor and data integrity, also presenting the EQIPD
- [2024 Best Negative Data Prize in Preclinical Neuroscience](https://paasp.net/2024-best-negative-data-prize-in-preclinical-neuroscience/) - The Global Preclinical Data Forum, in collaboration with Cohen Veterans Bioscience, the Partnership for Assessment and Accreditation of Scientific Practice (PAASP) and the European College of Neuropsychopharmacology (ECNP), announce the opening of submissions for the 2024 Best Negative Data Prize in Preclinical Neuroscience. The primary aim of the prize, which was first awarded in 2018,
- [Don't throw the baby out with the bathwater](https://paasp.net/dont-throw-the-baby-out-with-the-bathwater/) - The pressure to replace animal research with non-animal methods is growing. Earlier this year, NIH has issued a “Request for Information on Catalyzing the Development and Use of Novel Alternative Methods to Advance Biomedical Research” (LINK) and there is no doubt that new funding initiatives will follow in the near future. In a similar vein,
- [Newsletter December 2023](https://paasp.net/newsletter-december-2023/) - Welcome to the EQIPD/PAASP Newsletter! We wish all our readers, supporters, colleagues and friends a wonderful Holiday Season and a great start into the New Year! Highlights of this issue include: News Good Research Practice online course - Read more GoEQIPD is a partner in the iRISE research project - Read more Join the GoEQIPD society - Read more EQIPD Webinar
- [Sex as a biological variable in preclinical research:  Unforeseen and abused degree of freedom ](https://paasp.net/sex-as-a-biological-variable-in-preclinical-research-unforeseen-and-abused-degree-of-freedom/) - In many fields of biomedical research, in vivo studies traditionally involved the use of male subjects. The situation recently started to change due to both the research community recognizing the negative consequences of omitting female subjects and the clear guidance from funding agencies such as the US National Institutes of Health to include both sexes
- ["Home inspections” for life sciences companies going public before clinical proof of concept](https://paasp.net/home-inspections-for-life-sciences-companies-going-public-before-clinical-proof-of-concept/) - For over a decade, there is a trend of less specialized investment firms and public equity investors betting on life sciences companies with high-risk programs without clinical proof-of-concept. This area of investment was previously targeted by investors with knowledge and resources to assess the risks based on adequately planned and performed due diligence. Our analysis
- [Additional Reads in December 2023](https://paasp.net/additional-reads-in-december-2023/)
- [Effects of ketamine optical isomers, fluoxetine and naloxone on timing in differential reinforcement of low-rate response (DRL) 72-s task in rats](https://paasp.net/effects-of-ketamine-optical-isomers-fluoxetine-and-naloxone-on-timing-in-differential-reinforcement-of-low-rate-response-drl-72-s-task-in-rats/) - This is one of the first publications reporting the results of original research performed in an EQIPD-certified laboratory. This study was conducted in the Department of Behavioral Neuroscience and Drug Development (Head: Professor Piotr Popik). The EQIPD Quality System ensures the implementation of critical quality measures according to EQIPD expectations (like carefully designing the study
- [Systematic assessment of the replicability and generalizability of preclinical findings: Impact of protocol harmonization across laboratory sites](https://paasp.net/systematic-assessment-of-the-replicability-and-generalizability-of-preclinical-findings-impact-of-protocol-harmonization-across-laboratory-sites/) - The influence of protocol standardization between laboratories on their replicability of preclinical results has not been addressed in a systematic way. While standardization is considered good research practice as a means to control for undesired external noise (i.e., highly variable results), some reports suggest that standardized protocols may lead to idiosyncratic results, thus undermining replicability.
- [A qualitative study of the barriers to using blinding in in vivo experiments and suggestions for improvement](https://paasp.net/a-qualitative-study-of-the-barriers-to-using-blinding-in-in-vivo-experiments-and-suggestions-for-improvement/) - In animal experiments, blinding is a methodological strategy to reduce the risk that scientists, animal care staff, or other staff involved in the research may consciously or subconsciously influence the outcome. Lack of masking has been shown to correlate with an overestimation of treatment efficacy and false positive findings. The authors conducted exploratory interviews across
- [Recommendations to improve use and reporting of statistics in animal experiments](https://paasp.net/recommendations-to-improve-use-and-reporting-of-statistics-in-animal-experiments/) - Flaws in experimental statistics are a major contributor to the poor reproducibility of animal experiments. Informed decisions about whether conclusions are justified requires clear reporting of experimental data and the statistical methods used to analyse them. When data are misinterpreted, manipulated or concealed to generate publications, it creates an illusion that chance observations are robust
- [Co-creating Research Integrity Education Guidelines for Research Institutions](https://paasp.net/co-creating-research-integrity-education-guidelines-for-research-institutions/) - To support institutions to foster research integrity (RI), Krishma Labib and colleagues developed RI education guidelines together with RI experts and research administrators, exploring similarities and differences in recommendations across target groups, as well as recommendations about RI education using approaches other than formal RI training. The authors used an iterative co-creative process and conducted
- [Advanced methods and implementations for the meta-analyses of animal models: Current practices and future recommendations](https://paasp.net/advanced-methods-and-implementations-for-the-meta-analyses-of-animal-models-current-practices-and-future-recommendations/) - Meta-analytic techniques have been widely used to synthesize data from animal models of human diseases and conditions, but these analyses often face two statistical challenges due to complex nature of animal data (e.g., multiple effect sizes and multiple species): statistical dependency and confounding heterogeneity. These challenges can lead to unreliable and less informative evidence, which
- [Designing, conducting, and reporting reproducible animal experiments](https://paasp.net/designing-conducting-and-reporting-reproducible-animal-experiments/) - In this review, Emma Wilson and colleagues aim to engage researchers in the discussion on research reproducibility and to provide the tools necessary to increase the reproducibility of their research. The authors first highlight the causes and potential impact of non-reproducible research and emphasise the benefits of working reproducibly for the researcher and broader research
- [Is N-Hacking Ever OK?](https://paasp.net/is-n-hacking-ever-ok-2/) - The consequences of collecting more data in pursuit of statistical significanceYou probably have encountered this: you did an experiment, observed a numerical effect with a size of presumed biological relevance, but the calculated p-value is higher than your threshold (usually ≥0.05). This is an inconclusive experiment because you can neither conclude that there is an
- [EQIPD Webinar series 2023](https://paasp.net/eqipd-webinar-series-2023/) - The GoEQIPD Webinar Series provided a foundation for best practices in preclinical research and how the EQIPD quality system can be used to help ensure rigor, robustness and reproducibility in generating, interpreting and publishing findings. Speakers highlighted EQIPD’s role in different parts of the scientific ecosystem with a focus on best practices. Dr. Thomas Steckler
- [Join the GoEQIPD society](https://paasp.net/join-the-goeqipd-society/) - The GoEQIPD e.V. society was founded by former members of the EQIPD consortium in 2022 as the legacy organization for the IMI-funded EQIPD consortium. The goal of this society is to maintain all resources developed by the consortium – including the EQIPD Quality System. As of this year, interested persons and organizations can join the society and
- [GoEQIPD is a partner in the iRISE research project](https://paasp.net/goeqipd-is-a-partner-in-the-irise-research-project/) - The Guarantors of EQIPD (GoEQIPD) are delighted to be involved in the iRISE consortium, funded by the EU Horizon program. The iRISE project (short for “improving Reproducibility in SciencE”) will bring together experts to understand the causes of low levels of reproducibility and to identify effective solutions to increase reproducibility. More information can be found on the consortium website.GoEQIPD
- [Good Research Practice online course](https://paasp.net/good-research-practice-online-course/) - We are thrilled to announce that we have completed the development of our Good Research Practice online course and it will be launched in the coming weeks!This course aims at making students, post-docs and researchers familiar with the best practices in proper experimental design, data management and reporting as well as data analysis to make
- [R script: Sex as a biological variable in preclinical research](https://paasp.net/r-script-sex-as-a-biological-variable-in-preclinical-research/) - This is the script which is mentioned in the article HERE. library(ggplot2) sim = 1000 x1 = y1 = NULL for (n in c(16,32,64)) { p.values_all = p.values_sex = p.values_int = p.values_m = p.values_f = p.values_rep = p.values_neg = p.values_pos = NULL for (iteration in 1:sim) { p.value_now = NULL
- [Pre-study odds](https://paasp.net/pre-study-odds/) - One of the key themes in the 2005 seminal paper by John Ioannidis “Why most published research findings are false” is that positive predictive value of a study depends not only on power but even more so on prior odds of a study hypothesis being true. Therefore, if the prior odds are low, “surprising” results of
- [Newsletter November 2022](https://paasp.net/newsletter-november-2022/) - News "Aligned on Quality" meeting (Berlin, Oct 10th 2022) - Read more Launch of the “Research Quality Transparency” Tool - Read moreFederal Actions Needed to Promote Stronger Research Practices - Read moreA new GoEQIPD discussion room - Read moreRRID for the EQIPD Quality System - Read more Recent publications related to Good Research Practice - Read more Plea for a Simple But Radical Change in
- [A new GoEQIPD discussion room](https://paasp.net/a-new-goeqipd-discussion-room/) - The Guarantors of EQIPD plan to have an informal room for open conversations and discussions on the EQIPD quality system. The idea is to meet virtually from time to time to exchange ideas and thoughts on what needs to be improved and how we could address any issues and provide support. The first date is
- [Federal Actions Needed to Promote Stronger Research Practices](https://paasp.net/federal-actions-needed-to-promote-stronger-research-practices/) - The U.S. Government Accountability Office (GAO) was asked to review strategies to improve the reliability of federally funded research. In their report, GAO examines (1) what actions federal agencies could take to foster rigor and transparency in the research they fund; and (2) assesses the extent to which selected federal science funding agencies have taken actions to
- [Launch of the online version of the “Research Quality Transparency” Tool](https://paasp.net/launch-of-the-online-version-of-the-research-quality-transparency-tool/) - This tool was originally developed by an EQIPD Consortium Taskforce and is now implemented online with support from a SBIR award from the NIH. The tool creates a "snapshot" of the environment in which research is conducted in terms of implemented quality measures and is meant to help funders and applicants align on relevant quality
- ["Aligned on Quality" meeting (Berlin, Oct 10th 2022)](https://paasp.net/aligned-on-quality-meeting-berlin-oct-10th-2022/) - EQIPD and PAASP, together with colleagues from the QUEST Center and the Global Preclinical Data Forum, led a discussion on how to help funders and grant applicants align on research rigor expectations and avoid funding of research of unknown quality. We reviewed lessons learned from publicly funded programs (LADDER, GOT-IT, DECIDE) from the US and
- [Our study was conducted according to...](https://paasp.net/our-study-was-conducted-according-to/) - Over the past several years, more and more journals have revised their guides for authors and included specific instructions on information to be provided in the manuscripts – from animal welfare statements to various aspects of data analysis and study design. A paper by Horowitz et al. is a good illustration of the change triggered by these
- [EQIPD in different languages](https://paasp.net/eqipd-news-on-webpage/) - Besides this Newsletter, you will also find all relevant news and developments related to EQIPD on the EQIPD-website and in the EQIPD Toolbox. We will keep these websites up-to-date. To make it as convenient as possible for the global community to stay informed about EQIPD, PAASP Network colleagues have translated content into different languages:
- [EQIPD: PAASP’s contribution to the new Quality System for preclinical research](https://paasp.net/eqipd-paasps-contribution-to-the-new-quality-system-for-preclinical-research/) - EQIPD (European Quality In Preclinical Data) is a project that was funded by the Innovative Medicine Initiative with the vision to enable a smoother, faster and safer transition from preclinical to clinical testing by developing a new Quality System that will strengthen the robustness, rigor and validity of research data.Together with other project partners the team defined
- [Successful adaption of the EQIPD Quality System to specific research needs](https://paasp.net/successful-adaption-of-the-eqipd-quality-system-to-specific-research-needs/) - The EQIPD Quality System is the result of a collaborative effort between several people and organizations, yet it cannot address all potential scenarios under which research rigor measures are needed and will be implemented. The foundation laid by EQIPD is formulated in the “core requirements” and we welcome further efforts to support development of tools,
- [EQIPD-PAASP working relationship](https://paasp.net/eqipd-paasp-working-relationship/) - As an important step forward in the evolution of the EQIPD quality system for preclinical research, the Guarantors of EQIPD e.V and the PAASP Network are delighted to announce the launch of a joint effort to promote the EQIPD framework, to deliver and to further develop the EQIPD Quality System. We very much look forward to this next stage
- [The EQIPD Quality System was presented at the World Conference on Research Integrity](https://paasp.net/the-eqipd-quality-system-was-presented-at-the-world-conference-on-research-integrity/) - The World Conference on Research Integrity in 2022 happened in Cape Town, South Africa from May 29 to June 01. The packed program with over 150 presentations put the spotlight on research integrity from different angels and covered divers aspects of this topic from meta research to possible solutions for improvements. In one of the
- [The BioRN annual conference](https://paasp.net/the-biorn-annual-conference/) - The BIOtech network Rhein-Neckar (BioRN) held its annual (digitally) conference virtually on November 20th. The network brings together a mix of research organizations, industry and service providers.During the morning session, the focus was on specific research projects and technical innovations. This was followed by the poster session, where PAASP’s Björn Gerlach presented the EQIPD Quality System to
- [Meeting Report: Virtual FENS Regional Meeting 2021](https://paasp.net/meeting-report-virtual-fens-regional-meeting-2021/) - On 25 August 2021, at the Virtual FENS Regional Meeting, Anton Bespalov and Malgorzata Pietraszek (PAASP) moderated the Special Interest Event “How to maximize benefit from good research practice?”Efforts to enhance quality of research are often seen as a burden and are perceived as activities not bringing immediate benefits for scientists. Therefore, presenters from different
- [New EQIPD-certified research unit](https://paasp.net/new-eqipd-certified-research-unit/) - Concluding the pilot implementation efforts initiated by the EQIPD consortium team, the Department of Behavioral Neuroscience and Drug Development at the Maj Institute of Pharmacology, Polish Academy of Science (Head of Department: Prof. Piotr Popik) has implemented the EQIPD Quality System in their environment and was successfully assessed for compliance with EQIPD requirements. We congratulate Prof Popik
- [The EQIPD Framework](https://paasp.net/the-eqipd-framework/) - The EQIPD framework for rigor in the design, conduct, analysis, and documentation of animal experiments was published today. It defines the demands for five domains researchers should be aware of and the needs for them in research design and publications. https://www.nature.com/articles/s41592-022-01615-y
- [Many researchers were not compliant with their published data sharing statement: mixed-methods stud](https://paasp.net/many-researchers-were-not-compliant-with-their-published-data-sharing-statement-mixed-methods-stud/) - In this article, the authors analysed researchers’ compliance with their Data Availability Statement (DAS) from manuscripts published in open access journals with the mandatory DAS. Mirko Gabelica and colleagues selected 333 open-access journals published by BioMed Central and surveyed corresponding authors who wrote in the DAS that they would share the data. After accessing raw
- [Additional reads in June 2022](https://paasp.net/additional-reads-in-june-2022/) - European Journal of Behavior Analysis: women, men, and authorship Are there any good experiments that should not be done? ‘Robot scientist’ Eve finds that less than one third of scientific results are reproducible Nature journals raise the bar on sex and gender reporting in research​​​​​
- [Newsletter June 2022](https://paasp.net/newsletter-june-2022/) - News First International Society for Preclinical Research Quality Systems Launched - Read moreEQIPD-PAASP working relationship - Read more The EQIPD Quality System was presented at the World Conference on Research Integrity - Read more Recent publications related to Good Research Practice Bringing microscopy images to the next level - Read morePreregistration of animal research protocols: development and
- [First International Society for Preclinical Research Quality Systems Launched](https://paasp.net/first-international-society-for-preclinical-research-quality-systems-launched/) - The Guarantors of EQIPD e.V. (GoEQIPD) announce the formation of a registered association, registered in Heidelberg Germany, to host and to ensure the ongoing adoption of the EQIPD Quality System for preclinical research that can be applied in both the public and private sectors. The mission of the GoEQIPD is to keep these resources up to
- [The False Discovery Rate (FDR) – an important statistical concept](https://paasp.net/the-false-discovery-rate-fdr-an-important-statistical-concept/) - The p-value reports the probability of seeing a difference as large as the observed one, or larger, even if the two samples came from populations with the same mean value. However, and in contrast to a common perception, the p-value does not determine the probability that an observed finding is true! When conducting multiple comparisons
- [Partnership with GoEQIPD](https://paasp.net/partnership-with-goeqipd/) - The Guarantors of EQIPD and PAASP Network are delighted to announce the launch of a joint effort to promote the EQIPD framework, to deliver and to further develop the EQIPD Quality System. We very much look forward to this next stage in the EQIPD journey.
- [Newsletter March 2022](https://paasp.net/newsletter-march-2022/) - A snake, having made his hole close to the porch of a cottage, inflicted a severe bite on the cottager's infant son. The son subsequently died, to the great grief of his parents. The father resolved to kill the snake and the next day, on its coming out of its hole for food, took up
- [External validity in translational biomedicine: understanding the conditions enabling the cause to have an effect](https://paasp.net/external-validity-in-translational-biomedicine-understanding-the-conditions-enabling-the-cause-to-have-an-effect/) - A spectre is haunting biomedical research: It appears that a substantial fraction of published research results cannot be reproduced, while spectacularly successful novel treatments developed in experimental models of disease too often fail in clinical trials. A reproducibility crisis has been proclaimed, and bench-to-bedside translation appears to be lost in a “valley of death”. In
- [The past, present and future of Registered Reports](https://paasp.net/the-past-present-and-future-of-registered-reports-2/) - Registered Reports are a form of publication in which study proposals are peer reviewed and pre-accepted before research is undertaken. By deciding which articles are published based on the question, theory and methods, Registered Reports offer a remedy for a range of reporting and publication biases. In this article, Christopher Chambers and Loukia Tzavella reflect on the
- [The impact of methodology on the reproducibility and rigor of DNA methylation data](https://paasp.net/the-impact-of-methodology-on-the-reproducibility-and-rigor-of-dna-methylation-data/) - Research focusing on epigenetic modifications is a growing field in the neuroscience area. However, issues related to data reproducibility across laboratories remain. For example, separating meaningful experimental changes from background variability is a challenge in epigenomic studies. In this article, Detlev Boison and colleagues show that seemingly minor experimental variations, even under normal baseline conditions,
- [The MDAR (Materials Design Analysis Reporting) Framework for transparent reporting in the life sciences](https://paasp.net/the-mdar-materials-design-analysis-reporting-framework-for-transparent-reporting-in-the-life-sciences/) - The MDAR working group came together in late 2017 with the intention to develop a framework to promote transparent reporting, with a focus on implementation through journal policies and editorialpractice. In this article, the authors report the results of their project in the form of three main MDAR outputs: the MDAR Framework, which forms the
- [How much power should my next study have: One size fits all?](https://paasp.net/how-much-power-should-my-next-study-have-one-size-fits-all/) - There is a slow but steady increase in the number of publications where authors report on sample size justification. In most cases, the authors refer to power analysis as the means to estimate sample sizes for their studies. It is also common to read that sample size was estimated for alpha equal to 0.05 and
- [Experiences with the EQIPD QS](https://paasp.net/experience-report-about-the-eqipd-qs/) - The perks of a quality system in academia The research group of Prof Kas at the University of Groningen was one of the first research units that implemented the EQIPD Quality System and being awarded the EQIPD Certificate.In this new paper, María Arroyo-Araujo and Martien Kas describe and explain the advantages of having implemented the
- [Additional reads in March 2022](https://paasp.net/additional-reads-in-march-2022/) - The new normal? Redaction bias in biomedical science Why Discovering 'Nothing' in Science Can Be So Incredibly Important New Frontiers research topic: Towards a New 3Rs Era in Experimental Research A compact guide to the systematic review and meta-analysis of the literature in neuroscience. Group size planning of breedings of gene-modified animals UK Parliament: Reproducibility
- [Illustrating the role of PPV, power and sample size with an R script](https://paasp.net/illustrating-the-role-of-ppv-power-and-sample-size-with-an-r-script/) - This is the R Script referenced in the blog post LINK # ratio of true to not-true relationships tnott
- [Preparing for a journey](https://paasp.net/preparing-for-a-journey/) - Recently, I went on a trip to a nice hotel with a swimming pool. Upon arrival, standing in the modern room with a nice view into the countryside, I realized with pain that I didn’t pack my swimming suite. One can say that this is actually rather silly since everybody knows packing lists when preparing
- [PREMIER Symposium Report](https://paasp.net/premier-symposium-report/) - On March 16, 2018 the international symposium on ‘Quality Management for Academic Research in Preclinical Biomedicine: Burden or Boon?’ took place. The symposium served as a forum to discuss the challenges of quality management in a research environment that thrives on curiosity and creativity. This event served as the kick-off meeting for the PREMIER (Predictiveness
- [PAASP became member of BioRN](https://paasp.net/paasp-became-member-of-biorn/) - The BioRN Network, the Biotechnology Cluster Rhein Neckar, was founded in 1995 by the Heidelberg University and 40 companies to facilitate innovation and to take part in the BioRegio Competition. BioRN won this competition in 1996 and as a result, received federal grants amounting to approximately 26m € (and another 40m € in 2007) for
- ["Research quality is an urgent matter"](https://paasp.net/research-quality-is-an-urgent-matter/) - In the March 2018 issue of the newsletter, we have previously discussed that the research rigor & reproducibility discussion starts to backfire and may have unwanted effects on research. We have decided to bring this topic up again due to the recently published article: ‘Does animal-based research constitute 'silent fraud'?’ Indeed, the same evidence that
- [NIH Workshop on Optimizing Reproducibility in Non-Human Primate Research Studies by Enhancing Rigor and Transparency](https://paasp.net/nih-workshop-on-optimizing-reproducibility-in-non-human-primate-research-studies-by-enhancing-rigor-and-transparency/) - On September 16-17, 2019, NIH will be holding a workshop to build upon current reproducibility efforts by exploring best practices for enhancing rigor and transparency in studies specifically using non-human primate models. NIH is particularly interested in exploring the role of ethical factors that may influence study design given that these models are of such
- [Workshop: "Rigor, reproducibility and data management in nonclinical research"](https://paasp.net/workshop-rigor-reproducibility-and-data-management-in-nonclinical-research/)
- [NEWSLETTER December 2021](https://paasp.net/newsletter-december-2021/) - EQIPD News Update EQIPD Toolbox: Item “1.4.3.5 Expectations from public funders” - Read moreNew EQIPD-certified research unit - Read moreWorkshop: "Rigor, reproducibility and data management in nonclinical research" - Read more Featured Publication: How can Core Facilities support best research practices? - Read more Recent publications related to Good Research Practice The past, present and future of Registered Reports
- [Reference Collection to push back against “Common Statistical Myths”](https://paasp.net/reference-collection-to-push-back-against-common-statistical-myths/) - In this wiki, the author provides an easy to navigate list of references that may be used to argue against some common statistical myths.Given that this is a wiki, the whole scientific community is invited to edit and to add additional content.
- [The "from-quality-to-system" pendulum](https://paasp.net/the-from-quality-to-system-pendulum/) - by Anton Bespalov and Anja Gilis In the dialectics world of the German philosopher Georg Hegel, quantitative changes transform into qualitative changes. This often gets illustrated with the paradox of the heap: if you keep adding grains on the same spot, after a certain number of grains you will get a heap, only it seems impossible
- [Additional Reads in December 2021](https://paasp.net/additional-reads-in-december-2021/) - Want research integrity? Stop the blame game Einstein Foundation Award 2021 Understand the real reasons reproducibility reform fails Five keys to writing a reproducible lab protocol Half of top cancer studies fail high-profile reproducibility effort Some Cancer Studies Fail to Replicate. That Might Be OK
- [Nonreplicable publications are cited more than replicable ones](https://paasp.net/nonreplicable-publications-are-cited-more-than-replicable-ones/) - In this article, Marta Serra-Garcia and Uri Gneezy used publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the publication of the failure to replicate. The authors also discuss
- [Investigating the replicability of preclinical cancer biology](https://paasp.net/investigating-the-replicability-of-preclinical-cancer-biology/) - Replicability is an important feature of scientific research. Thus, the Reproducibility Project: Cancer Biology was set up to provide evidence about the replicability of preclinical research in cancer biology by repeating selected experiments from high-impact papers. A total of 50 experiments from 23 papers were repeated, generating data about the replicability of a total of
- [Misidentified biomedical resources: Journal guidelines are not a quick fix](https://paasp.net/misidentified-biomedical-resources-journal-guidelines-are-not-a-quick-fix/) - Some journals have implemented guidelines regarding the use and reporting of cell lines, antibodies, and laboratory animals to improve the value and usefulness of research outcomes. In this study, Wytske M. Hepkema and colleagues use existing and newly created datasets to investigate identification and authentication information of cell lines, antibodies and organisms before and after
- [Pre-Clinical Common Data Elements for Traumatic Brain Injury Research: Progress and Use Cases](https://paasp.net/pre-clinical-common-data-elements-for-traumatic-brain-injury-research-progress-and-use-cases/) - Traumatic brain injury (TBI) is an extremely complex condition due to heterogeneity in injury mechanism, underlying conditions, and secondary injury. Pre-clinical and clinical researchers face challenges with reproducibility that negatively impact translation and therapeutic development for improved TBI patient outcomes. To address this challenge, TBI Pre-clinical Working Groups expanded upon previous efforts and developed common
- [The past, present and future of Registered Reports](https://paasp.net/the-past-present-and-future-of-registered-reports/) - Registered Reports are a form of empirical publication in which study proposals are peer reviewed and pre-accepted before research is undertaken. By deciding which articles are published based on the question, theory and methods, Registered Reports offer a remedy for a range of reporting and publication biases. In this review article, Christopher D. Chambers and
- [How can Core Facilities support best research practices?](https://paasp.net/how-can-core-facilities-support-best-research-practices/) - Core Facilities (CFs) are a major player within the research landscape since they provide essential infrastructures, experimental support and knowledge to scientists and research groups. Additionally, CFs are dedicated to increase quality practices by setting their own standards and providing training to users performing experiments in their facility (Kos et al., 2020). However, members of
- [EQIPD Toolbox - Item “1.4.3.5 Expectations from public funders”](https://paasp.net/eqipd-toolbox-item-1-4-3-5-expectations-from-public-funders/) - EQIPD has developed a tool to support a) funders willing to communicate their expectations about data management and rigor in study design, conduct, analysis, and reporting as well as b) scientists applying for funding and willing to follow best practices in research rigor.An updated Excel-based tool is now available for download, which creates a "snapshot"
- [A wiki platform to support the organization of research labs](https://paasp.net/a-wiki-platform-to-support-the-organization-of-research-labs/) - As part of the PREMIER project, a document sharing system was developed and made freely available as a template to all interested parties for download and installation in a local environment. This wiki platform was developed to transparently share, store and further develop knowledge within a department, a laboratory or an institute.The structure of an open research wiki
- ["Don’t cut the tree you are sitting on!"](https://paasp.net/dont-cut-the-tree-you-are-sitting-on/) - According to a recent press release from the European parliament, an EU-wide action plan is requested with ambitious and achievable objectives for phasing-out the use of animals in research and testing new medicines, including timelines for when this process should be complete. This may be seen as a natural development. Indeed, there are substantial efforts by various stakeholders
- [Biological vs technical replicates: Now from a data analysis perspective: R script](https://paasp.net/biological-vs-technical-replicates-now-from-a-data-analysis-perspective-r-script/) - This is the R Script referenced in the blog post LINK ## "Effortlessly Read Any Rectangular Data"library(readit) ## "Linear and Nonlinear Mixed Effects Models"library(nlme) ## "Groupwise Statistics, LSmeans, Linear Contrasts, Utilities"library(doBy)
- [Biological vs technical replicates: Now from a data analysis perspective](https://paasp.net/biological-vs-technical-replicates-now-from-a-data-analysis-perspective/) - We have discussed this topic several times before (HERE and HERE). There seems to be a growing understanding that, when reporting an experiment’s results, one should state clearly what experimental units (biological replicates) are included, and, when applicable, distinguish them from technical replicates. In discussing this topic with various colleagues, it became obvious to us that there
- [Newsletter November 2021](https://paasp.net/newsletter-november-2021/) - NEWS EQIPD newsNews on website - Read moreUpdate on EQIPD Toolbox - Read moreEQIPD-certified research units - Read moreWorkshop on November 18th - Read moreEATRIS workshop - Read moreMeeting Report: Virtual FENS Regional Meeting 2021 - Read moreUKRN: Open research primers - Read moreMaterials Design Analysis Reporting (MDAR) Reports via SciScore - Read more Featured Publication: PEERS - a “Platform for the Exchange of
- [Support by artificial intelligence](https://paasp.net/support-by-artificial-intelligence/)
- [NINDS Rigor Resources](https://paasp.net/ninds-rigor-resources/) - The National Institute on Neurological Disorders and Stroke (NINDS) has been gathering a list of currently available public resources that are, or can be made, freely accessible to the scientific community and beyond.Categories of resources listed in the table provided include Books and Articles, Guidelines and Protocols, Media and Courses, Organizations and Training Programs, and Software and
- [Of peer review and data sharing](https://paasp.net/of-peer-review-and-data-sharing/) - We (preclinical) learn from the Big Brother (clinical). For example, they recognize the risks of bias in study design, conduct and analysis and we have discovered that it is relevant for us too. They introduced public pre-registration of studies and we start to realize that pre-registration can address many of the existing challenges faced by
- [Additional Reads in November 2021](https://paasp.net/additional-reads-in-november-2021/) - Science Forum: A community-led initiative for training in reproducible research Reproducibility: expect less of the scientific paper Share methods through visual and digital protocols Five keys to writing a reproducible lab protocol Quality shines when scientists use publishing tactic known as registered reports, study finds No study is ever flawless: A scoping review of common
- [Methodology over metrics: current scientific standards are a disservice to patients and society](https://paasp.net/methodology-over-metrics-current-scientific-standards-are-a-disservice-to-patients-and-society/) - Although the issues related to poor quality of medical research are well known, the research community fails to properly address them. In this paper, Van Calster and colleagues suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains
- [Toward Standardized Guidelines for Investigating Neural Circuit Control of Behavior in Animal Research](https://paasp.net/toward-standardized-guidelines-for-investigating-neural-circuit-control-of-behavior-in-animal-research/) - With the advent of tools for recording and manipulating activity with high spatiotemporal resolution in defined neural circuits in behaving animals, behavioral neuroscience is now tasked with establishing field-wide standards for implementing and interpreting these powerful approaches. Importantly, similar assays are often used to support widely disparate conclusions which in part has contributed to a
- [Initial evidence of research quality of registered reports compared with the standard publishing model](https://paasp.net/initial-evidence-of-research-quality-of-registered-reports-compared-with-the-standard-publishing-model/) - In registered reports (RRs), initial peer review and in-principle acceptance occur before knowing the research outcomes. This combats publication bias and distinguishes planned from unplanned research. How RRs could improve the credibility of research findings is straightforward, but there is little empirical evidence. Also, there could be unintended costs such as reducing novelty. In this
- [Technological advances in preclinical meta-research](https://paasp.net/technological-advances-in-preclinical-meta-research/) - Preclinical systematic reviews are vital; they serve many purposes by assessing the range and quality of the evidence. Through these reviews knowledge gaps can be identified, methodological quality improved, unnecessary duplication of experiments can be avoided, and clinical trial design can be informed.This article by Alexandra Bannach-Brown and colleagues discusses the past and present technological
- [eLabFTW as an Open Science tool to improve the quality and translation of preclinical research](https://paasp.net/elabftw-as-an-open-science-tool-to-improve-the-quality-and-translation-of-preclinical-research/) - Together with the group of Ulf Kahlert from the University of Düsseldorf, PAASP’s Björn Gerlach published an article in F1000Research on using an electronic laboratory notebook (ELN) to improve open science. Ulf and his team have established a freely available ELN in their research environment and are using it with great success. The solution is
- [PEERS - An Open Science “Platform for the Exchange of Experimental Research Standards” in Biomedicine](https://paasp.net/peers-an-open-science-platform-for-the-exchange-of-experimental-research-standards-in-biomedicine/) - Do I need to consider the sex of the animals for my study? Is the background noise level likely to vary? Do I need to control the illumination level during study conduct? Should I document any changes in cell density during my experiment?Ideally, these questions are clarified before starting an experiment - if it turns
- [Materials Design Analysis Reporting (MDAR) Reports via SciScore](https://paasp.net/materials-design-analysis-reporting-mdar-reports-via-sciscore/) - We have recently introduced the Materials, Design, Analysis, and Reporting (MDAR) framework aiming at helping authors, editors, and other interested parties to increase reporting transparency within life science manuscripts. The MDAR checklist serves as a generic, minimum reporting standard for life science studies and is organized into three different sections: Materials, Design, and Analysis.To support scientists in
- [UKRN: Open research primers](https://paasp.net/ukrn-open-research-primers/) - The UK Reproducibility Network (UKRN) has designed a new ‘primer series’ to introduce important topics in open and reproducible scholarship.Each primer includes an overview of the topic in the introductory “What?” section, reasons for undertaking these practices in the “Why?” section, followed by a longer “How?” section that provides guidance on how to do that
- [EATRIS Workshop on “Research Quality and Reproducibility”](https://paasp.net/eatris-workshop-on-research-quality-and-reproducibility/) - European research infrastructures support academic research by providing networking opportunities and informing about current topics. In this context, the ERIC Forum (European Research Infrastructure Consortium) held a two-day inter-disciplinary workshop on “Research Quality and Reproducibility” with speakers from different backgrounds. The EQIPD Quality System was presented as a tool to increase research rigor by Thomas
- [The first EQIPD-certified Research Units:](https://paasp.net/the-first-eqipd-certified-research-units/) - Concluding the pilot implementation efforts initiated by the EQIPD consortium team, the first four Research Units have implemented the EQIPD Quality System in their environment and were successfully assessed for compliance with EQIPD requirements. We congratulate these groups at the German Mouse Clinic at the Helmholtz Zentrum Münchenthe Fraunhofer Institute in Frankfurt (ITMP),the lab of
- [EQIPD Toolbox](https://paasp.net/eqipd-toolbox/) - We have made substantial updates to the following EQIPD Toolbox items: 1.4.3.3 Academia-academia: Research as service: The recommendations outlined here are intended to improve the robustness, reliability, traceability and integrity of the data obtained from the research activities supported by academic core facilities. The recommendations have been developed by a working group of members and
- [How to SOP](https://paasp.net/how-to-sop/) - Writing Standard Operating Procedures (SOP) is a usual procedure for any organization with a quality manage system. However, also an increasing number of labs in biomedical research are seeing advantages of standardized protocols. Susanne Hollmann and colleagues published “ten simple rules” on writing SOPs and their maintenance. This article provides very good guidance for any
- [Octopus - a replacement for scientists publishing that rewards good research?"](https://paasp.net/octopus-a-replacement-for-scientists-publishing-that-rewards-good-research/) - After 17 years working in the media I have returned to academia and been shocked to discover so much poor research practice – with all its consequences. Following problems back to their roots, it seems much is driven by the scientific publication system. It is a commercial system akin to journalism: the pressure is to
- [ERIC forum reports on "Research Quality and Reproducibility Workshop"](https://paasp.net/eric-forum-reports-on-research-quality-and-reproducibility-workshop/) - European research infrastructures support academic research by providing networking opportunities and informing about current topics. In this context, the ERIC Forum (European Research Infrastructure Consortium) held a two-day inter-disciplinary workshop on “Research Quality and Reproducibility” with speakers from different backgrounds. The EQIPD Quality System was presented as a tool to increase research rigor. The full
- [Accurate design of in vitro experiments – why does it matter?](https://paasp.net/accurate-design-of-in-vitro-experiments-why-does-it-matter/) - Good statistical design is a key aspect of meaningful research. Elements such as data robustness, randomization and blinding are widely recognized as being essential to producing valid results and reducing biased assessment. Although commonly used in in vivo animal studies and clinical trials, why is it that these practices seem to be so often overlooked
- [Newsletter June 2021](https://paasp.net/newsletter-june-2021/) - NEWS - New EQIPD paper published - Read more - The MDAR Framework - a new tool for life sciences reporting - Read more - The EQIPD principles - Read more - Royal Society Open Science welcomes PCI Registered Reports - Read more
- [Webinar at scientist.com](https://paasp.net/webinar-at-scientist-com/) - PAASP network member Christoph Emmerich will introduce the EQIPD framework in the context of scientist.com. Scientist.com is a stakeholder of EQIPD and together with the consortium has established a process -including a survey on their website- for service providers to foster Biopharma-CRO relationships. Click HERE to sign up for the seminar.
- [Power analysis for two-sided t-test](https://paasp.net/power-analysis-for-two-sided-t-test/) - The example below does not require any additional R packages to be installed (i.e. runs with the basic R installation).This example conducts power analysis for an expected difference between means equal to 2 with the standard deviation of 1 at a range of alpha and beta values. Any of these four parameters can be estimated
- [EQIPD Quality System published](https://paasp.net/eqipd-quality-system-published/) - The manuscript “Introduction to the EQIPD quality system” was recently accepted by and published in eLife. This publication marks an important milestone for the EQIPD project as it introduces the EQIPD Quality System (QS) to the broad scientific community.The paper summarizes the concept and principles of the EQIPD QS, explains how the QS is structured and
- [The MDAR Framework – a new tool for life sciences reporting](https://paasp.net/the-mdar-framework-a-new-tool-for-life-sciences-reporting/) - Incomplete or imprecise reporting of life sciences research contributes to challenges with reproducibility, replicability, and biomedical applications. For the last three years, a group of journal editors and researchers have been working together to develop a new framework for transparent reporting of life sciences research. This framework has just been published in PNAS.The MDAR Framework establishes
- [The EQIPD principles](https://paasp.net/the-eqipd-principles/) - The EQIPD Toolbox now contains a set of principles, which may help scientists, stakeholders and users to better understand what the EQIPD Quality System is all about.The aim of EQIPD is for the quality system to be perceived as lean, flexible, fit-for-purpose, and user-friendly. In this context, the EQIPD Key Principles are: Engage with autonomyGrow
- [The EQIPD Workshop “Rigor, reproducibility and data management in nonclinical research”](https://paasp.net/the-eqipd-workshop-rigor-reproducibility-and-data-management-in-nonclinical-research/) - On 21 April 2021 a virtual EQIPD workshop entitled “Rigor, reproducibility and data management in nonclinical research” was organized in Finland by the Neuroscience Center (NC), Institute for Molecular Medicine Finland (FIMM), the Helsinki Institute of Life Science (HiLIFE), the University of Helsinki, the European Infrastructure for translational Medicine (EATRIS), PAASP and EQIPD.This event was
- [Royal Society Open Science welcomes PCI Registered Reports](https://paasp.net/royal-society-open-science-welcomes-pci-registered-reports/) - The Royal Society Open Science is promoting Registered Reports (RRs) by welcoming the submission of Stage 2 Registered Reports that have been reviewed and recommended by the Peer Community In (PCI) Registered Reports platform.PCI Registered Reports is a non-profit, non-commercial platform that coordinates the peer review of Registered Report preprints. Once the submissions are accepted following peer
- [Standardized and reproducible measurement of decision-making in mice](https://paasp.net/standardized-and-reproducible-measurement-of-decision-making-in-mice/) - Reproducibility of data has never been more at the forefront of scientific endeavour than now. In their latest contribution, the International Brain Laboratory (a virtual network of neuroscience researchers from 22 laboratories established in 2017) have made a significant contribution in answering how it is possible to perform repeatable experiments across different laboratories in different
- [Meta-analysis of variation suggests that embracing variability improves both replicability and generalizability in preclinical research](https://paasp.net/meta-analysis-of-variation-suggests-that-embracing-variability-improves-both-replicability-and-generalizability-in-preclinical-research/) - The long-held belief that experimental standardization begets replicability has recently been challenged - based on the observation that the reduction of variability within studies can lead to lab-specific results that cannot be replicated. An alternative approach is to deliberately introduce heterogeneity, known as “heterogenization” of experimental design.In this article, the authors explore a novel perspective
- [What is the optimum design for my animal experiment?](https://paasp.net/what-is-the-optimum-design-for-my-animal-experiment/) - Within preclinical research, attention has focused on experimental design and how current practices can lead to poor reproducibility. There are numerous decision points when designing experiments. Ethically, when working with animals we need to conduct a harm-benefit analysis to ensure the animal use is justified for the scientific gain. Experiments should be robust, not use
- [Creating clear and informative image-based figures for scientific publications](https://paasp.net/creating-clear-and-informative-image-based-figures-for-scientific-publications/) - Scientists routinely use images to display data and images are a critical part of a scientific report or publication.However, many resources discuss fraudulent image manipulation and data on the legibility and interpretability of images are scarce.In this article, the authors systematically examined these factors in images published in the top 15 journals in 3 fields;
- [Putting the Self in Self-Correction: Findings from the Loss-of-Confidence Project](https://paasp.net/putting-the-self-in-self-correction-findings-from-the-loss-of-confidence-project/) - Science is often perceived to be a self-correcting enterprise. In principle, the assessment of scientific claims is supposed to proceed in a cumulative fashion, with the reigning theories of the day progressively approximating truth more accurately over time. In practice, however, cumulative self-correction tends to proceed less efficiently than one might naively suppose. Far from
- [Additional reads in June 2021](https://paasp.net/additional-reads-in-june-2021/) - Nonreplicable publications are cited more than replicable ones Good research begins long before papers get written Why indirect contributions matter for science and scientists Why don’t you publish your research here? A self-correcting fallacy – Why don’t researchers correct their own errors in the scientific record? Love DORA, Hate Rankings? Bias Is a Big Problem.
- [How to See More Clearly in the Lab?](https://paasp.net/how-to-see-more-clearly-in-the-lab/) - When you can see the world clearly, it’s easy to get where you want to go: You might still get where you want to go after your eyesight has deteriorated, but you are more likely to suffer the costs and delays of making wrong turns: What distinguishes clear vision from blurry vision is its much
- [A method to streamline p-hacking](https://paasp.net/a-method-to-streamline-p-hacking/) - The analytic strategy of p-hacking has rapidly accelerated the achievement of psychological scientists’ goals (e.g., publications & tenure), but has suffered a number of setbacks in recent years. In order to remediate this, this article presents a statistical inference measure that can greatly accelerate and streamline the p-hacking process: generating random numbers that are < .05.Results of
- [Aducanumab's approval is not FDA's failure, it is our failure](https://paasp.net/aducanumabs-approval-is-not-fdas-failure-it-is-our-failure/) - On June 7, 2021, the FDA approved aducanumab, an amyloid beta-directed monoclonal antibody indicated for the treatment of Alzheimer’s disease.However, most analysts describe this decision as controversial since the FDA overruled the near-unanimous negative recommendation put forward by the FDA advisory committee in November 2020. And there is a general agreement in the field that
- [Newsletter March 2021](https://paasp.net/newsletter-march-2021/) - NEWS from the PAASP network - New series of EQIPD lectures - Read more - EQIPD helps to define quality expectations for Industry-Academia collaborations - Read more - Presentation at the BioRN Lounge by Martin Michel - Read more -
- [A teaching tool about the fickle p-value and other statistical principles based on real-life data](https://paasp.net/a-teaching-tool-about-the-fickle-p-value-and-other-statistical-principles-based-on-real-life-data/) - A poor understanding of what results from statistical tests do and do not mean and an over-reliance on p-values is seen as a key contributor to poor reproducibility of non-clinical studies in the life sciences (Amrhein et al. 2019). Specifically, many investigators do not fully realize how random sampling error can affect study outcomes and
- [Pseudoreplication in Physiology - more means less](https://paasp.net/pseudoreplication-in-physiology-more-means-less/) - Many publications leave it to readers to guess whether reported data are based on independent biological replicates (e.g. number of animals) or technical replicates (e.g. one of several single measurements in an animal) as basis for reported means and statistical analysis. In a recent article, David Eisner explains that there are two sources of variability in
- [Let's discuss reproducibility - the new "Journal for Reproducibility in Neuroscience"](https://paasp.net/lets-discuss-reproducibility-the-new-journal-for-reproducibility-in-neuroscience/) - by Plinio Cabrera Casarotto, PhD,Editor-in-Chief JRepNeurosciThe replicability of results is a cornerstone of science. We can only rely on the outcomes of our scientific discoveries because they can be repeated, no matter where or by whom. However, especially but not exclusively, in academia unreplicable results are not a rare phenomena, and we started to acknowledge this
- [Additional reads in March 2021](https://paasp.net/additional-reads-in-march-2021/) - Science Forum: Improving preclinical studies through replications Assessment of transparency indicators across the biomedical literature: How open is open? Von Botswana lernen, heißt siegen lernen! (in German) Automated screening of COVID-19 preprints: can we help authors to improve transparency and reproducibility? Risk of being scooped drives scientists to shoddy methods A burden of proof (Angelika
- [Additional reads August 2019](https://paasp.net/additional-reads-august-2019/) - Road testing ARRIVE 2019 Rethinking impact factors: better ways to judge a journal A Waste of 1,000 Research Papers The p value wars (again) Research integrity is much more than misconduct Reproducibility trial publishes two conclusions for one paper Hyped-up science erodes trust. Here’s how researchers can fight back. Depositing and reporting of reagents: Accelerating
- [Reactivation-dependent amnesia for contextual fear memories: Evidence for publication bias](https://paasp.net/reactivation-dependent-amnesia-for-contextual-fear-memories-evidence-for-publication-bias/) - Research on memory reconsolidation has been booming in the last two decades, with numerous high-impact publications reporting promising amnestic interventions in rodents and humans.Based on these publications, Laura Luyten and colleagues conducted extensive series of conceptual and exact replication attempts, performed by several experimenters and in different laboratories. However, a clear evidence for reactivation-dependent amnesia
- [Taking a fresh look at FAIR for research software](https://paasp.net/taking-a-fresh-look-at-fair-for-research-software/) - Software is increasingly essential in most research, and much of this software is developed specifically for and during research. To make this research software findable, accessible, interoperable, and reusable (FAIR), it is critical to define exactly what FAIR means in the context of research software as a living and complex object for which it is impossible to
- [Advancing science or advancing careers? Researchers’ opinions on success indicators](https://paasp.net/advancing-science-or-advancing-careers-researchers-opinions-on-success-indicators-2/) - The way in which we assess researchers has been under the radar in the past few years. Critics argue that current research assessments focus on productivity and that they increase unhealthy pressure on scientists. Yet, the precise ways in which assessments should change is still open for debate. In this article, the authors conducted a survey
- [Reproducible image handling and analysis](https://paasp.net/reproducible-image-handling-and-analysis/) - Image data are universal in life sciences research. Their proper handling is not. A significant proportion of image data in research papers show signs of mishandling that undermine their interpretation. In this article, the authors propose that a precise description of the image processing and analysis applied is required to address this problem. A new
- [An excess of positive results: Comparing the standard Psychology literature with Registered Reports](https://paasp.net/an-excess-of-positive-results-comparing-the-standard-psychology-literature-with-registered-reports/) - Selectively publishing ‘positive’ results distorts the available evidence for scientific claims. For the past decade, scientists from different fields have been increasingly concerned about the degree of such distortion in their literature. A new publication format, Registered Reports, has been developed to prevent selective reporting. Here, peer review and the decision to publish take place before results
- [What do people mean when saying that studies were done in a blinded fashion?](https://paasp.net/what-do-people-mean-when-saying-that-studies-were-done-in-a-blinded-fashion/) - We have evaluated blinding procedures at 12 academic labs, 7 contract research organisations (CROs), and 4 industrial pharmacology labs and obtained access to information about 72 independent studies. Results of our analysis are presented in the Figure below: These results suggest that simply stating that studies were blinded may not always be sufficient, although the
- [Careful interpretation of Western blotting data](https://paasp.net/careful-interpretation-of-western-blotting-data/) - Western blotting represents a powerful technique for the semi-quantitative determination of protein expression and the detection of protein modifications like phosphorylation and ubiquitylation. It is still one of the most commonly used methods in modern cell biology laboratories due to its high specificity and sensitivity.As imaging software like Photoshop became so widely available, it is
- [December 2016](https://paasp.net/december-2016/) - PAASP publication: Lack of reproducibility - an opportunity for precision medicine? - Read more Meeting report: Building Blocks of Good Research Practice, Amsterdam 2016 - Read more Recent publications about Good Research Practice - Read more Case study: Careful interpretation of Western blotting data - Read more
- [Additional Reads in December 2016](https://paasp.net/additional-reads-in-december-2016/)
- [Building Blocks of Good Research Practice, Amsterdam 2016](https://paasp.net/building-blocks-of-good-research-practice-amsterdam-2016/) - On October 27, 2016, several PAASP team members participated in a meeting in Amsterdam organized by the ECNP Preclinical Data Forum's core team together with experts from various types of organizations involved in funding, conducting and disseminating results of biomedical research. While there are various ongoing and planned efforts to develop novel standards for Good Research
- [Lack of reproducibility - an opportunity for precision medicine?](https://paasp.net/lack-of-reproducibility-an-opportunity-for-precision-medicine/) - Our article ‘Reproducibility of Preclinical Data: One Man's Poison Is Another Man's Meat’ was published recently by the newly established journal Advances in Precision Medicine.The inability to reproduce findings in preclinical biomedical research is often considered to be a key factor for the lack of efficiency and productivity in drug development, as reflected in the
- [A priori power analysis - friend or foe?](https://paasp.net/a-priori-power-analysis-friend-or-foe/) - Performing a power analysis is important for planning experimental studies. It helps us to estimate the sample size necessary to support or reject a hypothesis in question. In life sciences, the use of power analysis is strongly supported by the need to minimize the number of animal subjects. Further, in some areas such as drug
- [November 2016](https://paasp.net/november-2016/) - Meeting report: Lean Product & Process Development Exchange - Read more Recent publications about Good Research Practice - Read more Case study: A priori power analysis - friend or foe? - Read more The False Discovery Rate (FDR) - an important statistical concept - Read more
- [Additional Reads November 2016](https://paasp.net/additional-reads-november-2016/)
- [Meeting report: Lean Product & Process Development Exchange, Philadelphia Sept 25th - 29th, 2016](https://paasp.net/meeting-report-lean-product-process-development-exchange-philadelphia-sept-25th-29th-2016/) - In a mix of seminars and workshops, participants and presenters shared experience and knowledge on the application of the Lean Product and Process Development (LPPD) principles to research and development. The meeting attracted R&D workers from diverse areas such as service, automotive and pharmaceutical industries. Whereas Lean thinking has been applied with great success to
- [Number of citations as a measure of research quality - a dangerous approach](https://paasp.net/number-of-citations-as-a-measure-of-research-quality-a-dangerous-approach/) - How Many Is Too Many? On the Relationship between Research Productivity and Impact. In this research article, published in PLOS One last week (), V. Larivière and R. Costas analysed the publication and citation records of more than 28 million researchers, who published at least one paper between 1980 and 2013. Using this database, the
- [Preclinical data reproducibility discussion: Learning from Big Brother](https://paasp.net/preclinical-data-reproducibility-discussion-learning-from-big-brother/) - In recent years, robustness of preclinical data has been increasingly in focus of discussions about the reasons why the success rate of new drug development is so low. There are various solutions suggested to enhance the robustness of preclinical data - stricter adherence to good research practice standards, collaborations and data sharing, etc.It seems worth
- [Newsletter October 2016](https://paasp.net/october-2016/) - Meeting report: 29th ECNP Congress, Vienna 2016 - Read more Preclinical data reproducibility discussion: Learning from Big Brother - Read more Building a nearshoring collaboration: a success story - Read more Number of citations as a measure of research quality - a dangerous approach - Read more Recent publications about Good Research Practice - Read
- [Searching for significance](https://paasp.net/searching-for-significance/) - To examine associations between urinary chemical concentrations and adult health status, the US Centers for Disease Control and Prevention (CDC) measured the urine of 1455 study participants (representing the general US adult population) for the presence of 275 environmental chemicals, including Bisphenol A (BPA).BPA is used in certain packaging materials such as polycarbonates for baby
- [Newsletter August 2016](https://paasp.net/august-2016/) - HENRICH Pharma-R&D Consulting: PAASP partners with HENRICH Consulting - Read more Bayes' Theorem: How do we weigh evidence to make decisions? - Read more Recent publications about Good Research Practice - Read more Be open: Ongoing efforts to make science more open - Read more Case study: Searching for significance - Read more Blinding -
- [Intelligent Effort - Quality in Drug Discovery](https://paasp.net/intelligent-effort-quality-in-drug-discovery/) - Guest commentary by Dr. Markus HenrichThere is a high demand for quality in daily life. Few of us would actively decide to forgo or ignore quality aspects during decision or selection processes. Consequently, most people immediately come up with mental pictures in the quality context. White sand and clear blue sea are frequently attributed to a
- [Re-evaluation of failed drugs and targets using contemporary knowledge, methodology and tools](https://paasp.net/re-evaluation-of-failed-drugs-and-targets-using-contemporary-knowledge-methodology-and-tools/) - Co-authored by PAASP’s managing partner, Anton Bespalov, the correspondence article ‘Failed trials for central nervous system disorders do not necessarily invalidate preclinical models and drug targets’ was published last week in Nature Reviews Drug Discovery. Here, the authors discuss the great importance of 1. Data robustness, 2. Data generalizability and 3. Target engagement when designing
- [Newsletter July 2016](https://paasp.net/july-2016/) - New member of the PAASP management team: Prof. Martin C. Michel - Read more PAASP publication: Re-evaluation of failed drugs and targets - Read more Recent publications about Good Research Practice - Read more Guest commentary: Intelligent Effort - Quality in Drug Discovery (from Dr. Markus Henrich) - Read more Useful Tools and Resources: R code
- [Scientists believed a whiff of the bonding hormone Oxytocin could increase trust between humans. Then they went back and checked their work... ](https://paasp.net/scientists-believed-a-whiff-of-the-bonding-hormone-oxytocin-could-increase-trust-between-humans-then-they-went-back-and-checked-their-work/) - Over the last two decades, the neuropeptide Oxytocin (OT) has been studied extensively and many articles have been published about its role in humans’ emotional and social lives, e.g. increasing trust and sensitivity to others’ feelings. Even a TED talk has been recorded (Trust, morality - and oxytocin?) with over 1.4 million viewers.The human trials
- [Newsletter June 2016](https://paasp.net/june-2016/) - Recent publications about Good Research Practice - Read more Case study: Oxytocin, the trust hormone - Read more Useful Tools and Resources: Block randomization - Read more
- [Newsletter May 2016](https://paasp.net/may-2016/) - Arlenda: PAASP partners with Arlenda - Read more Success story: Pharma shares unpublished results - Read more Recent publications about Good Scientific Practice - Read more Case study: GDF11 - the 'new-blood' anti-aging protein - Read more Useful Tools and Resources: E-learning tools - Read more
- [Newsletter April 2016](https://paasp.net/april-2016/) - Y47: PAASP partners with Y47 - Read more Decision-enabling studies: How robust are they - Read more Recent publications about Good Scientific Practice - Read more Case study: The Horizon homeopathic dilution experiment - Read more Useful Tools and Resources: Randomization and e-learning tools
- [Newsletter September 2016](https://paasp.net/september-2016/) - Martin C. Michel: 'My reasons to join PAASP' - Read more PAASP's presence at the World Congress on Alcohol and Alcoholism, Berlin 2016 - Read more Recent publications about Good Research Practice - Read more Case study: Accurate design of in vitro experiments - why does it matter? - Read more Nearshoring success stories -
- [Presented data do not always support conclusions made in a paper](https://paasp.net/presented-data-do-not-always-support-conclusions-made-in-a-paper/) - We will continue presenting Case Study publications that have received a lot of interest among the scientific community (and sometimes even in mass media) and are particularly interesting from the GSP perspective. We hope that these cases will be useful in training programs and will help younger scientists to learn about the basics of study design, planning
- [DGGF Membership](https://paasp.net/dggf-membership/) - DGGF MembershipPAASP became a member of the DGGF (Deutsche Gesellschaft für Gute Forschungspraxis; German Society for Good Research Practice).The DGGF is the largest association in Germany focusing on quality management in the chemical and pharmaceutical industry. It was founded in 1995 with the aim to promote exchange of scientific information and opinion, specific education and training, and to
- [March 2016](https://paasp.net/march-2016/) - PAASP became a member of the German Society for Good Research Practice (DGGF) - Read more Blinding analysis: Are all 'blinded' studies done blind? - Read more Retraction analysis – Can GSP governance make a difference? - Read more Case study: Presented data do not always support conclusions - Read more Recent publications about Good Scientific Practice - Read more
- [March 2017](https://paasp.net/march-2017/) - Recent publications related to Good Research Practice Acknowledging and Overcoming Nonreproducibility in Basic and Preclinical Research - Read more No publication without confirmation - Read more Reproducibility2020: Progress and Priorities - Read more Additional Reads in March 2017 Case study: Effect Vibrations and a Roman God - Read more Guest commentary: The Interplay between Data Quality
- [Effect Vibrations and a Roman God](https://paasp.net/effect-vibrations-and-a-roman-god/) - There are a large number of ways how to analyze the same data set. Depending on the decision made in handling, analyzing and presenting the data the outcome may be very different. Very often, there is a large uncertainty about what variable should be modeled and how they are related. This ‘availability of alternative options
- [Additional Reads in March 2017](https://paasp.net/additional-reads-in-march-2017/) - Replication is not about making or breaking careers: it is about providing an opportunity to move science forward.Psychology journal editor asked to resign for refusing to review papers unless he can see the dataThe hi-tech war on science fraudHeavyweight funders back central site for life-sciences preprintsScanning the horizon: towards transparent and reproducible neuroimaging research
- [April 2017](https://paasp.net/april-2017/) - Meeting Report: Reproducible Research and Registered Reports - Read more Recent publications related to Good Research Practice Increasing efficiency of preclinical research by group sequential designs - Read more Meta-assessment of bias in science - Read more Replication data collection highlights value in diversity of replication attempts - Read more Research Funding: the Case for a Modified Lottery - Read more
- [Need for a particularly rigorous planning of studies that are likely to raise a lot of attention when results are published](https://paasp.net/need-for-a-particularly-rigorous-planning-of-studies-that-are-likely-to-raise-a-lot-of-attention-when-results-are-published/) - After being published, research findings often become a subject of replication efforts. Such replication efforts may be especially important when the data represent a breakthrough and designate a new direction into which science may develop. This is certainly the case when the published work announces a hope for a new therapeutic to be developed. Studies
- [Additional Reads in April 2017](https://paasp.net/additional-reads-in-april-2015/) - How original are your scientific hypotheses really? (a german version can be found here)More than 3Rs: the importance of scientific validity for harm-benefit analysis of animal researchThe Reproducibility Wars: Successful, Unsuccessful, Uninterpretable, Exact, Conceptual, Triangulated, Contested ReplicationThe ACS Journals Tighten Up Screening StandardsReproducibility and replicability is a glossy science now so watch out for the hypeSharing data
- [Optimising reliability of mouse performance in behavioural testing: the major role of non-aversive handling](https://paasp.net/optimising-reliability-of-mouse-performance-in-behavioural-testing-the-major-role-of-non-aversive-handling/) - Handling laboratory animals during test procedures is an important source of stress that may impair reliability of test responses. Picking up mice by the tail is aversive, stimulating stress and anxiety. Responses among anxious animals can be confounded further by neophobia towards novel test environments and avoidance of test stimuli in open areas. However, handling
- [Empirical assessment of published effect sizes and power in the recent cognitive neuroscience and psychology literature](https://paasp.net/empirical-assessment-of-published-effect-sizes-and-power-in-the-recent-cognitive-neuroscience-and-psychology-literature/) - In this paper, Denes Szucs and John P.A. Ioannidis have empirically assessed the distribution of published effect sizes and estimated power by analyzing 26,841 statistical records from 3,801 cognitive neuroscience and psychology articles published recently. The reported median effect size was D = 0.93 (interquartile range: 0.64 ± 1.46) for nominally statistically significant results and
- [Research Funding: the Case for a Modified Lottery](https://paasp.net/research-funding-the-case-for-a-modified-lottery/) - The time-honored mechanism of allocating funds based on ranking of proposals by scientific peer review is no longer effective, because review panels cannot accurately stratify proposals to identify the most meritorious ones. Bias has a major influence on funding decisions, and the impact of reviewer bias is magnified by low funding paylines. Despite more than
- [Replication data collection highlights value in diversity of replication attempts](https://paasp.net/replication-data-collection-highlights-value-in-diversity-of-replication-attempts/) - Researchers agree that replicability and reproducibility are key aspects of science. Here, K. Andrew DeSoto and Martin Schweinsberg present datasets collected from a series of replication studies, each written in a transparent manner that would allow others to analyse the data themselves or compare it with past work. Several of the studies host their data
- [Meta-assessment of bias in science](https://paasp.net/meta-assessment-of-bias-in-science/) - Numerous biases are believed to affect the scientific literature, but their actual prevalence across disciplines is unknown. To gain a comprehensive picture of the potential imprint of bias in science, Daniele Fanellia, Rodrigo Costas and John P.A. Ioannidis probed for the most commonly postulated bias-related patterns and risk factors, in a large random sample of
- [Increasing efficiency of preclinical research by group sequential designs](https://paasp.net/increasing-efficiency-of-preclinical-research-by-group-sequential-designs/) - Despite the potential benefits of sequential designs, studies evaluating treatments or experimental manipulations in preclinical experimental biomedicine almost exclusively use classical block designs. With this article, published in PLoS Biology, Neumann et al. aim to bring the existing methodology of group sequential designs to the attention of researchers in the preclinical field and to clearly
- [Meeting Report: Reproducible Research and Registered Reports](https://paasp.net/meeting-report-reproducible-research-and-registered-reports/) - NIHR STATS Group: Laboratory StudiesLondon, 20 March 2017 Invited speakerThe meeting opened with a comprehensive presentation by guest speaker Professor Chris Chambers from Cardiff University on the registered reports project. This is a new publishing initiative supported by the journal Cortex and promoted by the Centre for Open Science. This class of publication gives researchers
- [IMI Call9: PAASP is part of the EQIPD consortium and co-leads the work package responsible for developing a new quality management system to improve preclinical data robustness](https://paasp.net/imi-call9-paasp-is-part-of-the-eqipd-consortium-and-co-leads-the-work-package-responsible-for-developing-a-new-quality-management-system-to-improve-preclinical-data-robustness/) - A consortium of pharma companies, SMEs and academic researchers launched an ambitious project to address research quality as one of the key requirements for the development of innovative medications. While the initial project’s focus is on neuroscience and preclinical safety, developed quality management tools and standards will hopefully be applicable in every field of nonregulated
- [The new ZWM program now contains a module about Good Research Practice](https://paasp.net/the-new-zwm-program-now-contains-a-module-about-good-research-practice/) - PAASP will collaborate with the ZWM (Zentrum für Wissenschaftsmanagement e.V.) to develop and present a course „Werkzeugkoffer für die Professur“ (‚Toolbox for Professors‘), which will start in March 2018. This course is aimed at newly appointed professors, junior professors with and without tenure track, research group leaders, private lecturers and other scientists with the career goal of
- [Webinar: 'GRADE for preclinical animal studies: translating evidence from bench to bedside'](https://paasp.net/webinar-grade-for-preclinical-animal-studies-translating-evidence-from-bench-to-bedside/) - Laboratory animal studies are used in a wide range of human health related research areas. The results of these studies can be used to inform decisions regarding clinical research in humans, for example the decision to proceed to clinical trials. If the research question relates to potential harms with no expectation of benefit (e.g., toxicology),
- [May 2017](https://paasp.net/may-2017/) - Newsletter May 2017: PAASP News: Introducing StuDySign, an innovative electronic Lab Notebook (eLN) for biomedical research - Read more Recent publications related to Good Research Practice Increasing value and reducing waste in stroke research - Read more Rigor, Reproducibility and in vitro CSF assays: The Devil in the Details - Read more Aligning physiology with psychology: Translational neuroscience in neuropsychiatric
- [Why details matter](https://paasp.net/why-details-matter/) - The Materials and Methods section is a crucial component of any formal lab report, such as a scientific publication. This part of the report explains the experimental procedures used to complete the experiments and should provide sufficient detail for other scientists to reproduce the studies presented in the report. Considering the importance of "reproducible results"
- [Additional Reads in May 2017](https://paasp.net/additional-reads-in-may-2017/) - Zu Risiken und Nebenwirkungen fragen Sie Ihren Bibliothekar (in German) Defending Biomedical Science in an Era of Threatened Funding Open review and the quest for increased transparency in neuroscience publication Why Scientists Must Share Their Failures Research integrity revisitedWhat incentives increase data sharing in health and medical research? A systematic reviewIntegrity starts with the health of research groups Ethics and
- [Methodological Rigor in Preclinical Cardiovascular Studies: Targets to Enhance Reproducibility and Promote Research Translation](https://paasp.net/methodological-rigor-in-preclinical-cardiovascular-studies-targets-to-enhance-reproducibility-and-promote-research-translation/) - Methodological sources of bias and suboptimal reporting contribute to irreproducibility in preclinical science and may negatively impact research translation. Randomization, blinding, sample size estimation, and considering sex as a biological variable are deemed crucial study design elements to maximize the quality and predictive value of preclinical experiments. In this article, F.D. Ramirez and colleagues examined
- [Questionable science and reproducibility in electrical brain stimulation research](https://paasp.net/questionable-science-and-reproducibility-in-electrical-brain-stimulation-research/) - Electrical brain stimulation (EBS) is a popular new technique used to change brain function and treat neurological, psychiatric and psychological disorders. In this article, M. E. Héroux and colleagues analyzed whether the published literature, which is dominated by positive results, reflects the experience of researchers using EBS. Specifically, the authors wanted to know whether researchers
- [The credibility crisis in research: Can economics tools help?](https://paasp.net/the-credibility-crisis-in-research-can-economics-tools-help/) - The issue of low data robustness and nonreplicable results in biomedical research is accompanied by an increasing interest in reforming research incentives and practices. How to optimally perform these reforms is a scientific problem, and economics has several scientific methods that can help evaluate research reforms. In this article, Thomas Gall, John P.A. Ioannidis and
- [Progress toward openness, transparency, and reproducibility in cognitive neuroscience](https://paasp.net/progress-toward-openness-transparency-and-reproducibility-in-cognitive-neuroscience/) - Accumulating evidence suggests that many findings in psychological science and cognitive neuroscience may prove difficult to reproduce; statistical power in brain imaging studies is low and has not improved recently; software errors in analysis tools are common and can go undetected for many years; and, a few large-scale studies notwithstanding, open sharing of data, code,
- [Aligning physiology with psychology: Translational neuroscience in neuropsychiatric drug discovery](https://paasp.net/aligning-physiology-with-psychology-translational-neuroscience-in-neuropsychiatric-drug-discovery/) - This review by Robert A. McArthur published in Neuroscience & Biobehavioral Reviews presents an overview of some of the pre-clinical and clinical issues that have contributed to the failures of potential novel neuropsychiatric drugs, which have prompted a re-examination of the role of animal models of neuropsychiatric disorders. Publication bias and over-reporting of positive data
- [Rigor, Reproducibility and in vitro CSF assays: The Devil in the Details](https://paasp.net/rigor-reproducibility-and-in-vitro-csf-assays-the-devil-in-the-details/) - This is not a new story and at least some of our readers may be familiar with the conflicting results regarding the presence of a GABA-A positive modulating substance in the CSF of patients with daytime sleepiness. Of note, GABA-A receptor potentiating effects of the patients' CSF is established using conventional electrophysiological methods characterized by
- [Introducing StuDySign, an innovative Electronic Lab Notebook (eLN) for biomedical research](https://paasp.net/introducing-studysign-an-innovative-electronic-lab-notebook-eln-for-biomedical-research/) - Contact us
- [June 2017](https://paasp.net/june-2017/) - PAASP News: PAASP partner became TÜV-certified 'Qualitätsbeauftragter, -manager and -auditor' - Read more Meeting Report : St. Petersburg - Read more Meeting Report : Washington, DC - Read more Meeting Report : WCRI, Amsterdam - Read more Towards greater reproducibility for life-sciences resarch in Nature - Read more Recent publications related to Good Research Practice A Guide for the Design of
- [The impact factor of an open access journal does not contribute to an article’s citations](https://paasp.net/the-impact-factor-of-an-open-access-journal-does-not-contribute-to-an-articles-citations/) - In this article, SK Chua et al. analyze the phenomenon that citations of papers are positively influenced by the journal’s impact factor (IF). The authors argue that for non-open access (non-OA) journals, this influence may be due to the fact that high-IF journals are more often purchased by libraries, and are therefore more often available
- [The reproducibility of research and the misinterpretation of P values](https://paasp.net/the-reproducibility-of-research-and-the-misinterpretation-of-p-values/) - Despite decades of warnings, many areas of science still insist on labelling a result of P < 0.05 as “significant”. In this article, D. Colquhoun discusses whether the inconsiderate use of p-values and other questionable research practices like multiple comparisons, lack of randomisation and P-hacking account for a substantial part of the reproducibility issue. He
- [The ABCs of finding a good antibody: How to find a good antibody, validate it, and publish meaningful data](https://paasp.net/the-abcs-of-finding-a-good-antibody-how-to-find-a-good-antibody-validate-it-and-publish-meaningful-data/) - Finding an antibody that works for a specific application can be a difficult task. Hundreds of vendors offer millions of antibodies, but the quality of these products and available validation information varies greatly. In addition, several studies have called into question the reliability of published data as the primary metric for assessing antibody quality. In
- [A Guide for the Design of Pre-clinical Studies on Sex Differences in Metabolism](https://paasp.net/a-guide-for-the-design-of-pre-clinical-studies-on-sex-differences-in-metabolism/) - In metabolic animal models, researchers often use male rodents because they show metabolic disease better than females. Thus, females are underrepresented in these studies because of an acknowledged sex difference. In this perspective article, F. Mauvais-Jarvis and colleagues discuss the experimental design and interpretation of studies addressing the mechanisms of sex differences in metabolic homeostasis
- [July 2017](https://paasp.net/july-2017/) - PAASP News: - New member of the PAASP network - Read more - PAASP participation in the ECNP workshop 'How to Make Preclinical Research Robust' - PAASPort Trademark - Read more Recent publications related to Good Research Practice - Read more Commentary: 'German Leibniz Institue director K.L. Rudolph guilty of misconduct' - Read more Case
- [August 2017](https://paasp.net/newsletter-august-2017/) - PAASP News: - New member of our PAASP Team - Read more Recent publications related to Good Research Practice - Read more Science with no fiction: measuring the veracity of scientific reports by citation analysis - read more Power-up: a reanalysis of 'power failure' in neuroscience using mixture modelling - read more Enhancing the usability of systematic
- [September 2017](https://paasp.net/september-2017/) - Recent publications related to Good Research Practice Standardized mean differences cause funnel plot distortion in publication bias assessments - Read more How To Survive the Medical Misinformation Mess - Read more Living systematic review: 1. Introduction - the why, what, when, and how - read more Commentary: 'Neuroscience has quietly become a hot space for
- [Useful Tools in Newsletter September 2017](https://paasp.net/useful-tools-in-newsletter-september-2017/) - In this Newsletter issue, we introduce helpful resources for educational and training purposes, which were recently published and which all address data integrity and reproducibility issues: 1. The American Physiological Society (APS) has provided access (full audio and slides) to the 2017 symposium ‘Why Scientific Rigor Matters and Ways to Improve It’. All presenters were asked to
- [Newsletter November 2017](https://paasp.net/newsletter-november-2017/) - TABLE OF CONTENTS: PAASP News: - IMI Call9: PAASP is part of the EQUIPD consortium - Read more - World's first prize for "negative" scientific results announced - Read more - The new ZWM program now contains a module about Good Research Practice - Read more Recent publications related to Good Research Practice - Read
- [Newsletter December 2017](https://paasp.net/newsletter-december-2017/) - PAASP News: - The Pharma Innovation Excellence (PHINNEX) consortium - Read moreRecent publications related to Good Research Practice - Read moreCommentary: 'The link between Portfolio Evolution and the Robustness of drug discovery data' - Read moreCase study: 'After the Nature checklists - what's next?' - Read more
- [The link between Portfolio Evolution and the Robustness of early phase drug discovery data](https://paasp.net/the-link-between-portfolio-evolution-and-the-robustness-of-early-phase-drug-discovery-data-2/) - The reproducibility discussion involves everyone who funds, authorizes, supervises, plans, conducts and publishes research. This recent LifeSciVC post showed that lacking research rigor may also affect financial returns of Venture Capital (VC) funders of biomedical research who, until now, have not been involved in the discussions or international initiatives aiming to enhance robustness of early phase (preclinical)
- [Newsletter January 2018](https://paasp.net/newsletter-january-2018/) - PAASP News: - PAASP is part of the BMBF-funded GOT-IT Project - Read more - New PAASP publication ('The reproducibility crisis in preclinical research - lessons to learn from clinical research') - Read more - World's first prize for 'negative' scientific results - Read more Recent publications related to Good Research Practice - Read more
- [Newsletter February 2018](https://paasp.net/newsletter-february-2018/) - PAASP News: - PAASP’s ‘Data Quality’ workshop at the Justus-Liebig-University Gießen - Read more - New PAASP publication (‘Publishing Transparent and Rigorous Scientific Research’) - Read more Commentary: ‘Don’t shoot the dog’ - Read more
- [Newsletter March 2018](https://paasp.net/newsletter-march-2018/) - PAASP News: - PAASP became a member of BioRN - Read more - PAASP is supporting two ITN-ETN applications - Read more - The PREMIER Symposium Report - Read more Recent publications related to Good Research Practice - Read more Commentary I: ‘Everyone knows mouse research is completely pointless’ - Read more Commentary II: ‘Crossing the river’ - Read
- [Newsletter May 2018](https://paasp.net/newsletter-may-2018/) - Highlight Topic: "How to shift the incentive for researchers from quantitiy to quality?" - Read more Featured publication: "What exactly is N in cell culture and animal experiments?" - Read more Commentary: "Is reading book summaries the same as reading the actual book?" - Read more Case study: "Heads I win, tails you lose" - Read more
- [Newsletter July 2018](https://paasp.net/newsletter-july-2018/) - News: - New Quality System in Football - Read more - New research platform Springer Nature Experiments - Read more - Newly developed HARRP published - Read more - Recommendations for the Design and Analysis of In Vivo Electrophysiology Studies - Read more Recent publications related to Good Research Practice - Read more Commentary I: "The strategy may change, but
- [Newsletter September 2018](https://paasp.net/newsletter-september-2018/) - News - ECNP Preclinical Network Data Prize: The Award Winner - Read more - The Neuroscience 2018 Satellite Symposium - Read more Recent publications related to Good Research Practice To Have Practical Relevance, Scientific Claims Need to be Accurate Read more Genetic and transcriptional evolution alters cancer cell line drug response Read more Guidelines on statistics for
- [Newsletter November 2018](https://paasp.net/newsletter-november-2018/) - News - ECNP Preclinical Network Data Prize: The Award Winner Read more - PAASP’s ‘Data Quality’ workshop at the HBIGS - Read more Featured publication: A Multi-Site Omics Study with iPSC-derived Neurons - Read more Recent publications related to Good Research Practice - Read more Invited Commentary: "Gods vs Earth Giants (by Elena Koustova)" - Read more Commentary
- [To Read More Papers, or to Read Papers Better? A Crucial Point for the Reproducibility Crisis ](https://paasp.net/to-read-more-papers-or-to-read-papers-better-a-crucial-point-for-the-reproducibility-crisis/) - A huge number of new scientific articles published every day often leads to poor reading habits. Both the information overload in today’s scientific literature and the current reproducibility crisis create, each on their own, challenges to the scientific practice. But things get much worse when the information overload and the reproducibility crisis start synergizing to
- [Balancing futility and benefit - Is academic research ready for higher research quality standards?](https://paasp.net/balancing-futility-and-benefit-is-academic-research-ready-for-higher-research-quality-standards/) - byAnton Bespalov (PAASP)Adrian G. Barnett (Queensland University of Technology, Brisbane, Australia)C. Glenn Begley (BioCurate, Melbourne, Australia) *For a condensed version of this commentary, please visit the Nature website. Many of the signals of concern about the current research system originate from industry and are not always positively received by the academic scientific community.In this commentary, we suggest why
- [Newsletter December 2018](https://paasp.net/newsletter-december-2018/) - News PAASP has a new office! Read more2nd Preclinical Data Network Training Workshop for Young Scientists Read more Recent publications related to Good Research Practice Digital tools and services to support research replicability and verifiability Read moreReproducible research practices, transparency, and open access data in the biomedical literature, 2015–2017 Read moreHow to design preclinical studies in nanomedicine
- [NEWSLETTER November 2019](https://paasp.net/newsletter-november-2019/) - NewsThe EQIPD Video Series LINK PAASP US Poster presentation at the Milken Institute LINK PAASP signed the DORA Declaration LINK New Handbook of Experimental Pharmacology focusing on Good Research Practice LINK Presentation of the newly developed Guidelines On Target Validation for Innovative Therapeutics LINK News from NIDA LINK Recent publications related to Good Research Practice - Read moreCommentary:
- [ARRIVE 2.0](https://paasp.net/arrive-2-0/) - A long-awaited revision of the ARRIVE guidelines has finally been published (The ARRIVE guidelines 2019).What impact can we expect from ARRIVE 2.0? At the very least, we hope that the Nature journals will update their life sciences checklist, which will certainly have an impact. As an example, let’s look at the recently published paper that reported on the impact
- [Estimation vs Hypothesis-Testing](https://paasp.net/estimation-vs-hypothesis-testing/) - As some of our readers may know, the PAASP team was involved in the “Negative results Award” project that took place in 2018. One important lesson for us was that any discussion about negative (or null) results should start with a decision whether results are really negative and how confident we are with such a
- [Newsletter March 2019](https://paasp.net/newsletter-march-2019/) - PAASP News: PAASP moves across the Atlantic! LINKPAASP US has won the NIH/NIDA Challenge Award LINKThank you, Bruce! Welcome, Glenn! LINK Recent Publication related to Good Research Practice Meta-Research: Incidences of problematic cell lines are lower in papers that use RRIDs to identify cell lines LINKWhy we need to report more than ’Data were Analyzed by
- [Newsletter May 2019](https://paasp.net/newsletter-may-2019/) - News Pilot implementation of the EQIPD Quality System started on May 14, 2019 Read more LINKNew members of the PAASP Advisory BoardRita Balice-GordonPhil Skolnick Recent publications related to Good Research Practice Endogenous Enterobacteriaceae underlie variation in susceptibility to Salmonella infection LINKExact replication: Foundation of science or game of chance? LINKComparing quality of reporting between preprints and peer-reviewed
- [Newsletter August 2019](https://paasp.net/newsletter-august-2019/) - NEWS The University of Heidelberg and PAASP join forces to work on the Q-CoFa project - Read moreThe EQIPD Summer school - Read moreLaunching of the first EQIPD video - Read more Featured publication: A multi-center study on the reproducibility of drug-response assays - Read more Recent publications related to Good Research Practice: Failing Grade: 89% of Introduction-to-Psychology Textbooks That
- [Newsletter December 2019](https://paasp.net/newsletter-december-2019/) - News - New publication: Be positive about negatives - Read more - EQIPD Stakeholder Group Meeting - Read more - Kick-Off Meeting: Quality Standards for In Vitro Research - Read more - DRAFT NIH Policy for Data Management and Sharing - Read more
- [Newsletter January 2020](https://paasp.net/newsletter-january-2020/) - News NIH has awarded an SBIR grant to a PAASP Network member in the US - Read moreNew Author Guidelines to improve the robustness and transparency of scientific reporting for ASPET journals - Read more Recent publications related to Good Research Practice Rigor and Transparency Index, a new metric of quality for assessing biological and medical science
- [Newsletter March 2020](https://paasp.net/newsletter-march-2020/) - Coronavirus: The need for solid, robust data - Read more Featured Publication: Improving quality of preclinical academic research through auditing: A feasibility study - Read more Recent publications related to Good Research Practice No raw data, no science: another possible source of the reproducibility crisis - Read moreResearch Culture and Reproducibility - Read moreImproving the trustworthiness, usefulness, and ethics
- [Newsletter October 2020](https://paasp.net/newsletter-october-2020/) - PAASP NEWS GPDF, CVB and ECNP announced the Winner of the 2020 Best Negative Data Prize - Read moreFunding opportunities: Accelerating Publication of Parkinson’s Disease Replication Data - Read morePEERS - the Platform for the Exchange of Experimental Research Standards - Read morePAASP’s contribution to the new EQIPD Quality System for preclinical research - Read morePAASP Editorial in Temperature - Read more
- [February 2016](https://paasp.net/february-2016/) - Introducing PAASP PAASP activities The Wheel of Science Introducing the PAASP Advisory Board Meeting reports Recent publications Case study: 'Sperm RNA carries marks of trauma'
- [Newsletter May 2020](https://paasp.net/newsletter-may-2020/) - NEWS The Global Preclinical Data Forum announces the 2020 Negative Data Prize - Read moreDr. Thomas Steckler joins the PAASP Advisory Board - Read morePAASP welcomes Dr. Renza Roncarati as the newest member of the global PAASP Network - Read morePLOS launches reserach data survey - Read more Recent publications related to Good Research Practice Variability in the analysis of a
- [Newsletter December 2020](https://paasp.net/newsletter-december-2020/) - NEWS from the PAASP network Successful adaption of the EQIPD Quality System to specific research needs - Read morePAASP publication: Guidelines for assessing and validating a new drug target - Read morePAASP publication: Q-CoFa - Read moreThe BioRN annual conference - Read moreGreat distinction for PAASP partner Martin C. Michel - Read more Selected publication related to Good Research Practice The
- [Great distinction for PAASP partner Martin C. Michel](https://paasp.net/great-distinction-for-paasp-partner-martin-c-michel/) - Martin - once again - made it into the Clarivate List of Highly Cited Researchers 2020. This list recognizes true pioneers in their fields, demonstrated by their production of multiple highly-cited papers that rank in the top 0.1% by citations for field and year in the Web of Science™. Furthermore, the British Pharmacological Society has elected Martin
- [The “replication crisis” in the public eye: Germans’ awareness and perceptions of the (ir)reproducibility of scientific research](https://paasp.net/the-replication-crisis-in-the-public-eye-germans-awareness-and-perceptions-of-the-irreproducibility-of-scientific-research/) - While 90% of scientists surveyed by Nature feel that there is a “reproducibility crisis” in science (Baker, 2016), and major media outlets such as The Economist have run cover stories on the topic (Anonymous, 2013), we have little knowledge how much of this has reached the public. A secondary analysis of a representative survey in
- [Credibility of preprints: an interdisciplinary survey of researchers](https://paasp.net/credibility-of-preprints-an-interdisciplinary-survey-of-researchers/) - Preprints increase accessibility and can speed scholarly communication if researchers view them as credible enough to read and use. Preprint services do not provide a journal's reputation or a selection and peer-review process that, regardless of their flaws, are often used as a guide for deciding what to read. In this paper, Soderberg and colleagues
- [Use of causal claims in observational studies: a research on research study](https://paasp.net/use-of-causal-claims-in-observational-studies-a-research-on-research-study/) - Many researchers remain tempted to draw causal conclusions from observational data despite acknowledging that mere association is not causation because causal inference is the ultimate goal of most biomedical research. To find out whether and how statements in study reports present confusing use of causal language (or lack thereof), Olarte Parra and colleagues examined abstracts
- [Publication rate in preclinical research: a plea for preregistration](https://paasp.net/publication-rate-in-preclinical-research-a-plea-for-preregistration/) - In biomedical research, limitations in the design and reporting of experiments are known to cause avoidable waste of time and resources. One important factor leading to avoidable waste is publication bias, in which the outcome of a study influences the chance of publishing.However, there are no data available to quantify the extent of this issue.
- [How often do leading biomedical journals use statistical experts to evaluate statistical methods? The results of a survey](https://paasp.net/how-often-do-leading-biomedical-journals-use-statistical-experts-to-evaluate-statistical-methods-the-results-of-a-survey/) - Scientific claims in biomedical research are typically derived from statistical analyses. However, misuse or misunderstanding of statistical procedures and results permeate the biomedical literature, affecting the validity of those claims. One approach journals have taken to address this issue is to enlist expert statistical reviewers. But how many journals actually do this and how is
- [ADDITIONAL READS IN DECEMBER 2020](https://paasp.net/additional-reads-in-december-2020/) - Collaboration on the road to better preclinical research Research integrity: nine ways to move from talk to walk Compliance Services for Data Integrity Millions of animals may be missing from scientific studies Institutions can retool to make research more rigorous She’s wary of the consensus based transparency checklist, and here’s a paragraph we should’ve added
- [How to organize data in a spreadsheet?](https://paasp.net/how-to-organize-data-in-a-spreadsheet/) - Spreadsheets are widely used as a digital tool to capture, organize, process and archive information. However, to organize the information provided properly and logically can be a complex task and doesn’t always come naturally. Therefore, a recent article approached this topic systematically by presenting 12 practical recommendations that should be considered when working with spreadsheets (in bold,
- [Five rules for evidence communication](https://paasp.net/five-rules-for-evidence-communication/) - Communicating science is difficult. We were told to tell exciting stories around our scientific discoveries - and it is certainly true that a good story can be far more memorable and engaging than simply reciting facts. But we should keep in mind that in some cases our attempts to make simple and persuasive communications cannot
- [The Costs of Competitiveness](https://paasp.net/the-costs-of-competitiveness/) - In one of the recent Nature issues, there was a piece called “France’s reforms: the costs of competitiveness”. In a nutshell, this is about the creation of Paris-Saclay, a behemoth conglomerate of research organizations that earned France (for the first time, as emphasized in the article) a place among the top 20 best universities in
- [A time to cast away stones, and a time to gather stones together](https://paasp.net/a-time-to-cast-away-stones-and-a-time-to-gather-stones-together/) - Since the seminal paper by Laura Bohn 20 years ago, expectations have built up that biased mu-opioid receptor agonists will deliver what we all hoped to see since Friedrich Sertürner isolated morphine from opium. With several hundreds of publications, many of which in top journals, a Nobel Prize and a very closely watched development as well as
- [New publication co-authored by PAASP: Survey of Core Facilities shows the importance of communication and management for optimal research quality](https://paasp.net/new-publication-co-authored-by-paasp-survey-of-core-facilities-shows-the-importance-of-communication-and-management-for-optimal-research-quality/) - PAASP and the Interdisciplinary Neurobehavioral Core (INBC) at the University of Heidelberg aim to establish a quality framework for Core Facilities (CF). One task within this project was a status quo analysis amongst different CFs in respect to quality practices and aspects that could be improved when interacting with CF users. More than 250 facilities
- [PAASP publication in Nature Reviews Drug Discovery: Improving target assessment in biomedical research - the GOT-IT recommendations](https://paasp.net/paasp-publication-in-nature-reviews-drug-discovery-improving-target-assessment-in-biomedical-research-the-got-it-recommendations/) - The PAASP team has published an article in Nature Reviews Drug Discovery, together with research groups from the Fraunhofer IME-TMP and the Charité Berlin - with additional input from experts within academia, CROs, TTOs, learned societies and industry. The publication originated from the BMBF-funded GOT-IT (Guidelines on Target assessment for Innovative Therapeutics) project. The aim of
- ['German Leibniz Institute director Karl Lenhard Rudolph guilty of misconduct'](https://paasp.net/german-leibniz-institute-director-karl-lenhard-rudolph-guilty-of-misconduct/) - On June 15th, 2017, The Leibniz Association, one of the largest networks of non-profit research institutions in Germany, has announced a decision in a case of misconduct against the Director of the Leibniz Institute for Aging Research – Fritz-Lipmann-Institut (FLI) in Jena, Professor Dr. Karl Lenhard Rudolph. There are many cases of fraud and misconduct
- [MANILA – A web tool for designing reproducible and transparent preclinical intervention studies](https://paasp.net/manila-a-web-tool-for-designing-reproducible-and-transparent-preclinical-intervention-studies/) - Teemu D. Laajala1,21: University of Turku, Turku (Finland), Department of Mathematics and Statistics2: University of Colorado, Denver (CO, US), Anschutz Medical Campus, Department of PharmacologyMANILA (MAtched ANimaL Analysis) is a novel web-based tool that leverages predictive baseline variables and incorporates complex baseline characteristics for allocating treatment groups in preclinical intervention studies. The need for MANILA was
- [Is N-Hacking ever OK?](https://paasp.net/is-n-hacking-ever-ok/) - It has been proposed repeatedly that adding samples based on results of initial experiments is a form of p-hacking (see e.g. new Instructions to Authors of journals of the Am Soc Exp Pharmacol Ther). While these recommendations were based on sound theoretical considerations, Pamela Rainagel from San Diego demonstrates in a manuscript not yet peer reviewed that the impact
- [Of lab notebooks and leaders in science](https://paasp.net/of-lab-notebooks-and-leaders-in-science/) - Good research practices are often said to work against the current success model in science (based on positive results, number and impact factor of publications, etc.). Changing the way we work requires the current science leaders to act as role models and set good examples. We applaud Dr Frances Arnold, a Nobel Prize winner, for retracting
- [From fecal transplants, obesity and the importance of randomizatIon and normalization](https://paasp.net/from-fecal-transplants-obesity-and-the-importance-of-randomization-and-normalization/) - In one of the last Newsletter issues (LINK), we wrote about the uncertainties which sometimes exist when trying to find the best normalization approach for a given study. In this context, the need to be transparent about normalization or randomization steps and provide sufficiently detailed information is nicely demonstrated by the following example:One of the
- [Coronavirus: The need for solid, robust data](https://paasp.net/coronavirus-the-need-for-solid-robust-data/) - Like everyone else we are with a great concern given the current coronavirus situation and the beginning of a global experiment: What are the right measures to fight the virus and for how long should these measures continue if the pandemic churns across the globe unabated? How can policymakers tell if they are doing more good
- [The Embassy of Good Science - An online platform fostering research integrity](https://paasp.net/the-embassy-of-good-science-an-online-platform-fostering-research-integrity/) - By Iris Lechner The field of research integrity is growing substantially. An increasing number of guidelines and initiatives to foster responsible research practices are being implemented worldwide. Individual researchers however sometimes find it difficult to know which policies, codes and rules of good research practices apply to them in their specific context. In addition, surviving in academia
- [Sample Size Matters - An App Exploring Sample Size and Power](https://paasp.net/sample-size-matters-an-app-exploring-sample-size-and-power/) - Problems with statistical analysis and data visualization in published papers (REF1, REF2, REF3, REF4) have led to calls to improve training for biomedical scientists. Although statistics are essential for biomedical research, statistics training is not always required to complete a PhD.A new set of free online simulators allow readers visually to explore statistical concepts. Each simulator includes a series of questions. Users
- [Conflict of interest – Education needed!](https://paasp.net/conflict-of-interest-education-needed/) - A “Conflict of Interest (CoI)” is a very special situation of which we are usually reminded about when a famous scientist gets criticized - most often in connection to highly publicized areas of science such as CRISPR or Covid-19. For many scientists in Academia, awareness about CoI issues is limited to what is found in the journals’ Instructions
- [Covid-19 and the PPV](https://paasp.net/covid-19-and-the-ppv/) - There has been a lot in the news recently about using antibody tests to detect people who have had Covid-19 and who might therefore be immune to further infection (this remains to be proven). Despite the relatively good performance of many of the proposed antibody tests, with sensitivity and specificity above 95% in most cases,
- [Beauty is not everything](https://paasp.net/beauty-is-not-everything/) - Being able to trust the experimental data is critical for experimental research. This is certainly also true for Western Blotting as one of the most commonly used methods in cell biology laboratories due to its high specificity and sensitivity.Hence there is a critical need for comprehensive reporting of Western Blotting conditions to improve the accuracy
- [Using Microsoft OneNote as an ELN](https://paasp.net/using-microsoft-onenote-as-an-eln/) - Electronic research data documentation can be achieved with either comprehensive software applications or “do-it-yourself” solutions. Whereas the first is often quite cost intensive, the latter one is usually labor intensive to set it up properly. An interesting intermediary solution is provided by Microsoft OneNote:Guerrero and colleagues compared different electronic lab notebook (ELN) applications and found
- [No raw data, no science: another possible source of the reproducibility crisis](https://paasp.net/no-raw-data-no-science-another-possible-source-of-the-reproducibility-crisis/) - Inappropriate practices of science, such as HARKing, p-hacking, and selective reporting of positive results, have been suggested as causes of irreproducibility. In this editorial, the Editor-in-Chief of Molecular Brain, Tsuyoshi Miyakawa, proposed that a lack of raw data or data fabrication is another possible cause of irreproducibility:Since 2017, Tsuyoshi Miyakawa has made 41 editorial decisions categorized as
- [Research Culture: Framework for advancing rigorous research](https://paasp.net/research-culture-framework-for-advancing-rigorous-research/) - There is a pressing need to increase the rigor of research in the life and biomedical sciences. To address this issue, the authors propose to establish communities of ’rigor champions’, who campaign for reforms of the research culture that has led to shortcomings in rigor. These rigor champions would also assist in the development and
- [Rigor and Transparency Index, a new metric of quality for assessing biological and medical science methods.](https://paasp.net/rigor-and-transparency-index-a-new-metric-of-quality-for-assessing-biological-and-medical-science-methods/) - The reproducibility crisis in science is a multifaceted problem involving practices and incentives, both in the laboratory and in publication.Using SciScore, an automated tool developed to review the methods sections of manuscripts for the presence of criteria associated with the NIH and other reporting guidelines (e.g. ARRIVE and RRIDs) the authors have analyzed ~1.6 million
- [Publishers’ Responsibilities in Promoting Data Quality and Reproducibility](https://paasp.net/publishers-responsibilities-in-promoting-data-quality-and-reproducibility/) - Scholarly publishers can help to increase data quality and reproducible research by promoting transparency and openness. Increasing transparency can be achieved by publishers in six key areas: (1) understanding researchers’ problems and motivations; (2) raising awareness of issues and encouraging behavioural and cultural change; (3) improving the quality and objectivity of the peer-review process; (4)
- [Is N-Hacking Ever OK? A simulation-based study](https://paasp.net/is-n-hacking-ever-ok-a-simulation-based-study-2/) - After an experiment has been completed and analyzed, a trend may be observed that is “not quite significant”. Sometimes in this situation, researchers incrementally grow their sample size N in an effort to achieve statistical significance. This is especially tempting in situations when samples are very costly or time-consuming to collect, such that collecting an
- [Additional READS in January 2020](https://paasp.net/additional-reads-in-january-2020/) - Measuring Transparency and Reproducibility of Biomedical Articles Causal claims about correlations reduced in press releases following academic study of health news Working together towards reproducibility Has reproducibility improved? Introducing the Transparency and Rigor Index Registered Reports are coming to PLOS ONE
- [Research Culture and Reproducibility](https://paasp.net/research-culture-and-reproducibility/) - There is an ongoing debate regarding the robustness and credibility of published scientific research. In this article, the authors argue that these issues stem from two broad causal mechanisms: the cognitive biases of researchers and the incentive structures within which researchers operate. To address these issues, the UK Reproducibility Network (UKRN) was founded and is
- [Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature](https://paasp.net/comparing-quality-of-reporting-between-preprints-and-peer-reviewed-articles-in-the-biomedical-literature-2/) - Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this study, the authors
- [Additional reads in March 2020](https://paasp.net/additional-reads-in-march-2020/) - Preregistration of exploratory research: Learning from the golden age of discovery What Research Institutions Can Do to Foster Research Integrity When Science Needs Self-Correcting Journal transparency index will be ‘alternative’ to impact scores Universities ‘should bolster their research integrity policies’ Wozu Tierversuche? Medikamente gibt’s doch in der Apotheke (in German) Scientists offered €1,000 to publish
- [Commentary March 2020](https://paasp.net/commentary-march-2020/) - Comment on Walsh et al. “The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility Index” J Clin Epidemiol 67: 622-628, 2014Despite common misconceptions, a p-value does not tell us anything about truth (i.e. that an observed finding in a sample is representative for the underlying population of interest);
- [Variability in the analysis of a single neuroimaging dataset by many teams](https://paasp.net/variability-in-the-analysis-of-a-single-neuroimaging-dataset-by-many-teams/) - To test the reproducibility and robustness of results obtained in the neuroimaging field, 70 independent teams of neuroimaging experts from across the globe were asked to analyze and interpret the same functional magnetic resonance imaging dataset.The authors found that no two teams chose identical workflows to analyse the data - a consequence of the degrees
- [Systematic review of guidelines for internal validity in the design, conduct and analysis of preclinical biomedical experiments involving laboratory animals](https://paasp.net/systematic-review-of-guidelines-for-internal-validity-in-the-design-conduct-and-analysis-of-preclinical-biomedical-experiments-involving-laboratory-animals/) - Several initiatives have set out to increase transparency and internal validity of preclinical studies. While many of the points raised in these various guidelines are identical or similar, they differ in detail and rigour. Most of them focus on reporting, only few of them cover the planning and conduct of studies.The aim of this systematic
- [Die Reproduzierbarkeitskrise: Bedrohung oder Chance für die Wissenschaft? (In German)](https://paasp.net/die-reproduzierbarkeitskrise-bedrohung-oder-chance-fur-die-wissenschaft-in-german/) - In this Editorial, published in Biologie in unserer Zeit, Martin C. Michel and Ralf Dahm discuss threats and opportunities related to the current reproducibility crisis in biomedical sciences.The authors highlight several top-down approaches currently in place to increase data quality and reproducibility: the BMBF, the EU or the NIH have launched research programs on the
- [Additional reads in May 2020](https://paasp.net/additional-reads-in-may-2020/) - SuperPlots: Communicating reproducibility and variability in cell biology Against pandemic research exceptionalism Pseudoscience and COVID-19 — we’ve had enough already Spin in Scientific Publications: A Frequent Detrimental Research Practice Pseudoscience and COVID-19 — we’ve had enough already Coronavirus in context: Scite.ai tracks positive and negative citations for COVID-19 literature Pandemic researchers — recruit your own
- [Impact of tumour heterogeneity and tissue sampling for genetic mutation testing: a systematic review and post hoc analysis](https://paasp.net/impact-of-tumour-heterogeneity-and-tissue-sampling-for-genetic-mutation-testing-a-systematic-review-and-post-hoc-analysis/) - Staff at QED Biomedical Ltd have conducted research to demonstrate how sample bias in patient- derived tumour tissue samples with somatic mutations may affect current clinical research and precision medicine. The research identified the following limitations:The review found no guidelines to aid systematic reviewers, clinical researchers, or decision makers in considering, critiquing, and understanding the
- [Introducing PAASP: Why not a non-profit organisation?](https://paasp.net/introducing-paasp-why-not-a-non-profit-organisation/) - We, Anton Bespalov, Björn Gerlach and Christoph Emmerich, the three co-founders of PAASP, all reside in Germany and we have carefully evaluated various legal forms that PAASP could take. Because of the nature of our activities (especially in the consulting and assessment aspects), legal advice was to select a form that limits founders’ personal liability.
- [PAASP: current and future activities](https://paasp.net/paasp-current-and-future-activities/) - PAASP was founded with the mission to ‘protect the integrity of science, increase reproducibility and ensure proper training of new generations of scientists’ and is focusing specifically on the development and implementation of research standards in the area of Good Scientific Practice (GSP) and training programs to enhance robustness of pharmaceutical drug discovery. Over the
- [The Wheel of Science](https://paasp.net/the-wheel-of-science/) - You might have seen the Wheel of Science (WoS) on the front page of our website - but what does it actually mean and why is it at the central focal point for our activities at PAASP? The WoS summarizes the proper way of conducting a research project according to the basics of GSP. The blue gear-wheels
- [Y47 Partnership](https://paasp.net/y47-partnership/) - PAASP services aim to identify areas that need improvement and to provide our clients with the necessary tools. We believe that this process becomes successful only when the need for change is understood and driven from the inside of the clients’ organization. To that end, and in addition to our training program, PAASP has partnered
- [PAASP enters a new partnership with Arlenda](https://paasp.net/paasp-enters-a-new-partnership-with-arlenda/) - Various aspects of the service provided by PAASP are directly or indirectly related to data analysis. While the PAASP team has been trained to apply data analysis tools and methods, we do believe that additional expertise from highly specialized statisticians will help our clients to establish best data handling practices for relevant projects. To that
- [Development of an information sharing platform - Pharma shares unpublished results](https://paasp.net/development-of-an-information-sharing-platform-pharma-shares-unpublished-results/) - F1000 Research has published an article entitled “In search of the mechanisms of ketamine’s antidepressant effects: How robust is the evidence behind the mTor activation hypothesis” co-authored by PAASP’s managing partner Anton Bespalov, together with colleagues from AbbVie, Servier, Pfizer and Alkermes. Independently of each other, all four groups followed the reports that the antidepressant-like
- [PAASP partner became TÜV-certified ‘Qualitätsbeauftragter, -manager and -auditor’](https://paasp.net/paasp-partner-became-tuv-certified-qualitatsbeauftragter-manager-and-auditor/) - PAASP partner Björn Gerlach undertook a three-month course focusing on classical quality management systems, like ISO9001 and EFQM. After passing written and oral examinations, Björn became a TÜV-Rhineland certified quality manager (“Qualitätsbeauftragter, -manager and -auditor”).This knowledge will contribute to PAASP’s mission of enhancing quality in biomedical research but also helps to implement a quality system
- [Meeting Report - St. Petersburg:](https://paasp.net/meeting-report-st-petersburg/) - June 1, 2016 - Anton Bespalov participated in the meeting "Current issues in the preclinical and clinical research on novel drugs, biomedical cell products and medical devices" in St Petersburg. This meeting, held for the fifth time, is a unique opportunity for the academic and industrial researchers and organizations (including CROs and SMEs) to meet
- [Meeting Report - Washington, DC](https://paasp.net/meeting-report-washington-dc/) - June 5, 2017 - Anton Bespalov took part in the meeting in Washington, DC (USA) hosted by Francis Collins, Director of National Institutes of Health (NIH), and Nora Volkow, Director of National Institute on Drug Abuse. This meeting was aimed to discuss the role of science in addressing the opioid crisis (LINK) and was attended
- [Meeting report - PAASP at the 5th World Conference on Research Integrity (WCRI)](https://paasp.net/meeting-report-paasp-at-the-5th-world-conference-on-research-integrity-wcri/) - Björn Gerlach attended the 5th WCRI, which was held in Amsterdam from May 28th to May 31st. With over 800 participants, it is the biggest conference of its kind addressing all different aspects of research integrity, e.g. meta-research, mechanisms to improve reproducibility and how to deal with research misconduct and fraud.Many speakers with different backgrounds
- [PAASP enters a new partnership with HENRICH Pharma-R&D Consulting](https://paasp.net/paasp-enters-a-new-partnership-with-henrich-pharma-rd-consulting/) - We are proud to announce that PAASP has partnered with HENRICH Pharma-R&D Consulting, a specialised consulting firm located in the Frankfurt area in Germany (http://en.dr-henrich.com). Markus Henrich, founder and managing partner, looks back at two decades of experience in pharma R&D, especially in the preclinical field. During his time at the industry he gained expertise
- [PAASP moves into new offices](https://paasp.net/paasp-moves-into-new-offices/) - In January 2019, we are moving into new office space, located in the centre of Heidelberg (Kunsthaus 25, Hauptstraße 25, 69117 Heidelberg). Please step by and say hello when you are in the area!
- [PDN Training Workshop](https://paasp.net/pdn-training-workshop/) - Feb 27 – Mar 1, 2019 (Athens, Greece)“How to Make Preclinical Research Robust”2nd Preclinical Data Network Training Workshop for Young ScientistsCoordinators (Europe): Anton Bespalov (PAASP), Thomas Steckler (Janssen)Coordinators (North America): Magali Haas, Patricia Kabitzke, Chantelle Ferland-Beckham (Cohen Veterans Bioscience)Local organizers: Christina Dalla, Nikolaos Kokras (National and Kapodistrian University of Athens)This workshop aims to enhance awareness and
- [PAASP moves across the Atlantic!](https://paasp.net/paasp-moves-across-the-atlantic/) - We have always enjoyed our connections to peers in the US and the support from our US-based advisors, but have felt the need to be in better contact with the research scene in the US. To help us achieve this goal, we are very glad and proud to announce that our long-term colleagues and collaborators
- [Presentation of the newly developed Guidelines On Target Validation for Innovative Therapeutics (GOT-IT)](https://paasp.net/presentation-of-the-newly-developed-guidelines-on-target-validation-for-innovative-therapeutics-got-it/) - Representing the GOT-IT Team, Christoph Emmerich presented the GOT-IT Guidelines at the “BMBF Vernetzungstreffen zur Nationalen Wirkstoffinitiative” on the 8th of October 2019, which was attended by academic PIs, industry representatives, officials from the Federal Ministry of Education and Research and members of the German Parliament.Furthermore, PAASP co-organized and led a workshop on target validation for
- [PAASP signed the DORA Declaration](https://paasp.net/paasp-signed-the-dora-declaration/) - The Declaration on Research Assessment (DORA) recognizes the need to improve the ways in which the outputs of scholarly research are evaluated.Read more about the DORA Declaration HERE.
- [Be positive about negatives - recommendations for the publication of negative (or null) results.](https://paasp.net/be-positive-about-negatives-recommendations-for-the-publication-of-negative-or-null-results/) - PAASP’s Anton Bespalov together with Phil Skolnick (Opiant) and Thomas Steckler (Janssen) address the issue of negative data being rarely disclosed in a form of scientific publications. There seems to be general reluctance to publish negative results, due to a range of factors (e.g., the preference to publish positive findings that are more likely to
- [PAASP is part of the BMBF-funded GOT-IT (‘Guidelines On Target Validation for Innovative Therapeutics’) Project](https://paasp.net/paasp-is-part-of-the-bmbf-funded-got-it-guidelines-on-target-validation-for-innovative-therapeutics-project/) - Medical progress and continued supply of innovative medicines can only be guaranteed by continuous research and development of new active drugs and therapeutics. The most important starting point for the identification of new drugs are disease-modifying targets. Thus, the proper validation of pharmaceutically relevant targets based on defined quality criteria is a key criterion for
- [PAASP US, LLC receives funding from NIH](https://paasp.net/paasp-us-llc-receives-funding-from-nih/) - The PAASP Network is very glad to announce that the NIH has awarded an SBIR grant to a Network member – PAASP US, LLC. Robust nonclinical data is an absolute requirement for building an effective translational strategy and developing clinically safe and effective medications. Most current efforts to facilitate generation of robust nonclinical research data focus
- [PEERS - the Platform for the Exchange of Experimental Research Standards](https://paasp.net/peers-the-platform-for-the-exchange-of-experimental-research-standards/) - We are happy to announce that PAASP is part of the PEERS (Platform for the Exchange of Experimental Research Standards) initiative, which is supported by and run in collaboration with Cohen Veterans Bioscience. The project originated from the ECNP Preclinical Data Forum and started in July 2020.The aim of PEERS is the development of an open-access online platform that
- [Upcoming Events](https://paasp.net/upcoming-events/) - - February 20-22, 2020 - Berlin, GermanyREWARD / EQUATOR Conference 2020Hosted by the BIH QUEST Center, the topic of the conference is: Sharing Strategies for Research Improvement - Challenges and opportunities for Improvement for Ethics Committees and Regulators, Publishers, Institutions and Researchers, Funders – and Methods for measuring and testing Interventions.A preliminary program is available HERE.
- [PAASP at the REWARD/EQUATOR Conference in Berlin (February 20-22, 2020)](https://paasp.net/paasp-at-the-reward-equator-conference-in-berlin-february-20-22-2020/) - We will present our activities to improve Good Research Practice and Data Quality and are very much looking forward to meet you in Berlin.The topic of the conference is: Sharing Strategies for Research Improvement - Challenges and opportunities for Improvement for Ethics Committees and Regulators, Publishers, Institutions and Researchers, Funders – and Methods for measuring
- [Pilot implementation of the EQIPD Quality System](https://paasp.net/pilot-implementation-of-the-eqipd-quality-system/) - EQIPD (European Quality in Preclinical Data) is developing a flexible quality-management framework that aims to improve conduct and reporting of preclinical research in both the public and the private sectors. Being part of the team, we are glad to share the exciting news that the EQIPD team has reached a consensus on the design and
- [EQIPD Summer School 2019](https://paasp.net/eqipd-summer-school-2019/) - "Improving preclinical data quality and robustness"Now open for registration! We’re excited to announce that, for the second consecutive year, SYRCLE will host the EQIPD Summer School 2019 entitled "Improving preclinical data quality and robustness"! Date and place: September 16th-19th 2019 at Radboud university medical center, Nijmegen, The Netherlands Click here for the full draft program.To register, please
- [Want to learn about EQIPD?](https://paasp.net/want-to-learn-about-eqipd/) - A series of videos is published about EQIPD by the ECNP network. The first video gives a brief introduction by Dr Thomas Steckler. In his second video, Thomas explains why EQIPD is needed. The third video is about the objectives of EQIPD. The fourth video describes the idea on how the EQIPD QS will be
- [March 2-3, 2020: EQIPD Meeting in Frankfurt am Main, Germany](https://paasp.net/march-2-3-2020-eqipd-meeting-in-frankfurt-am-main-germany/) - Hosted by Fraunhofer IME-TMP and co-sponsored by PAASP, the next EQIPD Stakeholder Group meeting will review the practical aspects of using EQIPD Quality System tools and will brainstorm the long-term sustainability of the EQIPD Quality System framework.
- [Building a nearshoring collaboration: Success story](https://paasp.net/building-a-nearshoring-collaboration-success-story/) - Starting to work together with someone you do not know is often associated with some risk-taking if this person is outside your regular circle of collaborators and is off the mainstream of usual partners. We often observe that pharma companies are much more open to collaboration with service providers in the Far East countries than
- [Decision-enabling studies: Robust enough to support critical decisions?](https://paasp.net/decision-enabling-studies-robust-enough-to-support-critical-decisions/) - Decision-making is an essential function of any company and determines long-term success. However, what are the key factors that influence decision-enabling in the pharmaceutical industry leading to new products and approved drugs? To analyze the importance of Good Research Practice (GRP) standards as well as the quality and validity of data for this decision process
- [Blinding - does it really have an impact?](https://paasp.net/blinding-does-it-really-have-an-impact/) - Zubin Mehta, conductor of the Los Angeles Symphony from 1964 to 1978 and of the New York Philharmonic from 1978 to 1990, is credited with saying, “I just don’t think women should be in an orchestra.” In 1970, the top five orchestras in the U.S. had fewer than 5% female musicians and this number gradually
- [Number of citations as a measure of research quality - a dangerous approach](https://paasp.net/478/) - How Many Is Too Many? On the Relationship between Research Productivity and Impact. In this research article, published in PLOS One (Larivière V, Costas R (2016) PLoS ONE 11(9): e0162709), V. Larivière and R. Costas analysed the publication and citation records of more than 28 million researchers, who published at least one paper between 1980
- [Error bars can convey misleading information](https://paasp.net/error-bars-can-convey-misleading-information/) - by Martin C. Michel The most common type of graphical data reporting are bar graphs depicting means with SEM error bars. Based on simulated data, Weissgerber et al. have argued convincingly that bar graphs are not showing but rather hiding data, as various patterns of underlying data can lead to the same mean value (Weissgerber
- [Improving quality of preclinical academic research through auditing: A feasibility study](https://paasp.net/improving-quality-of-preclinical-academic-research-through-auditing-a-feasibility-study/) - Commentary provided by Claudia Kurreck (Department of Experimental Neurology, Charité -Universitätsmedizin Berlin, Germany) The performance of audits and assessments is always a sensitive issue in the academic preclinical research environment. The most important argument for not conducting audits in the scientific community has been that audits would restrict the freedom of research; in the past, they
- [The Hong Kong Principles for assessing researchers: Fostering research integrity](https://paasp.net/the-hong-kong-principles-for-assessing-researchers-fostering-research-integrity/) - For knowledge to benefit research and society, it must be trustworthy. Trustworthy research is robust, rigorous, and transparent at all stages of design, execution, and reporting. However, assessment of researchers still rarely includes considerations related to trustworthiness, rigor, and transparency. Thus, and as part of the 6th World Conference on Research Integrity, the authors have developed
- [New Author Guidelines for Displaying Data and Reporting Data Analysis and Statistical Methods in Experimental Biology](https://paasp.net/new-author-guidelines-for-displaying-data-and-reporting-data-analysis-and-statistical-methods-in-experimental-biology/) - To improve the robustness and transparency of scientific reporting, the American Society for Pharmacology and Experimental Therapeutics (ASPET), with input from PAASP’s Martin Michel, T.J. Murphy and Harvey Motulsky, has updated the Instructions to Authors (ItA) for ASPET’s primary research journals: Drug Metabolism and Disposition, Journal of Pharmacology and Experimental Therapeutics, and Molecular Pharmacology. The revised ItA went into effect on
- [Data analysis - Issues, challenges and solutions](https://paasp.net/data-analysis-issues-challenges-and-solutions/) - The first official meeting of the Preclinical Data Forum took place in Berlin in 2014 and one of the central seminars was given by Viswanath Devanarayan, head of Discovery Biostatistics at AbbVie at that time. And the first thing Devan did was to tell us the following story:A biologist and a statistician are in the death row,
- [How to shift the incentive for researchers from quantity to quality?](https://paasp.net/how-to-shift-the-incentive-for-researchers-from-quantity-to-quality/) - In the current hyper-competitive research environment, scientists feel the constant need to publish novel findings as often and as fast as possible, as career progression and attracting funding are mainly associated with publication records. Reporting positive results over negative or inconclusive outcomes is often encouraged, which places an emphasis on novelty and comes at the
- [Be open! Ongoing efforts to make science more open...](https://paasp.net/be-open-ongoing-efforts-to-make-science-more-open/) - At the beginning of July, the Wellcome Trust (WT), one of UK's biggest non-governmental biomedical research funders, announced that they will provide a platform for researchers funded by WT to publish their data and research studies for free online. After uploading, the data can be critically read and openly commented by the scientific community. On July 28th, WT has
- [Research rigor in preclinical studies on biological effects of whole-body exposure to electromagnetic fields (2G/3G cell phone technology)](https://paasp.net/research-rigor-in-preclinical-studies-on-biological-effects-of-whole-body-exposure-to-electromagnetic-fields-2g-3g-cell-phone-technology/) - Various modern technologies are known to bear risks to the human health. In many cases, the society learns about these risks only once negative consequences have become obvious, for example in the cases of asbestos, DDT and, most recently, the broad-spectrum systemic herbicide Glyphosate. In the area of drug development, there is a risk mitigation
- [Reproducibility of animal research in light of biological variation](https://paasp.net/reproducibility-of-animal-research-in-light-of-biological-variation/) - Context-dependent biological variation presents a unique challenge to the reproducibility of results in experimental animal research, because organisms’ responses to experimental treatments can vary with both genotype and environmental conditions. In contrast to the current gold standard of rigorous standardization in experimental animal research, the authors recommend the use of systematic heterogenization of study samples
- [Improving the trustworthiness, usefulness, and ethics of biomedical research through an innovative and comprehensive institutional initiative](https://paasp.net/improving-the-trustworthiness-usefulness-and-ethics-of-biomedical-research-through-an-innovative-and-comprehensive-institutional-initiative/) - The reproducibility crisis triggered worldwide initiatives to improve rigor, reproducibility, and transparency in biomedical research. There are many examples of scientists, journals, and funding agencies adopting responsible research practices. The QUEST (Quality-Ethics-Open Science-Translation) Center offers a unique opportunity to examine the role of institutions. The Berlin Institute of Health founded QUEST to increase the likelihood
- [Fun, fun, fun...](https://paasp.net/fun-fun-fun/) - A mathematician, a physicist, and a statistician went hunting for deer. When they chanced upon one buck lounging about, the mathematician fired first, missing the buck’s nose by a few inches.The physicist then tried his hand and missed the tail by a wee bit.The statistician started jumping up and down saying, “We got him! We
- [PAASP Editorial in the Journal Temperature](https://paasp.net/paasp-editorial-in-the-journal-temperature/) - Please following this LINK to our Editorial “Enhancing quality in preclinical data: Of hot science and cool quality”, which was just published in the Journal Temperature.In this Editorial, we focus on the heated discussions around the use of different Covid-19 treatments like hydroxychloroquine or the safety of modern 5 G cell phone technologies - and how to equip the research community
- [Reproducibility in systems biology modelling](https://paasp.net/reproducibility-in-systems-biology-modelling-2/) - The reproducibility crisis has emerged as an important concern across many fields of science. Systems biology modelling, which involves mathematical representation of biological processes to study complex system behaviour, was expected to be least affected by this crisis.However, in this article, the authors systematically attempted to reproduce 455 kinetic models of biological processes published in
- [Ten simple rules on how to write a standard operating procedure](https://paasp.net/ten-simple-rules-on-how-to-write-a-standard-operating-procedure/) - The long-term accessibility of research data is fundamental in the economy of the research production process. However, the availability of data is not sufficient by itself, but also their quality must be verifiable. Measures to ensure re-use and reproducibility need to include the entire research life cycle, from the experimental design to the generation of
- [How the COVID-19 pandemic highlights the necessity of animal research](https://paasp.net/how-the-covid-19-pandemic-highlights-the-necessity-of-animal-research/) - Recently, a petition was offered to the European Commission calling for an immediate ban on animal testing. Although a Europe-wide moratorium on the use of animals in science is not yet possible, there has been a push by the non-scientific community and politicians for a rapid transition to animal-free innovations. However, advances on alternative methods
- [Violation of research integrity by selective citation](https://paasp.net/violation-of-research-integrity-by-selective-citation/) - We have written repeatedly (LINK, LINK) about the border between the fields of Good Research Practice and Research Integrity being more nuanced than many of us have previously assumed. The European Code of Conduct for Research Integrity (ALLEA) provides several examples of unacceptable research practices that have nothing to do with fabrication, falsification or plagiarism, forms of
- [Additional reads in October 2020](https://paasp.net/additional-reads-in-october-2020/) - When antibodies mislead: the quest for validation Von Maus zu Mensch durch das Tal des Todes (in German) Researchers’ Perceptions of a Responsible Research Climate: A Multi Focus Group Study A platform for reproducibility You Want to See My Data? I Thought We Were Friends! How to empower a Culture of Failure in Science Reimagining
- [In vivo veritas](https://paasp.net/in-vivo-veritas/) - Most of our readers are biologists but nevertheless we are occasionally exposed to medicinal chemistry literature describing novel research tools, lead molecules or drug candidates. Medicinal chemistry papers often include evidence from animal research supporting certain qualities of novel chemical entities. Like us, you may have noticed that, while the chemistry methods are presented with
- [Newsletter August 2020](https://paasp.net/newsletter-august-2020/) - NEWS - PAASP US receives a Small Business Innovation Research (SBIR) grant - Read more - PAASP welcomes Dr. Valentina Vengeliene as a new member of the global PAASP Network - Read more - NIH RFI aims at enhancing rigor, transparency, and translatability to improve biomedical research
- [Academic criteria for promotion and tenure in biomedical sciences faculties: cross-sectional analysis of international sample of universities](https://paasp.net/academic-criteria-for-promotion-and-tenure-in-biomedical-sciences-faculties-cross-sectional-analysis-of-international-sample-of-universities/) - Understanding the variability of criteria and thresholds for promotion and tenure applied across institutions requires a systematic empirical assessment. Therefore, the authors aimed to identify and document a set of pre-specified traditional (for example, number of publications) and non-traditional (for example, data sharing) criteria used to assess scientists for promotion and tenure within faculties of
- [Advancing science or advancing careers? Researchers’ opinions on success indicators](https://paasp.net/advancing-science-or-advancing-careers-researchers-opinions-on-success-indicators/) - The way in which we assess researchers has been under the radar in the past few years. Critics argue that current research assessments focus on productivity and that they increase unhealthy pressures on scientists. Yet, the precise ways in which assessments should change is still open for debate. In this article, the authors designed a
- [Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence](https://paasp.net/using-bayes-factor-hypothesis-testing-in-neuroscience-to-establish-evidence-of-absence/) - For neuroscience and brain research to progress, it is critical to differentiate between experimental manipulations which have no effect and those that do have an effect. The dominant statistical approaches used in neuroscience rely on p-values and can establish the latter but not the former. This makes non-significant findings difficult to interpret: do they support
- [Choice of y-axis can mislead readers](https://paasp.net/choice-of-y-axis-can-mislead-readers/) - Biases at the level of study design, conduct, data analysis and reporting have been recognized as major contributing factors to poor reproducibility. Authors from Turkey, UK and Germany (including PAASP partner Martin C. Michel) now add another type of bias to the growing list of biases, “perception bias”. Based on examples from the non-scientific literature
- [Additional reads in August 2020](https://paasp.net/additional-reads-in-august-2020/) - Five better ways to assess science $48 Billion Is Lost to Avoidable Experiment Expenditure Every Year Opinion: Surgisphere Fiasco Highlights Need for Proper QA Assuring research integrity during a pandemic Reproducibility in Cancer Biology: Pseudogenes, RNAs and new reproducibility norms The Problems With Science Journals Trying to Be Gatekeepers – and Some Solutions Replications do
- [Federal judge invalidates patents - but on the basis of a common statistical mistake](https://paasp.net/federal-judge-invalidates-patents-but-on-the-basis-of-a-common-statistical-mistake/) - In a recent case before the US District Court in the District of Nevada, the judge ruled six method-of-use patents to be invalid because the claims were obvious based on previously published data (“prior art”). Curfman et al. (2020) argue her decision was incorrect, because the judge interpreted the published statistical analysis incorrectly. Mori et al. (2000) measured
- [Best-dose analysis - A confirmatory research case](https://paasp.net/best-dose-analysis-a-confirmatory-research-case/) - It is often observed and discussed that there are substantial inter-individual differences that can overshadow effects of otherwise effective treatments. These differences can be present in the form of a varying pre-treatment “baseline” that often motivates researchers to express the post-treatment results not in absolute terms but relative to the baseline. A less commonly discussed scenario
- [Risk‐of‐bias VISualization (robvis): An R package and Shiny web app for visualizing risk‐of‐bias assessments](https://paasp.net/risk‐of‐bias-visualization-robvis-an-r-package-and-shiny-web-app-for-visualizing-risk‐of‐bias-assessments/) - There is currently no generic tool for producing figures to display and explore the risk‐of‐bias assessments that routinely take place as part of systematic review.In this article, the authors, therefore, present a new tool, robvis (Risk‐Of‐Bias VISualization), available as an R package and web app, which facilitates rapid production of publication‐quality risk‐of‐bias assessment figures. A
- [Reproducibility in systems biology modelling](https://paasp.net/reproducibility-in-systems-biology-modelling/) - A recent report by Tiwari et al. investigated the reproducibility rate in systems biology modelling by reproducing the mathematical representation of 455 kinetic models. The authors tried to 1.) reproduce the published model (step 1), 2.) if failed, adjust their efforts based on experience (step 2), 3.) if failed again, contact the authors of the original study
- [Signing digitally with Microsoft](https://paasp.net/signing-digitally-with-microsoft/) - A. Background & Definitions Microsoft Office (incl. Word, Excel and PowerPoint) offers the possibility to create a digital signature (digital ID) as an electronic stamp of authentication on digital documents. ​B. Guidance & Expectations To create a digital signature, a signing certificate is required: you can create your own digital certificate for freeto allow verification of the
- [R script BestDose](https://paasp.net/r-script-bestdose/) - library(scales)library(ggplot2)## sample sizen1
- [Scaling the y-axis](https://paasp.net/scaling-the-y-axis/) - One of our colleagues sent us this interesting image from a national TV station. Even though the topic is very sad and concerning, the scaling of the y-axis caught our attention and left us with perplexing astonishment.
- [Octopus: The primary research record](https://paasp.net/octopus-the-primary-research-record/) - Created in partnership with the UK Reproducibility Network, the Octopus platform is free to use and publishes all kinds of scientific work, whether it is a hypothesis, a method, data, an analysis or a peer review. The principle behind Octopus is to break the ‘unit of publication’ down from being a ‘paper’ to its constituent
- [PLOS launches research data survey](https://paasp.net/plos-launches-research-data-survey/) - PLOS has launched a major survey targeting researchers in North America and Europe: The goal is to deepen the understanding of researchers’ priorities with regards to sharing and reusing research data, and to understand how well existing tools and services are meeting researchers’ needs.Please consider taking part in the survey and / or forward to
- [Fun Section January 2020](https://paasp.net/fun-section-january-2020/) - A funny way to show the importance of describing your study/experiment in most detail and to be transparent and precise so that colleagues are able to reproduce your results…
- [Is N-Hacking Ever OK? A simulation-based study](https://paasp.net/is-n-hacking-ever-ok-a-simulation-based-study/) - After an experiment has been completed and analyzed, a trend may be observed that is “not quite significant”. Sometimes in this situation, researchers incrementally grow their sample size N in an effort to achieve statistical significance. This is especially tempting in situations when samples are very costly or time-consuming to collect, such that collecting an
- [Parachute use to prevent death and major trauma when jumping from aircraft: randomized controlled trial](https://paasp.net/parachute-use-to-prevent-death-and-major-trauma-when-jumping-from-aircraft-randomized-controlled-trial/) - Objective: To determine if using a parachute prevents death or major traumatic injury when jumping from an aircraft.Design: Randomized controlled trial.Setting: Private or commercial aircraft between September 2017 and August 2018.Participants: 92 aircraft passengers aged 18 and over were screened for participation. 23 agreed to be enrolled and were randomized.Intervention: Jumping from an aircraft (airplane or helicopter) with a parachute
- [When p-hacking is not p-hacking - or: How shall the data be reported?](https://paasp.net/when-p-hacking-is-not-p-hacking-or-how-shall-the-data-be-reported/) - Organ bath experiments are a key technology to assess contractility of smooth muscle. When comparing force of contraction, investigators typically normalize measured force for size of the tissue specimen as a larger piece of tissue should develop greater force. However, there is a lack of agreement which parameter should be used as denominator for normalization. To
- [Instead of replicating studies with problems, let's replicate the good studies](https://paasp.net/instead-of-replicating-studies-with-problems-lets-replicate-the-good-studies/) - A few months ago, the “Reproducibility and Replicability in Science” report from the National Academies of Sciences, Engineering, and Medicine was published. It included a set of criteria to help determine when testing replicability may be warranted:1) The scientific results are important for individual decision-making or for policy decisions.2) The results have the potential to
- [An ounce of prevention is worth a pound of cure](https://paasp.net/an-ounce-of-prevention-is-worth-a-pound-of-cure/) - We have read with great interest a recent commentary in Nature about scientific research organizations hiring integrity reviewers to vet their manuscripts before publication. According to the article, several European institutions have now hired external companies or dedicated in-house experts to check research manuscripts before they are submitted to journals.The institutions say the cost of the endeavor
- [ADDITIONAL READS December 2019](https://paasp.net/additional-reads-december-2019/) - Why scientists need to be better at data visualization Statistical significance gives bias a free pass Petitions in scientific argumentation: Dissecting the request to retire statistical significance Review Commons, a pre-journal portable review platform Raising research quality will require collective action When it comes to good practice in science, we need to think global but
- [A consensus-based transparency checklist](https://paasp.net/a-consensus-based-transparency-checklist/) - Transparency of research processes is required not only for evaluating and reproducing results, but also for research synthesis and meta-analysis from the raw data and for effective replication and extension of that work.To improve transparency, the authors provide a consensus-based transparency checklist for behavioural and social sciences, with a special focus on confirmatory work.The checklist
- [Publication rates in animal research. Extent and characteristics of published and non-published animal studies followed up at two German university medical centres](https://paasp.net/publication-rates-in-animal-research-extent-and-characteristics-of-published-and-non-published-animal-studies-followed-up-at-two-german-university-medical-centres/) - Non-publication and publication bias in animal research are prominent topics in current debates on the “reproducibility crisis” and “failure rates in clinical research”. To date, however, we lack reliable evidence on the extent of non-publication in animal research. In this article, Wieschowski and colleagues analysed the publication rate of 210 animal study protocols obtained from
- [News from NIDA](https://paasp.net/news-from-nida/) - The National Institute on Drug Abuse (NIDA), part of the US National Institutes of Health (NIH), is pleased to announce an intent to publish a funding opportunity announcement for basic scientists, including those residing outside of the USA. This unique program aims to expand the range of drug targets and mechanisms for Substance Use Disorder (SUD) therapies.
- [Maze with cheese enters human trials following decades of testing on mice](https://paasp.net/maze-with-cheese-enters-human-trials-following-decades-of-testing-on-mice/) - Maze with cheese enters human trials following decades of testing on mice“After thousands of rounds of animal testing going back to the early 1950s, I speak for everyone at Harvard when I say we are overjoyed to have finally reached our end-stage testing goal: placing full-sized adult humans in a labyrinth and forcing them to
- [A FAIRy tale](https://paasp.net/a-fairy-tale/) - Once upon a time in the beautiful kingdom of Datamania lived a prince named Prince Fairhair. Though he was gentle as few, and good looking too, his father would not let him choose the love of his life on his own. No, he was destined to marry a woman from the neighbouring kingdom. He did
- [Thoughts on How Institutions Can Promote a Culture of Research Integrity](https://paasp.net/thoughts-on-how-institutions-can-promote-a-culture-of-research-integrity/) - By Dr. Michael Lauer (NIH) Link to web page
- [Additional reads November 2019](https://paasp.net/additional-reads-november-2019/) - Fixing the Flaws in Animal Research No Crisis but No Time for Complacency Licence to publish will restore trust in science Responding to the replication crisis: reflections on Metascience2019 What is replication? ‘There is a problem’: Australia’s top scientist Alan Finkel pushes to eradicate bad science Impact! II Impact! III The Hong Kong Principles for
- [Off-target toxicity is a common mechanism of action of cancer drugs undergoing clinical trials](https://paasp.net/off-target-toxicity-is-a-common-mechanism-of-action-of-cancer-drugs-undergoing-clinical-trials/) - Use of high-quality tools is an essential element of Good Research Practice. Like for many other aspects, "high quality" is a relative term suggesting that the tools are fit-for-purpose according to the best information available today.A recent paper by Lin and colleagues illustrates that, with the advancement of technologies, good knowledge may be replaced by
- [Toward Good In Vitro Reporting Standards](https://paasp.net/toward-good-in-vitro-reporting-standards/) - Many areas of biomedical science have developed reporting standards and checklists to support the adequate reporting of scientific efforts, but in vitro research still has no generally accepted criteria. In this article, the authors discuss ‘focus points’ of in vitro research, ensuring that the scientific community is able to take full advantage of the animal-free
- [Reproducible and Transparent Research Practices in Published Neurology Research](https://paasp.net/reproducible-and-transparent-research-practices-in-published-neurology-research/) - The objective of this study by Rauh et al. was to evaluate the nature and extent of reproducible and transparent research practices in neurology research.Thus, the authors conducted a PubMed search to retrieve articles published in neurology journals over a five-year period from 2014 to 2018 and determined whether publications provided access to items such
- [Four erroneous beliefs thwarting more trustworthy research](https://paasp.net/four-erroneous-beliefs-thwarting-more-trustworthy-research/) - A range of problems currently undermines public trust in biomedical research. In this article, Mark Yarborough and colleagues discuss four erroneous beliefs that may prevent the biomedical research community from recognizing the need to focus on deserving this trust, and which can act as powerful barriers to necessary improvements in the research process. The erroneous
- [Laboratory mice born to wild mice have natural microbiota and model human immune responses](https://paasp.net/laboratory-mice-born-to-wild-mice-have-natural-microbiota-and-model-human-immune-responses/) - Mice can be a valuable model for early biomedical research, but many of the drugs that demonstrate promising results in these animals still fail in human trials. There are multiple reasons for this, but researchers are beginning to realize that environmental factors such as the microbiome may also have an effect. In most preclinical work,
- [New Handbook of Experimental Pharmacology focusing on Good Research Practice](https://paasp.net/new-handbook-of-experimental-pharmacology-focusing-on-good-research-practice/) - The Handbook of Experimental Pharmacology is one of the most authoritative and influential book series in pharmacology. It provides critical and comprehensive discussions of the most significant areas of pharmacological research.PAASP members have contributed to the new Handbook of Experimental Pharmacology “Good Research Practice in Pharmacology and Experimental Life Sciences” as Editors and/or authors of
- [PAASP US: Poster presentation at the Milken Institute](https://paasp.net/paasp-us-poster-presentation-at-the-milken-institute/) - The Milken Institute Future of Health Summit (Oct 28-30, 2019) was recently held in Washington D.C. (USA) and brought together thought leaders and decision-makers to confront some of the world’s most significant health challenges by matching human, financial, and educational resources with the most innovative and impactful ideas.PAASP US was invited to present PAASPort, our proprietary platform
- [Long-Awaited Medical Study Questions the Power of Prayer](https://paasp.net/long-awaited-medical-study-questions-the-power-of-prayer/) - The question whether prayer can heal illness has for years been the subject of speculation.To once and for all obtain an answer to this issue, a scientifically rigorous investigation was designed, involving more than 1,800 patients:At six hospitals, patients were monitored who received coronary bypass surgery, in which doctors reroute circulation around a clogged vein or artery.
- [fiddle: the file drawer data liberation effort tool](https://paasp.net/fiddle-the-file-drawer-data-liberation-effort-tool/) - fiddle is a free, open source “matchmaking” tool designed to help researchers to identify the publication format that will work best for a particular dataset that may be hard to publish in traditional journals.Researchers can use this tool to quickly compare characteristics of different publications formats and search for a format that best meets their needs.
- [License to Kill - From Killer Experiments and Synthetic Lethality](https://paasp.net/license-to-kill-from-killer-experiments-and-synthetic-lethality/) - The Maternal Embryonic Leucine zipper Kinase (MELK) is an interesting enzyme:In 2005, MELK was first implicated in cancer by finding elevated levels of MELK RNA expression in many human tumors (REF1). Since the initial article, another 32 articles have been published that specifically implicate MELK as a therapeutic target in human cancer, including ovarian, breast,
- ["Avoiding the Edge Effect - How to increase reproducibility of in vitro microplate experiments?"](https://paasp.net/avoiding-the-edge-effect-how-to-increase-reproducibility-of-in-vitro-microplate-experiments/) - The randomization of study subjects is commonly discussed for in vivo studies and is in general an accepted practice. However, for in vitro experiments, randomization is often seen by scientists as unnecessary effort with questionable impact.In our Featured Publication, an assay artefact called Edge Effect was identified as a major factor leading to a decrease in data reproducibility
- ["Integrity and Trust, a University cannot do Without"](https://paasp.net/integrity-and-trust-a-university-cannot-do-without-2/) - "Trust us, we are a University"KU Leuven was ranked the most innovative university in Europe for the fourth year in a row! This raises the question what is so special about this University? We have no specific answer but would like to remind our readers about a relatively recent case when KU Leuven attracted our attention:On September
- [Invited Commentary: Qeios - from a powerful writing tool to an immidiate Open Access platform](https://paasp.net/invited-commentary-qeios-from-a-powerful-writing-tool-to-an-immidiate-open-access-platform/) - By Gabriele MarinelloCo-founder, QeiosWe have just started with Qeios the path towards the necessary revolution in research production, quality check and sharing.We have built an astonishingly simple integrated system which combines those three distinct phases of the research life-cycle. Besides being freely accessible to everyone, simpler and quicker than the current decoupled system, Qeios' most distinctive characteristic
- [Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations](https://paasp.net/meta-research-use-of-the-journal-impact-factor-in-academic-review-promotion-and-tenure-evaluations/) - When issues associated with the current academic evaluation systems are discussed, the use - and potential misuse - of the JIF is often stressed and discussed. However, the extent to which the JIF is actually used to evaluate faculty is unknown and quantitative analyses are missing.In this study, the authors analysed 864 documents related to
- [Outcome heterogeneity and bias in acute experimental spinal cord injury](https://paasp.net/outcome-heterogeneity-and-bias-in-acute-experimental-spinal-cord-injury/) - In this meta-analysis and meta-regression, Ralf Watzlawick and colleagues determined the impact of study characteristics, methodologic and reporting bias, and the quality of neurologic recovery after experimental spinal cord injury (SCI) in a large cohort of 9,535 animals.Overall, the included studies reported a neurobehavioral outcome improvement of 26.3%. However, the authors found that using multiple
- [Good Practice for Conference Abstracts and Presentations: GPCAP](https://paasp.net/good-practice-for-conference-abstracts-and-presentations-gpcap/) - GPCAP provides recommendations on good submission and presentation practice for scientific and medical congresses. These recommendations cover conference abstracts, posters and slides for oral presentations. GPCAP focuses on company-sponsored research i.e. research that is sponsored and/or funded by a pharmaceutical, medical device or biotechnology company. Company-sponsored research refers to all types of research, including preclinical
- [The association between quality measures of medical university press releases and their corresponding news stories](https://paasp.net/the-association-between-quality-measures-of-medical-university-press-releases-and-their-corresponding-news-stories/) - One of the key sources of health-related and medical information are university press releases (PR). This study by Maike Winters et al. aims to a) explore the relation between the quality of PRs from medical universities and their corresponding news stories and b) to identify the likelihood that specific scientific and interest-raising measures appear or
- [Knowledge and attitudes among life scientists towards reproducibility within journal articles](https://paasp.net/knowledge-and-attitudes-among-life-scientists-towards-reproducibility-within-journal-articles/) - This study by EK Samota and RP Davey investigated the knowledge of researchers about issues related to data reproducibility as well as factors that can improve reproducibility.The authors conducted a survey on 251 researchers who have published in the eLIFE journal, and researchers from the Norwich Biosciences Institutes (NBI).In general, according to this survey, scientific
- [3Rs missing: animal research without scientific value is unethical](https://paasp.net/3rs-missing-animal-research-without-scientific-value-is-unethical/) - The scientists in biomedical research are increasingly worried about the growing number of rules and regulations that they have to comply with. Daniel Strech and Ulrich Dirnagl in a recent BMJ publication provide arguments to expand the conventional 3Rs to 6Rs. This is obviously notto make scientists’ lives more complicated. In fact, following their recommendations should
- [Failing Grade: 89% of Introduction-to-Psychology Textbooks That Define or Explain Statistical Significance Do So Incorrectly](https://paasp.net/failing-grade-89-of-introduction-to-psychology-textbooks-that-define-or-explain-statistical-significance-do-so-incorrectly/) - Null-hypothesis significance testing (NHST) is commonly used in psychology and biomedical research areas. However, statisticians have long warned that researchers regularly misinterpret and misapply the technique.In this paper, published by Scott Cassidy and colleagues, the authors investigated whether introduction-to-psychology textbooks actually accurately define and explain statistical significance.In an analysis of 30 introductory psychology textbooks, it
- [A Multi-center Study on the Reproducibility of Drug-Response Assays in Mammalian Cell Lines](https://paasp.net/a-multi-center-study-on-the-reproducibility-of-drug-response-assays-in-mammalian-cell-lines/) - In the biomedical field, a significant proportion of preclinical research data sets are not robust enough to translate into successful clinical programs and a lot of resources are wasted on research that turns out to be irreproducible.In this paper, published in Cell Systems in July 2019, Mario Niepel and colleagues from five different research centers
- [Willing to test ARRIVE guidelines?](https://paasp.net/willing-to-test-arrive-guidelines/) - The NC3R is looking for volunteers to test and share experience about the newly published ARRIVE guidelines. Testing newly developed guidelines for practicability is always an important step. Please contact the institution on THIS WEB SITE. We would also be interested to hear your thoughts on our blog!
- [Integrity and trust, a university cannot do without](https://paasp.net/integrity-and-trust-a-university-cannot-do-without/) - Speech by rector Luc Sels from KU Leuven on September 24th, 2018. Please find the original speech including an automated translation in the pdf document. LINK LINK to original source. DISCLAIMER: PAASP is not responsible for the correctness of the translation into English.
- [Updated Arrive guidelines 2019](https://paasp.net/updated-arrive-guidelines/) - A long awaited revision of the ARRIVE guidelines has finally been published. There are three main reasons why the revision was badly needed and comes at the right time. First, the list of recommendations has been re-worked to identify the Essential 10 – i.e. those recommendations that should receive most attention. This is not to say
- [Everything we eat causes cancer - or cures it!](https://paasp.net/everything-we-eat-causes-cancer-or-cures-it/) - For their 2013 paper 'Is everything we eat associated with cancer? A systematic cookbook review', Jonathan D Schoenfeld and John PA Ioannidis selected recipes at random from a popular cookbook and evaluated all the ingredients to see if there was any research literature suggesting they increased or decreased cancer risk.Interestingly, they found that most ingredients
- [Updated review of electronic laboratory notebooks (ELNs) published by LabsExplorer](https://paasp.net/updated-review-of-electronic-laboratory-notebooks-elns-published-by-labsexplorer/) - LabsExplorer has recently published an updated review on electronic lab notebooks. The first review was published in 2017 (LINK) giving a comprehensive list including short summaries for a variety of applications.In this updated review, the authors provide a ranking list which was established by using a score system based on five different criteria: user-friendliness, completeness,
- [Searching for incentives to do better research](https://paasp.net/searching-for-incentives-to-do-better-research/) - n a recent commentary, Dorothy Bishop has referred to “the four horsemen of the reproducibility apocalypse: publication bias, low statistical power, P-value hacking and HARKing (hypothesizing after results are known)” and has indicated that these “problems are older than most junior faculty members”. Do we know how to address these problems?Indeed, at least for HARKing, “the
- [To "p" or not to "p"](https://paasp.net/to-p-or-not-to-p/) - “A biologist and a statistician are in prison and, before being executed, are asked about their last wish. Statistician wants to give a course on statistics. Biologist is asking to be executed first ...”This old joke reflects the difficult relationships between statistics and many biologists. Indeed, at least from the outside, in the eyes of
- [It takes two to do the dance](https://paasp.net/it-takes-two-to-do-the-dance/) - We are often asked what is meant by “quality culture”. As one of our colleagues put it, “quality culture is the part of the iceberg that is under the water, while the top of the iceberg is the data you see”. For many colleagues, “quality culture” is mainly associated with certain high-level statements declaring an
- [Trial Transparency at European Universities](https://paasp.net/trial-transparency-at-european-universities/) - We have previously discussed that there are significant efforts to make results of all clinical trials public. And there are already very good examples of organizations reporting most or all of their trial outcomes. However, this recent report suggests that the progress is slower than wanted and shows surprising geographical differences.Why are trials registered and results not
- [Tax support and incentives for research and development](https://paasp.net/tax-support-and-incentives-for-research-and-development/) - In many countries, governments are developing and implementing various mechanisms to incentivize innovative research and development. There is a new mechanism recently announced by the German Ministry of Finance. Starting in Jan 01, 2020, research organizations will be able to receive financial support of up to 25% of taxes paid on salaries to employees in Germany. For
- [private forever](https://paasp.net/private-forever/) - There is growing awareness about the values of preregistered studies or key elements thereof. And there is a growing number of online resources that offer preregistration services. Some preregistration platforms are aimed to serve any area of science, others focus on specific fields (e.g. animal research). There are many other features that distinguish these platforms.
- [Additional Read in may 2019](https://paasp.net/additional-read-in-may-2019/) - Unclog pipeline for new medicines Improving the way research is done: the UK Reproducibility Network Major medical journals don’t follow their own rules for reporting results from clinical trials Replication on the Rise Statistical-significance thinking is not just a bad way to publish, it’s also a bad way to think Duke University’s huge misconduct fine
- [FAIRsharing as a community approach to standards, repositories and policies](https://paasp.net/fairsharing-as-a-community-approach-to-standards-repositories-and-policies/) - We say we need standards, but do we use them?The scientific community, funders and publishers endorse the concept that common data and metadata standards underpin data reproducibility, ensuring that the relevant elements of a dataset are reported and shared consistently and meaningfully. However, navigating through the many available standards can be discouraging and often unappealing
- [Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature](https://paasp.net/comparing-quality-of-reporting-between-preprints-and-peer-reviewed-articles-in-the-biomedical-literature/) - Preprint usage is growing rapidly in the life sciences; however, questions remain on the relative quality of preprints when compared to published articles. An objective dimension of quality that is readily measurable is completeness of reporting, as transparency can improve the reader’s ability to independently interpret data and reproduce findings. In this observational study, the
- [Exact replication: Foundation of science or game of chance?](https://paasp.net/exact-replication-foundation-of-science-or-game-of-chance/) - The replication of initial results is a critical part of the scientific process. In preclinical biomedical research, it is common practice to conduct exact replications with the same sample sizes as those used in the initial experiments. In this article, the authors point out that such replication attempts have lower probability of replication than is
- [Endogenous Enterobacteriaceae underlie variation in susceptibility to Salmonella infection](https://paasp.net/endogenous-enterobacteriaceae-underlie-variation-in-susceptibility-to-salmonella-infection/) - An important source of variation in animal experiments is the microbiome, but little is known about specific changes in the microbiota composition that cause phenotypic differences. In this article, the authors show that genetically similar laboratory mice obtained from four different commercial vendors exhibited marked phenotypic variation in their susceptibility to Salmonella infection. Faecal microbiota
- [New members of the PAASP Advisory Board](https://paasp.net/new-members-of-the-paasp-advisory-board/) - We are delighted to announce that Dr. Rita Balice-Gordon and Dr. Phil Skolnick have joined PAASP’s Advisory Board:Rita Balice-Gordon, Ph.D., is the Global Head, Rare and Neurologic Diseases Research Therapeutic Area at Sanofi, Inc. Rita was formerly Vice-President and Head of Circuits, Neurotransmitters and Signaling in Pfizer’s Neuroscience and Pain Research Unit, and was Head
- [Replication Study: The microRNA miR-34a inhibits prostate cancer stem cells and metastasis by directly repressing CD44](https://paasp.net/replication-study-the-microrna-mir-34a-inhibits-prostate-cancer-stem-cells-and-metastasis-by-directly-repressing-cd44/) - The Reproducibility Project: Cancer Biology aims to replicate a number of landmark studies in the field of tumor biology published between 2010 – 2012. The latest replication attempt was published on March 12thin eLIFE and focused on a publication from 2011 by Liu et al. The attempt to replicate the major findings was unsuccessfully. The publication by
- [Thank you, Bruce! Welcome, Glenn!](https://paasp.net/thank-you-bruce-welcome-glenn/) - As many of our readers already know, our dear colleague and advisor, Bruce Altevogt, moved on to take a new and exciting assignment of the Vice President and Head External Medical Engagement, Hospital Business Unit at Pfizer. This is a very important step in Bruce’s career and we wish Bruce all the success and more
- [The US team has won the 6th NIH/NIDA Challenge Award](https://paasp.net/the-us-team-has-won-the-6th-nih-nida-challenge-award/) - In December 2018, the National Institute on Drug Abuse (NIDA) initiated its sixth annual Challenge competition with the aim to solicit and support entrepreneurial ideas that could eventually result in marketed products advancing knowledge and providing healthcare solutions in the field of Substance Use Disorders. On January 23, NIDA has announced the results of this
- [Death is certain, the time is not](https://paasp.net/death-is-certain-the-time-is-not/) - Finally, the first scientific study to examine the mortality and survival in Game of Throneshas been published (LINK). The authors found that the probability of a character dying within the first hour after first being introduced on screen was about 14%. By the end of the seventh season, more than half of the important characters had
- [Within-subject study designs: Latin Square?](https://paasp.net/within-subject-study-designs-latin-square/) - In within-subject study designs (also known as the cross-over), subjects may be given sequences of treatments with the intent of studying the differences between the effects produced by individual treatments. One should keep in mind that such sequence of testing always bears the danger that the first test might affect the following ones. If there
- [Something is rotten in the state of antibody quality](https://paasp.net/something-is-rotten-in-the-state-of-antibody-quality/) - A team of researchers led by Eleftherios P. Diamandis at the University of Toronto set out to discover novel serological markers for the early detection of pancreatic adenocarcinoma (PDAC). Their research hypothesis was that proteins expressed uniquely by the pancreas present stronger candidate biomarkers for pancreatic cancer. The team used commercial immunoassay tests (ELISA) to
- [Promoting transparency in preclinical research: preregistration of animal study protocols on www.preclinicaltrials.eu](https://paasp.net/promoting-transparency-in-preclinical-research-preregistration-of-animal-study-protocols-on-www-preclinicaltrials-eu/) - Smit NW1, Van der Naald M2,3, Wever KE4, Duncker DJ1,5, Chamuleau SAJ2,3,6 1Netherlands Heart Institute, The Netherlands 2University Medical Center Utrecht, The Netherlands 3Member of the Transnational AllianCe for regenerative Therapies In Cardiovascular Syndromes 4SYRCLE, Department for Health Evidence, Radboud university medical center, Nijmegen, The Netherlands 5Erasmus Medical Center, The Netherlands 6Nucleus member of the CARE working group of the
- [Additional Reads in March 2019](https://paasp.net/additional-read-in-march-2019/) - The reproducibility crisis in the age of digital medicine It’s not a replication crisis. It’s an innovation opportunity The Role of Big Data in Science’s Reproducibility Crisis The reproducibility opportunity Congratulations on the Promotion. But Did Science Get a Demotion? Don't Ignore Government's Contribution to the Reproduction Crisis Reproducibility of research is critical for open
- [Meta-Research: Incidences of problematic cell lines are lower in papers that use RRIDs to identify cell lines](https://paasp.net/meta-research-incidences-of-problematic-cell-lines-are-lower-in-papers-that-use-rrids-to-identify-cell-lines/) - Scientific articles using cell lines, which are registered on the International Cell Line Authentication Committee (ICLAC) or the Cellosaurus database as ‘misidentified’ continue to be published. Often, the routinely use of short-tandem repeat profiling to test for contamination is not implemented as a standard procedure. Research Resource Identifiers (RRIDs) are unique identifiers for cell lines,
- [Why we need to report more than ’Data were Analyzed by t-tests or ANOVA’](https://paasp.net/why-we-need-to-report-more-than-data-were-analyzed-by-t-tests-or-anova/) - In this article,Weissgerber et al. present findings suggesting that scientific publications are often lacking sufficient information about the statistical methods used, which are required by independent scientists to successfully replicate the published results. The authors evaluated the quality of reporting of statistical tests (such as t-tests and ANOVA) in 328 research papers published in physiology journals
- [A Reaction Norm Perspective on Reproducibility](https://paasp.net/a-reaction-norm-perspective-on-reproducibility/) - When studying living organisms, scientists are faced with inherent biological variation which is distinct from random noise or measurement error and which is fundamental to the correct interpretation of experimental results. As a consequence, rigorous standardization of both the animals and the environment can lead to a low external validity of research outcomes. In this
- [The Costs of Reproducibility](https://paasp.net/the-costs-of-reproducibility/) - Improving the reproducibility of (biomedical) research is of great concern, especially to early-career researchers (ECRs). In this viewpoint article, Russell A. Poldrack from Stanford University outlines the potential costs for ECRs in adopting practices to improve reproducibility. He discusses the ways in which ECRs can achieve their career goals while doing better science and highlights
- [The Brazilian Reproducibility Initiative](https://paasp.net/the-brazilian-reproducibility-initiative/) - In this article, the authors introduce The Brazilian Reproducibility Initiative, a multi-center effort to estimate the reproducibility of Brazilian biomedical science. The initiative aims to repeat between 60 and 100 experiments in a systematic manner: the project will focus on a set of common laboratory methods, repeating each experiment in three different laboratories. The results,
- [Visualization of Biomedical Data](https://paasp.net/visualization-of-biomedical-data/) - The rapid increase in volume and complexity of biomedical data requires changes in research, communication, and clinical practices. This includes learning how to effectively present and visualize data sets and research outcomes that clearly express complex phenomena. In this review, the authors we summarize key principles and resources from data visualization research that help address
- [Past Events](https://paasp.net/past-events/) - - September 2-5, 2019 - Rome, Italy17th International Society of Scientometrics and Informetrics ConferenceThe ISSI 2019 Conference will provide an international forum for scientists, research managers and administrators, as well as information and communication related professionals to share research and debate the advancements of informetric and scientometric theory and applications.Topics include a) Retractions, b) Open
- [Workshop at ERA-NET Neuron meeting](https://paasp.net/workshop-at-era-net-neuron/) - ERA-NET Neuron organised a workshop research data quality on January 22nd, 2019 in Bonn. PAASP Team members, Anton Bespalov and Martin Michel, contributed to the program by leading two breakout sessions. Slides used to guide the discussion in these sections can be found below. Anton Bespalov's session on "Practical issues in preclinical study design": Martin
- [Max Planck Society ends Elsevier subscription](https://paasp.net/max-planck-society-ends-elsevier-subscription/) - The Max Planck Society (MPS) is a German research organisation acting in many different research areas and consists of over 14.000 scientists. On December 18th, 2018, the society announced that it will end the subscription with Elsevier. Hence, scientists will no longer have free access to over 2.500 journals. However, the MPS is very consistent
- [The hidden message](https://paasp.net/the-hidden-message/)
- [Guidelines rule! And not only in the area of preclinical biomedical research](https://paasp.net/guidelines-rule-and-not-only-in-the-area-of-preclinical-biomedical-research/) - Thanks to this ‘Christmas Tree Decoration Guide’ we can finally decorate a Christmas tree properly and in a reproducible manner…
- [Collection of resources for the use of R in study design and analysis](https://paasp.net/collection-of-resources-for-the-use-of-r-in-study-design-and-analysis/) - In the recent report on „Digital tools and services to support research replicability and verifiability”, Caroline Skirrow and Markus Munafó have argued that “publication of analysis scripts can help to improve transparency of data analytic methods, allowing greater replicability and verifiability of scientific results”.We strongly support the transparency of analytical methods and the use of software packages
- [The SOD1 mouse - 10 years later](https://paasp.net/the-sod1-mouse-10-years-later/) - It has been more than 10 years since two seminal papers by Ludolph et al (2007) and Scott et al (2008) have introduced recommendations for the use of an SOD1 mutant mouse strain to discover new treatments against amyotrophic lateral sclerosis (ALS). We, as well as many of our colleagues, have repeatedly referred to the work done by the ALS Therapy
- [Additional Reads in December 2018](https://paasp.net/additional-reads-in-december-2018/) - Statistical pitfalls of personalized medicine How sure are you of your result? Put a number on it Design preclinical studies for reproducibility How do you deal with a problem like reproducibility? Be open about drug failures to speed up research Science Is Getting Less Bang for Its Buck The main obstacles to better research data
- [How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation](https://paasp.net/how-to-design-preclinical-studies-in-nanomedicine-and-cell-therapy-to-maximize-the-prospects-of-clinical-translation/) - Reproducibility in preclinical research may be low because of the high prevalence of biases and of suboptimal research practices (such as biased allocation of experimental groups, experimenter bias and lack of necessary controls, the use of uncharacterized materials, poor use of statistics, poor scientific training, etc.). Several evaluations have shown that most preclinical studies are
- [Reproducible research practices, transparency, and open access data in the biomedical literature, 2015–2017](https://paasp.net/reproducible-research-practices-transparency-and-open-access-data-in-the-biomedical-literature-2015-2017/) - In this article, the authors analysed potential sources of bias in 149 randomly selected biomedical research papers published between 2015 and 2017. The study is a follow-up of a previous analysis of 441 biomedical articles by John Ioannidis and colleagues for the period between 2000 and 2014. In both studies, similar reproducibility and transparency indicators were evaluated.In
- [Digital tools and services to support research replicability and verifiability](https://paasp.net/digital-tools-and-services-to-support-research-replicability-and-verifiability/) - Digital tools hold promise for improving replicability and verifiability of scientific research. In this paper, the availability and use of such tools to improve practices in biomedical research was examined, focusing on 4 key areas: 1) Design, 2) Data collection, 3) Data analysis, and 4) Publication and dissemination. The authors performed a literature review and
- [Do Boring Speakers Really Have Longer Lectures? Science Finally Has An Answer](https://paasp.net/do-boring-speakers-really-have-longer-lectures-science-finally-has-an-answer/) - When attending an international conference, Robert M. Ewers, professor of ecology at Imperial College London, found that 34 interesting talks lasted, on average, a punctual 11 minutes and 42 seconds. In contrast, the 16 boring ones he recorded dragged on for 13 minutes and 12 seconds (thereby wasting a statistically significant 1.5 min; t-test, t
- [Useful Tools and Resources November 2018](https://paasp.net/useful-tools-and-resources-november-2018/) - A new video resource for introductory training on the 3Rs The NC3R published a new educational video on the 3Rs (replacement, refinement and replacement) on their web page. It is a great resource, you might want to check it out! Example of how to perform randomization The Lambeth Conventions (II): Guidelines for the study of
- [Reporting details - Differential induction of innate immune responses by LPS](https://paasp.net/reporting-details-differential-induction-of-innate-immune-responses-by-lps/) - The importance of reporting small details and making well-informed decisions about which information to include for each experimental parameter/factor in scientific publications can be demonstrated by the following example: Lipopolysaccharide (LPS) is the major component of the cell wall surface of gram-negative bacteria. It is an amphipathic glycoconjugate and consists of a core oligosaccharide region
- [Of negative results and dust](https://paasp.net/of-negative-results-and-dust/) - Do studies with negative results have value or not? We hope that majority of our readers would agree that high-quality results originating from properly designed and conducted studies do have value, irrespective of whether the outcome is positive or negative (null). A recent post by John LaMattina, a former head of R&D at Pfizer, argues
- [Cutting the Gordian knots of industry-academia relationships](https://paasp.net/cutting-the-gordian-knots-of-industry-academia-relationships/) - Facing a seemingly intractable problem, we are often moved to go for any fast solution - just not to deal with this problem any longer. Such radical solutions may have adverse effects but, as the saying goes: “You have to break an egg to make an omelet”. Back in the early 2000s, there was some
- [Gods vs Earth Giants](https://paasp.net/gods-vs-earth-giants/) - by Elena Koustova In the long gone Soviet higher (university-based) education system there were no electives. As aspiring biologists (e.g. natural scientists) at the Moscow State University, we were expected to study all kinds of physical and formal sciences, all with equal degree of dedication and rigor. One of the inescapable courses would bring the
- [Additional Reads in November 2018](https://paasp.net/additional-reads-in-november-2018/) - Further commentaries, articles and blog posts worth reading: Meet Octopus, a new vision for scientific publishing Reboot undergraduate courses for reproducibility Losing impact Most Cited versus Uncited Papers. What Do They Tell Us? The changing forms and expectations of peer review Congratulations. Your Study Went Nowhere. Researcher Requests for Inappropriate Analysis and Reporting Pharma Failures
- [Many Analysts, One Data Set: Making Transparent How Variations in Analytic Choices Affect Results](https://paasp.net/many-analysts-one-data-set-making-transparent-how-variations-in-analytic-choices-affect-results/) - In this article, 29 independent research teams used the same data set to address the same research question: whether soccer referees are more likely to give red cards to dark-skin-toned players than to light-skin-toned players. Analytic approaches varied widely across the teams and 20 teams (69%) found a statistically significant positive effect, and 9 teams
- [Meta-analysis of amantadine efficacy for improving preclinical research reliability](https://paasp.net/meta-analysis-of-amantadine-efficacy-for-improving-preclinical-research-reliability/) - While L-DOPA remines the gold standard symptomatic treatment for Parkinson's disease (PD), its long-term use is often associated with motor fluctuations and dyskinesias. Currently, amantadine produces the most potent antidyskinetic effect in PD. However, side effects evoked by this drug limit its use, making treatment of L-DOPA-induced dyskinesia (LID) an open challenge. Preclinical models of
- [Simple changes of individual studies can improve the reproducibility of the biomedical scientific process as a whole](https://paasp.net/simple-changes-of-individual-studies-can-improve-the-reproducibility-of-the-biomedical-scientific-process-as-a-whole/) - Today, the probability of successfully publishing negative/null results in biomedical research is lower than that for positive results. For instance, negative results repeatedly remain in lab books or drawers, or are not being published because they are rejected by scientific journals. These seemingly positive results then lead to further studies which build on the supposedly
- [Open Science challenges, benefits and tips in early career and beyond](https://paasp.net/open-science-challenges-benefits-and-tips-in-early-career-and-beyond/) - In well designed and adequately powered experiments null findings are often as informative as ‘positive’ results but the current incentive structure has skewed the literature toward positive findings. In this context, Registered Reports (RR) offer a path to publication irrespective of the findings. In this article, the authors therefore addressed the question whether more null
- [Replication Study: Intestinal inflammation targets cancer-inducing activity of the microbiota](https://paasp.net/replication-study-intestinal-inflammation-targets-cancer-inducing-activity-of-the-microbiota/) - As part of the Reproducibility Project: Cancer Biology, this report describes the attempt to replicate critical experiments from the paper “Intestinal Inflammation Targets Cancer-Inducing Activity of the Microbiota” (Arthur et al., 2012). In agreement with the original study, the authors did not observe any changes on bacterial growth or colonization when the polyketide synthase (pks)
- [Researcher Requests for Inappropriate Analysis and Reporting: A U.S. Survey of Consulting Biostatisticians](https://paasp.net/researcher-requests-for-inappropriate-analysis-and-reporting-a-u-s-survey-of-consulting-biostatisticians/) - In this report, Wang and colleagues present the results of a national survey of nearly 400 consulting statisticians about requests from investigators to engage in inappropriate statistical practices. The four most frequently reported inappropriate requests were (in order of frequency): a) removing or altering some data records to better support the research hypothesis; b) interpreting
- [Reproducibility of Molecular Phenotypes after Long-Term Differentiation to Human iPSC-Derived Neurons: A Multi-Site Omics Study](https://paasp.net/reproducibility-of-molecular-phenotypes-after-long-term-differentiation-to-human-ipsc-derived-neurons-a-multi-site-omics-study/) - At the presentation of the ECNP Negative Data Award (see above), there was an interesting point made by one of the presenters – about the important role of large multi-national multi-lab collaboration projects for the scientific progress. More specifically, it was emphasized that initiatives such as the IMI projects have created an open communication culture
- [PAASP’s ‘Data Quality’ workshop at HBIGS](https://paasp.net/paasps-data-quality-workshop-at-hbigs/) - PAASP’s ‘Data Quality’ workshop at the Heidelberg Biosciences International Graduate School (HBIGS) Recognizing the lack of educational courses for students, postdocs and life scientists about ‘Good Research Practice’ in biomedical research, PAASP actively continues to offer short introductory lectures(2-4 hours), training courses and seminar series covering key aspects of data quality in biomedical research, including:
- [Annual conference of BioRN](https://paasp.net/annual-conference-of-biorn/) - Our colleague, Dr. Björn Gerlach, will present our innovative research quality assessment platform PAASPort at the Joint BioRN & Ci3 Annual Conference on October 25th, 2018 in Darmstadt.
- [Pre-Neuroscience 2018  Seminar and Networking event](https://paasp.net/pre-neuroscience-2018-seminar-and-networking-event/) - Our collaborators within EQIPD from Noldus IT are hosting an interesting event with many well known speakers in the field of research quality. This event in close proximity to the SfN meeting in San Diego will be held in a very relaxed atmosphere in the Ale House Ale House “Revel Revel”, 868 Fifth Avenue! Please
- [New tutorial video by the NC3R](https://paasp.net/new-tutorial-video-by-the-nc3r/) - The NC3R published a new educational video on the 3Rs (replacement, refinement and replacement) on their web page. It is a great resource, you might want to check it out! https://www.nc3rs.org.uk/contemporary-training-3rs
- [Meet PAASP at the following events](https://paasp.net/meet-paasp-at-the-following-events/) - Health Axis Europe Visionary Seminar 2018 – Precision Oncology (September 25th) Joint BioRN & Ci3 Annual Conference – Immunotherapy and beyond, The next generation of cancer treatment (October 25th): PAASP team member Björn Gerlach will be present at this meeting and will present a poster about the proprietary data evaluation platform PAASPort® developed by PAASP. Future
- [NC3R Workshop: ‘Improving peer review of in vivo research proposals’](https://paasp.net/nc3r-workshop-improving-peer-review-of-in-vivo-research-proposals/) - On May 9th, 2018, a workshop hosted by the NC3Rs about „Improving peer review of in vivo research proposals“ and included presentations by several of the most prominent figures in the field of preclinical data reproducibility and Good Research Practice. All talks can still be watched online! The workshop was chaired by Mark Prescott who
- ["Andromeda and Orion of modern biomarker research"](https://paasp.net/andromeda-and-orion-of-modern-biomarker-research/) - Amyloid beta (Aß) accumulation in the brain is regarded as one of the histopathological hallmarks of Alzheimer’s disease. However, Aß build-up may not necessarily result in Alzheimer's disease in all patients. A recent paper claimed that there is a unique combination of 15 proteins that distinguishes Aß build-up cases with and without a clinical picture
- ["How to pick an electronic laboratory notebook?](https://paasp.net/how-to-pick-an-electronic-laboratory-notebook-2/) - Commentary about the Nature-Toolbox article by Roberta Kwok (August 6th, 2018) Laboratory Notebooks (LN) play a key role in research since they are the primary documentation platform for research experiments and should contain all information about the experimental execution. For decades, the paper-based format has not changed and, only in recent years, various electronic solutions
- [Additional reads in September 2018](https://paasp.net/additional-reads-in-september-2018/) - “Cluster Failure”: fMRI False Positives Revisited Journals and refereeing: toward a new equilibrium In the name of reproducibility There is an absence of scientific authority over research assessment as a professional practice, leaving a gap that has been filled by database providers Has the tide turned towards responsible metrics in research? Plan to replicate 50
- [Neuroscience 2018 Satellite Symposium](https://paasp.net/neuroscience-2018-satellite-symposium/) - Quality in preclinical data: Increasing the robustness and validity of behavioral and physiological testing in animal studies This meeting will take place on November 2nd (3-6 pm) in San Diego, CA, USA and is co-organized by EQIPD and Noldus Information Technology. It is open for everyone to participate. There is an exciting agenda with presentations
- [Genetic and transcriptional evolution alters cancer cell line drug response](https://paasp.net/genetic-and-transcriptional-evolution-alters-cancer-cell-line-drug-response/) - In this paper, published in Nature, the authors analysed how different cancer cells are - not so much from the original tumor samples but from other batches of what are supposed to be the exact same cells. Cancer cell lines tend to be genomically unstable in general and in this article, the authors provide interesting
- [To Have Practical Relevance, Scientific Claims Need to be Accurate](https://paasp.net/to-have-practical-relevance-scientific-claims-need-to-be-accurate/) - For all different stakeholders within the scientific community (researchers, reviewers, editors, policymakers, funding agencies, journalists, and the general public) it is important that scientific claims are as accurate as possible. However, there is increasing evidence questioning the robustness and accuracy of social and biomedical research outcomes. In this article, Rolf Zwaan and Anita Eerland have
- [Guidelines on statistics for researchers using laboratory animals: the essentials](https://paasp.net/guidelines-on-statistics-for-researchers-using-laboratory-animals-the-essentials/) - There is a growing concern that flawed statistics and deficient reproducibility in biomedical studies results in an unethical waste of animals in research. This review by Romain-Daniel Gosselin aims to provide guidelines in biostatistics for researchers, based on frequently observed mistakes, misuses and misconceptions as well as on the specificities of animal experimentation. Twelve recommendations
- [A randomised controlled trial of an Intervention to Improve Compliance with the ARRIVE guidelines (IICARus)](https://paasp.net/a-randomised-controlled-trial-of-an-intervention-to-improve-compliance-with-the-arrive-guidelines-iicarus/) - The ARRIVE guidelines are widely endorsed but compliance is limited. The IICARus Collaboration group sought to determine whether journal-requested completion of an ARRIVE checklist improves full compliance with the guidelines. In a randomised controlled trial, manuscripts reporting in vivo animal research submitted to PLOS ONE (March-June 2015) were allocated to either requested completion of an
- [ECNP Preclinical Network Data Prize: The Award Winner](https://paasp.net/ecnp-preclinical-network-data-prize-the-award-winner/) - The ECNP Preclinical Network has announced the winner of the Award for the best publication of negative results in preclinical neuroscience. The Award was presented by Dr. Patricia Kabitzke (Cohen Veterans Bioscience, the main sponsor of the Award) during the ECNP Congress in Barcelona on October 7, 2018 to Prof. Tom Beckers (KU Leuven, Belgium)
- [Social sciences: Replication studies show that 3 out of 5 is good](https://paasp.net/social-sciences-replication-studies-show-that-3-out-of-5-is-good/) - Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015 Being able to replicate scientific findings is crucial for scientific progress. The authors of this study published in Nature Human Behaviour tried to replicate 21 systematically selected experimental studies in the social sciences published in Nature and Science between 2010
- [A repository for protocols – protocols.io](https://paasp.net/a-repository-for-protocols-protocols-io/) - Lenny Teytelman wrote in a Nature - World View article about the necessity to share experimental protocols to be able to safe time, understand experiments in detail and -most importantly- reference protocols. At PAASP, we agree that the last point is very important and have reported previously about the new protocol sharing platform from the
- [Unambiguous identification of antibodies, cell lines and organisms around the globe: A call for the Research Resource ID](https://paasp.net/unambiguous-identification-of-antibodies-cell-lines-and-organisms-around-the-globe-a-call-for-the-research-resource-id/) - Unambiguous identification of antibodies, cell lines and organisms around the globe: A call for the Research Resource ID The reproducibility crisis affecting different research areas is widely discussed, and - without any doubt- the underlying causes are very complex. It is also clear that there is not just one solution, but many different pieces must
- [Studies Unable to Reproduce Results of Two Diabetes Papers](https://paasp.net/studies-unable-to-reproduce-results-of-two-diabetes-papers/) - Two examples from Diabetes research of non-reproducible studies. A commentary on The Scientist published on August 10th, 2018. There will always be reasons why studies cannot be replicated and that can be to the smallest experimental details. This is ok and will always happen in research. However, it is not ok, that this is not
- [FAIR and ALCOAplus - data management principles](https://paasp.net/fair-and-alcoaplus-data-management-principles/) - Data recording practices play a central element in research and can vary largely from lab to lab and researcher to researcher. However, everybody looking for specific data sets or experimental details in published articles or the own lab notebook will agree that it is absolutely essential to be very diligent when recording and documenting his
- [The Four Most Dangerous Words? A New Study Shows](https://paasp.net/the-four-most-dangerous-words-a-new-study-shows/) - The two philanthropists Laura and John Arnold funded with an incredible sum of $967 million (link) projects for education, public pensions reforms, criminal justice dietary policy and reproducibility in science. With their strategy the founders of the Laura and John Arnold Foundation (LJAF) aim to strengthen areas of the society that underperform or are in
- [BioFIT 2018](https://paasp.net/biofit-2018/) - BioFIT 2018 (link) will be held in Lille from December 4th to 5th and is one of the largest conferences to foster industry-academia collaborations. Many big pharma companies, biotech, academic groups and investors are attending the conference. PAASP will also be present and if you want to meet up, please contact us at link.
- [Additional Reads in August 2016](https://paasp.net/additional-reads-in-august-2016/) - eNeuro editorial: Scientific Rigor or Rigor Mortis? Christophe Bernard, editor in chief of eNeuro, discusses in this editorial the issue of scientific rigor with a reference to two commentaries by Katherine Button and Oswald Steward. To show that it is not a novel phenomenon, he gives the fitting example of a dispute between Louis Pasteur
- [Bayes' Theorem: How do we weigh evidence to make decisions?](https://paasp.net/bayes-theorem-how-do-we-weigh-evidence-to-make-decisions/) - In this clearly and graphically explained educational video, Amber Biology offers an intuitive introduction to Bayes’ Theorem, using biomarkers and ovarian cancer testing as an example for life science applications of the Bayesian approach. As the authors state, “Bayes’ Theorem is something that every scientist, physician and engineer should understand, but it also has far wider
- [Reproducibility Issues - The Ghosts of HeLa](https://paasp.net/reproducibility-issues-the-ghosts-of-hela/) - Listeria monocytogenes is an intracellular pathogen and the causative agent of the food-borne disease listeriosis. This disease primarily affects pregnant women, newborns, older adults, and people with an impaired or weakened immune system. L. monocytogenes is able to not only invade macrophages but also non-phagocytic cells. In such cases, adhesion and internalization are mediated mainly
- [Elsevier replies to The Guardian](https://paasp.net/elsevier-replies-to-the-guardian/) - Hot publications appear not only in Science and Nature. The lay press is also capable of getting their readers excited and can trigger agitated discussions. For example, last week’s commentary in The Guardian could not go unnoticed – and many people have started a discussion whether McDonald’s indeed should be given a task to “monitor
- [Before Reproducibility must come Preproducibility](https://paasp.net/before-reproducibility-must-come-preproducibility/) - Many of us ask a question – what can I do to help improve the research data quality? And we are often discouraged by the apparent size of the problem and easily come to a conclusion that one individual cannot do much, there is a need for a societal action that would force different players
- [The strategy may change, but high quality standards should stay](https://paasp.net/the-strategy-may-change-but-high-quality-standards-should-stay/) - Like many of our colleagues in neuroscience, we were surprised to see the recent steps Pfizer took in the field of Neuroscience. More specifically, Pfizer deprioritized neuroscience early R&D earlier this year, although now announced that 25% of the $600m added to its venture fund will be spent on neurology investments. We asked ourselves: Why
- [Additional information in July 2018](https://paasp.net/additional-information-in-july-2018/) - Rigorous Resources for Rigorous Research Bill of Health Blog Symposium: Research Integrity and Trustworthy Science Registered Reports to support reproducibility – an author and reviewer in conversation Sloppy Science Happens More Than You Think Software updates: the “unknown unknown” of the replication crisis Can Auditing scientific Research help fix its Reproducibility Crisis? China introduces sweeping
- [Researchers’ risk-smoothing publication strategies: Is productivity the enemy of impact?](https://paasp.net/researchers-risk-smoothing-publication-strategies-is-productivity-the-enemy-of-impact/) - In the quest for balancing research productivity and impact, researchers in science and engineering are often encouraged to adopt a ‘play-it-safe’ research and publication strategy that allows them to maintain high publication productivity and accelerate their career advancement but may reduce the likelihood of high impact or breakthrough research outcomes. In this paper, Kolesnikov et
- [Four simple ways to increase power without increasing the sample size](https://paasp.net/four-simple-ways-to-increase-power-without-increasing-the-sample-size/) - Underpowered experiments have three problems: true effects are harder to detect, the true effects that are detected tend to have inflated effect sizes and as power decreases so does the probability that a statistically significant result represents a true effect. To increase power, many researchers only consider increasing the sample size (N). Indeed, standard power
- [Crisis or self-correction: Rethinking media narratives about the well-being of science](https://paasp.net/crisis-or-self-correction-rethinking-media-narratives-about-the-well-being-of-science/) - This essay by Kathleen H. Jamieson has explored three news narratives about science (quest discovery, counterfeit quest, systemic problem) and recommended ways to increase the extent to which these storylines convey the realities of scientific discovery and the role of self-correction in protecting the integrity of science. The author argued that a poorly constructed survey
- [The bench is closer to the bedside than we think: Uncovering the ethical ties between preclinical researchers in translational neuroscience and patients in clinical trials](https://paasp.net/the-bench-is-closer-to-the-bedside-than-we-think-uncovering-the-ethical-ties-between-preclinical-researchers-in-translational-neuroscience-and-patients-in-clinical-trials/) - The question of how quality of preclinical data is connected to patients in clinical trials is addressed in this article by Yarborough et al. This discussion is certainly overdue as the ethical implementations of doing tests in human subjects without adequate preclinical justification are not bearable for an advanced civilisation of the 21st century. Yarborough
- [P values in display items are ubiquitous and almost invariably significant: A survey of top science journals](https://paasp.net/p-values-in-display-items-are-ubiquitous-and-almost-invariably-significant-a-survey-of-top-science-journals/) - P values represent a widely used, but pervasively misunderstood and fiercely contested method of scientific inference. Display items, such as figures and tables, often containing the main results, are an important source of P values. In this article, published in PlosONE, Ioana A. Cristea and John P.A. Ioannidis conducted a survey comparing the overall use
- [Recommendations for the Design and Analysis of In Vivo Electrophysiology Studies](https://paasp.net/recommendations-for-the-design-and-analysis-of-in-vivo-electrophysiology-studies/) - Recommendations for the Design and Analysis of In Vivo Electrophysiology Studies The Journal of Neuroscience has recently released a series of editorials on issues related to experimental design across several research areas. This time there is an editorial entitled “Recommendations for the Design and Analysis of In Vivo Electrophysiology Studies”. The Journal of Neuroscience is
- [Newly developed ‘Harmonized animal research reporting principles’ (HARRP) published](https://paasp.net/newly-developed-harmonized-animal-research-reporting-principles-harrp-published/) - The International Council for Laboratory Animal Science (ICLAS) has recently published Harmonized Animal Research Reporting Principles (HARRP), the first step of a unified approach by ICLAS to improve research reporting standards worldwide. ICLAS was established in 1956, under the auspices of UNESCO with the goal of advancing human and animal health by promoting the ethical
- [New research platform Springer Nature Experiments](https://paasp.net/new-research-platform-springer-nature-experiments/) - On 2018 July 25th, the SpringerProtocols.com platform will be deactivated and replaced by the new research platform Springer Nature Experiments, a research solution dedicated to protocols and methods (the actual SpringerProtocols content is still hosted on SpringerLink). Free-to-use, Springer Nature Experiments has been specifically designed to help researchers find and evaluate different research protocols and
- [New Quality System in Football!](https://paasp.net/new-quality-system-in-football/) - Like most of our readers, colleagues and friends, we cannot imagine doing anything these days without taking the football world cup into account … So, let’s talk about football 😊 The most hotly debated innovation in modern-day football are Video-Assisted Referees (VARs), i.e. video replays for referees that are supposed to help players avoid making and
- [Heads I win, tails you lose](https://paasp.net/heads-i-win-tails-you-lose/) - Preclinical in vivo scientists often have to deal with a very interesting situation: Imagine we design a study to demonstrate that “our” drug can exert certain pharmacodynamic activity. As it unfortunately happens rather often, we design this study to include only one dose of our drug (e.g. because we have no resources to study more
- [Is reading book summaries the same as reading the actual book?](https://paasp.net/is-reading-book-summaries-the-same-as-reading-the-actual-book/) - Books that can be summarized in three sentences (https://jamesclear.com/book-summaries). And one can summarize in a couple of sentences what most movies are about. We frequently produce such short summaries to provide a quick overview about the format and content of such media. Like many of our colleagues, we have read the recent analysis that appeared
- [How to grow a healthy lab](https://paasp.net/how-to-grow-a-healthy-lab/) - A healthy research environment is fundamental to good science. However, this is an aspect that is rarely discussed. That’s partly because a lab’s “health” is complex and difficult to assess – it is the product of a whole host of factors, such as inclusivity, communication, expectations and training. In this special Nature issue, multiple authors
- [Replication Study: Fusobacterium nucleatum infection is prevalent in human colorectal carcinoma](https://paasp.net/replication-study-fusobacterium-nucleatum-infection-is-prevalent-in-human-colorectal-carcinoma/) - As part of the “Reproducibility Project: Cancer Biology”, a Registered Report (Repass et al., 2016) was published in 2016, that described how to replicate an experiment from the paper “Fusobacterium nucleatuminfection is prevalent in human colorectal carcinoma” (Castellarin et al., 2012). Here, the “Reproducibility Project: Cancer Biology” Team reported the results, published in eLIFE. When
- [Improving animal research reporting standards](https://paasp.net/improving-animal-research-reporting-standards/) - For decades, scientists and organizations have expressed concerns about the quality of animal research reporting. These concerns and efforts to establish better standards along with guidelines for researchers have gained more attention and importance lately given the ongoing discussion about a “reproducibility crisis” in biomedical research. Given the variation in awareness and implementation of current
- [What exactly is N in cell culture and animal experiments?](https://paasp.net/what-exactly-is-n-in-cell-culture-and-animal-experiments/) - “Accurate Design of in vitro experiments – Why does it matter?” was the name of a previous post (LINK) from our August 2016 Newsletter, where we presented and discussed the concept of Pseudoreplication for in vitro experiments. Towards the end, we called for a meta-analysis of articles to get an idea about the ratio between
- [Improving Reproducibility in Research - a Healthcare Triage series](https://paasp.net/improving-reproducibility-in-research-a-healthcare-triage-series/) - This episode is part of Healthcare Triage’s series on Improving Reproducibility in Research. The Introduction to the series can be found HERE. Healthcare Triage is a series about healthcare hosted by Dr. Aaron Carroll who explains healthcare policy, medical research, and answers a lot of other questions you may have about medicine, health, and healthcare.
- [Educational Corner - March 2018](https://paasp.net/educational-corner-march-2018/) - In this Newsletter issue, we introduce a new section - the ‘Educational Corner’. At regular intervals, we will select a published paper that our readers may use themselves or suggest to their students for self-studying or Journal Club discussions. We will try to select publications that represent interesting areas of science where it may be
- [Crossing the river](https://paasp.net/crossing-the-river/) - In the previous issue of the Newsletter, we have already highlighted the recent paper by Bernhard Voelkl et al. from University of Bern. This publication has apparently caught the attention of many of our colleagues and triggered diverse feedback. We would like to mention one particular commentary published by ‘DrugMonkey’. All in all, this is
- [Everyone knows mouse research is completely pointless](https://paasp.net/everyone-knows-mouse-research-is-completely-pointless/) - We strongly disagree with the title above - however, this statement is borrowed from a recent post on Medical Republic. While we, the scientific community, are debating on what defines reproducibility vs replicability vs repeatability and about further important specifications, there are people who are following our activities closely and who make their own conclusions.
- [Additional reads in March 2018](https://paasp.net/additional-reads-in-march-2018/) - Performance-driven culture is ruining scientific research Science needs to redefine excellence How to make replication the norm Von Mäusen, Makaken und Menschen (in German) Q&A: Blazing trails through the Wild West of research metrics Statistical errors may taint as many as half of mouse studies The Proposal to Lower P Value Thresholds to .005 Mice
- [Sackler Colloquium on Improving the Reproducibility of Scientific Research](https://paasp.net/sackler-colloquium-on-improving-the-reproducibility-of-scientific-research/) - At the Sackler Colloquium focused on "Reproducibility of Research: Issues and Proposed Remedies," David B. Allison, Richard Shiffrin, and Victoria Stodden invited discussion on the main topics of defining reproducibility in various research contexts and providing remedies that contribute to greater reproducibility and transparency. A dozen articles shaping the colloquium were published in a special
- [PREPARE (Planning Research and Experimental Procedures on Animals: Recommendations for Excellence) Guidelines](https://paasp.net/prepare-planning-research-and-experimental-procedures-on-animals-recommendations-for-excellence-guidelines/) - As part of ongoing efforts to reduce waste and increase the reproducibility of animal research and testing, a group of experts led by the Secretary of Norecopa has produced a set of guidelines for planning animal experiments: The PREPARE guidelines for planning animal experiments complement the ARRIVE guidelines and other guidance for reporting experiments. PREPARE
- [Prestigious Science Journals Struggle to Reach Even Average Reliability](https://paasp.net/prestigious-science-journals-struggle-to-reach-even-average-reliability/) - In which journal a scientist publishes is considered one of the most crucial factors determining their career. The underlying common assumption is that only the best scientists manage to publish in a highly selective tier of the most prestigious journals. However, in this article, Björn Brembs summarizes several lines of evidence suggesting that the methodological
- [PAASP is supporting two “Marie Skłodowska-Curie Innovative Training Networks (ITN-ETN)” applications](https://paasp.net/paasp-is-supporting-two-marie-sklodowska-curie-innovative-training-networks-itn-etn-applications/) - The purpose of these two ITN-ETN calls is to train a new generation of creative and innovative early-stage researchers, focusing on two specific and distinct research areas. The ultimate aim is to raise excellence research and doctoral training, thereby extending the traditional academic research training setting, and equipping researchers with the right combination of research-related
- [All preclinical trials should be registered in advance in an online registry](https://paasp.net/all-preclinical-trials-should-be-registered-in-advance-in-an-online-registry/) - The Food and Drug Administration Act of 2007 established requirements for the preregistration of clinical trials and also set penalties for non-compliance. These measures are meant to decrease publication bias which is, however, also a major issue in preclinical studies. The idea to expand this concept also for preclinical studies was indeed published in 2014
- [Further commentaries, articles and blog posts worth reading - Feb 2018](https://paasp.net/further-commentaries-articles-and-blog-posts-worth-reading-feb-2018/) - Robust research needs many lines of evidence The Diminishing Value of the Scientific Journal Article Wer‘s glaubt, wird selig! (in German) The importance of being second Barriers to publishing in biomedical journals Quantity does matter as citation impact increases with productivity An Open Letter to the owners of the Impact Factor Introducing a replication-first rule
- [Facilitating healthcare decisions by assessing the certainty in the evidence from preclinical animal studies](https://paasp.net/facilitating-healthcare-decisions-by-assessing-the-certainty-in-the-evidence-from-preclinical-animal-studies/) - Laboratory animal studies are used in a wide range of human health related research areas, such as basic biomedical research, drug research, experimental surgery and environmental health. The results of these studies can be used, for example, to inform decisions regarding clinical research in humans. If the research question relates to potential harms with no
- [Zebrafish (Danio rerio) Environmental Summary, Aquatic Resources Program, Boston Children's Hospital 2017](https://paasp.net/zebrafish-danio-rerio-environmental-summary-aquatic-resources-program-boston-childrens-hospital-2017/) - Environmental and housing conditions experienced by laboratory animals exert profound effects on their biology, physiology, and behavior. These parameters are important and often overlooked sources of potential variation in experiments. To that end, Christian Lawrence and colleagues provide a summary of the environmental conditions in zebrafish (Danio rerio) aquaculture facilities at Boston Children's Hospital (BCH).
- [Abstract Sifter: a comprehensive front-end system to PubMed](https://paasp.net/abstract-sifter-a-comprehensive-front-end-system-to-pubmed/) - In this article, Nancy Baker and colleagues introduce the Abstract Sifter, a Microsoft Excel based application that enhances existing search capabilities of PubMed. The Abstract Sifter assists researchers to search effectively, triage results, and keep track of articles of interest. The tool implements an innovative “sifter” functionality for relevance ranking, giving the researcher a way
- [Reproducibility of preclinical animal research improves with heterogeneity of study samples](https://paasp.net/reproducibility-of-preclinical-animal-research-improves-with-heterogeneity-of-study-samples/) - Pre-clinical animal research is typically based on single-laboratory studies conducted under highly standardized conditions. However, a new study published by Bernhard Voelkl, Lucile Vogt, Emily S. Sena and Hanno Würbel from the Universities of Bern and Edinburgh showed that such approach risks producing results that are valid only under very specific conditions. In contrast, multi-laboratory
- [Publishing Transparent and Rigorous Scientific Research](https://paasp.net/publishing-transparent-and-rigorous-scientific-research/) - Transparency in how research is conducted is a major obstacle to reproducibility efforts. Without a complete and accurate report of how a study was designed, executed and results analyzed, progress in basic and clinical research will falter. In the most extreme cases this could lead to detrimental effects in clinical research trials. In the article
- [PAASP’s ‘Data Quality’ workshop at the Justus-Liebig-University Gießen](https://paasp.net/paasps-data-quality-workshop-at-the-justus-liebig-university-giesen/) - PAASP Partner Prof. Martin Michel led a two-day workshop at the Giessen Graduate Centre for the Life Sciences (GGL). Together with the managing director of the centre, Dr. Lorna Lück, the PAASP team designed the program “Coping with the reproducibility crisis”, which has been integrated into the curriculum of the school. This two-day workshop dealt
- [PREPARE: guidelines for planning animal research and testing](https://paasp.net/prepare-guidelines-for-planning-animal-research-and-testing/) - The PREPARE (Planning Research and Experimental Procedures on Animals: Recommendations for Excellence) guidelines were published in 2017 to provide overarching guidance on how to plan animal experiments. This comprehensive set consists of 15 topics to cover literally all aspects of animal research. A detailed checklist is incredibly helpful and provides good guidance when planning animal experiments
- [Enhancing Rigor and Transparency in Neuroscience](https://paasp.net/enhancing-rigor-and-transparency-in-neuroscience/) - The Society for Neuroscience (SfN) held a virtual and open access conference on April 10th, 2018, from 9 am to 5 pm EDT. The talks of this conference are now on demand. The interesting panel of speakers is well known in the community of „good research practice“ and the talks were cutting-edge for improving and
- [Simple statistics](https://paasp.net/simple-statistics/) - This website was published by Tom MacWright and contributers to provide a library of statistical methods in readible JavaScript. This detailed descirption of codes facilitates usage of statistics in browsers and servers. Simple statistics is bridging the power of statistics with the code and enables better understanding between coders and statisticians. Find out more about
- [ERA-NET NEURON Cofund Workshop 2018](https://paasp.net/era-net-neuron-cofund-workshop-2018/) - Dr. Anton Bespalov, CEO, Partnership for Assessment and Accreditation of Scientific Practice (PAASP), is going to attend ERA-NET NEURON Cofund Workshop, Network of European Funding for Neuroscience Research January 24th, 2018, Tel Aviv, Israel. Dr. Bespalov will give a talk on the topic: Assessing quality of research practice: From manuscript checklists to auditing.
- [The latest career strategy](https://paasp.net/the-latest-career-strategy/)
- [Make hay while the sun shines](https://paasp.net/make-hay-while-the-sun-shines/) - “When she arrived, I gave her a data set of a self-funded, failed study which had null results (it was a one month study in an all-you-can-eat Italian restaurant buffet where we had charged some people ½ as much as others). I said, "This cost us a lot of time and our own money to
- [Lessons from clinical studies' (Martin C. Michel)](https://paasp.net/lessons-from-clinical-studies-martin-c-michel/) - At least partly driven by regulatory requirements, technical data quality in clinical studies has markedly improved in the past decades and may exceed that in many non-clinical studies. Thus, reduction of bias by blinding, randomization and pre-specified sample sizes statistical analysis plans have become standard in clinical trials, particularly those performed for regulatory purposes and
- [Additional reads in January 2018](https://paasp.net/additional-reads-in-january-2018/) - HARKing: How Badly Can Cherry-Picking and Question Trolling Produce Bias in Published Results? Should Researchers committed to and promoting Reproducible Research be additionally Rewarded? Progress on reproducibility The Replication Crisis in Science When evaluating research, different metrics tell us different things A Scientist's Gender Can Skew Research Results Reproducibility in Cancer Biology: Getting to grips
- [Replication studies - Improving reproducibility in the empirical sciences](https://paasp.net/replication-studies-improving-reproducibility-in-the-empirical-sciences/) - Scientific progress requires studies to be conducted rigorously, so that when they are repeated their results will be reasonably similar. Over the past few years, however, several systematic series of replication studies have been unable to reproduce many important results, even when applying lenient definitions of reproducibility. This newly released report by the Royal Netherlands
- [The Reproducibility Crisis and Academic Libraries](https://paasp.net/the-reproducibility-crisis-and-academic-libraries/) - In this editorial, Franklin Sayre and Amy Riegelman discuss how academic libraries can lead institutional support for reproducible research. In recent years, evidence has emerged from disciplines ranging from biology to economics that many scientific studies are not reproducible. This evidence has led to declarations in both the scientific and lay press that science is
- [Rigor and reproducibility in rodent behavioral research](https://paasp.net/rigor-and-reproducibility-in-rodent-behavioral-research/) - In this review article, Directors of Rodent Behavior Cores at NICHD-supported Intellectual and Developmental Disorders Research Centers (IDDRCs) and other behavioral core facilities offer their expertise for conducting rigorous mouse and rat behavioral assays. Behavioral assays have a reputation for high variability and, in practice, reaching consensus on methods has proven difficult because of the
- [Researchers’ interpretations of research integrity: A qualitative study](https://paasp.net/1199-2/) - Despite increasing interest in integrity issues, relatively few studies have examined researchers’ own interpretations of integrity. As part of the Perspectives on Research Integrity in Science and Medicine (PRISM) project, the authors D. Shaw and P. Satalkar analyse in this article how researchers themselves define research integrity. The authors conducted 33 semi-structured interviews with clinical
- [World's first prize for 'negative' scientific results](https://paasp.net/worlds-first-prize-for-negative-scientific-results/) - What is believed to be the world’s first prize for published “negative” scientific results, the “ECNP Preclinical Network Data Prize” has been announced by the ECNP’s Preclinical Data Forum. The €10,000 prize, aimed initially at neuroscience research, is to encourage publication of data where the results do not confirm the expected outcome or original hypothesis.
- [New PAASP publication: ‘The reproducibility crisis in preclinical research – lessons to learn from clinical research’](https://paasp.net/new-paasp-publication-the-reproducibility-crisis-in-preclinical-research-lessons-to-learn-from-clinical-research/) - In this article, Laia Pedro-Roig and Christoph Emmerich discuss ways and measures how preclinical research and development (especially in its confirmatory phase) would benefit from adapting some of the internationally accepted quality standards and principles used in clinical research. In contrast to clinical research, with generally high quality standards in place, quality standards and good
- [Meetings in 2017](https://paasp.net/meetings-in-2017/) - June 28, 2017 - Webinar (11 AM - 12 PM EST ) Seminar by Carlijn Hooijmans presenting the Grading of Recommendations Assessment, Development and Evaluation (GRADE) concept for preclinical research - July 3-5, 2017 - Heidelberg, Germany ECNP Workshop for Young Scientists “How to Make Preclinical Research Robust” - August 14-18, 2017 - Nijmegen, Netherlands
- [Asking a question makes writing abstracts easy](https://paasp.net/asking-a-question-makes-writing-abstracts-easy/) - Writing papers that have titles posed as questions isn't very common, but perhaps it should be. It makes wiritng the abstract potentially very simple.
- [After the Nature checklists - what's next?](https://paasp.net/after-the-nature-checklists-whats-next/) - In the November issue of our Newsletter, we have featured a publication by the NPQIP Collaborative Group (LINK) that analyzed the impact of the Nature journals' “checklists” for life sciences research on the completeness of reporting of the “Landis 4” items (randomization, blinding, sample size calculation, exclusions). These checklists were introduced in May 2013 and
- [The link between Portfolio Evolution and the Robustness of early phase drug discovery data](https://paasp.net/the-link-between-portfolio-evolution-and-the-robustness-of-early-phase-drug-discovery-data/) - The reproducibility discussion involves everyone who funds, authorizes, supervises, plans, conducts and publishes research. This recent LifeSciVC post showed that lacking research rigor may also affect financial returns of Venture Capital (VC) funders of biomedical research who, until now, have not been involved in the discussions or international initiatives aiming to enhance robustness of early
- [Additional reads in December 2017](https://paasp.net/additional-reads-in-december-2017/) - Further commentaries, articles and blog posts worth reading: Rewarding negative results keeps science on track Research health needs a dedicated group Corporate collaboration boosts buzz on research Don’t fool yourself Five ways to fix statistics
- [Data management plans will be an integral part of project funding applications submitted to the SNSF](https://paasp.net/data-management-plans-will-be-an-integral-part-of-project-funding-applications-submitted-to-the-snsf/) - Since October 2017, the Swiss funder SNSF requires a Data Management Plan (DMP). The aim of a Data Management Plan (DMP) is to plan the life cycle of data. It offers a long-term perspective by outlining how data will be generated, collected, documented, shared and preserved. The SNSF provides templates to help researchers complete their
- [Do bibliometrics and altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime, altmetrics, and citation data](https://paasp.net/do-bibliometrics-and-altmetrics-correlate-with-the-quality-of-papers-a-large-scale-empirical-study-based-on-f1000prime-altmetrics-and-citation-data/) - In this study, Lutz Bornmann and Robin Haunschild discuss the relationship between altmetrics and the quality of scientific publications (as measured by the post-publication peer-review system of F1000Prime assessments). One intention of the authors is to test whether altmetrics should really be used in research evaluation practice. A necessary requirement for this use is that
- [A systematic review of sample size and power in leading neuroscience journals](https://paasp.net/a-systematic-review-of-sample-size-and-power-in-leading-neuroscience-journals/) - Adequate sample size is key to reproducible research findings: low statistical power can increase the probability that statistically significant results are false positive. To increase data robustness and reproducibility, journals started to implement measurements such as reporting checklists. In this paper, Carter et al. conducted a systematic review comparing articles submitted to Nature Neuroscience 3
- [PAASP and Phinnex](https://paasp.net/paasp-and-phinnex/) - PAASP, Henrich Pharma Consulting and Global Clinical Trials (GCT) are the founding members of the Pharma Innovation Excellence (PHINNEX) consortium What is PHINNEX? High-quality, cost-efficient drug discovery outsourcing to service providers and academic institutes in Eastern and Central Europe is managed by professionals and scientists with decades of experience in the Pharmaceutical Industry. PHINNEX matches
- [Biologist talks to a statistician](https://paasp.net/biologist-talks-to-statistician/) - Does this conversation sounds familiar?
- [The Birthday Paradox](https://paasp.net/the-birthday-paradox/) - In biomedical research, dealing with probabilities is part of the daily routine for many scientists, independently of their specific research area. Statistics and probability calculations are important during the design phase of experiments (e.g., for group size calculation and power estimations), as well as during the analysis of study results and outcomes. However, for researchers
- ['How many studies produce negative results?'](https://paasp.net/commentary-how-many-studies-produce-negative-results/) - The July issue of the Newsletter mentioned a recent publication by Daniel Benjamin and his colleagues who have analyzed the ability of cancer researchers to judge whether selected preclinical reports would be reproduced or not. On average, researchers forecasted a 75% probability of replicating the statistical significance and a 50% probability of replicating the effect
- [Additional reads November 2017](https://paasp.net/additional-reads-november-2017/) - Further commentaries, articles and blog posts worth reading: Null is beautiful: On the importance of publishing null results Funding debate over paper quality vs quantity Remove, rather than redefine, statistical significance Steps towards transparency in research publishing Von den Gefahren allzu schöner Geschichten (in German) Sloppy reporting on animal studies proves hard to change Transparency
- [The ghosts of HeLa: How cell line misidentification contaminates the scientific literature](https://paasp.net/the-ghosts-of-hela-how-cell-line-misidentification-contaminates-the-scientific-literature/) - While problems with cell line misidentification have been known for decades, an unknown number of published papers remains in circulation reporting on the wrong cells without warning or correction. In this article, published in PLOS ONE, the authors provide an estimate of how many scientific articles are affected by this issue. They found 32,755 articles
- [Do Neuroscience Journals Accept Replications? A Survey of Literature](https://paasp.net/do-neuroscience-journals-accept-replications-a-survey-of-literature/) - Recent reports in neuroscience, especially those concerning brain-injury and neuroimaging, have revealed low reproducibility of results within the field and urged for more replication studies. However, it is unclear if the neuroscience journals welcome or discourage the submission of reports on replication studies. This article by Andy W.K. Yeung, therefore, assessed the explicit position of
- [The Experimental Design Assistant](https://paasp.net/the-experimental-design-assistant/) - Addressing the common problems that researchers encounter when designing and analyzing animal experiments will improve the reliability of in vivo research. In this article, the authors introduce the Experimental Design Assistant (EDA), which was launched to support the scientific community with these processes. The EDA is a web-based tool that guides the in vivo researcher
- [A checklist is associated with increased quality of reporting preclinical biomedical research: A systematic review](https://paasp.net/a-checklist-is-associated-with-increased-quality-of-reporting-preclinical-biomedical-research-a-systematic-review/) - Irreproducibility of preclinical biomedical research has gained recent attention. To improve the quality and transparency of scientific reporting, some journals introduced checklists requiring authors to complete at the time of manuscript submission. Whether a checklist enhances data and reporting quality of preclinical animal studies, however, has not been empirically studied. In this publication, Han et
- [Findings of a retrospective, controlled cohort study of the impact of a change in Nature journals' editorial policy for life sciences research on the completeness of reporting study design and execution.](https://paasp.net/findings-of-a-retrospective-controlled-cohort-study-of-the-impact-of-a-change-in-nature-journals-editorial-policy-for-life-sciences-research-on-the-completeness-of-reporting-study-design-and-execut/) - Poor replication of in vivo and in vitro biomedical studies has been reported and this can be linked in many cases to insufficient descriptions of the experimental and analytical details. Thus, the aim of this study by Malcolm Macleod and the NPQIP Collaborative group was to determine whether the implementation of checklists by NPG Journals,
- [Abandon Statistical Significance](https://paasp.net/abandon-statistical-significance/) - In science publishing and many areas of research, we have reached a ‘binary decision rule’ in which any result is first required to have a p-value that surpasses the 0.05 threshold and only then is consideration given to such results as strong evidence in favor of a scientific theory. There have been recent proposals to
- [Modeling science trustworthiness under publish or perish pressure](https://paasp.net/modeling-science-trustworthiness-under-publish-or-perish-pressure/) - A new mathematical model by David R. Grimes, Chris T. Bauch and John P.A. Ioannidis suggests that a bias by journals towards studies with positive findings is undermining the trustworthiness of published science. The findings published on the bioRxiv preprint server are a first step in measuring how factors such as competition for funding and
- [World’s first prize for “negative” scientific results announced](https://paasp.net/worlds-first-prize-for-negative-scientific-results-announced/) - What is believed to be the world’s first prize for published “negative” scientific results, the “ECNP Preclinical Network Data Prize” has been announced by the ECNP’s Preclinical Data Forum. The €10,000 prize, aimed initially at neuroscience research, is to encourage publication of data where the results do not confirm the expected outcome or original hypothesis.
- [Randomization - The Horizon homeopathic dilution experiment](https://paasp.net/979-2/) - All Case Study publications presented in this section have received a lot of interest among the scientific community and are particularly interesting from a GSP perspective. These case studies demonstrate the need for a high-quality study design, including the incorporation of basic GSP standards and guidelines, which is the foundation of all PAASP services provided.
- [Simple Randomisation](https://paasp.net/simple-randomisation/) - A randomization tool for the daily routine The case study in this Newsletter illustrates very well the importance of study subject randomization and blinding for clinical studies to prevent selection bias. The same is true for preclinical animal studies where it is also absolutely necessary to ensure that, for example, animals for an analysis are
- [Block randomisation](https://paasp.net/block-randomisation/) - In this section we provide information about useful tools for designing and analyzing experiments - instruments and equipment, which we at PAASP frequently use. In addition, we also introduce helpful resources for educational and training purposes. The concept of block randomization and a free-ware online tool In a previous post we discussed the concept of
- [Further commentaries, articles and blog posts - September 2017](https://paasp.net/further-commentaries-articles-and-blog-posts-september-2017/) - Paul Glasziou and Iain Chalmers: Funders and regulators are more important than journals in fixing the waste in research Exzellenztheater: Zeit für einen Wechsel im Spielplan? (in German) Faculty promotion must assess reproducibility Go Forth and Replicate: On Creating Incentives for Repeat Studies 'One-size-fits-all’ threshold for P values under fire Addressing scientific integrity scientifically
- [Tools and resources - September 2017](https://paasp.net/tools-and-resources-september-2017/) - In this Newsletter issue, we introduce helpful resources for educational and training purposes, which were recently published and which all address data integrity and reproducibility issues: 1. The American Physiological Society (APS) has provided access (full audio and slides) to the 2017 symposium ‘Why Scientific Rigor Matters and Ways to Improve It’. All presenters were
- [From dull rats and bright rats](https://paasp.net/from-dull-rats-and-bright-rats/) - In 1963, Robert Rosenthal and Kermit L. Fode supervised an animal study performed by students in order to gain further experience in duplicating experimental findings and, in addition, to introduce the students to the field of animal research and to help them overcome any fears that they may have with regard to working with rats.
- [Neuroscience has quietly become a hot space for start-ups](https://paasp.net/neuroscience-has-quietly-become-a-hot-space-for-start-ups/) - The most recent post in the LiveSciVC blog opens with the statement: “Neuroscience has quietly become a hot space for start-ups”. Does this come as a surprise? Perhaps, yes but only for those who underestimated the medical and social need and associated commercial opportunities in the fields of neurology and psychiatry. Over the past decade, we have
- [Living systematic review: 1. Introduction - the why, what, when, and how](https://paasp.net/living-systematic-review-1-introduction-the-why-what-when-and-how/) - Systematic reviews are difficult to keep up to date, but failure to do can lead to a decay in review currency, accuracy, and utility. In this article, members of the Living Systematic Review Network introduced a novel approach to systematic review updating termed ‘‘Living systematic review’’ (LSR): systematic reviews that are continually updated, incorporating relevant
- [How To Survive the Medical Misinformation Mess](https://paasp.net/how-to-survive-the-medical-misinformation-mess/) - In this article, John P. A. Ioannidis and colleagues discuss the problem of having much unreliable and non-useful published medical research. They argue that most physicians and other healthcare professionals are unaware of the pervasiveness of poor quality clinical evidence that contributes considerably to overuse, underuse, avoidable adverse events, missed opportunities for right care and
- [Standardized mean differences cause funnel plot distortion in publication bias assessments](https://paasp.net/standardized-mean-differences-cause-funnel-plot-distortion-in-publication-bias-assessments/) - Meta-analysis is a complex statistical method which involves synthesis of data from relevant studies to devise an effect size or a conclusion and has increasingly been recognized as an important tool in the field of biomedical life sciences. Meta-analyses often include an assessment of publication bias based on visual or analytical detection of asymmetry in
- [More interesting stories in August 2017](https://paasp.net/more-interesting-stories-in-august-2017/) - A long journey to reproducible results Don't run biomedical science as a business Metrology is key to reproducing results Do our measures of academic success hurt science? Spreadsheet Risks in Science Thoughts on Reproducibility Are the times a-changin’? Reporting before and after the 2015 statistical guidelines
- ['Redefine statistical significance'](https://paasp.net/redefine-statistical-significance-2/) - A P-value of < 0.05 is commonly accepted as the borderline between a finding and the empty-handed end of a research project. However, there are problems with that. First, P-values around 0.05 are notoriously irreproducible – as they should be on theoretical grounds (Halsey et a., 2015). Second, P-values around 0.05 are associated with a
- [When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment](https://paasp.net/when-null-hypothesis-significance-testing-is-unsuitable-for-research-a-reassessment/) - Null hypothesis significance testing (NHST) is linked to several shortcomings that are likely contributing factors behind the widely debated replication crisis in psychology and biomedical sciences. In this article, Denes Szucs and John P. A. Ioannidis review these shortcomings and suggest that NHST should no longer be the default, dominant statistical practice of all biomedical
- [Enhancing the usability of systematic reviews by improving the consideration and description of interventions](https://paasp.net/enhancing-the-usability-of-systematic-reviews-by-improving-the-consideration-and-description-of-interventions/) - The importance of adequate intervention descriptions in minimizing research waste and increasing reproducibility rates has gained attention in the past few years. Improving the completeness of intervention descriptions in systematic reviews is likely to be a cost-effective contribution towards facilitating evidence implementation from reviews – a statement that is true for the clinical area as
- [Power-up: a reanalysis of 'power failure' in neuroscience using mixture modelling](https://paasp.net/power-up-a-reanalysis-of-power-failure-in-neuroscience-using-mixture-modelling/) - In 2013, a paper by Katherine S. Button called ‘Power failure: why small sample size undermines the reliability of neuroscience’ was published in Nature Reviews Neuroscience. It got a lot of attention at the time and has since been cited more than 1700 times. The authors concluded that the average statistical power of studies in
- [Science with no fiction: measuring the veracity of scientific reports by citation analysis](https://paasp.net/science-with-no-fiction-measuring-the-veracity-of-scientific-reports-by-citation-analysis/) - The current ‘reproducibility crisis’ in biomedical research is enabled by the lack of publicly accessible information on whether the reported scientific claims are valid. In this paper, published on bioRxiv, Peter Grabitz and colleagues propose an approach to solve this problem that is based on a simple numerical measure of veracity, the R-factor, which summarizes
- [New PAASP member](https://paasp.net/new-paasp-member/) - We are delighted to announce that Malgorzata Pietraszek has joined our PAASP Team. Malgorzata has over 20 years of experience in CNS pharmacology acquired in both pharmaceutical industry and academic environments. Malgorzata holds a PhD from the Institute of Pharmacology Polish Academy of Sciences (PAS) in Cracow and a MSc from the Jagiellonian University (Cracow).
- [Two neglected aspects when discussing research quality](https://paasp.net/two-neglected-aspects-when-discussing-research-quality/) - Scientific Excellence vs. Research Quality Regulated vs. Non-regulated Scientific excellence is the key to advance science and to develop novel drugs. However, scientific excellence does not guarantee that the conducted experiments deliver robust results. There are two primary reasons for that. First, education in science does not always focus enough on the requirements for delivering
- [What do PAASPort and Coca-Cola have in common?](https://paasp.net/what-do-paasport-and-coca-cola-have-in-common/) - PAASPort is our tool to evaluate bias in preclincical drug discovery research. Application of PAASPort is based on the analysis of a balance between potential sources of biases (related to various types of pressure to obtain or deliver data) and the protective measures that exist at various levels – from the organization level to individual
- [How to write successful grants in 1920](https://paasp.net/how-to-write-successful-grants-in-1920/) - Submitted by the German Biochemist and Nobel laureate, Otto Warburg (1883-1970) to the ‘Notgemeinschaft der Deutschen Wissenschaft’ (Emergency Association of German Science), the application, which consisted of a single sentence, “I require 10,000 marks”, was funded in full. Published in Koppenol et al., Nature Reviews Cancer 11, 325-337 (May 2011).
- [Additional reads in July 2017](https://paasp.net/additional-reads-in-july-2017/) - Further commentaries, articles and blog posts worth reading Promote scientific integrity via journal peer review data: Argumentation to make the Peer Review process data available to the science community Results-free review: impressions from the first published article Make Data Count: Building a System to Support Recognition of Data as a First Class Research Output Cancer
- [Redefine Statistical Significance](https://paasp.net/redefine-statistical-significance/) - When statistician Ronald Fisher introduced the P-value in the 1920s, he did not mean it to be a definitive test. He intended it simply as an informal way to judge whether the obtained results are ‘worthy of a second look’ and Fisher understood that the ‘threshold’ of 0.05 for defining statistical significance was rather arbitrary.
- [Can cancer researchers accurately judge whether preclinical reports will reproduce?](https://paasp.net/can-cancer-researchers-accurately-judge-whether-preclinical-reports-will-reproduce/) - There is currently a vigorous debate about the reproducibility of research findings in cancer biology. Whether scientists can accurately assess which experiments will reproduce original findings is important to determine the pace at which science self-corrects. To address this question, Daniel Benjamin et al. collected forecasts from basic and preclinical cancer researchers on the first
- [Common pitfalls in preclinical cancer target validation](https://paasp.net/common-pitfalls-in-preclinical-cancer-target-validation/) - In this Perspective, published in Nature Reviews Cancer, William G. Kaelin Jr outlined some of the common pitfalls in preclinical cancer target identification and some potential approaches to mitigate them. An alarming number of papers from laboratories nominating new cancer drug targets contain findings that cannot be reproduced by others or are simply not robust
- [Is the staggeringly profitable business of scientific publishing bad for science?](https://paasp.net/is-the-staggeringly-profitable-business-of-scientific-publishing-bad-for-science/) - Back in 1988, Robert Maxwell predicted that, in the future, there would only be a handful of immensely powerful publishing companies left, operating in an electronic age with very low printing costs, leading to almost ‘pure profit’. In this theguardian article, Stephen Buranyi describes how the scholarly publishing industry came to be what it is
- [The academic–industrial complex: navigating the translational and cultural divide](https://paasp.net/the-academic-industrial-complex-navigating-the-translational-and-cultural-divide/) - In this review article, Stephen Freedman and Kevin Mullane offer a personal perspective on the opportunities, models and approaches that harness the increased interface and growing interdependency between biomedical research institutes, the biopharmaceutical industry and the technological world: In general, academic discoveries can only be translated into therapeutics through joint efforts with industry. However, the
- [Various Commentaries](https://paasp.net/various-commentaries/) - Macleod, MR 2010. "Why animal research needs to improve." Nature 477, 511 Young, SS and Karr, A 2011. "Deming, data and observational studies." Significance; Volume 8, Issue 3, pages 116–120
- [Peer Review and Impact Factor](https://paasp.net/peer-review-and-impact-factor/) - Brembs, B et al. 2013. "Deep impact: unintended consequences of journal rank." Front. Hum. Neurosci., 24;7:291. Park, IU et al. 2014. "Modelling the effects of subjective and objective decision making in scientific peer review." Nature 506, 93–96 Lauer, MS and Nakamura, R 2015. "Reviewing Peer Review at the NIH." N Engl J Med; 373:1893-1895
- [Reporting Bias](https://paasp.net/reporting-bias/) - Vinkers, CH et al. 2015. "Use of positive and negative words in scientific PubMed abstracts between 1974 and 2014: retrospective analysis." BMJ; 351 Macleod, MR et al. 2015. "Risk of Bias in Reports of In Vivo Research: A Focus for Improvement." PLOS Biology | DOI:10.1371/journal.pbio.1002273 Tsilidis, KK et al. 2013. "Evaluation of Excess Significance Bias
- [Therapeutic Indication](https://paasp.net/therapeutic-indication/) - Perrin, S 2014. “Make Mouse Studies Work.” Nature 507:423. O'Collins, VE et al. 2011. "Preclinical Drug Evaluation for Combination Therapy in Acute Stroke Using Systematic Review, Meta-Analysis, and Subsequent Experimental Testing." J Cereb Blood Flow Metab; vol. 31 no. 3 962-975 Vesterinen, HM et al. 2010. "Improving the translational hit of experimental treatments in multiple sclerosis." Multiple
- [Data quality tools](https://paasp.net/data-quality-tools/) - Tools to improve data quality Benjamini, Y and Hochberg, Y 1995. "Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing" Journal of the Royal Statistical Society. Series B (Methodological) Vol. 57, No. 1, pp. 289-300 Vesterinen, HM et al. 2014. "Meta-analysis of data from animal studies: A practical guide." Journal of
- [Data Analysis and Statistics](https://paasp.net/data-analysis-and-statistics/) - This collection of articles is all about data analysis and statistics. Gelman, A 2012. "Why We (Usually) Don’t Have to Worry About Multiple Comparisons." Journal of Research on Educational Effectiveness, 5: 189–211 Nuzzo, R et al. 2015. "Scientific method: Statistical errors." Nature; Vol 506 Motulsky, HJ 2014. "Common misconceptions about data analysis and statistics." Naunyn-Schmiedeberg's
- [Reproducibility and Date Robustness](https://paasp.net/reproducibility-and-date-robustness/) - These articles are dealing with the Reproducibility and Robustness of Data Collins, FS and Tabak, LA 2014. "NIH plans to enhance reproducibility." Nature 30; 505(7485): 612–613. Clemens, M 2015. "The Meaning of Failed Replications: A Review and Proposal." CGD Working Paper 399. Washington, DC: Center for Global Development. Pulverer, B 2015. “Reproducibility Blues.” 34(22):2721–24. Alberts,
- [Study Design](https://paasp.net/study-design/) - These articles are presenting ideas on how to improve experiments. Howells, DW et al. 2014. "Bringing rigour to translational medicine." Nature Reviews Neurology 10, 37–43 Kwon, BK et al. 2011. "A Grading System To Evaluate Objectively the Strength of Pre-Clinical Data of Acute Neuroprotective Therapies for Clinical Translation in Spinal Cord Injury." Journal of Neurotrauma
- [Consequences of poor data quality](https://paasp.net/consequences-of-poor-data-quality/) - These are a number of featured articles dealing with the consequences of poor data quality Pankevich, DE et al. 2014. "Improving and Accelerating Drug Development for Nervous System Disorders." Neuron; Volume 84, Issue 3, Pages 546–553 Cummings, JL et al. 2014. "Alzheimer’s disease drug-development pipeline: few candidates, frequent failures." Alzheimer's Research & Therapy, 6:37 Hay,
- [NPG's Policy on authorship](https://paasp.net/npgs-policy-on-authorship/) - 08.09.2011: NPG’S POLICY ON AUTHORSHIP - Important change to submission criteria “To the dismay of many (yet to the delight of a few), Nature Publishing Group announced that its flagship journal, Nature, will no longer accept submissions from humans (Homo sapiens). The new policy, which has been under editorial consideration for many years, was sparked
- [John Oliver on Scientific Studies](https://paasp.net/654/) - John Oliver commenting on the problem and even featuring Brian Nosek!
- [PAASP is launching new web page](https://paasp.net/paasp-is-launching-new-web-page/) - After founding PAASP almost two years ago and with the important upcoming projects, it was time to give the web interface a new appearance and include more functionality. Despite providing clearer access to PAASPs products, a new information database was included in the style of in internet blog. This gives you the possibility to search
- [“The TOP Guidelines”](https://paasp.net/the-top-guidelines/) - Guidelines for Transparency and Openness Promotion (TOP) in Journal Policies and Practices which are published by the Center for Open Science (COS). LINK
- [Nosek et al., 2015 Science](https://paasp.net/nosek-et-al-2015-science/) - Brian Nosek et al. present in this communication an informative introduction to standards set-up by the Transparency and Openness Promotion (TOP) committee to facilitate a culture of open research (e.g. the publication of null results). A comprehensive table is provided summarizing the eight standards and three levels of TOP guidelines. LINK
- [The Committee on Publication Ethics (COPE)](https://paasp.net/the-committee-on-publication-ethics-cope/) - The Committee on Publication Ethics was established in 1997 and has grown to over 10000 members. It provides advice on publication ethics, but also on how to handle misconduct in scientific publications. LINK
- [RIGOR guidelines](https://paasp.net/rigor-guidelines/) - Comprehensive guidelines especially designed for research in animal models of stroke. However, it does contain basic aspects that can be applied to other animal experiments. LINK
- [MIFlowCyt guidelines](https://paasp.net/miflowcyt-guidelines/) - Lee et al., 2008 Journal of the International Society for Advancement of Cytometry (“MIFlowCyt”) Guidelines about the Minimum Information a Flow Cytometry Experiment should contain. These guidelines give a general overview on how to report cytometry experiments.
- [Steckler et al. 2016 editorial in psychopharmacology](https://paasp.net/steckler-et-al-2016-editorial-in-psychopharmacology/) - These recently published guidelines for the Journal of Psychopharmacology are a great example on information to be reported with animal experiments.
- [Simera et al., 2010 Eur J of Clin Invest](https://paasp.net/simera-et-al-2010-eur-j-of-clin-invest/) - Introduction to the EQUATOR Network, which provides resources, education and training to facilitate good research reporting and assists in the development, dissemination and implementation of robust reporting guidelines. LINK
- [Bravo et al., 2015 BMC Medicine](https://paasp.net/bravo-et-al-2015-bmc-medicine/) - Guideline on how to cite bioresources (CoBRA). LINK
- [Moher et al., 2015 BMC Medicine](https://paasp.net/moher-et-al-2015-bmc-medicine/) - Overview of published guidelines on reporting preclinical research. LINK
- [Ioannidis and Khoury, 2014 JAMA](https://paasp.net/ioannidis-and-khoury-2014-jama/) - In this viewpoint the assessing value in biomedical research is discussed based on research that is Productive, High-quality, Reproducible, Shareable and Translatable (PQRST). LINK
- [Guidelines by the European Science Foundation (ESF)](https://paasp.net/guidelines-by-the-european-science-foundation-esf/) - The European Code of Conduct for Research Integrity Intended to provide an europe-wide reference, this code addresses the proper conduct and principled practice of systematic research in the medical, natural and social sciences and the humanities. It was established in 2010 by 31 research funding and performing organisations from 22 countries, together with All European
- [Steward and Balice-Gordon, 2014 Neuron](https://paasp.net/steward-and-balice-gordon-2014-neuron/) - Review of best practices and presentation of new guidelines with a focus on preclinical studies relevant to human neurological and psychiatric disorders. LINK
- [WHO quality practices](https://paasp.net/who-quality-practices/) - The WHO provides in this handbook guidance for research institutions and individual researchers to improve the quality of their research data. These practices were especially designed for a non-regulatory quality management system. LINK
- [GSP document by DFG](https://paasp.net/gsp-document-by-dfg/) - Proposal for Safeguarding Good Scientific Practice by the German Research Foundation (DFG). The first recommendations were published in 1997 with an updated version published in 2013. It builds “the basis for the DFG’s continuing endeavours to accord the highest importance to safeguarding good scientific practice as an essential prerequisite for research and as the core
- [MIATA guidelines](https://paasp.net/miata-guidelines/) - This webpage provides useful information on how to publish data derived from flow cytometry experiments in particular when analysing T-cells and NK-cells. It describes the set of information and data to be included in material and method sections to be able to understand and reproduce published experiments. LINK: http://miataproject.org
- [STROBE Statement](https://paasp.net/strobe-statement/) - “STROBE stands for an international, collaborative initiative of epidemiologists, methodologists, statisticians, researchers and journal editors involved in the conduct and dissemination of observational studies, with the common aim of STrengthening the Reporting of OBservational studies in Epidemiology.” On their homepage they provide for example a checklist of items that should be reported in observational studies.
- [ARRIVE guidelines 2010](https://paasp.net/arrive-guidelines/) - NEW guidelines are available: Updated Arrive guidelines These guidelines were presented by the National Centre for the Replacement, Refinement and Reduction of Animals in Research (NC3Rs) and provide an excellent checklist, which includes a range of factors to consider when performing and/or publishing experiments involving animals. They can be considered as a milestone to improve the
- [PAASP member was invited to a meeting organised by NIH ](https://paasp.net/paasp-member-was-invited-to-a-meeting-organised-by-nih/) - June 5, 2017 – Anton Bespalov took part in a meeting in Washington, DC (USA) hosted by Francis Collins, Director of National Institutes of Health, and Nora Volkow, Director of National Institute on Drug Abuse. This meeting was aimed to address the role of science in addressing the opioid crisis (link to the NEJM paper
- [Nature is making a step towards greater reproducibility for life-sciences research](https://paasp.net/nature-is-making-a-step-towards-greater-reproducibility-for-life-sciences-research/) - This month Nature started to publish, alongside every life-sciences manuscript, a new reporting-summary document, to which authors are now expected to add details of experimental design, reagents and analysis. This summary documentis essentially the checklist that was accompanying Nature life sciences manuscript submissions since 2013. However, the checklist was not made available to the readers. We believe
- [Are 'Secret' Software Codes part of the reproducibility crisis?](https://paasp.net/are-secret-software-codes-part-of-the-reproducibility-crisis/) - A commentary based on the two articles by Jiménez et al. and Eglen et al. about the need to publish the software code of computer programs developed and used in research labs The generation of non-reproducible research data causes a huge scientific and social problem wasting many billions of US dollars and other resources every
- [The different sample size of inter-connected research methods](https://paasp.net/the-different-sample-size-of-inter-connected-research-methods/) - We will continue presenting Case Study publications that are particularly interesting from the Good Research Practice perspective. We hope that these cases can be useful in training programs and will help younger scientists to learn about the basics of study design, planning and analysis. We invite our readers to share examples that can be used
- [Increasing value and reducing waste in stroke research](https://paasp.net/increasing-value-and-reducing-waste-in-stroke-research/) - Stroke is a major burden to patients and society, and resources spent on stroke research must be used efficiently and show improvements in human health. However, many instances of poor value from stroke research funding have resulted from the way in which stroke research topics have been chosen and how studies have been designed, conducted,
- [Reproducible and reusable research: are journal data sharing policies meeting the mark?](https://paasp.net/reproducible-and-reusable-research-are-journal-data-sharing-policies-meeting-the-mark/) - This study by N. Vasilevsky et al. set out to analyze the pervasiveness and quality of data sharing policies in the biomedical literature. There is wide agreement in the biomedical research community that research data sharing is a primary ingredient for ensuring that science is more transparent and reproducible. Publishers could play an important role
- [Not allowed to publish everywhere](https://paasp.net/652/) - The Economist reported (link) that the biggest foundation in the world, the Bill & Melinda Gates Foundation, have a new policy requiring that all research funded by them has to be made available to everybody for free. This is really interesting, since it will not allow researchers receiving funding from this foundation to publish their
- [February 2017](https://paasp.net/february-2017/) - Biowebspin: PAASP partners with the academic-industry network platform Biowebspin - Read more Author checklists: We do make an impact - Read more Recent publications related to Good Research Practice - Read more Publication archive on the PAASP website - Read more Case study: Bexarotene - Can clinical results resolve controverisal preclinical findings? - Read more
- [No publication without confirmation](https://paasp.net/no-publication-without-confirmation-2/) - In a Nature Comment article Malcolm McCleod and Jeffrey Mogli present a very interesting idea for preclinical research to improve trust in animal studies by performing large confirmatory studies, called ‘preclinical trials’. The authors suggest that critical preclinical studies should be confirmed by an independent lab, with the results being published in the same article
- [Reproducibility2020: Progress and Priorities](https://paasp.net/reproducibility2020-progress-and-priorities/) - One year after Global Biological Standards Institute (GBSI) issued its Reproducibility2020 challenge and action plan for the biomedical research community, Freedman et al. (President GBSI) report encouraging progress toward the goal to significantly improve the quality of preclinical biological research by year 2020. The Report is a comprehensive review of community-led action and impact to
- [The Interplay between Data Quality and Animal Welfare](https://paasp.net/the-interplay-between-data-quality-and-animal-welfare/) - The 3Rs (Replacement, Reduction and Refinement) originating from Russell and Burch (1959) are the guiding principles in preclinical animal research. They had major influence on the legislation on animal testing in many countries and have been incorporated into the US Guide for the Care and Use of Laboratory Animals (Chapter 1) and the European Directive
- [No publication without confirmation](https://paasp.net/no-publication-without-confirmation/) - In a Nature Comment Malcolm McCleod and Jeffrey Mogli present an idea for preclinical research to improve trust in animal studies by performing large confirmatory studies, which they call preclinical trial. The authors suggest that preclinical studies should be confirmed by an independent lab. These additional studies could be published in the same article as
- [Acknowledging and Overcoming Nonreproducibility in Basic and Preclinical Research](https://paasp.net/acknowledging-and-overcoming-nonreproducibility-in-basic-and-preclinical-research/) - In this Viewpoint article, published in JAMA on Feb 13, 2017, John P.A. Ioannidis summarizes critical factors (e.g. poor statistical methods, suboptimal study design, small sample size, etc.) leading to the observed high rate of non-reproducible research studies. This finding is underlined by recently published replication efforts on 5 cancer biology topics (Nosek, BA; Elife.
- [Publish or Perish Debate at WCAA](https://paasp.net/publish-or-perish-debate-at-wcaa/) - Together with Rainer Spanagel (Central Institute of Mental Health, Mannheim) and Henry Kranzler (University of Pennsylvania Perelman School of Medicine), Anton Bespalov took part in the „publish or perish“ debate during the World Congress on Alcohol and Alcoholism (Berlin, Sep 2-5, 2016). There were a range of issues discussed – from the efforts undertaken by
- [Webinar bei Martin Michel](https://paasp.net/webinar-bei-martin-michel/) - Prof. Dr. Martin Michel presented the November Cohen Veterans Bioscience Webinar on November 16th from 12 pm noon - 1 pm ET. Martin shared several interesting but also funny insights to the current crisis in the scientific community. He created awareness about the scope of the problem and informed about current activities taking on the challenge to
- [A manifesto for reproducible science](https://paasp.net/a-manifesto-for-reproducible-science/) - Manufo et al published an open access manifesto in Nature Human Behavior for reproducible science. This interesting piece summarizes the problems in science and presents several key elements that need to be widely implemented to optimize the scientific process. The authors refer to current analysis showing that several elements indeed improve the current situation. However,
- [A pocket guide to electronic laboratory notebooks in the academic life sciences.](https://paasp.net/a-pocket-guide-to-electronic-laboratory-notebooks-in-the-academic-life-sciences/) - Scientists use lab notebooks (LNs) to document their hypotheses, experiments and initial analysis or interpretation of experiments. However, while complexity of science has changed dramatically over the last century, LNs have remained essentially unchanged since pre-modern science. In this article, U. Dirnagl and I. Przesdzing describe their experience when recently switching from a paper-based laboratory
- [Authorization of Animal Experiments Is Based on Confidence Rather than Evidence of Scientific Rigor](https://paasp.net/authorization-of-animal-experiments-is-based-on-confidence-rather-than-evidence-of-scientific-rigor/) - Hanno Würbel and his team investigated the measures taken to decrease the risk of research biases in grant applications or publications: Their findings reveal that only a few grant applications describe protection mechanisms against research biases: A) only 8% mention whether a sample-size calculation was preformed when designing the experiment, B) only 13% mention whether
- [A Laboratory Critical Incident and Error Reporting System for Experimental Biomedicine](https://paasp.net/a-laboratory-critical-incident-and-error-reporting-system-for-experimental-biomedicine/) - Incident reporting has its origins in the 1950s within the aviation industry where it has been seen to be successful in reducing the number of incidents and to improve the safety of pilots. Risk management activities and Critical Incident Reporting (CIR) has been later introduced in clinical medicine and e.g. practitioners are expected to report
- [Ranking major and minor research misbehaviors: results from a survey among participants of four World Conferences on Research Integrity](https://paasp.net/ranking-major-and-minor-research-misbehaviors-results-from-a-survey-among-participants-of-four-world-conferences-on-research-integrity/) - This recently published survey identifies the most frequent problem in science: sloppy research. The survey was performed among participants of the World Conference on Research Integrity and contained 60 questions whereas from the 1500+ participants 17% replied by answering the questions. However, even though fabrication of data ranked high when asking for the impact on
- [29th ECNP Congress - Vienna 2016](https://paasp.net/29th-ecnp-congress-vienna-2016/) - Two reproducibility symposia were held during the 29th annual congress of European College of Neuropsychopharmacology on September 20, 2016 (link): For a number of years, much of the so called reproducibility discussion was largely limited to describing the phenomenon of strikingly low robustness of preclinical data. Now, the focus of the discussion is shifting towards
- [How Many Is Too Many? On the Relationship between Research Productivity and Impact.](https://paasp.net/how-many-is-too-many-on-the-relationship-between-research-productivity-and-impact/) - In this research article, published in PLOS One, V. Larivière and R. Costas analysed the publication and citation records of more than 28 million researchers, who published at least one paper between 1980 and 2013. Based on this data base, the authors aimed to understand the relationship between research productivity and scientific impact: using the
- [Predatory Publishing Threatens the Scientific Enterprise](https://paasp.net/predatory-publishing-threatens-the-scientific-enterprise/) - Open-access publishing has grown dramatically, with a linear increase in the number of articles published, from about 53,000 in 2010 to 420,000 in 2014 (Shen and Björk 2015). This growth has been accompanied by a proliferation of so-called “predatory journals” (Beall 2012) or “pseudojournals” (McGlynn 2013), estimated to comprise 25% of open-access journals (Beall 2012).
- [Additional Publications October 2016](https://paasp.net/additional-publications-october-2016/) - The article ‘Never waste a good crisis: Confronting Reproducibility in Translational Research’ by Daniel Drucker and published in Cell Metabolism picks up many well-known and extensively discussed issues concerning the reproducibility crisis, but also introduced some really interesting ideas which could be game changers for the scientific community. Drucker is a scientist working in the
- [Publications September 2016](https://paasp.net/publications-september-2016/) - From a mouse: systematic analysis reveals limitations of experiments testing interventions in Alzheimer’s disease mouse models. Systematic review and meta-analysis are powerful tools to assess the validity and robustness of data published in a certain research field. In this article, Egan et al. used a systematic review approach to analyze the prevalence and impact of
- [World Congress on Alcohol and Alcoholism (Berlin, Sep 2-5, 2016)](https://paasp.net/world-congress-on-alcohol-and-alcoholism-berlin-sep-2-5-2016/) - Together with Rainer Spanagel (Central Institute of Mental Health, Mannheim) and Henry Kranzler (University of Pennsylvania Perelman School of Medicine), Anton Bespalov took part in the „publish or perish“ debate during the World Congress on Alcohol and Alcoholism (Berlin, Sep 2-5, 2016). There were a range of issues discussed – from the efforts undertaken by
- [Martin C. Michel's reason to join PAASP](https://paasp.net/martin-c-michels-reason-to-join-paasp/) - In God we trust” is minted on each US coin. The evidence-based medicine movement has adapted this to “In God we trust, all others must bring data”, and this credo has considerably improved the quality of medical care over past decades. But for the non-clinical sciences it has become clear that we cannot necessarily trust
- [Never waste a good crisis: Confronting Reproducibility in Translational Research.](https://paasp.net/never-waste-a-good-crisis-confronting-reproducibility-in-translational-research/) - „Never waste a good crisis: Confronting Reproducibility in Translational Research“ by Daniel Drucker was published in Cell Metabolism and picks up many well-known and extensively discussed issues concerning the reproducibility crisis, but also introduced some really interesting ideas which could be game changers for the scientific community. Drucker is a scientist working in the field
- [Reproducibility: Respect your cells!](https://paasp.net/reproducibility-respect-your-cells/) - Working with cell cultures seems to be pretty easy -at least most times- and is done routinely in many in vitro labs. However, an article by Monya Baker (Reproducibility: Respect your cells!) points out many pitfalls when working with cell cultures and really addresses that the devil can be in the detail. Most scientists will
- [Evaluation of recombinant monoclonal antibody SVmab1 binding to NaV1.7 target sequences and block of human NaV1.7 currents](https://paasp.net/evaluation-of-recombinant-monoclonal-antibody-svmab1-binding-to-nav1-7-target-sequences-and-block-of-human-nav1-7-currents/) - The Preclinical Reproducibility & Robustness (PRR) channel provides a venue for researchers to publish both confirmatory and non-confirmatory studies to help improve reproducibility of results, mitigate publication bias towards positive results and to promote open dialogue between scientists. During last month three important announcements were made: 1. The advisory board of PRR was expanded by several
- [Statement by Martin Michel](https://paasp.net/statement-by-martin-michel/) - “In God we trust” is minted on each US coin. The evidence-based medicine movement has adapted this to “In God we trust, all others must bring data”, and this credo has considerably improved the quality of medical care over past decades. But for the non-clinical sciences it has become clear that we cannot necessarily trust
- [A proposal for validation of antibodies.](https://paasp.net/a-proposal-for-validation-of-antibodies/) - The International Working Group on Antibody Validation (IWGAV) is an independent group of international scientists with diverse research interests in the field of protein biology. Thermo Fisher Scientific provided financial support to the IWGAV in 2015 to spearhead the development of industry standards and help combat the common challenges associated with antibody specificity and reproducibility.
- [A STAR Is Born](https://paasp.net/a-star-is-born/) - A STAR Is Born - Cell Press transforms the methods section of articles to improved transparency and accessibility. As one of the steps to improve scientific reproducibility, the biomedical journal Cell will introduce a redesigned methods section to help authors to communicate more clearly how experiments are conducted. As stated by Cell, ‘the Structured, Transparent, Accessible Reporting (STAR)
- [Retraction notice:](https://paasp.net/retraction-notice/) - ‘…There was no response from the authors despite our attempts to reach them and request to clarify these discrepancies. More importantly, the authors of this paper are non-existent and were never employed by the Australian National University, Canberra, Australia. (PubMed ID 25010391)
- [Mouse microbes may make scientific studies harder to replicate.](https://paasp.net/mouse-microbes-may-make-scientific-studies-harder-to-replicate/) - "Microbiome" is a term used to refer to gut bacteria but also to other inhabitants of the gut, like viruses, fungi, and protozoa. In this article, K. Servick discussed the impact of the microbiome on varying experimental data. The microbes that reside in mice can make it difficult to replicate scientific studies. While mice in
- [From a mouse: systematic analysis reveals limitations of experiments testing interventions in Alzheimer’s disease mouse models.](https://paasp.net/from-a-mouse-systematic-analysis-reveals-limitations-of-experiments-testing-interventions-in-alzheimers-disease-mouse-models/) - Systematic review and meta-analysis are powerful tools to assess the validity and robustness of data published in a certain research field. In this article, Egan et al. used a systematic review approach to analyze the prevalence and impact of quality factors known to influence the risk of bias (e.g. reporting of random allocation to group,
- [eNeuro publishes Series on Scientific Rigor](https://paasp.net/eneuro-publishes-series-on-scientific-rigor/) - Christophe Bernard, editor in chief of eNeuro, mentions in this editorial the issue of scientific rigor with a reference to two Commentaries by Katherine Button and Oswald Steward. To show that it is not a novel phenomenon, he gives the wonderful example of a dispute between Louis Pasteur and Claude Bernard. Interestingly, since then clear guidelines and
- [Block randomization: R code](https://paasp.net/block-randomization-r-code/) - There are a variety of free online tools that can be easily accessed to address various data analysis needs, such as the randomization tools described in the last two Newsletter issues. One would only need to be aware of such resources, maintain these references and links in a convenient format and place and, last but
- [Publications July 2016](https://paasp.net/publications-july-2016/) - Standards for Cell Line Authentication and Beyond. Cell line authentication is a powerful approach to add confidence to the results of a scientific study. However, most researchers do not perform a simple, affordable test to authenticate these key resources. In this issue, Almeida et al. discuss the importance of developing standards for authentication of cell
- [Why Most Clinical Research Is Not Useful.](https://paasp.net/why-most-clinical-research-is-not-useful/) - In this essay, John P.A. Ioannidis argues that features relating to problem base, context placement, information gain, pragmatism, patient centeredness, value for money, feasibility, and transparency define useful clinical research. As many studies do not satisfy these criteria, he concludes that most clinical research is not useful and reform is overdue. Importantly, he points out that
- [Publications June 2016](https://paasp.net/publications-june-2016/) - Reproducibility Crisis: Are We Ignoring Reaction Norms? In this letter, published in Trends in Pharmacological Sciences, Bernhard Voelkl and Hanno Würbel discuss the importance of phenotypic plasticity in experimental design and analysis. Generally, phenotypic plasticity is the capacity of a single genotype to exhibit variable phenotypes in different environments. Due to this variability, results should
- [1,500 scientists lift the lid on reproducibility](https://paasp.net/1500-scientists-lift-the-lid-on-reproducibility/) - According to the survey conducted by Nature (link), more than 52% of 1,576 researchers representing different areas of science see a „significant reproducility crisis“. As acknowledged by the author of this report, Monya Baker, „the survey — which was e-mailed to Nature readers and advertised on affiliated websites and social-media outlets as being ‘about reproducibility’
- [Publications May 2016](https://paasp.net/publications-may-2016/) - Innovative Medicine Initiative (IMI) Announcement: On 27 April 2016 IMI officially launched its 9th Call for proposals under IMI 2. It includes a program on “Data quality in preclinical research”, demonstrating a raising awareness amongst all stakeholders that robustness, rigor and validity of research data can be problematic and that there is a “need for
- [E-Learning tools and MOOCs II](https://paasp.net/e-learning-tools-and-moocs-ii/) - E-learning platforms and Massive Open Online Courses (MOOCs) are picking up momentum in popularity and are an emerging new model for education and training that delivers videotaped lectures and other course materials over the Internet for students and scientists at many different levels. These novel educational technologies do not only represent tools for learning, but
- [GDF11 - the 'new blood' anti-aging protein](https://paasp.net/gdf11-the-new-blood-anti-aging-protein/) - The seminal paper by John Ioannidis entitled “Why Most Published Research Findings Are False” (2005 PLoS Medicine 2: e124), contains some statements that are easy to understand and follow, e.g. smaller sample sizes indicate that research findings are less likely to be true. However, there are others that, in spite of being very well presented
- [An incentive-based approach for improving data reproducibility](https://paasp.net/an-incentive-based-approach-for-improving-data-reproducibility/) - In the editorial published in Science Translational Medicine, Michael Rosenblatt, Merck’s executive vice president and chief medical officer, said bad results from academic labs caused pharmaceutical companies to waste millions and “threatens the entire biomedical research enterprise.” He suggests an incentive-based approach for improving data reproducibility that is essentially a “full or partial money-back guarantee.”
- [The Experiment Factory: Standardizing Behavioral Experiments](https://paasp.net/401/) - Vanessa V. Sochat and colleagues from Stanford University have presented the Experiment Factory, a modular infrastructure that applies a collaborative, open source framework to the development and deployment of psychology web-based experiments. Psychology is one of the fields of science that has been affected by the so called „reproducibility“ crisis (link) and it is argued that reproducible
- [E-learning tools and MOOCs](https://paasp.net/e-learning-tools-and-moocs/) - E-learning platforms and Massive Open Online Courses (MOOCs) are picking up momentum in popularity and are an emerging new model for education and training that delivers videotaped lectures and other course materials over the Internet for students and scientists at many different levels. These novel educational technologies do not only represent tools for learning, but
- [Publications April 2016](https://paasp.net/publications-april-2016/) - Statement on Statistical Significance and P-values. The world’s largest professional association of statisticians, the American Statistical Association, has made a public statement regarding the use of P-values in research. This statement, presented by Wasserstein and Lazar, aims to provide some clarification on the proper use and interpretation of the P-value which ‘can be a useful
- [In search of the mechanisms of ketamine’s antidepressant effects: How robust is the evidence behind the mTor activation hypothesis](https://paasp.net/in-search-of-the-mechanisms-of-ketamines-antidepressant-effects-how-robust-is-the-evidence-behind-the-mtor-activation-hypothesis/) - Intravenous ketamine has been repeatedly shown to induce a rapid and long-lasting antidepressant effect in treatment-resistant patients. A 2010 Science paper by Li and colleagues described a pathway activated by ketamine and suggested to underlie antidepressant effects of ketamine. This could enable development of novel antidepressant drugs sharing ketamine's efficacy but free from ketamine's side-effects.
- [Statement on Statistical Significance and P-values](https://paasp.net/statement-on-statistical-significance-and-p-values/) - The world’s largest professional association of statisticians, the American Statistical Association, has made a public statement regarding the use of P-values in research. This statement, presented by Wasserstein and Lazar aims to provide some clarification on the proper use and interpretation of the p-value which „can be a useful statistical measure but is commonly misused
- [When Quality Beats Quantity: Decision Theory, Drug Discovery, and the Reproducibility Crisis](https://paasp.net/when-quality-beats-quantity-decision-theory-drug-discovery-and-the-reproducibility-crisis/) - In this article written by Scannell and Bosley, the contrast between increased costs for drug discovery and the decreased success rate is analyzed using a quantitative decision-theoretic model of the R&D model (quite complex :). In a nutshell, results of this analysis indicate that, "when searching for rare positives (e.g., candidates that will successfully complete
- [Additional Reads in March 2016](https://paasp.net/additional-reads-in-march-2016/) - Robust science needs robust corrections. David Allison and his colleagues argue that mistakes in peer-reviewed papers are easy to find but hard to fix. In this Nature commentary, six key problems are identified and excellent suggestions are made on how to improve the current situation. Most interestingly, authors argue that ‘scientists who engage in post-publication review
- [Retraction analysis: Can GSP governance make a difference?](https://paasp.net/retraction-analysis-can-gsp-governance-make-a-difference/) - During the past decade, the number of retractions increased dramatically, even when normalized by the total number of articles published in life science journals (see Figure below). Focusing on retracted articles related to drug discovery processes, we asked the question whether some problems that eventually resulted in the retraction of published findings could have been
- [Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps.](https://paasp.net/irreproducibility-in-preclinical-biomedical-research-perceptions-uncertainties-and-knowledge-gaps/) - Over the last several years, many articles and commentaries were written on the subject of „reproducibility of research data“. In this new review, Jarvis and Williams provide a very refreshing view arguing that „perceptions of research irreproducibility in the preclinical sciences are based on limited, frequently anecdotal data from select therapeutic areas of cell and
- [Sperm RNA carries marks of trauma](https://paasp.net/sperm-rna-carries-marks-of-trauma/) - We will use this Case Study section to draw your attention to publications that have received a lot of attention in the scientific community and mass media and are particularly interesting from the GSP perspective. Since 2011, there were reports that sperm RNA can 'remember' traumatic experiences (Gapp et al., Nature Neuroscience 2014, 17, 667–669). Can environmental factors involving
- [Additional Reads February 2016](https://paasp.net/additional-reads-february-2016/) - Use of positive and negative words in scientific PubMed abstracts between 1974 and 2014: retrospective analysis. Christiaan Vinkers and colleagues at Utrecht University reported in the British Medical Journal results of the lexicographic analysis of the use of positive and negative words in scientific abstracts. Over the last four decades, the absolute frequency of positive words
- [Meeting Report 'Critique as a professional service?' Berlin, Dec 2015](https://paasp.net/meeting-report-critique-as-a-professional-service-berlin-dec-2015/) - 'Critique as a professional service?' was the title of the anniversary conference by the Institute for Research Information and Quality Assurance (iFQ) held in Berlin at the beginning of December last year. The iFQ was found in 2005 with the aim to inform, analyze and give advice to members of universities, research institutes and policy makers about
- [Robust science needs robust corrections.](https://paasp.net/robust-science-needs-robust-corrections/) - David Allison and his colleagues argue that mistakes in peer-reviewed papers are easy to find but hard to fix. In this Nature commentary, six key problems are identified and excellent suggestions are made on how to improve the current situation. Most interestingly, authors argue that «scientists who engage in post-publication review often do so out of
- [Reproducible Research Practices and Transparency across the Biomedical Literature.](https://paasp.net/reproducible-research-practices-and-transparency-across-the-biomedical-literature/) - A team of authors, led by John P.A. Ioannidis, analyzed a randomly chosen set of 441 PubMed-indexed papers related to biomedicine which were published between 2000 and 2014. Among these 441 publications, 268 included empirical data. Of these 268, only one study provided a complete and full protocol. None of the selected 268 papers provided

## Pages

- [Home](https://paasp.net/) - Do you want to turn a scientific discovery into a safe and effective therapy? Since 2015, PAASP enhances productivity of biopharmaceutical R&D by securing high quality of research data and thereby data-driven decision making. We work with everyone in drug discovery involved in creating value – from academic scientists and biotech innovators to public funders
- [Webinars](https://paasp.net/resources/webinars/) - FIN3R Center symposium October 27, 2025 The work of the Harm-Benefit Task force was presented by Anton Bespalov at the FIN3R Center symposium in Turku (Finland). Copy of the presentation “Striking a Balance: ​ A Proposed Benefit Assessment Matrix for Ethical Animal Research“ is available from the OSF repository (link: https://osf.io/9cs3u/files/63x8m) Yerevan State University October
- [Incubator](https://paasp.net/incubator/) - ProCeeD INCUBATOR Translating academic discoveries into safe and effective medications How does ProCeeD incubator work? Step 1 – ProCeeD team evaluates project and confirms eligibility criteria Step 2 – Inventor and ProCeeD ​jointly present ​the project to raise funds Step 3 – The ProCeeD team executes the project towards the agreed milestone Step 4 –
- [Publishing Negative Results](https://paasp.net/resources/publishing-negative-data/) - PUBLISHING NEGATIVE DATA Disclosure of negative data is essential for the progress of science. PAASP invites all colleagues to share resources that support decisions on when negative data are worth publishing and tips about how to do that in the most efficient manner. TOOLS TO DECIDE WHETHER, WHEN, WHERE AND HOW TO PUBLISH NEGATIVE OR NULL
- [EQIPD](https://paasp.net/resources/eqipd/) - ENHANCING QUALITY IN PRECLINICAL DATA (EQIPD) EQIPD framework is for any lab interested in generating robust and reliable data Developed by an Innovative Medicine Initiate (IMI) consortium, EQIPD framework provides simple and sustainable solutions that facilitate improvements in data quality without impacting innovation and freedom of research. The ​​​​​​EQIPD Quality System is particularly intended for research
- [Resources](https://paasp.net/resources/) - RESOURCES A treasure trove of materials related to data quality and best practices. EDUCATIONAL CORNER ENHANCING QUALITY IN PRECLINICAL DATA (EQIPD) WEBINARS PUBLISHING NEGATIVE DATA Looking for something else? CONTACT US
- [Services](https://paasp.net/services/) - SERVICES Improving data integrity We provide a host of services to support you and your team’s efforts to generate robust data, evaluate data quality, and inform decision-making. Eliminating potential sources of research bias increases research value and aids in the identification of investment opportunities. Assess We partner with you to assess data quality by identifying
- [Privacy Policy](https://paasp.net/home/privacy-policy/) - General data protection policy 1. Introduction PAASP GmbH welcomes you to our website; thank you for your interest in our company, and our products and services. The protection of your personal information throughout the entire business process is a matter of importance to us and we want you to feel safe while visiting our website.
- [Network](https://paasp.net/network/) - NETWORK The PAASP Network We are a growing, global network. Contact us for information on becoming a network member! The PAASP Network Partners Anton BespalovCEO PAASP GmbH Anne CollinsPartner UK and Ireland Christoph EmmerichCSO PAASP GmbH Björn GerlachCOO PAASP GmbH Arnoud HerremansPartner The Netherlands Patricia KabitzkePartner US Connie LeungPartner China Martin MichelCBO PAASP GmbH Rob
- [Initiatives](https://paasp.net/home/initiatives/) - EXTERNALLY FUNDED PROJECTS EQIPD A Quality System for Basic Research GOT-IT Guidelines for Target Validation PEERS A Platform for the Exchange of Experimental Research Standards COFA A Quality Framework for Core Facilities DECIDE Success Factors and Best Practice Guideline for Confirmatory Studies PAASPORT® Expanding the Research Evaluation Tool Good Research Practice in Non-Clinical Pharmacology and
- [EQIPD-nl](https://paasp.net/eqipd-nl/) - EQIPD in Nederland Onze visie Op een eenvoudige en duurzame manier ondersteunen van het verbeteren van de kwaliteit van onderzoeksdata, zonder dat het innovatieve vermogen en de vrijheid van onderzoek wordt beperkt. Te vaak ontstaat er nadat een studie is afgerond twijfel over de kwaliteit van de onderzoeksdata. Meer dan eens blijkt dat door problemen
- [EQIPD-pl](https://paasp.net/eqipd-pl/) - EQIPD w Polsce Nasza wizja Proste i zrównoważone rozwiązania, które ułatwiają poprawę jakości danych bez wpływu na innowacje i swobodę badań. Często omawiamy jakość danych badawczych dopiero po zaplanowaniu i zakończeniu badań (schemat po lewej) – co w wielu przypadkach skutkuje stratą czasu i zasobów. Głównym celem EQIPD jest zapewnienie spełnienia wszystkich podstawowych wymagań jakościowych
- [EQIPD-rs](https://paasp.net/eqipd-rs/) - EQIPD в России Наша миссия повышение качества данных без ущерба для инноваций и свободы научно-исследовательской деятельности Качество исследовательских данных часто становится предметом обсуждения только после того, как исследование было запланировано и выполнено (схема слева), что во многих случаях приводит к трате времени и ресурсов. Основная задача EQIPD в том, чтобы обеспечить соблюдение всех основных требований к качеству
- [EQIPD-it](https://paasp.net/eqipd-it/) - EQIPD in Italia La nostra Visione Soluzioni semplici e facilmente applicabili che permettono di migliorare la qualità dei dati senza limitare la ricerca e la capacità di innovazione. Spesso la qualità dei dati ottenuti da uno studio viene discussa solo dopo che questo è stato pianificato e concluso (schema a sinistra) – il che porta
- [EQIPD-fr](https://paasp.net/eqipd-fr/) - EQIPD en France Votre vision Des solutions simples et durables qui facilitent l’amélioration de la qualité des données sans nuire à l’innovation et à la liberté de recherche. Nous ne discutons souvent de la qualité des données de recherche qu’après la planification d’une étude et la fin d’une expérience (schéma à gauche), ce qui entraîne
- [EQIPD-es](https://paasp.net/eqipd-es/) - EQIPD en España Nuestro Concepto Soluciones simples y sostenibles que faciliten mejoras en la calidad de los datos sin impactar la innovación y la libertad investigadora. A menudo se habla sobre la calidad de los resultados científicos únicamente después de planear, ejecutar y finalizar los experimentos (diagrama de la izquierda), lo que resulta, en muchos
- [Academic Project Support](https://paasp.net/home/academic-project-support/) - Quality Assurance and Monitoring Founded in 2015, PAASP is the first full-service consulting and auditing company providing support to questions of operational risks related to quality of research data. The focus is on preclinical research in large consortia who create value for biomedical research. Planned activities can be introduced in grant applications with four modules: Module
- [Services-update](https://paasp.net/services-update/) - We support you and your team’s efforts to generate robust data, evaluate data quality, and inform decision-making Academic scientists We have developed services and user-friendly tools to support academic scientists in achieving their objectives: Train your students and postdocs on various aspects of Good Research Practice – face-to-face or online (contact Prof Martin Michel) Increase
- [Research Rigor Support](https://paasp.net/services/research-rigor-support/) - RESEARCH RIGOR SUPPORT FOR GRANT APPLICANTS Adherence to research quality standards makes the outcome of any research project more valuable and is therefore desirable from the perspective of funders and reviewers of grant applications. We have developed a comprehensive support program that starts with a contribution to the grant application development and ends with the
- [EQIPD-de](https://paasp.net/eqipd-de/) - EQIPD für die DACH Region Unsere Vision Wir möchten einfache und nachhaltige Lösungen schaffen, welche eine Verbesserung der Datenqualität ermöglichen, ohne gleichzeitig die Innovation und Forschungsfreiheit zu beeinträchtigen. Im heutigen Forschungsalltag diskutieren wir oft erst über die Qualität von Forschungsdaten, nachdem eine Studie bereits geplant wurde und ein Experiment abgeschlossen ist (siehe Zyklus links) –
- [R Programming](https://paasp.net/resources/r-programming/) - R PROGRAMMING Script-based methods in study design and analysis support transparency of analytical methods. PAASP invites all colleagues to share their examples of R scripts, links to useful R packages, literature and training resources. Email us, and we’ll make them public on this page. R packages The R project and the CRAN site – getting
- [translating academic excellence](https://paasp.net/services/translating-academic-excellence/) - Translating Academic Excellence Translating academic excellence into innovative therapeutics: A neglected aspect of ‘translational’ research The Challenge – industry and academia speak different languages: The transfer of academic innovation into drug development requires the translation of “efficacy claims in animals” into “therapeutic efficacy in humans”. For most academic projects, a critical step is also to
- [Grant application survey logout](https://paasp.net/grant-application-survey-logout/) - Grant Application Survey Your are successfully logged out. Access to the “FUNDER TOOL” Log in again. MORE
- [Grant application survey login](https://paasp.net/grant-application-survey-login/) - Grant Application Survey A tool to support grant applicants This tool was developed by funding organisations to provide an overview of implement practices at the applicants research units. Showcase to funders With this tool you can tell your funders: Which best practices you have in place Which quality practices are not relevant for you Mirroring
- [Gender Equality Plan](https://paasp.net/home/gender-equality-policy/) - The PAASP management supports and has been facilitating measures to support gender equality. With this document, the PAASP management states that the company has dedicated resources to further develop and implement gender equality measures listed below. Dedicated resources PAASP GmbH is a founding member of the global PAASP Network. Individual members of the network may
- [User](https://paasp.net/user/) - [ultimatemember form_id="7824"]
- [Login](https://paasp.net/login/) - [ultimatemember form_id="7823"]
- [Register](https://paasp.net/register/) - [ultimatemember form_id="7822"]
- [Members](https://paasp.net/members/) - [ultimatemember form_id="7825"]
- [Logout](https://paasp.net/logout/)
- [Account](https://paasp.net/account/) - [ultimatemember_account]
- [Password Reset](https://paasp.net/password-reset/) - [ultimatemember_password]
- [Risk analysis of biotech investments](https://paasp.net/home/risk-analysis-of-biotech-investments/) - Innovation in Research Quality Governance Founded in 2015, PAASP is the first full-service consulting and auditing company that specializes in providing assessment of operational risks related to quality of research data. Our focus is on organizations that create value by conducting drug discovery research. For historical reasons, early-phase preclinical drug discovery research is largely exempt
- [Survey: Repeat experiments](https://paasp.net/survey-repeat-experiments/) - Welcome to our one-question-fun-quiz! Since we at PAASP have heart exactly this question or some variation of it, we were interested how common it indeed is. [qsm quiz=4]
- [PAASP in Europe](https://paasp.net/network/paasp-europe/) - The PAASP Network in Europe Anton BespalovCEO PAASP GmbH Anne CollinsPartner UK and Ireland Christoph EmmerichCSO PAASP GmbH Björn GerlachCOO PAASP GmbH Arnoud HerremansPartner The Netherlands Martin MichelCBO PAASP GmbH Paul MoserPartner France Malgorzata PietraszekPartner Poland Renza RoncaratiPartner Italy Valentina VengelienePartner Baltic Region
- [Survey: Study plan requirements](https://paasp.net/home/survey-study-plan-requirements/) - SURVEY Importance of items in the Study Template from EQIPD The following statements were taken from the Study Plan template suggested by EQIPD. If you would like to get more background on each item, you can also have a look in the EQIPD Toolbox linked HERE. Please rate the importance of the following items [qsm
- [Tools for Researchers](https://paasp.net/resources/educational-corner/tools-for-researchers/) - EDUCATIONAL CORNER Tools for Researchers Assessment of benefit of animal researchDecember 19, 2025 Unless and until we have validated non-animal alternative methods available for routine use, the involvement of animals in research is required… Read More Valuable resource: Sex as a biological variableDecember 19, 2025 Several years ago, we were part of an NIH-funded consortium
- [New Publications](https://paasp.net/resources/educational-corner/new-publications/) - EDUCATIONAL CORNER New Publications Additional Reads in December 2023December 22, 2023 Further commentaries, articles and blog posts worth reading:Zen und die Kunst, Forschung zu bewerten (in German) In defense of quantitative metrics… Read More Effects of ketamine optical isomers, fluoxetine and naloxone on timing in differential reinforcement of low-rate response (DRL) 72-s task in ratsDecember
- [Guidelines in Research](https://paasp.net/resources/educational-corner/guidelines/) - EDUCATIONAL CORNER Guidelines in Research DRIVER: Design and reporting of in vitro experimentsDecember 18, 2025 The RIVER project – originally standing for Reporting In Vitro Experiments Responsibly – was launched in order to improve reporting standards… Read More Why sex as a biological variable matters in preclinical researchAugust 20, 2025 Treating sex as a biological
- [Fun Section](https://paasp.net/resources/educational-corner/fun-section/) - EDUCATIONAL CORNER Fun Section May the laughter help us!December 22, 2025 In science, the most (in)famous dichotomy is created by p
- [Editorials](https://paasp.net/resources/educational-corner/editorials/) - EDUCATIONAL CORNER Editorials PAASP Editorial in the Journal TemperatureOctober 8, 2020 Please following this LINK to our Editorial “Enhancing quality in preclinical data: Of hot science and cool quality”, which was just published in… Read More Die Reproduzierbarkeitskrise: Bedrohung oder Chance für die Wissenschaft? (In German)May 28, 2020 In this Editorial, published in Biologie in unserer Zeit,
- [Commentaries](https://paasp.net/resources/educational-corner/commentaries/) - EDUCATIONAL CORNER Commentaries Questionable data in neurodegeneration research: A coincidence?December 23, 2025 If you have not read the book “Doctored” by Charles Piller (here), you may want to have a look at the… Read More Scientist.com: Supporting EQIPDDecember 22, 2025 Contributed by Matt McLoughlin (Senior Vice President | Compliance & Categories) As the industry-leading solution
- [Case Studies](https://paasp.net/resources/educational-corner/case-studies/) - EDUCATIONAL CORNER Case Studies Good Research Practice: Why not?December 18, 2025 This is indeed the central theme of the current newsletter and this has been the central theme in our discussions with… Read More To ARRIVE or not: Ticking (wrong) boxesDecember 17, 2025 Every now and then we read publications stating that experiments “were conducted according to ARRIVE
- [All Posts](https://paasp.net/resources/educational-corner/all/) - EDUCATIONAL CORNER All Posts Announcement: Quality management workshopDecember 24, 2025 Organized by the EXCELSciOR project, GoEQIPD’s deputy René Bernard is conducting a full day Quality Management Workshop on January 29, 2026… Read More Ten years later: Are we there yet?December 24, 2025 PAASP was founded in November 2015 to provide services related to rigor in nonregulated biomedical
- [Events](https://paasp.net/resources/events/) - EVENTS For your convenience, we’ve compiled a list of events that have been organized by like-minded people within the non clinical research industry. Upcoming [MEC id=”4857″] Past [MEC id=”4856″]
- [Educational Corner](https://paasp.net/resources/educational-corner/) - EDUCATIONAL CORNER A carefully curated collection of news and resources relevant to our favorite topics. Guidelines in Research DRIVER: Design and reporting of in vitro experimentsDecember 18, 2025 The RIVER project – originally standing for Reporting In Vitro Experiments Responsibly – was launched in order to improve reporting standards… Read More Why sex as a
- [PAASP in the United States](https://paasp.net/network/unitedstates/) - The PAASP Network in the United States Patricia KabitzkePartner US Rob MillerPartner US
- [PAASP in DACH region](https://paasp.net/network/dach/) - The PAASP Network for Germany, Austria and Switzerland Anton BespalovCEO PAASP GmbH Christoph EmmerichCSO PAASP GmbH Björn GerlachCOO PAASP GmbH Martin MichelCBO PAASP GmbH
- [Contact us](https://paasp.net/contact-us/) - CONTACT US Contact us by email or by entering your information here to learn more about our network and services. PAASP GmbHKunsthaus 25Hauptstrasse 25D- 69117 HeidelbergGermany Your Name (required) Your Email (required) Subject Your Message
- [News](https://paasp.net/news/) - NEWS News from the PAASP network Ten years later: Are we there yet?December 24, 2025 PAASP was founded in November 2015 to provide services related to rigor in nonregulated biomedical research – with a mission to… Read More Campfire Session on Research Quality at ECNP 2025December 22, 2025 At the ECNP Congress in Amsterdam, Anton Bespalov and Arnoud
- [PAASPort](https://paasp.net/services/paasport/) - PAASPORT® PAASPort® A platform to evaluate data quality in biomedical research. Introduce quality into early decisions to improve the probability that basic nonclinical discoveries will translate into safe and effective clinical treatments. A proprietary tool that evaluates the quality of research practice. Uses machine learning models to predict the probability of clinical success based on
- [Newsletter](https://paasp.net/newsletter/) - Our monthly Newsletter covers different topics in the area of preclinical research quality, including publication highlights from the previous month, guest commentaries about research quality, case studies with helpful tools and tips, and current developments in the field of research integrity. See below our latest published newsletters. Subscribe to the PAASP Newletter (required) Contacting Permissions
- [Education](https://paasp.net/services/education/) - EDUCATION Education by PAASP PAASP offers several formats of educating researchers on best practices. How to recognize data likely to be irreproducible How to generate reproducible data How to comply with best documentation practices Lecture Our lectures provide an introduction to the topic of Good Research Practice and create awareness about researchers bias. The focus
- [Survey: In Vivo Results](https://paasp.net/home/in-vivo-results/) - SURVEY Reporting of In Vivo Results in Medicinal Chemistry Articles Medicinal chemistry papers often report results of experiments assessing effects of novel compounds using in vivo methods. We are interested in your opinion on the reporting standards of the in vivo experiments in these papers and would be very grateful if you could answer the following
- [News from the PAASP Network](https://paasp.net/news/paasp-network/) - NEWS News from the PAASP network Ten years later: Are we there yet?December 24, 2025 PAASP was founded in November 2015 to provide services related to rigor in nonregulated biomedical research – with a mission to… Read More Campfire Session on Research Quality at ECNP 2025December 22, 2025 At the ECNP Congress in Amsterdam, Anton Bespalov and Arnoud
- [Why GRP?](https://paasp.net/home/why-grp/) - Good Research Practice (GRP) or Good Scientific Practice (GSP) Good scientific practice is promoted by many academic institutions, companies and funding agencies. For instance, the DFG (German Science Society) has a publicly available document on “Safeguarding good scientific practice”. Similarly, the WHO (World Health Organization) has developed suggestions on “Quality practices in Basic Biomedical Research”.
- [Legal Information PAASP GmbH](https://paasp.net/home/legal-info-gmbh/) - Name and Address PAASP GmbH Am Aukopf 14/1 D- 69118 Heidelberg Germany Registration Court: Amtsgericht Mannheim Registration Number: HRB 723704 Geschäftsführer: Dr Anton Bespalov Limitation of Liability for Internal Content The content of our website has been compiled with meticulous care and to the best of our knowledge. However, we cannot assume any liability for
- [StuDySign](https://paasp.net/services/studysign/) - Solid experimental design, data analysis and data storage are among the fundamental requirements for Good Research Practice. Originally, these aspects were documented in hand-written lab notebooks. To support scientists in collecting and archiving the mostly electronically generated data sets, several companies have developed electronic Lab-Notebooks (eLN) over the last decade. However, most eLNs focus on
- [Evaluation](https://paasp.net/services/evaluation/) - EVALUATE Evaluation by PAASP PAASP offers the evaluation of research manuscripts and data for compliance with best practices in research. Statistical analysis Compliance with technical standards. Comprehensiveness of documentation. Would like to know more? CONTACT US

## Team Members

- [Renza Roncarati](https://paasp.net/team/renza-roncarati/) - Renza Roncarati studied biology at the University of Bologna in Italy and obtained her PhD from the Max-Planck-Institute for Plant Breeding Research and the University of Cologne in Germany. Subsequently, she was a Postdoctoral Fellow at the Department of Medical Genetics and Virology of the University of Cologne where she studied host-virus interactions at the molecular
- [Valentina Vengeliene](https://paasp.net/team/valentina-vengeliene/) - Valentina obtained a PhD in pharmacology from Heidelberg University in 2005, based on her research done at the Central Institute of Mental Health in Mannheim, Germany. Following her PhD, she continued as a scientist at the Central Institute of Mental Health, focusing on addiction. In particular, she identified new therapeutic targets that could help patients
- [Malgorzata Pietraszek](https://paasp.net/team/malgorzata-pietraszek/) - Malgorzata Pietraszek has over 20 years of experience in CNS pharmacology acquired in both pharmaceutical industry and academic environments. Malgorzata holds a PhD from the Institute of Pharmacology Polish Academy of Sciences (PAS) in Cracow and a MSc from the Jagiellonian University (Cracow). Between 1993 and 2007, Malgorzata conducted research in the therapeutic areas of
- [Paul Moser](https://paasp.net/team/paul-moser/) - Paul trained as a pharmacologist in the UK, first in Bristol, then in Bath for his Ph.D., specialising in chronopharmacology. He has spent over 30 years in the pharma industry in both big and medium pharma companies, biotech and also in contract research. After a few years at Wyeth in the UK and after his
- [Connie Leung](https://paasp.net/team/connie-leung/) - Connie Leung received her veterinary medical degree from the University of Guelph, Canada and her doctorate degree in philosophy from The University of Hong Kong, People’s Republic of China. After obtaining her PhD degree, she continued as a scientist at the School of Public Health, The University of Hong Kong and her research focused on the
- [Rob Miller](https://paasp.net/team/rob-miller/) - Rob has 17 years of biopharma business development and pipeline commercial experience with Lilly, Abbott and AbbVie that provides the PAASP team with an in-depth understanding of how biopharma companies evaluate risk and make decisions to optimise their pipelines with internal and external innovation: New product commercial development and for over 40 neuroscience programs Commercial
- [Martin Michel](https://paasp.net/team/martin-michel/) - Martin C. Michel is a physician trained in experimental and clinical pharmacology in Essen (Germany) and San Diego (California). He headed the Nephrology and Hypertension Research Laboratory in Essen (1993-2002), the Department of Pharmacology & Pharmacotherapy at the University of Amsterdam (The Netherlands, 2003-2011) and was Global Head of Product and Pipeline Scientific Support at
- [Patricia Kabitzke](https://paasp.net/team/patricia-kabitzke/) - Patricia Kabitzke serves as the Senior Advisor and Chief of Staff to the Director of the Stanley Center for Psychiatric Research at the Broad Institute of MIT and Harvard. Prior to joining the Broad, Patricia served as the Associate Director of Scientific Programs at Cohen Veterans Bioscience (CVB), a national nonprofit focused on diagnostic tests
- [Arnoud Herremans](https://paasp.net/team/arnoud-herremans/) - Dr Arnoud Herremans, founder and CEO of Y47 provides a service to introduce processes that continuously improve workflow and bring Innovation Excellence to Life Science and Chemical organizations where research is an important part of daily life. The center of Arnoud’s service is Lean Thinking which builds a mind set in every employee to clearly
- [Christoph Emmerich](https://paasp.net/team/christoph-emmerich/) - Christoph Emmerich, a Biochemist by training, carried out his PhD studies in the fields of cancer biology and apoptosis at the German Cancer Research Centre (DKFZ), Heidelberg and at the Imperial College London. In 2011, Christoph joined the MRC Protein Phosphorylation and Ubiquitylation Unit (MRC-PPU) in Dundee, Scotland where he was involved in several industry-academic
- [Björn Gerlach](https://paasp.net/team/bjorn-gerlach/) - Björn Gerlach studied biology at the University of Giessen, Germany, to obtain his Diploma with a focus on immunology, microbiology and biochemistry. He started his PhD at the German Cancer Research Centre in Heidelberg but after one year moved with his supervisor, Prof. Dr. Henning Walczak, to Imperial College London. After obtaining the PhD degree,
- [Anne Collins](https://paasp.net/team/anne-collins/) - Anne Collins studied Biochemistry at the University of Glasgow and obtained her PhD, in cancer biology from the University of Edinburgh. Subsequently, she was a Postdoctoral fellow in cancer research at the Department of Surgery and Urology, Newcastle University Medical school and until 2018 was an Associate Professor in the Cancer Research Unit, Department of
- [Anton Bespalov](https://paasp.net/team/anton-bespalov/) - Anton Bespalov obtained his MD degree from Pavlov Medical University (St. Petersburg) and after completion of PhD studies in St. Petersburg and Utrecht held NIH-supported Fellowships at Medical College of Virginia (Richmond, VA) and Scripps Institute (La Jolla, CA). After habilitation (DMedSci) in 2000, Anton acted as a research director of Valdman Institute of Pharmacology.
- [Andre Der-Avakian](https://paasp.net/team/andre-der-avakian/) - Andre Der-Avakian is Assistant Professor of Psychiatry at the University of California San Diego (UCSD) and Associate Member of the American College of Neuropsychopharmacology (ACNP). He is Principal Investigator on research projects funded by grants from the National Institute of Mental Health (NIMH) and National Institute on Alcohol Abuse and Alcoholism (NIAAA) and has managed
- [Dan Deaver](https://paasp.net/team/dan-deaver/) - During Dan's academic career he fostered important research collaborations both within and outside the university related to drug development. These efforts required the generation of robust data packages. In the late 1980s, Dan worked closely with the Upjohn Company during their development of recombinant bovine somatotropin. During the early 1990s he developed an extensive research
- [Rita Balice-Gordon](https://paasp.net/team/rita-balice-gordon/) - Rita Balice-Gordon, Ph.D., is the CEO of Muna Therapeutics, a newly formed Neurology focused biotech company working on developing novel therapeutics for neurodegenerative diseases. She is working with Anders Hinsby, Jakob Busch-Petersen, Joachim Vilstrup, Simon Glerup Pedersen and the team at Novo Ventures to transform cutting-edge science into impactful therapeutics for CNS diseases. Dr. Balice_Gordon
- [Prof Malcolm Macleod](https://paasp.net/team/prof-malcolm-macleod/) - Malcolm Macleod, BSc(Hons) MBChB PhD FRCP Ed, is Professor of Neurology and Translational Neuroscience at the University of Edinburgh, head of Neurology at Forth Valley Royal Hospital, and Honorary Principal Research Fellow, Florey Neurosciences Unit, Melbourne, Australia. Prof. Macleod was a founding co-ordinator of the Collaborative Approach to Meta-Analysis and Review of Animal Data in
- [Dario Doller](https://paasp.net/team/dario-doller/) - Dario earned a Ph.D. in Organic Chemistry from the Facultad de Ciencias Exactas y Naturales, UBA, Argentina. He conducted postdoctoral studies with Sir Derek Barton at Texas A&M University. His industrial career includes Rohm & Haas, Schering-Plough Research Institute, 3-Dimensional Pharmaceuticals, Gliatech, Neurogen, Lundbeck, CoNCERT, Sage and Sunovion Pharmaceuticals, where he is currently Director, Medicinal
- [Thomas Steckler](https://paasp.net/team/thomas-steckler/) - Thomas Steckler, MD, is Associate Director, Bioresearch Quality & Compliance, Preclinical Quality Risk Management and global Bioresearch Quality & Compliance Lead Animal Welfare, Janssen Pharmaceutica NV, Belgium. He studied Medicine at the Free University of Berlin, Germany and habilitated in Biological Psychology at the Heinrich-Heine University, Düsseldorf, Germany. Prior to joining the Bioresearch Quality &
- [Phil Skolnick](https://paasp.net/team/phil-skolnick/) - Dr. Skolnick is the Chief Scientific Officer at Opiant Pharmaceuticals, Inc. Prior to joining Opiant, he was the Director, Division of Therapeutics and Medical Consequences at the National Institute on Drug Abuse, NIH (2010-2017). He served as Chief Scientific Officer (2001-2009) and President (2007-2009) of DOV Pharmaceutical, Inc. Dr. Skolnick was a Lilly Research Fellow
- [Magali Haas](https://paasp.net/team/magali-haas/) - Magali Haas is CEO and President of Cohen Veterans Bioscience, a non-profit brain research organization based in Cambridge, MA. She previously served as founding Chief Science and Technology Officer for One Mind for Research. Magali has over 15 years of pharmaceutical executive and clinical research experience, predominantly at Johnson & Johnson, where she assumed broad
- [Prof Ulrich Dirnagl](https://paasp.net/team/prof-ulrich-dirnagl/) - Ulrich Dirnagl, MD, PhD, is the Director of the Department of Experimental Neurology at the Charité Universitätsmedizin Berlin, Chief Executive Director of the Center for Stroke Research Berlin, Clinical program coordinator of the Excellence Cluster NeuroCure and the Berlin partner site of the German Center for Neurodegenerative Diseases (DZNE), as well as Program Director of the International
- [C. Glenn Begley](https://paasp.net/team/c-glenn-begley/) - M.B., B.S., Ph.D., F.R.A.C.P., F.R.C.P.A., F.R.C.Path., F.A.H.M.S. Dr Begley is the inaugural CEO of BioCurate, a joint initiative of Monash and Melbourne Universities and created to provide commercial focus in the early phases of drug development. He served as Chief Scientific Officer at Akriveia Therapeutics, California (2016-2027) and TetraLogic Pharmaceuticals, Pennsylvania (2012-2016). From 2002-2012, he was Vice-President
- [Khusru Asadullah](https://paasp.net/team/khusru-asadullah/) - Khusru Asadullah, MD, is Professor of Medicine at the department of Dermatology, Charité – Berlin Medical School, Chairman of the Management Board of German Skin Research Center, board certified consultant for Dermatology, Venerology, Allergology and Immunology, former Vice-President Target Discovery at Bayer-Schering Pharma. Publication highlights: Asadullah K, Busch A, Gottwald M, Reinke P, Landeck L (2015)

## Categories

- [Uncategorized](https://paasp.net/category/uncategorized/)
- [Case Study](https://paasp.net/category/case-study/)
- [Commentaries](https://paasp.net/category/commentaries/)
- [Educational corner](https://paasp.net/category/educational-corner/)
- [Featured Article](https://paasp.net/category/featured-article/)
- [Fun section](https://paasp.net/category/fun-section/)
- [Guest commentaries](https://paasp.net/category/commentaries/guest-commentaries/)
- [Guidelines](https://paasp.net/category/guidelines/)
- [Guidelines for Publishers](https://paasp.net/category/guidelines/guidelines-for-publishers/)
- [Guidelines for Techniques](https://paasp.net/category/guidelines/guidelines-for-techniques/)
- [Guidelines on Reporting](https://paasp.net/category/guidelines/guidelines-on-reporting/)
- [Infos about PAASP](https://paasp.net/category/infos-about-paasp-site-notes/)
- [Literature](https://paasp.net/category/literature/)
- [Open Access](https://paasp.net/category/literature/open-access/)
- [Published Newsletter](https://paasp.net/category/published-newsletter/)
- [Statistics](https://paasp.net/category/literature/statistics/)
- [Stories of unreproducibility](https://paasp.net/category/stories-of-unreproducibility/)
- [Tools and Resources](https://paasp.net/category/tools-and-resources/)
- [BioELN](https://paasp.net/category/literature/bioeln/)
- [Editorial](https://paasp.net/category/literature/editorial/)
- [General](https://paasp.net/category/guidelines/general/)
- [R Scripts](https://paasp.net/category/tools-and-resources/r-scripts-tools-and-resources/)
- [self-study](https://paasp.net/category/tools-and-resources/self-study/)
- [Journal](https://paasp.net/category/journal/)
- [EQIPD](https://paasp.net/category/eqipd/)
- [General](https://paasp.net/category/general-2/)
- [Workshop](https://paasp.net/category/workshop/)

## Tags

- [FACS](https://paasp.net/tag/facs/)
- [Flow Cytometry](https://paasp.net/tag/flow-cytometry/)
- [protocols](https://paasp.net/tag/protocols/)

## Team Categories

- [PAASP Network US](https://paasp.net/team_category/paasp-network-us/)
- [PAASP Advisory Board](https://paasp.net/team_category/advisoryboard/)
- [PAASP Network Europe](https://paasp.net/team_category/paasp-network-eur/)
- [PAASP Germany](https://paasp.net/team_category/paasp-germany/)
- [PAASP Asia](https://paasp.net/team_category/paasp-asia/)
- [PAASP global](https://paasp.net/team_category/paasp-global/)

## Client Categories

- [Partners](https://paasp.net/client_category/partners/)