Virtual Symposia

Tuesday, April 18 |
8 am BST | 5 pm AEST | 3 am EDT
Towards Objective Indicators of Trustworthiness of Research Findings – Lessons Learned in the Transparent Psi Project (TPP)
Abstract

The Transparent Psi Project (TPP) is a multi-site replication of Bem’s (2011) Experiment 1 that aims to demonstrate the use of methodological tools that facilitate highly credible and rigorous research. The study protocol for this project was developed through an expert consensus procedure (ECO) in which more than 20 stakeholders in the field contributed to finalizing the protocol. The protocol includes a comprehensive toolkit of safeguards against researcher biases and mistakes, such as radical transparency about the entire research pipeline through Born Open Data, Direct Data Deposition, Real-time Research Reports, automation, third-party research audits, tamper-evident seals on data and software, documented training, and laboratory logs.

The primary goal of this program is to inform audiences about the methodologies implemented in the TPP and how they empower researchers to conduct robust and highly credible studies, the results of which are useful and acceptable to most stakeholders. All the while taking into account the practicalities, costs, and barriers of implementation from the perspectives of individuals with different roles in the project, in order to facilitate informed decisions about adopting these methods.

This moderated panel discussion will involve contributors with various roles in the TPP (ECO panel members, collaborating lab leaders, reviewers of the registered report publication, etc.) who will discuss lessons learned, the benefits and costs of the different methodologies implemented in the project, and ways to improve the feasibility of these tools in psychological and biomedical research.

Supported by