1/16
Looks like no tags are added yet.
Replication crisis
This is a __in psychology. We’re realizing that many effects that are reported in journals don’t replicate. Not enough transparency in reporting methods, so it’s hard to re-create the exact conditions in the original study
Questionable Research Practices (QRPs)
p-hacking and HARKing
p-hacking-slightly adjusting evaluation criteria until you get p< .05
Stopping data collection when you reach significance. Adjusting exclusive criteria after data are collected. Making decisions about outliers after data are collected
HARKing-Hypothesis after result is known
Generating a hypothesis (or explanation for a pattern of data) only after the data are analyzed and the result is clear
Researcher degrees of freedom
The things that researchers can adjust after data collection/analysis are known as ___. More researcher degrees of freedom can mean less transparency and more questionable research practices. We don’t want to totally take degrees of freedom away-researchers need to be able to make important decisions about how to treat their data
A solution for the replication crisis
Make the decisions before data collection and analysis and formally register them. Important decisions are informed and well thought out ahead of time
Pre-registrations
Good for the replication crisis. Register your rationale, research question, hypotheses, sample size, analysis plan before data collection. Limits researcher degrees of freedom after data collection and often publicly available. Good for science overall, research is very well thought out, early documentation of a plan or idea, and all changes to designs are incremental and well justified
Other open science practices
Making use of the Open Science framework (and similar sites)
Pre-prints
Registered reports
Publishing open-access manuscripts
Making use of the Open Science framework (and similar sites)
An online repository to host pre-registrations and experiment code/data for public access
Pre-prints
Posting a written manuscript (somewhere like OSF) before it has been submitted/accepted to a journal as a ___. Helps the file drawer problem (the tendency to only publish significant results), Moves science along more quickly (easier to stay up to date), and addresses journals as “gatekeepers”
Registered reports
Submit a plan to a journal for pre-data peer review. Conditional acceptance-no matter how your data tune out, your paper will be published. Helps the file drawer problem (the tendency to only publish significant data)
Publishing open-access manuscripts
Some journals have open-access options. Researcher pays for this, but the public can access the manuscript without a subscription to the journal
Replication crisis definition
A phenomenon in many scientific disciplines where it is difficult to replicate the results of published studies
p-hacking definition
The misuse of data analysis to find patterns that are statistically significant, often by manipulating data or statistical models
Questionable research practices definition
Actions that fall short of outright fraud but can still bias results and undermine scientific integrity
Researcher degrees of freedom definition
A term used to describe the many choices researchers make during data collection and analysis that can influence the final outcome
Open Science practices definition
Efforts to make scientific research, data, and methodologies more transparent, accessible, and reproducible