Human Cognition Open Science

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/16

encourage image

There's no tags or description

Looks like no tags are added yet.

17 Terms

1
New cards

Replication crisis

This is a __in psychology. We’re realizing that many effects that are reported in journals don’t replicate. Not enough transparency in reporting methods, so it’s hard to re-create the exact conditions in the original study

2
New cards

Questionable Research Practices (QRPs)

p-hacking and HARKing

3
New cards

p-hacking-slightly adjusting evaluation criteria until you get p< .05

Stopping data collection when you reach significance. Adjusting exclusive criteria after data are collected. Making decisions about outliers after data are collected

4
New cards

HARKing-Hypothesis after result is known

Generating a hypothesis (or explanation for a pattern of data) only after the data are analyzed and the result is clear

5
New cards

Researcher degrees of freedom

The things that researchers can adjust after data collection/analysis are known as ___. More researcher degrees of freedom can mean less transparency and more questionable research practices. We don’t want to totally take degrees of freedom away-researchers need to be able to make important decisions about how to treat their data

6
New cards

A solution for the replication crisis

Make the decisions before data collection and analysis and formally register them. Important decisions are informed and well thought out ahead of time

7
New cards

Pre-registrations

Good for the replication crisis. Register your rationale, research question, hypotheses, sample size, analysis plan before data collection. Limits researcher degrees of freedom after data collection and often publicly available. Good for science overall, research is very well thought out, early documentation of a plan or idea, and all changes to designs are incremental and well justified

8
New cards

Other open science practices

Making use of the Open Science framework (and similar sites)

Pre-prints

Registered reports

Publishing open-access manuscripts

9
New cards

Making use of the Open Science framework (and similar sites)

An online repository to host pre-registrations and experiment code/data for public access

10
New cards

Pre-prints

Posting a written manuscript (somewhere like OSF) before it has been submitted/accepted to a journal as a ___. Helps the file drawer problem (the tendency to only publish significant results), Moves science along more quickly (easier to stay up to date), and addresses journals as “gatekeepers”

11
New cards

Registered reports

Submit a plan to a journal for pre-data peer review. Conditional acceptance-no matter how your data tune out, your paper will be published. Helps the file drawer problem (the tendency to only publish significant data)

12
New cards

Publishing open-access manuscripts

Some journals have open-access options. Researcher pays for this, but the public can access the manuscript without a subscription to the journal

13
New cards

Replication crisis definition

A phenomenon in many scientific disciplines where it is difficult to replicate the results of published studies

14
New cards

p-hacking definition

The misuse of data analysis to find patterns that are statistically significant, often by manipulating data or statistical models

15
New cards

Questionable research practices definition

Actions that fall short of outright fraud but can still bias results and undermine scientific integrity

16
New cards

Researcher degrees of freedom definition

A term used to describe the many choices researchers make during data collection and analysis that can influence the final outcome

17
New cards

Open Science practices definition

Efforts to make scientific research, data, and methodologies more transparent, accessible, and reproducible