Applied Research Methods: Development

studied byStudied by 10 people
5.0(1)
Get a hint
Hint

what type of research can be conducted using observations?

1 / 101

flashcard set

Earn XP

Description and Tags

102 Terms

1

what type of research can be conducted using observations?

finding phenomena

New cards
2

what type of research can be conducted using correlations and quasi-experiments?

finding relationships

New cards
3

what type of research can be conducted using experiments?

finding causal relationships

New cards
4

what is meant by the precision of a theory?

accuracy of classification of which new data can be explained by the theory

e.g. “A will score higher than B in X, but lower than C, and B will score higher than A in Y".”

New cards
5

principle of parsimony

choosing the most straightforward theory from among theories fitting the data equally well

New cards
6

why are falsifiability and testability important?

to distinguish science from pseudoscience and compare studies based on their degree of falsifiability

New cards
7

internal validity

extent to which the observed results represent the truth in the population we are studying

→ observed mean difference

New cards
8

external validity

extent to which the results of the study are generalizable to other situations, populations, …

New cards
9

construct validity

the extent to which your test or measure accurately assesses what it's supposed to

New cards
10

statistical validity

the extent to which drawn conclusions of a research study can be considered accurate and reliable from a statistical test

New cards
11

how can correlations be interpreted?

direction and size

New cards
12

how can regression be interpreted

prediction

New cards
13

advantages of within-subject designs

  • requires fewer participants

  • increases chance of discovering a true difference among conditions

  • more statistical power (individual variation is reduced)

New cards
14

advantages of between-subject designs

  • minimizes learning effects across conditions

  • shorter sessions

  • easier to set up and analyze

New cards
15

what is the difference between a quasi-experiment and a true experiment?

no randomization in a quasi-experiment

New cards
16

alpha error

type 1 error → false positive

New cards
17

beta error

type 2 error → false negative

New cards
18

effect size

how large the difference/correlation/relationship is

New cards
19

true effect

effect size in the population, cannot be observed only estimated

(should be made before the study)

New cards
20

observed effect

calculated after the study, also an estimation of the true effect

New cards
21

statistical power

probability that the effect is statistically significant and correctly rejects the null hypothesis

New cards
22

what does low/high statistical power mean?

low power → small chance of detecting a true effect, results likely to be distorted

high power → large chance of detecting a true effect

New cards
23

cohen’s d formula

d = (m1-m2) / SD

New cards
24

what are the conventional values for small/medium/large effect sizes?

0,8 → large

<0,2 → small

in between → medium

New cards
25

which factors affect the statistical power of a study

  • effect size

  • alpha

  • sample size

New cards
26

how can the power of a study be increased?

  • increasing sample size

  • increasing the measured effect size

  • increasing the alpha error (because more results are accepted as significant)

New cards
27

disadvantages of small sample studies?

more fluctuation and inflated effect size

→ publication bias

New cards
28

which results should you not trust?

results of studies with small samples cannot be trusted

New cards
29

cross-sectional design

all measures are collected in a single assessment

New cards
30

longitudinal design

measures collected in repeated assessments

New cards
31

advantages of experimental research

manipulation isolates the effect of interest, so alternative explanations are minimized

New cards
32

disadvantages of experimental research

  • difficult to conduct (time & money)

  • biases (volunteer & selection bias)

  • can be ethically problematic

  • limited generalizability

New cards
33

advantages of observational research

  • more generalizability

  • easier to obtain larger samples

New cards
34

disadvantages of observational research

  • longitudinal studies are expensive (time & money)

  • greater risk of biases and confounds

  • data more likely to be incomplete and of poorer quality

New cards
35

cohort studies

assess prospective changes → looking forward in time

New cards
36

case-control studies

assess retrospective predictors → looking backwards in time

New cards
37

selection biases

biases introduced in the selection process, so that proper randomization is not achieved

e.g. sampling bias, allocation bias, non-response bias, publication bias, volunteer bias

New cards
38

information biases

biases introduced by systematic differences in the collection and handling of information in a study

e.g. misclassification bias, observer bias, interviewer bias, social desirability bias, recall bias, performance bias, detection bias

New cards
39

moderator

a variable that alters the strength of the linear relationship between a predictor (X) and an outcome (Y)

New cards
40

which statistical analyses are commonly used to test moderation

if X and Z are categorical and Y is continuous → ANOVA

if X, Z, and Y are continuous OR if X and/or Z are categorical and Y is continuous → Multiple linear regression

if X and Z are continuous and Y is categorical OR if X is continuous and Z and Y are categorical → Logistic regression

<p>if X and Z are categorical and Y is continuous → ANOVA</p><p>if X, Z, and Y are continuous OR if X and/or Z are categorical and Y is continuous → Multiple linear regression</p><p>if X and Z are continuous and Y is categorical OR if X is continuous and Z and Y are categorical → Logistic regression</p>
New cards
41

How to interpret a moderation effect from a linear regression?

  1. Center X and Z scores (→ individual score-M)

  2. Calculate interaction with centered scores (X*Z)

  3. Perform analysis with centered scores and new interaction effect as predictors

  4. If significant → plot simple slopes

New cards
42

When should a moderator variable be measured?

at the same time as predictors

New cards
43

mediator

The IV influences the mediator variable, which in turn influences the DV

New cards
44

total effect (c)

effect X has on Y including the effect of the mediator

New cards
45

direct effect (c’)

effect X has on Y without taking the mediator into account

New cards
46

indirect effect

total effect - direct effect

New cards
47

absolute mediation

indirect effect explains the complete effect

New cards
48

How is mediation commonly tested?

using regression…

  1. Show that X predicts Y

  2. Show that X predicts the mediator

  3. Show that the mediator predicts Y

  4. Show the mediator produces an effect of X on Y

New cards
49

bootstrapping

testing of mediation effects using a resampling technique to adjust the standard errors of the coefficitents

New cards
50

3 things to consider before conducting a mediation analysis

  1. have a directionality assumption (avoid reversal causal effect)

  2. consider when to measure the mediator

  3. choose reliable measurements

New cards
51

When should the mediator be assessed?

after the predictor and before the outcome

New cards
52

What is the difference between mediation and moderation?

Mediation describes indirect effects, moderation describes conditional effects

New cards
53

signal detection theory (SDT)

measures the ability to differentiate between stimuli (information-bearing patterns) and noise (random patterns)

→ measures how humans make decisions under circumstances of uncertainty

e.g. witness tries to identify a criminal, trying to remember whether you know someone, looking for spelling mistakes, discovering a spider on your wall

New cards
54

According to SDT, what are the 2 factors affecting human discrimination decisions?

  1. sensitivity

  2. decision/response criterion

New cards
55

sensitivity (in SDT)

  • strength of the signal

  • ability of the observer

New cards
56

decision/response criterion (in SDT)

  • consequences of decisions (pay-off matrix)

  • frequency of signal

New cards
57

According to SDT what are the possible responses (matrix)

knowt flashcard image
New cards
58

theoretical assumptions that explain differences in sensitivity

in reality, dichotomous events (there is a signal or not) but subjective experience varies and is usually distributed around the mean

New cards
59

what does it mean when someone responds liberally/neutrally/conservatively?

liberal → lot of false alarms but few/no misses

neutral → responds with yes and no equally

conservative → many misses but no few/no false alarms

New cards
60

d’ (d prime in SDT)

standardized difference between the means of the Signal Present and Signal Absent distributions (strength of the signal relative to noise)

→ d’ = z(Hits) - z(False Alarms)

New cards
61

β (in SDT)

observers ability to correctly identify a stimulus (willingness to give Yes responses)

→ β = y(Hits) / y(False Alarms)

(β = 1 means neutral responses)

New cards
62

what does a low/high d’ mean?

low = 0 (personal cannot discriminate at all, guessing)

high = 4.66 (almost perfect at discriminating, 99% accuracy)

New cards
63

what problems are caused by missing data?

  • Response rate bias

  • low statistical power

  • invalid conclusions

New cards
64

missingness mechanisms

reasons why data is missing

New cards
65

ignorable missingness mechanisms

MCAR (missing completely at random) → independent of observed or missing values

MAR (missing at random) → partly depends on observed values but not missing ones

New cards
66

non-ignorable missingness mechanisms

MNAR (missing not at random) → depends on missing values themselves

New cards
67

proactive strategies for minimizing missingness

  • advanced warnings

  • personalized surveys

  • follow-up reminders

  • monetary incentives

New cards
68

listwise deletion

deleting all cases with any missing values

(violates a fundamental principle of missing data analysis)

New cards
69

pairwise deletion

still including cases with missing values into the analysis

(attempts to minimize the loss that occurs in listwise deletion)

New cards
70

imputation

replacing missing data with substituted values

(SPSS: → Analyze → Multiple Imputation → Analyze Patterns)

New cards
71

mean item imputation

mean of the observed values for each variable is computed and the missing values for that variable are imputed by this mean

(can lead to severely biased estimates)

New cards
72

advantage of using multiple imputation over single imputation

does not provide a deterministic idea of what the missing value should be, but allows it to have a range of different scores

New cards
73

what is the best way of handling missing values?

  • Item(s) missing → mean item imputation

  • Scale(s) missing → multiple imputation (if not MCAR)

New cards
74

disadvantage of comparing an experimental treatment with a waiting-list/treatment-as-usual group

easy to show that experimental condition is effective but overall less power

New cards
75

formula: percentage of improvement

(pre-post)/pre*100

New cards
76

Lasagna’s Law

overestimation (with a factor ten to one) of the number of patients available for inclusion into your study in a certain period

New cards
77

when do you use Bonferroni correction?

→ if you test multiple times (to reduce inflated error probability)

New cards
78

ways to reduce unnecessary within-group variance in treatment outcome measurements

  • specific hypotheses

  • specific instruments

  • inclusion- and exclusion criteria

  • treatment manual, trained therapists, trained assessors

  • inspection for outliers

New cards
79

treatment dropout/´refusal in psychoptherapy

~25%

New cards
80

What are ERPs and what brain activity do they reflect?

= voltage fluctuations in the ongoing EEG that are time-locked to an event (e.g. stimulus onset or response execution)

→ reflect the sensory, cognitive, affective, and motor processes elicited by the event; usually labeled by their polarity (N/P)

New cards
81

Which properties make ERPs useful?

  • covert monitoring of processing when overt behavior is difficult to measure

  • can measure processes not evident in behavior

→ e.g. in infants, animals, coma patients, …

New cards
82

major challenge of the ERP technique and how to deal with it

many different processes happen in the brain at the same time

→ using a zero measurement (starting point assessment)

New cards
83

cognitive artifact

something physical or digital that has aided a mental process

→  leftover remnants indicative of the efforts it takes to unravel mental processes

New cards
84

challenges of recording/studying ERPs in clinical populations and their solutions

  • The effect of medication on cognitive processing → compare to unmedicated patients

  • opposing effects of comorbid disorders → investigate individuals of the same disorder with and without comorbidity

  • individuals with disorder show more artifacts → adjust recording procedures (less conditions, less electrodes, rest breaks, etc.)

New cards
85

how are ERP components usually quantified?

latency = amplitude and time between stimulus and peak

New cards
86

conclusions that can be drawn from ERP studies

presence, size, or timing of a specific mental operation, and the effect of manipulations or individual differences on these factors

New cards
87

Big Hypothesis (Rossignol et al., 2012)

people with high levels of social anxiety have a greater P1 (encoding of faces) and P2 (attentional resources) effect than people with low levels of social anxiety.

New cards
88

why did they use ERPs? (Rossignol et al., 2012)

attentional bias can already be detected 100ms after the first stimulus is presented

New cards
89

Conclusions (Rossignol et al., 2012)

perceptual processing of social cues is extra strong in people with social anxiety (P1 component), but linking attention is generic for all anxious states

New cards
90

what differences do you look at when comparing ERPs across conditions/individuals?

  • amplitude differences

  • latency differences

New cards
91

How can ERPs be used to study disturbances in clinical populations?

  • between-group comparisons (diagnosed/no diagnosis)

  • correlational approach (relate ERPs to symptoms/traits)

  • longitudinal studies (assess risk for psychopathology)

New cards
92

examples for direct vs. indirect measures

  • direct measures: questionnaires (directly infer attitudes)

  • indirect measures: reaction time (infer attitudes from results)

New cards
93

advantages of indirect measures

measure implicit attitudes, which predict automatic behavior

New cards
94

projective tests and their disadvantages

tests that commonly use ambiguous stimuli

e.g. Rorschach, TAT

→ low reliability and validity

New cards
95

advantages of modern indirect measures

  • more objective than projective tests

  • reliability and validity can be determined

New cards
96

how does the Implicit Association Test (IAT) measure associations?

measures mean reaction time for compatible and incompatible blocks of stimuli → short RTs indicate stronger associations

New cards
97

which 4 types of stimuli are needed for IAT?

2 target stimuli and 2 attribute categories

New cards
98

formula IAT effect

mean RT(incomp. block)-mean RT(comp. block)

New cards
99

problems with the interpretation of IAT effects

two types of targets → effect can be caused by either target being more associated with one stimulus or both (usually both)

New cards
100

problems with most indirect measures

  • lack of convergence

  • reliability

  • validity

  • general vs individual stimuli

New cards

Explore top notes

note Note
studied byStudied by 127 people
Updated ... ago
5.0 Stars(1)
note Note
studied byStudied by 39 people
Updated ... ago
5.0 Stars(2)
note Note
studied byStudied by 7 people
Updated ... ago
5.0 Stars(1)
note Note
studied byStudied by 33 people
Updated ... ago
5.0 Stars(1)
note Note
studied byStudied by 15 people
Updated ... ago
5.0 Stars(3)
note Note
studied byStudied by 16 people
Updated ... ago
5.0 Stars(3)
note Note
studied byStudied by 1 person
Updated ... ago
5.0 Stars(1)
note Note
studied byStudied by 18828 people
Updated ... ago
4.6 Stars(97)

Explore top flashcards

flashcards Flashcard61 terms
studied byStudied by 23 people
Updated ... ago
5.0 Stars(2)
flashcards Flashcard54 terms
studied byStudied by 102 people
Updated ... ago
4.4 Stars(5)
flashcards Flashcard20 terms
studied byStudied by 11 people
Updated ... ago
5.0 Stars(3)
flashcards Flashcard148 terms
studied byStudied by 2 people
Updated ... ago
5.0 Stars(1)
flashcards Flashcard20 terms
studied byStudied by 3 people
Updated ... ago
5.0 Stars(1)
flashcards Flashcard33 terms
studied byStudied by 26 people
Updated ... ago
5.0 Stars(1)
flashcards Flashcard186 terms
studied byStudied by 15 people
Updated ... ago
5.0 Stars(1)
flashcards Flashcard110 terms
studied byStudied by 12 people
Updated ... ago
5.0 Stars(1)