Psychology Research Methods: Reliability, Validity & Sampling

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/124

encourage image

There's no tags or description

Looks like no tags are added yet.

125 Terms

1
New cards

What is reliability?

The consistency of a measurement across repeated observations.

2
New cards

What is validity?

How accurately a measure assesses what it is intended to measure.

3
New cards

Can a measure be reliable but invalid?

Yes. It can consistently produce an incorrect result.

4
New cards

What is internal consistency?

How consistently items on a scale measure the same underlying construct.

5
New cards

What is Cronbach's alpha?

A statistic measuring the internal consistency of items in a scale.

6
New cards

What does a high Cronbach's alpha indicate?

Items are strongly related and tend to measure the same construct.

7
New cards

What is split-half reliability?

The consistency between scores on two halves of the same test.

8
New cards

What is test-retest reliability?

The consistency of scores when the same test is administered at different times.

9
New cards

What is inter-rater reliability?

The degree of agreement between different observers or raters.

10
New cards

What is an item-total correlation?

The correlation between an individual item and the overall scale score.

11
New cards

What is a unidimensional scale?

A scale designed to measure one underlying construct.

12
New cards

What can researchers do if internal consistency is low?

Revise or remove weak items and check whether the scale measures one construct.

13
New cards

What is the difference between reliability and validity?

Reliability concerns consistency while validity concerns accuracy.

14
New cards

Does high reliability guarantee validity?

No. A consistently inaccurate measure is reliable but invalid.

15
New cards

What is the cognitive process of answering a survey?

Question interpretation, information retrieval, judgment formation, response formatting, response editing.

16
New cards

What is question interpretation?

Understanding what a survey question is asking.

17
New cards

What is information retrieval?

Recalling relevant memories or information needed to answer a question.

18
New cards

What is judgment formation?

Using recalled information to decide on an answer.

19
New cards

What is response formatting?

Translating a judgment into the available response options.

20
New cards

What is response editing?

Adjusting an answer before reporting it, sometimes due to social expectations.

21
New cards

What does BRUSO stand for?

Brief, Relevant, Unambiguous, Specific, Objective.

22
New cards

Why should survey questions be brief?

Short questions reduce confusion and respondent burden.

23
New cards

Why should survey questions be relevant?

They should collect information directly related to the research.

24
New cards

Why should survey questions be unambiguous?

Participants should interpret the question in the same intended way.

25
New cards

Why should survey questions be specific?

They should clearly identify the behavior or topic being measured.

26
New cards

Why should survey questions be objective?

To avoid leading participants toward particular answers.

27
New cards

What is face validity?

Whether a measure appears to assess the intended construct.

28
New cards

What is content validity?

Whether a measure adequately covers all important aspects of a construct.

29
New cards

What is judgmental validity?

Validity evaluated through judgments about whether items represent the intended construct.

30
New cards

What is criterion validity?

Whether a measure agrees with or predicts an independent criterion or gold standard.

31
New cards

What is predictive validity?

Whether test scores predict a future outcome.

32
New cards

What is concurrent validity?

Whether a measure agrees with an independent measure collected at approximately the same time.

33
New cards

SAT scores predicting college GPA demonstrate what?

Predictive validity.

34
New cards

Comparing two depression scales administered together demonstrates what?

Concurrent validity.

35
New cards

How did Hilger et al. support questionnaire validity?

They reviewed literature and modified established questionnaires.

36
New cards

Which types of validity best describe Hilger et al.'s approach?

Face validity and content validity.

37
New cards

What would strengthen Hilger et al.'s criterion validity?

Comparing questionnaire results with an independent established measure or outcome.

38
New cards

What is a population?

The entire group researchers want to draw conclusions about.

39
New cards

What is a sample?

The subset of a population that participates in a study.

40
New cards

What is a sampling frame?

The accessible list or source of population members from which participants are selected.

41
New cards

What is probability sampling?

Sampling in which population members have known nonzero probabilities of selection.

42
New cards

What is simple random sampling?

Randomly selecting members so each has an equal chance of inclusion.

43
New cards

What is systematic sampling?

Selecting every kth member from an ordered list after a random starting point.

44
New cards

What is stratified sampling?

Dividing a population into subgroups and sampling from each subgroup.

45
New cards

What are strata?

Subgroups that are similar within themselves but different from other strata on a selected characteristic.

46
New cards

How did Carstensen et al. stratify their sample?

By age and gender.

47
New cards

What is cluster sampling?

Selecting naturally occurring groups rather than individually selecting every participant.

48
New cards

How do clusters differ from strata?

Clusters ideally contain diverse members while strata contain members similar on a selected characteristic.

49
New cards

What is quota sampling?

Nonrandomly recruiting participants until predetermined subgroup quotas are filled.

50
New cards

What is sampling error?

Random differences between sample statistics and population values caused by chance selection.

51
New cards

How can sampling error be reduced?

Increase sample size and use appropriate probability sampling.

52
New cards

What is sampling bias?

Systematic differences between the sample and the target population.

53
New cards

What is volunteer bias?

When people who volunteer differ systematically from those who do not.

54
New cards

What is nonresponse bias?

When people who do not respond differ systematically from respondents.

55
New cards

Does increasing sample size eliminate sampling bias?

No. A large sample can still systematically misrepresent the population.

56
New cards

How can sampling bias be reduced?

Use representative recruitment strategies and diversify recruitment sources.

57
New cards

How did Hilger et al. recruit students?

Through flyers, mailing lists, social networks, and advertising in classes.

58
New cards

What is satisficing?

Answering survey questions with minimal effort instead of careful consideration.

59
New cards

What is straightlining?

Repeatedly selecting the same response option without carefully considering each item.

60
New cards

What is correlational research?

Research examining the direction and strength of relationships between variables.

61
New cards

What is a positive correlation?

As one variable increases, the other tends to increase.

62
New cards

What is a negative correlation?

As one variable increases, the other tends to decrease.

63
New cards

What does r = 0 mean?

There is no linear correlation between the variables.

64
New cards

What does r = +1 mean?

A perfect positive linear relationship.

65
New cards

What does r = -1 mean?

A perfect negative linear relationship.

66
New cards

What determines correlation strength?

The absolute value of r, with values closer to 1 indicating stronger linear relationships.

67
New cards

What does r² represent?

The proportion of variance accounted for by a linear relationship.

68
New cards

If r = 0.50, what is r²?

0.25, meaning 25% of the variance is accounted for.

69
New cards

When is Pearson's r used?

To measure linear relationships between continuous interval or ratio variables.

70
New cards

When is Spearman's rho used?

For rank-based relationships, especially ordinal variables such as Likert items.

71
New cards

What is a predictor variable?

A variable used to predict or explain another variable.

72
New cards

What is a criterion variable?

The outcome variable being predicted or explained.

73
New cards

Why can't correlation establish causation?

Because the direction of causality and alternative explanations remain unresolved.

74
New cards

What is a confounding variable?

A third variable that may explain an observed relationship between two variables.

75
New cards

What is a spurious correlation?

An association that does not reflect the proposed causal relationship.

76
New cards

What is a benefit of correlational research?

It can study relationships when experiments are unethical or impractical.

77
New cards

What is a limitation of correlational research?

It cannot establish cause-and-effect relationships by itself.

78
New cards

What is construct validity?

Whether a measure actually represents the theoretical construct it claims to measure.

79
New cards

What is convergent validity?

Evidence that a measure correlates with other measures of the same or related constructs.

80
New cards

What is divergent validity?

Evidence that a measure is distinct from measures of unrelated constructs.

81
New cards

Who introduced an influential construct validity framework in 1955?

Lee Cronbach and Paul Meehl.

82
New cards

What is anhedonia?

Reduced ability to experience pleasure or reduced interest in rewarding experiences.

83
New cards

What is physical anhedonia?

Reduced pleasure from physical or sensory experiences.

84
New cards

What is social anhedonia?

Reduced pleasure from social interactions and relationships.

85
New cards

What did Chapman et al. (1976) develop?

Psychological scales measuring physical and social anhedonia.

86
New cards

What is social desirability bias?

Answering in ways that appear socially acceptable rather than completely truthful.

87
New cards

What is acquiescence bias?

A tendency to agree with survey statements regardless of their content.

88
New cards

What is an experiment?

A study manipulating an independent variable to test its causal effect on an outcome.

89
New cards

What is an independent variable?

The variable manipulated by the researcher.

90
New cards

What is a dependent variable?

The outcome measured to assess the effect of the independent variable.

91
New cards

What is a directional hypothesis?

A prediction specifying the expected direction of an effect or relationship.

92
New cards

What is a nondirectional hypothesis?

A prediction that an effect exists without specifying its direction.

93
New cards

What is the null hypothesis?

The hypothesis that there is no effect or relationship in the population.

94
New cards

What is internal validity?

Confidence that the independent variable rather than confounds caused the observed outcome.

95
New cards

What is external validity?

The extent to which findings generalize beyond the specific study conditions.

96
New cards

What is random assignment?

Using chance to assign participants to experimental conditions.

97
New cards

How does random assignment improve internal validity?

It helps distribute participant differences across conditions.

98
New cards

What is a between-groups design?

Different participants are assigned to different experimental conditions.

99
New cards

What is a within-groups design?

The same participants complete multiple experimental conditions.

100
New cards

What is a matched-pairs design?

Participants are matched on relevant characteristics before assignment to different conditions.