EPSE 528: Basic Principles of Measurement

Understand and define key terminology related to tests, measurement, and assessment.

• Tests

• Standardized tests

• Measurement

• Assessment

• Reliability

• Validity

• Maximum Performance Tests

• Achievement and aptitude tests

• Objective and Subjective Tests

• Speed and Power Tests

• Typical Response Tests

• Objective Personality Tests

• Projective Personality Tests

• Tests: A procedure in which a sample of an individual’s behaviour is obtained, evaluated, and scored using standardized procedures.

• Standardized tests: A test that is administered, scored, and interpreted in a standard manner.

• Measurement: A set of rules for assigning numbers to represent objects, traits, attributes, or behaviours.

• Assessment: Any systematic procedure for collecting information that can be used to make inferences about the characteristics of people or objects.

• Reliability: Stability or consistency of test scores (the degree that they are free from measurement errors.)

• Validity: accuracy of interpretation of test scores.

• Maximum Performance Tests: Designed to assess the upper limits of an examinee’s knowledge and abilities.

  • Achievement tests: Assess knowledge and skills in an area (in which an examinee had received instruction).

    • Speed Tests: e.g. a timed typing test.

    • Power Tests: e.g. a spelling test containing words of increasing difficulty.

  • Aptitude tests: Assess knowledge and skills accumulated as the result of overall life experiences.

    • Speed Tests: e.g. a timed tests where test take quickly scans groups of symbols and marks symbols that meet predetermined criteria.

    • Power Tests: e.g. a test of nonverbal reasoning and problem-solving that requires the test-taker to solve problems of increasing difficulty.

• Objective Tests: Scoring of a test does not rely on the subjective judgement of the individual scoring, it is said to be objective.

• Subjective Tests: Scoring relies on subjective judgement.

  
  

• Typical Response Tests: Designed to measure the typical behaviour and characteristics of examinees.

  • Objective Personality Tests: Selected-response items. e.g. True/False tests

  • Projective Personality Tests: Interpretation of unstructured, ambiguous, material. Requires subjectivity in scoring. e.g. Inkblot test.

Class 1, “Intro & What is Measurement?” LO1

List and describe the 10 assumptions of measurement and assessment.

1: Psychological constructs exist. Constructs ae the traits or characteristics a test is designed to measure.

2: Psychological constructs can be measured. “If a thing exists, it exists in some amount. If it exists in some amount, it can be measured.”

3: Although we can measure constructs, our measurement is not perfect (imperfect). Some degree or error (“measurement error”) is inherent in all measurements.

4: There are different ways to measure any given construct. E.g. interviews, observations, behavioral rating scales.

5: All assessment procedures have strengths and limitations.

6: Multiple sources of information should be a part of the assessment process.

7: Performance on tests can be generalized to non-test behaviours.

8: Assessments can provide information that helps psychologists make better professional decisions. Assessments are not perfect, but useful.

9: Assessments can be conducted in a fair manner. (When used with the correct population, administration, procedures, and interpretation.)

10: Testing and assessment can benefit individuals and society as a whole.

Acronym:

E-M-I-D-"SL”-M-G-D-F-B

Every Monkey Indeed Defecates. SLy Monkeys Go Demand Fat Bananas.

OR:
Every Measurement Is Different; Strengths Matter. Generalize Decisions Fairly, Benefit.

OR:

“Exist. Measure. Error. Different. Strengths. Multiple. Generalize. Decide. Fair. Benefit.”

Class 1, “Intro & What is Measurement?” LO2

List and describe the 6 types of response biases, when they are likely to occur, how they affect research, and what we might do about them.

Class 1, “Intro & What is Measurement?” LO3:

Discuss the importance of measurement in research and other life endeavours.

• Diagnosis

• Treatment planning and effectiveness

• Selection (e.g. for schools)

• Placement

• Classification

• Self-understanding

• Evaluation

• Licensing

• Program evaluation

• Scientific method

Class 1, “Intro & What is Measurement?” LO4:

Define or describe:

Acquiescence bias

Class 1, study guide LO1

Define or describe:

Balanced scales

Class 1, study guide LO1

Define or describe:

Criterion-referenced vs norm-referenced test (interpretations)

Class 1, study guide LO1

Define or describe:

Demand characteristics

Class 1, study guide LO1

Define or describe:

Extreme vs. moderate reporting

Class 1, study guide LO1

Define or describe:

Formative vs summative evaluation

Class 1, study guide LO1

Define or describe:

Hawthorne effect vs John Henry effect vs Pygmalion effect

Class 1, study guide LO1

Define or describe:

Impression management vs self-deception

Class 1, study guide LO1

Define or describe:

Malingering

Class 1, study guide LO1

Define or describe:

Maximum performance vs typical response tests

Class 1, study guide LO1

Define or describe:

Measurement

Class 1, study guide LO1

Define or describe:

Objective vs subjective vs projective tests

Class 1, study guide LO1

Define or describe:

Maximum performance vs typical response tests

Class 1, study guide LO1

Define or describe:

Objective vs. subjective vs. projective tests

Class 1, study guide LO1

Define or describe:

Psychometrics

Class 1, study guide LO1

Define or describe:

Random (or careless) responding

Class 1, study guide LO1

Define or describe:

Reactivity

Class 1, study guide LO1

Define or describe:

Social desirability (bias)

Class 1, study guide LO1

Define or describe:

Speeded tests vs. power tests

Class 1, study guide LO1

Define or describe:

Test vs. assessment

Class 1, study guide LO1

Highlight some critical facts associated with Carl Fredrich Gauss.

Class 1, study guide LO2

List and describe 10 assumptions of measurement and assessment.

Class 1, study guide LO3

Prepare a short list of 10-20 everyday activities in your life, aspects of your school or work life, and large projects or events in the world that are immpacted by measuremment.

Class 1, study guide LO4