Psychological Testing: Introduction and History

Introduction to Psychometrics

  • Psychometrics: Psychological Measurement
  • Definitions:
    • Measurement of mental capacity, thought processes, aspects of personality, etc., especially by mathematical or statistical analysis.
    • Science or study of this; construction and application of psychological tests.

Definition of Psychometrics: Important Aspects

  1. Measures a lot of different things
    • Mental processes; personality; behaviour; intelligence & cognition; etc.
  2. Aims to operationally define & quantify the things it measures
    • e.g. anxiety
    • And then be able to predict it
  3. Concerned with constructing tests to measure things
    • And evaluating how good these tests are

Basic Terms and Concepts

  • Psychological measurement is the measurement of human behaviour
    • Overt behaviour
      • Observable
      • Example: Time needed to put 10 pegs in a peg board
    • Covert behaviour
      • Mental, social, or physical action or practice that is not immediately observable
      • Example: feelings of anxiety, depression

Psychological Tests and Behavioural Samples

  • We can’t measure every aspect of every type of mental process, behaviour, emotional process, etc. that a person has
  • So we take a sample of that behaviour, through a psychological tests
  • A psychological test is therefore:
    • “a test designed to provide a quantitative analysis of a person's mental capacities or personality traits, typically as shown by responses to a standard series of questions or statements”

Psychological Test: More Definitions

  • A set of items that is designed to measure characteristics of human beings that pertain to behaviour
  • The process of measuring psychology-related variables by means of devices or procedures designed to obtain a sample of behaviour
  • A systematic procedure for obtaining samples of behaviour relevant to cognitive or affective functioning, and for scoring and evaluating those samples according to standards

How Do We Quantify Behaviour?

  • Through test items
    • A test question; something a person must do in a test; a task in a test a person must perform etc.
    • NB: note that a test items is not necessarily always a question – can be spotting a missing detail in a picture, etc.
  • Test items are therefore defined as:
    • “A specific stimulus to which a person responds overtly”

Types of Tests

  • Individual tests
    • Designed to be administered to 1 person at a time
    • Useful for collecting comprehensive info
    • e.g., some personality tests, some IQ tests
    • Usually some degree of subjectivity in the scoring
    • Time, cost, labour intensive
  • Group tests
    • Designed to be administered to more than 1 person at a time, i.e. ‘mass testing’
    • e.g., university class tests (especially MCQs)
    • Scoring is usually more objective
    • Economical and time-saving

Example of Individual Test 1

  • The Wechsler Adult Intelligence Scale (WAIS)
    • Block Design
    • Requires blocks to be assembled into a certain pattern
    • Testee is given a number of different trials
    • A trial refers to a test ‘run’

Example of Individual Test 2

  • The Rorschach

Rorschach Interpretations

  • Card 1
    • This card is meant to determine a person's subconscious paranoia level and feelings about body image.
    • If someone sees a "bat, butterfly, moth or a female figure," they are said to be normal/average, and there is no problem indicated.
    • If a person sees a "Jack-o-lantern, Mask, or the face of an animal," then their response may indicate a sense of paranoia.
    • Finally, if someone sees anything derogatory or insulting about the female physique, his/her response indicates that he/she has negative feelings about his or her own body image.

Ability Tests

  • Measure skills in terms of speed, accuracy (power), or both
    • (1) Achievement
      • Previous learning
    • (2) Aptitude
      • Potential for acquiring a specific skill/learning
    • (3) Intelligence
      • General mental abilities

Ability Tests: Achievement Tests

  • Refers to a person’s past/previous learning
  • Achievement tests are designed to measure person’s past learning on accomplishment of a task (group tests of achievement)

Ability Tests: Aptitude Tests

  • Aptitude refers to an individual’s potential to learn a specified task under provision of training
  • Potential for learning or acquiring a new skill
  • Capability of learning a specific task or acquiring a specific skill

Ability Tests: Intelligence Tests

  • Refers to a person’s general potential to solve problems, adapt to changing circumstances, think abstractly, benefit from experience
  • Measure general mental abilities
  • E.g., Stanford-Binet; Raven’s Progressive Matrices; WAIS

Raven's Progressive Matrices

  • Consists of 50 designs, each with a cut-out segment

Personality Tests

  • Personality Tests
    • Measure typical behaviour – traits, temperaments, dispositions, etc.
    • Designed to measure a person’s individuality in terms of their unique traits and behaviour
    • Tests can help in predicting future behaviour
    • E.g., MMPI, Rorschach, TAT, 16PF Questionnaire

Personality Tests: Types

  • Structured (objective)
    • Self-report statements
    • Choose between 2 or more alternative responses
    • e.g., true/false; yes/no; this statement is “not at all like me; a bit like me; somewhat like me; a lot like me” etc.
  • Projective
    • Unstructured; Spontaneous response required of test- takers
    • Provides an ambiguous stimulus; response requirements unclear
    • Assumes that person’s interpretation of an ambigious stimulus will reflect their unique characteristics
    • e.g., Rorschach

Example: Structured

  • JUNG TYPOLOGY TEST
    1. You are almost never late for your appointments
      YES NO
    2. You like to be engaged in an active and fast-paced job
      YES NO
    3. You enjoy having a wide circle of acquaintances
      YES NO
    4. You feel involved when watching TV soaps.
      YES NO
    5. You are usually the first to react to a sudden event, such as the telephone ringing or unexpected question
      YES NO

Example: Projective

  • THEMATIC APPerception Test (TAT)

Projective Personality Test - Thematic Apperception Test (TAT)

  • Provides ambiguous pics and have to make up a story
  • Story includes:
    • What had led up to event
    • What is happening in moment
    • Emotions and thoughts of characters
    • What outcome of story was
  • Story content and structure thought to reveal the person’s attitudes, inner conflicts and motives, needs for achievement, power, intimacy, and views
  • 31 pictures in standard TAT

Norm- and Criterion-Referenced

  • Norm-Referenced Tests
    • Test score is judged against the distribution of scores obtained by the other test takers
    • This distribution is called the norms
    • Compares an individual’s results on the test with statistically representative sample
    • Rank the performance of a student in a particular group
  • Criterion-Referenced Tests
    • Compare each individual’s performance to a criterion or expected level of performance
    • Testee’s score compared to objectively stated standard of performance on that test
    • Establish standard/criterion and marks students against it
    • E.g., you need 50% to pass your exams

Summary

  • Psychometrics is the quantitative measurement of mental capacity, thought processes, aspects of personality, etc.
  • Overt or covert behaviours
  • Measured by test items
  • Types of Tests / Mode of Administration:
    • Individual Tests
    • Group Tests
  • Categories of Test / Dimension Measured:
    • Ability Tests
      • Achievement
      • Aptitude Test
      • Intelligence Test
    • Personality Tests
      • Structured
      • Projective
  • Mode of Interpretation / Performance Assessment:
    • Norm-referenced tests
    • Criterion-referenced tests