Technical Issues in Measurement and Numbers

PART ONE Technical Issues

Key References

  • Cohen, R. J., & Swerdlik, M. E. (1999). Psychological testing and assessment: An introduction to tests and measurements (4th ed.). Mountain View, CA: Mayfield.
  • Cronbach, L. J. (1975). Five decades of public controversy over mental testing. American Psychologist, 30, 1-14.
  • DuBois, P. H. (1970). A history of psychological testing. Boston: Allyn & Bacon.
  • Gottfredson, L. S., & Sharf, J. C. (1988). Fairness in employment testing: Journal of Vocational Behavior, 33(3).
  • Gregory, R. J. (1996). Psychological testing: History, principles, and applications (2nd ed.). Boston: Allyn & Bacon.
  • Haney, W. (1981). Validity, vaudeville, and values: A short history of social concerns over standardized testing. American Psychologist, 36, 1021-1034.
  • Various authors and topics related to measurement, statistics, and psychological testing.

Measurement and Numbers

Questions to Ask About Test Scores
  • What are the various scores and demographics of students in a specific class? (e.g. Ms. Johnson's and Mr. Cordero's classes represented in test data)
  • How to approach organizing and interpreting these scores via statistical methods?
Scales of Measurement
  • Nominal Scale: Numbers represent categories without order or value (e.g., Class and Gender).
  • Ordinal Scale: Numbers indicate rank order, but do not possess equal intervals.
  • Interval Scale: Equal intervals represent equal differences in the trait, but no true zero exists.
  • Ratio Scale: Equal intervals with a true zero point, allowing for statements of proportion (rare in education).
The Importance of Questions
  1. General Patterns: What do the scores look like overall?
  2. Average Performance: What is the typical score? Consider means, medians, modes.
  3. Variability: How spread out are the scores? Use range, interquartile range, and standard deviation.
  4. Individual Performance: How does an individual score compare to the group?
  5. Relationships between Scores: How do different tests correlate?
  6. Future Predictions: How can test scores predict future performance?
Frequency Distribution Techniques
  • Preparation of Frequency Distributions: Restructure raw score lists into frequency distributions to visualize and comprehend data effectively.
    • Example frequency distribution table of students' math scores shows how many occurred.
  • Cumulative Frequency Distributions: Displays the running total of frequencies to understand how many scores fall below a certain point.
  • Graphic Representation: Use histograms to illustrate score distributions, contributing to easier interpretations of data.

Measures of Central Tendency

  • Mode: Most frequently occurring score.
  • Median: Middle score when data is ordered.
  • Mean: Average score calculated as the total of all scores divided by the number of scores.
  • Different measures may yield different insights, especially in skewed distributions.

Measures of Variability

  • Range: Difference between highest and lowest scores.
  • Interquartile Range: Scores between the 25th and 75th percentiles.
  • Standard Deviation: A measure of the average distance of each score from the mean, quantifying variability.

Interpreting Standard Deviation

  • The standard deviation characterizes the spread of scores around the mean.
  • In normally distributed data, it provides insight into the proportion of scores within standard deviation units.

Measures of Relationship

  • Pearson Correlation Coefficient (r): A value that indicates the degree and direction of relationship between two sets of scores
  • Scatterplots: Visual representation of relationships between two variables captures trends and correlations using Z-scores.
  • A positive correlation indicates a direct relationship, while a negative correlation implies an inverse relationship.

Regression Analysis

  • Regression Equation: Describes the line of best fit through the data points, useful for making predictions.

  • Use of Regression for Prediction: Enables estimation of a criterion variable based on the score of a predictor variable using defined slope and intercept.

    • Example equation:
      extY^=ByxX+Aext{Ŷ} = B_{yx}X + A
  • Utilizing simple software tools (SPSS, Excel) allows for efficient computation of regressions and prediction models.

Conclusion

  • Measurement and statistical techniques are crucial for interpreting test scores.
  • Understanding scales of measurement, central tendency, variability, and relationships enhances the ability to make informed decisions based on data in educational contexts.