Technical Issues in Measurement and Numbers
PART ONE Technical Issues
Key References
- Cohen, R. J., & Swerdlik, M. E. (1999). Psychological testing and assessment: An introduction to tests and measurements (4th ed.). Mountain View, CA: Mayfield.
- Cronbach, L. J. (1975). Five decades of public controversy over mental testing. American Psychologist, 30, 1-14.
- DuBois, P. H. (1970). A history of psychological testing. Boston: Allyn & Bacon.
- Gottfredson, L. S., & Sharf, J. C. (1988). Fairness in employment testing: Journal of Vocational Behavior, 33(3).
- Gregory, R. J. (1996). Psychological testing: History, principles, and applications (2nd ed.). Boston: Allyn & Bacon.
- Haney, W. (1981). Validity, vaudeville, and values: A short history of social concerns over standardized testing. American Psychologist, 36, 1021-1034.
- Various authors and topics related to measurement, statistics, and psychological testing.
Measurement and Numbers
Questions to Ask About Test Scores
- What are the various scores and demographics of students in a specific class? (e.g. Ms. Johnson's and Mr. Cordero's classes represented in test data)
- How to approach organizing and interpreting these scores via statistical methods?
Scales of Measurement
- Nominal Scale: Numbers represent categories without order or value (e.g., Class and Gender).
- Ordinal Scale: Numbers indicate rank order, but do not possess equal intervals.
- Interval Scale: Equal intervals represent equal differences in the trait, but no true zero exists.
- Ratio Scale: Equal intervals with a true zero point, allowing for statements of proportion (rare in education).
The Importance of Questions
- General Patterns: What do the scores look like overall?
- Average Performance: What is the typical score? Consider means, medians, modes.
- Variability: How spread out are the scores? Use range, interquartile range, and standard deviation.
- Individual Performance: How does an individual score compare to the group?
- Relationships between Scores: How do different tests correlate?
- Future Predictions: How can test scores predict future performance?
Frequency Distribution Techniques
- Preparation of Frequency Distributions: Restructure raw score lists into frequency distributions to visualize and comprehend data effectively.
- Example frequency distribution table of students' math scores shows how many occurred.
- Cumulative Frequency Distributions: Displays the running total of frequencies to understand how many scores fall below a certain point.
- Graphic Representation: Use histograms to illustrate score distributions, contributing to easier interpretations of data.
Measures of Central Tendency
- Mode: Most frequently occurring score.
- Median: Middle score when data is ordered.
- Mean: Average score calculated as the total of all scores divided by the number of scores.
- Different measures may yield different insights, especially in skewed distributions.
Measures of Variability
- Range: Difference between highest and lowest scores.
- Interquartile Range: Scores between the 25th and 75th percentiles.
- Standard Deviation: A measure of the average distance of each score from the mean, quantifying variability.
Interpreting Standard Deviation
- The standard deviation characterizes the spread of scores around the mean.
- In normally distributed data, it provides insight into the proportion of scores within standard deviation units.
Measures of Relationship
- Pearson Correlation Coefficient (r): A value that indicates the degree and direction of relationship between two sets of scores
- Scatterplots: Visual representation of relationships between two variables captures trends and correlations using Z-scores.
- A positive correlation indicates a direct relationship, while a negative correlation implies an inverse relationship.
Regression Analysis
Regression Equation: Describes the line of best fit through the data points, useful for making predictions.
Use of Regression for Prediction: Enables estimation of a criterion variable based on the score of a predictor variable using defined slope and intercept.
- Example equation:
- Example equation:
Utilizing simple software tools (SPSS, Excel) allows for efficient computation of regressions and prediction models.
Conclusion
- Measurement and statistical techniques are crucial for interpreting test scores.
- Understanding scales of measurement, central tendency, variability, and relationships enhances the ability to make informed decisions based on data in educational contexts.