PSYC 3377

Communication and Lecture Format

• Importance of clear communication in a lecture setting.
  • Microphone Issues: Speaker mentions a past incident where their microphone failed, making it difficult for students in the back to hear.
  • Emphasizes the importance of being heard and understood in large lectures.

Class Structure

• Overview of today's class schedule.
  • Duration of class: 75 minutes.
  • Planned segments:
  • 20 minutes of lecture.
  • In-class activity: Preparation for an upcoming exam on Tuesday.
  • Group activity: Students will work in groups, followed by a review of questions based on the activity.
  • Availability for questions related to the study guide that was posted the previous Tuesday.

Review of Past Material

• Reviewing Key Concepts:
  • Question posed to the group about what was discussed in the previous class.
  • Zealous about keeping to the schedule.

Scoring Methods

• Percentiles:

  • Definition: Percentiles represent the relative standing of a score in a distribution.
  • Example: A score in the 90th percentile indicates the score is better than 90% of the scores in the distribution.

• Stanines:

  • Definition: A stanine score is a standardized score system that classifies scores from 1 to 9.
  • Interpretation:
  • Stanine scores of 1-3 indicate below average performance.
  • 4-6 represent average performance.
  • 7-9 indicate above average performance.

• Deciles:

  • Definition: Dividing a distribution into 10 equal parts.

• Z-scores and T-scores:

  • Shared characteristic: Both utilize standard deviation for calculations.
  • Z-scores:
  • Applicable for larger groups (more than 30).
  • Can be positive or negative, indicating position relative to the mean.
  • Interpretation: Tells how many standard deviations a score is from the mean.
  • T-scores:
  • Typically used with smaller groups.
  • Similar to Z-scores in utility.

Item Response Theory (IRT)

• Introduction to Item Response Theory as a method for evaluating individual test items.

Item Performance Evaluation

• Importance of assessing how well individual test items function.
  • Judging efficacy: Ability to distinguish between individuals with and without knowledge/ability.

Item Characteristics and Curves

• Item Characteristic Curve (ICC): A graphical representation useful for analyzing item difficulty and discrimination.
  • Difficulty Assessment:
  • Determined by the horizontal position of the curve on the x-axis (theta).
    • Farther right indicates a more difficult question.
    • Steeper slopes tied to better discrimination.
  • Distinction: How well the item separates those with knowledge from those without knowledge.
  • Steeper slopes indicate better discrimination ability.

Example Discussion

• Analysis of an item with peculiar features regarding difficulty and discrimination.
  • Reference to common pitfalls like low discrimination in items due to phrasing.

Data Analysis in Testing

• Utilization of item statistics from test data to refine future tests.
  • Preference for blue scantron sheets due to better data collection and analysis capabilities.
  • Insights gained from analyzing patterns of response:
  • Percentage of correct answers.
  • Discrimination indices to compare responses of high and low performers.

Revising Test Items

• Procedures for refining ill-performing test items:
  • Rewriting unclear items or making ambiguous items more precise.
  • Trialing revised items to ensure improved performance.
  • Emphasis on the iterative process of item development to create fair and challenging questions.

Conclusion

• Summary of IRT's utility in assessing individual test items instead of overall test performance.
• Reinforcement of a structured approach to test development:
  • Creation of items based on theoretical foundation and research.
  • Administration of the test.
  • Use of IRT to evaluate and enhance the effectiveness of each item based on data analysis.