PSYC 3377 Chapter 11: True-False Tests Study Notes

Chapter 11: True-False Tests

Overview of True-False Items

  • Definition: True-False items are used to assess achievement when there is a clear distinction between two alternates.
  • Examples of Alternates:
    • True–False
    • Right–Wrong
    • Yes–No
    • Like–Dislike
  • Writing True-False Questions:
    • It might seem easy to write T/F items, but there is little space for precision.

Guidelines for Writing True-False Tests

  • Declarative Sentences:
    • Must state as declarative sentences; avoid phrasing such as “Is it true or false?”
    • Example of a poor question: "Is it true or false that a leap year occurs every 4 years?"
    • Focus on clear choices in a binary format.
Specificity in Topics
  • Focus on One Topic/Concept:
    • Example of a well-structured True-False item:
    • True or False? A roux can be prepared using fat and flour.
  • Avoid broad or overly general statements.
Avoiding Misleading Statements
  • Avoid Statements of Opinion:
    • Example of an opinion question: "In the video, I liked the way the teacher handled the interaction."
    • Revised example: Instead, frame it to ask about specific facts.
  • Beware of Double Negatives:
    • Example of a bad format: "Yes or No? Neither Technique #1 nor Technique #2 should be used with caution."
    • Revised to: "Yes or No? Technique #1 should be used with caution."
Qualifiers and Construct Length
  • Caution with Qualifiers:
    • Words such as always, never, and sometimes can mislead students.
  • Equal Number of Items:
    • Ensure the test contains an equal number of true and false items.
  • Complex Material:
    • Do not include overly complex material, which may not suit the T/F format.

Advantages and Disadvantages of True-False Tests

Advantages
  • Convenience in Writing: True-False tests are generally easier to write.
  • Ease of Administration: Simple to administer to students.
  • Scoring Efficiency: Quick and straightforward to score.
  • Time Efficiency: Students can answer a greater number of T/F questions in the same time compared to multiple-choice (MC) questions.
Disadvantages
  • Reliance on Memorization: True-False tests emphasize memorization of facts rather than deeper understanding.
  • Guessing Factor: The correct answer can often be guessed by students, leading to potential inaccuracies in knowledge assessment.
  • Lower-Level Knowledge Measurement: T/F items are generally ineffective for assessing higher-level knowledge or comprehension skills.

Common Issues with True-False Items

  • Example Statements:
    • "Do you think the Raiders will win the Superbowl this year?"
    • "Cold fusion always works."
    • "Students would not be better off if they couldn’t take advantage of school tutoring."
    • "Health care and childcare are major concerns for our society."

Variations of True-False Items

Confidence-Weighted True-False Items (CTF)
  • Definition: CTF items gauge student confidence in their answers.
  • Example Categories:
    1. I am sure the statement is true.
    2. I think the statement is true, but I am unsure.
    3. I think the statement is false, but I am unsure.
    4. I am sure the statement is false.
  • Reference: Dutke & Barenberg (2015).
Research on CTF Items
  • Learning Progress Sensitivity: Study by Dutke and Barenberg (2009) showed:
    • Mid-semester, 20 CTF items divided into:
    • 10 items on material already covered.
    • 10 items on upcoming material.
    • Results indicated higher performance on previously covered items compared to new content.
  • End-Semester Assessments: Same set administered at the semester's end showed an increase in both correct and confident answers.
Predictive Validity of CTF Items
  • Correlation with Essay Questions: CTF items showed reasonable correlation with performances in essay questions on the same content.
  • Influence on Score Range: Predictive ability was affected by the score range in essays.
  • Reduction of Guessing Impact: CTF items provide additional insight into teaching and testing methods, reducing guessing concerns.
Multiple True-False Items (MTF)
  • Format: MTF items resemble MC questions but consist of a stem followed by several statements for evaluation as T/F.
  • Benefits: MTF format can mitigate common test-taking strategies that depend on comparing options.
  • Study Findings:
    • Couch, Hubbard, & Brassil (2018) found that MTF questions allow students to answer more items in the same timeframe as MC questions, providing deeper insights into their understanding.