Standards Review for Early Pages (Validity, Reliability, and Core Concepts)

A set of Q&A style flashcards covering the 13 standards and their key details as presented in the first several pages of the lecture notes, focusing on validity, reliability, fairness, documentation, and the intended audience for each standard.

What does the overarching Standard 1.0 (Validity) pertain to and entail?

Pertains to test developers and test users; requires clear articulation of score interpretations and provision of validity evidence for each interpretation.

What does Standard 1.1 require developers to state about test scores?

How test scores are intended to be used, who the intended population is, and what construct is being measured.

What must Standard 1.2 provide for each intended interpretation?

Rationale, evidence, and theory supporting the interpretation.

What does Standard 1.3 require if a likely interpretation hasn’t been validated?

Clearly state that it hasn’t been validated and warn against misuse.

What does Standard 1.4 require if a user applies a test in a new, unvalidated way?

The user must justify the new use and gather evidence.

What does Standard 1.5 require when an interpretation implies a specific outcome?

Present evidence supporting the outcome for that interpretation.

What does Standard 1.6 require for claimed indirect benefits of using the test?

Rationale and evidence for those benefits must be clear.

What does Standard 1.7 require if it’s claimed that coaching doesn’t affect performance?

Provide evidence to support the claim.

What is the focus of Standard 2.0 (Reliability/Precision and Errors of Measurement)?

Provide appropriate evidence of reliability/precision for each intended use.

What does the notes indicate about the scope of Standards beyond page 24?

Reliability and other technical standards begin beyond page 24, likely outside the current quiz scope.

What is Standard 3 and what does it pertain to?

Test Development and Revision; pertains to test developers and entails creating/refining tests based on a conceptual framework with clear construct definitions and user needs.

What is Standard 4 and what does it entail?

Scales, Norms, and Score Comparability; pertains to developers and users; ensures scores are interpretable and comparable across versions/times and norm-referenced appropriately.

What is Standard 5 and what does it entail?

Test Administration, Scoring, and Reporting; pertains to test administrators and users; standardizes procedures to promote fairness and consistency.

What is Standard 6 and what does it entail?

Supporting Documentation for Tests; pertains to developers, publishers, and users; provides comprehensive documentation on purpose, development, scoring procedures, and validity/reliability evidence.

What is Standard 7 and what does it entail?

Fairness in Testing; pertains to developers, users, and policymakers; aims to prevent bias and ensure fairness across all test taker subgroups.

What is Standard 8 and what does it entail?

Rights and Responsibilities of Test Takers; pertains to test users and administrators; ensures examinees understand their rights and responsibilities (e.g., confidentiality, test security).

What is Standard 9 and what does it entail?

Testing Individuals of Diverse Linguistic Backgrounds; pertains to developers, admins, and users; addresses language-related issues, translation, equivalence, interpreter use, and linguistic fairness.

What is Standard 10 and what does it entail?

Testing Individuals with Disabilities; pertains to developers, users, and administrators; provides accommodations/modifications and ensures accessibility in compliance with laws and validity.

What is Standard 11 and what does it entail?

Standards Involving General Responsibilities of Test Users; pertains to test users; emphasizes using tests wisely, seeking validity evidence for new uses, and maintaining reliability/fairness when adapting tests.

What is Standard 12 and what does it entail?

Psychological Testing and Assessment; pertains to psychologists and assessment professionals; covers proper selection, administration, interpretation, and integration with other information in psychological contexts.

What is Standard 13 and what does it entail?

Educational Testing and Assessment (including Employment and Credentialing); pertains to educators, employers, policymakers; involves applying tests in education and employment with validation and fairness.