CHAPTER 1: Introduction to Psychological Testing and Assessment

Introduction to Measurement in Psychology

All human endeavors involve measurement and utilize specific tools and units. In common experience, this occurs when purchasing smartphones or computers with units such as speed ($gigahertz$), screen resolution ($12\,megapixels$), and storage ($512\,gigabytes$). Jewelry measurements involve the $4$ Cs: cut, color, clarity, and carat. In psychology, measurement is used to understand people before providing assistance. Psychological assessment applies scientific rigor to this process and is a tool for great helpers to understand the individual in need. Methods include direct observation, interviews, questionnaires, tests, and case file reviews.

While educational testing determines what a person has learned, psychological assessment provides insights into what can be learned about a person. The experience of being heard and understood often provides comfort to those seeking help.

The History of Psychological Testing and Assessment

The roots of modern testing can be traced to early twentieth-century France. In $1905$, Alfred Binet and Theodore Simon published a test to help place Paris schoolchildren in appropriate classes. This arose from educational reforms between the $1870s$ and $1890s$ that mandated free public education for all children. Administrators needed a fair and efficient method to identify children with intellectual disabilities who required separate, intensive instruction.

Binet and Simon warned that without scientific rigor, decisions would be subjective and uncontrolled. Their series of tests aimed to forecast which students would fall behind their peers. Although it became known as an "intelligence test," it was originally for the narrow purpose of identifying those needing support. Later, William Stern developed the Intelligence Quotient ($IQ$), but he was horrified when it was used for oppression rather than its original goal of liberation. He asserted that working "on" a human must always entail working "for" a human.

Expansion and Differentiation of the Testing Enterprise

During World War I in $1917$, the United States military used psychological testing to screen large numbers of recruits for intellectual and emotional problems. This use expanded during World War II. Post-war, tests were developed for personality, brain functioning, and work performance.

A semantic distinction between testing and assessment emerged around World War II. While "testing" originally referred to the entire process from administration to interpretation, "assessment" is now recognized as a more inclusive term. Assessment acknowledges that tests are only one tool (alongside interviews and other methods) and that the process is linked to the knowledge and skill of the assessor.

Definitions and Conceptual Distinctions

• Psychological Assessment: The gathering and integration of psychology-related data for the purpose of making a psychological evaluation, accomplished through tests, interviews, case studies, behavioral observation, and specialized apparatuses.

• Psychological Testing: The process of measuring psychology-related variables by means of devices or procedures designed to obtain a sample of behavior.

Table of Contrasts between Testing and Assessment

• Objective: Testing seeks to obtain a gauge, usually numerical ($test\,score$). Assessment seeks to answer a referral question or solve a problem.

• Process: Testing is often group-oriented and results-focused. Assessment is individualized and focuses on how the person processes information.

• Role of Evaluator: In testing, the tester is interchangeable. In assessment, the assessor is key to tool selection and concluding findings.

• Skill of Evaluator: Testing requires technician-like skills. Assessment requires expertise in selecting tools and integrating complex data.

• Outcome: Testing yields a score. Assessment entails a logical problem-solving approach involving multiple data sources.

Varieties of Psychological Assessment

Specialty areas are often identified by the modifiers added to the word "assessment":

• Therapeutic Psychological Assessment: Assessment designed to provide therapeutic self-discovery and understanding throughout the process.

• Educational Assessment: Using tools like intelligence and achievement tests to evaluate skills relevant to school success.

• Retrospective Assessment: Evaluative tools used to draw conclusions about a person as they existed at a prior point in time.

• Remote Assessment: Gathering data on a subject not in physical proximity to the evaluator.

• Ecological Momentary Assessment (EMA): "In the moment" evaluation of problems at the exact time and place they occur.

• Collaborative Psychological Assessment: An approach where the assessor and assessee work as partners.

• Dynamic Assessment: An interactive approach following a model of ($1$) evaluation, ($2$) intervention, and ($3$) evaluation to measure learning potential.

Close-Up: Behavioral Assessment Using Smartphones

Mental health is fluid and subject to internal and external factors. Dror Ben-Zeev and colleagues utilize smartphone sensors to identify behavioral patterns associated with stress or deterioration.

• Acoustics: Software activates the microphone to detect human conversation. To protect privacy, raw audio is not recorded; instead, it calculates the number and average length of conversations in a $24$-hour period.

• Location: $GPS$ generates geospatial coordinates. In closed settings, microbluetooth beacons track movement between rooms.

• Movement: Accelerometers detect physical activity levels.

Research involving college students showed that social engagement and daily geospatial activity were significantly related to changes in depression over a $10$-week period. Using this data helps clinicians create personalized treatment protocols. Subjects generally appreciate this passive detection system when used ethically with consent.

Tools of Psychological Assessment

The Test

A test is a measuring device or procedure. Medical tests measure health variables (e.g., blood tests), while psychological tests measure variables like intelligence, personality, or aptitude. These tests focus on samples of behavior, which can be elicited stimuli or naturally occurring behavior.

Tests vary by:

• Content: Different developers may define traits (like personality) differently based on theoretical orientation (e.g., psychoanalytic vs. behavioral).

• Format: The plan, structure, and layout of items, as well as administration forms (computerized or paper-and-pencil).

• Administration: Some require one-on-one attention; others are for groups without a present administrator.

• Scoring and Interpretation:

  • Score: A code or summary statement reflecting performance.

  • Scoring: The process of assigning evaluative codes.

  • Cut Score: A reference point used to divide data into classifications (e.g., pass/fail). These have emotional consequences for those who just miss or just make the cut.

• Psychometric Soundness: Refers to the science of measurement (Psychometrics). It includes Validity (accuracy) and Reliability (consistency). Utility refers to the practical value of a test for a specific purpose.

The Interview

A method of gathering information through direct communication involving reciprocal exchange. It goes beyond talk to include verbal and nonverbal behavior (body language, dress, eye contact).

• Panel Interview: Also known as a board interview; involves multiple interviewers to minimize individual bias, though costs are higher.

• Motivational Interviewing: A therapeutic dialogue combining person-centered listening with cognition-altering techniques to effect change.

Additional Tools

• The Portfolio: A file of work products (paper, video, audio) used as samples of ability.

• Case History Data: Records, transcripts, and archival information (from schools, hospitals, or social media). A Case Study is the illustrative account compiled from this data.

• Behavioral Observation: Monitoring actions by visual or electronic means. Naturalistic Observation occurs in the setting where behavior typically happens.

• Role-Play Tests: Assessees act as if they are in a particular situation to evaluate skills (e.g., conflict mediation or the Test of Grocery Shopping Skills).

Computers as Assessment Tools

Computers assist in administration, scoring, and interpretation.

• Scoring Reports: Can be simple listings or Extended Scoring Reports with statistical analysis.

• Interpretive Reports: Include narrative statements. Consultative Reports provide expert opinions for professionals. Integrative Reports combine test data with other sources (e.g., medication records).

• Computer Adaptive Testing (CAT): The computer tailors the test to the testtaker's ability (e.g., switching from math to English after multiple failures).

• Computer-Assisted Psychological Assessment (CAPA): Tools like Q-Interactive allow iPad-based administration and immediate scoring.

Pros and Cons of CAPA

• Pros: Saves time, minimizes human scoring errors, ensures standardized administration, and facilitates testing for isolated populations.

• Cons: Requires time to learn software, risks hardware/software glitches, restricts certain test-taking strategies (like skipping questions), and raises concerns about "test-client integrity" (verifying identity and preventing cheating) in online formats.

Parties in the Assessment Enterprise

1. Test Developers: Create over $20,000$ new tests annually. They follow "the Standards" (Standards for Educational and Psychological Testing) initially published in $1954$ and revised in $1966$, $1974$, $1985$, $1999$, and $2014$.

2. Test Users: Professionals such as clinicians, counselors, and HR personnel. Controversy exists regarding who is qualified to use certain tests.

3. Testtakers: Individuals being evaluated. They vary in anxiety, cooperation, pain, distress, coaching, and alertness. A Psychological Autopsy is used to reconstruct the profile of a deceased individual.

4. Society at Large: Influences testing through laws, court decisions, and the demand for systematizing individual differences.

Settings and Applications of Assessment

• Educational: Achievement tests (evaluate learning, e.g., $SAT$, $GRE$), diagnostic tests (identify deficits), and informal evaluations.

• Clinical: Diagnosis of behavior problems, malingering checks, and competency to stand trial.

• Counseling: Focus on improvement in adjustment and productivity.

• Geriatric: Evaluating quality of life and screening for Dementia (cognitive loss). Pseudodementia refers to severe depression mimicking dementia symptoms.

• Business and Military: Selection, promotion, and product engineering. Lt. Col. Alan Ogle (USAF) uses clinical measures like the $MMPI$ and specialized screening for Military Training Instructors (MTIs) using KSAOs (Knowledge, Skills, Abilities, and Other characteristics) and Multidimensional Peer Assessment (MDPA).

• Credentialing: Governmental licensing (e.g., bar exams, psychology boards).

• Academic Research: Measurement is essential for publishing research (e.g., role of inspiration, animal intelligence).

The Assessment Process and Conduct

Assessment typically follows a flow: Referral -> Clarification of referral questions -> Tool selection -> Formal assessment -> Report findings -> Feedback session.

Conduct Obligations

• Before: Proper test selection, secure storage, and ensured training for the administrator.

• During: Establishing Rapport (a working relationship) and ensuring the environment is conducive (avoiding noise, extreme temp).

• After: Safeguarding Protocols (the forms on which responses are entered) and clear communication of results.

Assessment of People with Disabilities

Accommodation involves adapting a test or situation to make it suitable for an assessee with exceptional needs (e.g., large print, sign language, or frequent breaks). Alternate Assessment is a procedure that varies from the standardized way a measurement is derived. Factors to consider for accommodation include the assessee's capabilities, the purpose of the assessment, the meaning of the scores (validity), and the assessor's capabilities.

Reference Sources for Test Information

• Test Catalogues: Brief descriptions from publishers; primarily sales-oriented.

• Test Manuals: Most detailed source for standardization samples and administration; often restricted to professionals.

• Professional Books: In-depth discussion of specific tests by experienced practitioners.

• Reference Volumes: The Buros Center for Testing publishes the Mental Measurements Yearbook (test reviews) and Tests in Print.

• Journal Articles: Up-to-date reviews and independent studies on psychometric soundness (e.g., Psychological Assessment).

• Online Databases: ERIC (educational resources), PsycTESTS (over $58,000$ test descriptions), PsycINFO, and Educational Testing Service (ETS) (distributors of the $SAT$ and $GRE$ with a staff of over $3200$ people).