PSYCH ASS (A)

Kyuti + St. Anne mix

Psychometric Properties

The technical qualities and characteristics of psychological tests and assessments that determine their scientific soundness and practical usefulness

Psychometric Properties

These are crucial for ensuring that a test is measuring what it intends to measure, that its results are consistent, and that the scores can be meaningfully interpreted

Reliability

Extent to which a method yields the same results under similar conditions

Reliability

Consistency or dependability in measurement

Reliability Coefficient

An index of reliability, a proportion that indicates the ratio between the true score variance on a test and the total score

0 to 1

Range of reliability coefficient

Reliability

The proportion of the total variance attributed to the true variance

Reliability

Precedes validity. Without this, a test cannot be valid.

Perfect Reliability

The 1.0 range in Reliability

1.0

Reliability range that may indicate redundancy or homogeneity

Excellent Reliability

The ≥ 0.9 range in Reliability

≥ 0.9

Reliability range that is minimum for clinical setting

Good Reliability

The ≥ 0.8 < 0.9 range in Reliability

≥ 0.8 < 0.9

The reliability range that is considered good

≥ 0.7 < 0.8

Reliability range that is minimum for psychometric tests

Acceptable Reliability

The ≥ 0.7 < 0.8 range in Reliability

≥ 0.6 < 0.7

Reliability range that is acceptable for research

Questionable Reliability

The ≥ 0.6 < 0.7 range in Reliability

≥ 0.5 < 0.6

Reliability range that is poor reliability

Poor Reliability

The ≥ 0.5 < 0.6 range in Reliability

< 0.5

Reliability range that is unacceptable reliability

Unacceptable Reliability

The < 0.5 range in Reliability

0.0

Reliability range that has No Reliability

No Reliability

The 0.0 range in Reliability

Educational Assessment

The use of tests and other tools to evaluate abilities and skills relevant to success or failure in a pre-/school context (e.g., intelligence tests, achievement tests, reading comprehension tests)

Retrospective Assessment

The use of evaluative tools to conclude psychological aspects of a person as they existed at some point in time before the assessment

Remote Assessment

The use of psychological tools to gather data and draw conclusions about subjects who are not in physical proximity to the person or people conducting the evaluation

Ecological Momentary Assessment

The “in the moment” evaluation of specific problems and related cognitive and behavioral variables at the very time and place that they occur

Psychological Testing

This is the process of measuring variables by means of devices or procedures designed to obtain a sample of behavior

Psychological Test

A device or procedure designed to measure variables related to psychology

The gathering and integration of psychology-related data for the purpose of making a psychological evaluation that is accomplished through the use of tools, tests, interviews, case studies, behavioral observation, and specially designed apparatuses

Dynamic Psychological Assessment

• Interactive approach

• evaluation-intervention-evaluation

Sandwich Method

The method of evaluation-intervention-evaluation is called

Collaborative Psychological Assessment

The assessor and assessee may work as “partners” from the initial contact to the final feedback

Therapeutic Psychological Assessment

Assessment of therapeutic self-discovery and new understandings throughout the process

Content

Variable of testing that relates to the subject matter

Format

Variable of testing that relates to the form, plan, structure, arrangement, layout of a test

Item

Variable of testing that relates to the specific stimulus to which a person responds overtly and this response is being scored or evaluated

Administration Procedure

Variable of testing that relates to the individual basis or group administration

Score

Variable of testing that relates to the code or summary of statement, usually but not necessarily numerical in nature, but reflects an evaluation of performance on a test

Scoring

Variable of testing that relates to the process of assigning scores to performances

Cut Score

Variable of testing that relates to the reference point, usually numerical, derived by judgment and used to divide a set of data into two or more classification

Psychometric Soundness

Variable of testing that relates to the technical quality of a test

Psychometric

The science of psychological measurements

Psychometrician

The professional who uses, analyzes, and interprets psychological test data

Testing

Objective is to measure a construct

Assessment

Objective is to answer a referral question

Testing

Focus is on nomothetic approach

Assessment

Focus is on Idiographic Approach

Testing

Process is individual or group

Assessment

Process is individual only

Testing

Outcome is Psychometric Report or test score

Assessment

Outcome is Psychological Report

Testing

Source is testtaker only

Assessment

Source is collateral sources

Testing

Tester is not the key

Assessment

Assessor is the key

Testing

Duration is shorter

Assessment

Duration is longer

Testing

Cost is inexpensive

Assessment

Cost is expensive

Testing

Qualifications needs to have technician-like skills; RPm

Assessment

Qualifications are highly specialized; RPsy

Reliability

Goals are to estimate errors or anything unaccounted for in psychological measurement

Reliability

Goal is to device techniques to improve testing so errors are reduced

Classical Test Theory

A score on an ability is presumed to reflect not only the test taker’s true score on the ability being measured but also the error

True Score

The value that genuinely reflects an individual’s ability level as measured by a particular test

True Score

This can never be observed directly and its approximate can be identified by averaging measurements

Error

The component of observed test score that does not have to do with the test taker’s ability

Classical Test Theory

• Most widely used and accepted model in the psychometric literature

• Much simpler to understand than IRT

True Score

Long-term average of many measurements free of carryover effects

Accuracy

Factors that influence this are

• Time lapses between measurements

• Act of measurement

Carryover Effects

Happens when test-retest interval is short, wherein the second test is influenced by the first test because they remember or practiced the previous test

Practice Effect

Scores on the second session are higher due to their experience of the first session of testing

Practice Effects

Test itself provides an opportunity to learn and practice the ability being measured

Test Sophistication

Items are remembered by the test takers especially the difficult ones/items that we got highlight confused

Fatigue Effects

Repeated testing reduces overall mental energy or motivation to perform on a test

Construct Score

Person’s standing on a theoretical variable independent of any particular measurement

Reliable Tests

Tests that give scores closely approximate true scores

Valid Tests

Tests that give scores that closely approximate construct scores

Tests that give Classical Test Theory

Formula is X = T + E

where X is observed score, T is true score, and E is amount of measurement error

Variance

• This is useful in describing sources of test score variability

• The standard deviation squared

True Variance

The variance from true difference

Error Variance

• The variance from irrelevant, random sources

• May increase or decrease a test score by varying amounts

Bias

The degree to which a measure predictably overestimates or underestimates a quantity

Measurement Error

All of the factors associated with the process of measuring some variables, other than variables being measured

Measurement Error

Inherent uncertainty associated with any measurement, even after care has been taken to minimize preventable mistakes

Error

Refers to the component of the observed test score that does not have to do with the test taker's ability

Random Error

Unavoidable source of error in measuring a targeted variable caused by unpredictable fluctuations and inconsistencies of other variables in the measurement process

Random Error

• This affects precision

• Does not affect the average score in the long run, but increase variability in scores

Noise

What is random error also called as

Systematic Error

• This affects accuracy

• Consistent and predictable

• A threat to validity more than to reliability

Systematic Error

Avoidable if corrected source of error in measuring a variable that is typically constant or proportionate to what is presumed to be the true value of the variable being measured.

Item Sampling

Error in the variation among items within a test as well as to variation among items between tests

Item Sampling

Extent of error to which a testtaker’s score is affected by the content sampled on a test and by the way the content is sampled

Content Sampling Error

Item sampling error is also called as

Test Construction

Error in this is item sampling/content sampling

Test Administration

Error in this are test environment, testtaker variables, examiner-related variables