utility

Utility

• usefulness or practical value of testing to improve efficiency\

• practical value

• Helps us to make decisions

Psychometric Soundness

the reliability and validity of a test or tool

Costs

disadvantages, losses, or expenses, both economic and noneconomic

Benefits

profits, gains, or advantages

Utility Analysis

entails a cost-benefit analysis designed to yield information relevant to a decision about the usefulness and/or practical value of a tool of assessment

Expectancy Tables

provide an indication that a test taker will score within some interval of scores on a criterion measure (passing, acceptable, failing)

Taylor-Russell Tables

provide an estimate of the extent to which inclusion of a particular test in the selection system will improve selection

Selection Ratio

numerical value that reflects the relationship between the number of people to be hired and the number of people available to be hired

𝑠𝑒𝑙𝑒𝑐𝑡𝑖𝑜𝑛 𝑟𝑎𝑡𝑖𝑜

𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 ℎ𝑖𝑟𝑒𝑑 𝑐𝑎𝑛𝑑𝑖𝑑𝑎𝑡𝑒𝑠 / 𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑎𝑛𝑑𝑖𝑑𝑎𝑡𝑒

Naylor-Shine Tables

the difference between the means of the selected and unselected groups to derive an index of what the test is adding to already established procedures

Brogden-Cronbach-Gleser Formula

used to calculate the dollar amount of a utility gain resulting from the use of a particular selection instrument

Decision Theory

developers examine the usefulness of test scores in helping the test user make decisions

Relative Cut Score

reference point based on norm-related considerations

Fixed Cut Score

set with reference to a judgement concerning minimum level of proficiency required

Multiple Cut Scores

two or more cut score with one predictor

Multiple Hurdle

multi-stage selection process, a cut score is in place for each predictor

Compensatory Model of Selection

assumption that high scores on one attribute can compensate for lower scores

Angoff Method

setting fixed score, requires expert judges

Known Groups Method

collection of data on the predictor of interest from groups known to possess, and not to possess, a trait, attribute, or ability of interest

IRT-based Methods

cut scores are typically set based on test taker’s performance across all the items on the test