Utility

Flashcards about the Utility. The flashcards are in Question and Answer style.

What is Utility?

Usefulness or practical value of testing to improve efficiency

What is Psychometric Soundness?

Reliability and validity of a test

What are Costs in the context of Utility Analysis?

Disadvantages, losses, or expenses in both economic and noneconomic terms

What is the Economic Perspective in Utility Analysis?

Financial returns that a successful testing program can yield

What is the Noneconomic Perspective in Utility Analysis (in industrial settings)?

Increased work quality and quantity as a result of testing procedures

What is Utility Analysis?

A cost-benefit analysis designed to yield information relevant to a decision about the usefulness and/or practical value of a tool of assessment

What is Expectancy Data?

An indication of the likelihood that a testtaker will score within some interval of scores on a criterion measure

What does the Taylor-Russell Table provide?

An estimate of the extent to which inclusion of a particular test in the selection system will improve selection

What is the Validity Coefficient?

Test validity

What is the Selection Ratio?

Relationship between the number of people to be hired and the number of people available to be hired

What is the Base Rate?

Percentage of people hired under the existing system who are successful at their work

What does the Naylor-Shine Table entail?

Obtaining the difference between the means of the selected and unselected groups to derive an index of what test is adding to already established procedures

What is Utility Gain?

Estimate of the benefit (monetary or otherwise) of using a particular test or selection method

What is Productivity Gain?

Estimated increase in work output

What is a Relative Cut Score?

Reference point set based on norm-related considerations rather than on the relationship of test scores to a criterion

What is a Fixed Cut Score?

Set with reference to a judgment concerning a minimum level of proficiency required to be included in a particular classification

What are Multiple Cut Scores?

Use of two or more cut scores with reference to one predictor for the purpose of categorizing testtakers

What is Multiple Hurdle?

Achievement of a particular cut score on one test is necessary in order to advance to the next stage of evaluation of a selection process

What is the Compensatory Model of Selection?

An assumption is made that high scores on one attribute can compensate for low scores on another attribute

What happens in Angoff Method?

Judgments of experts are averaged to yield cut scores for the test

What happens in Known Groups Method?

Collection of data on the predictor of interest from groups known to possess, and not to possess, a trait, attribute, or ability of interest

What happens in Item Response Theory-Based Methods?

Each item is associated with a particular level of difficulty

What happens in Item-Mapping Method?

Entails the arrangement of items in a histogram, with each column containing items deemed to be of equivalent value

What happens in Bookmark Method?

Experts are given a book of items, with one item printed per page, such that items are arranged in an ascending order of difficulty

What are Floor Effects?

When a considerable percentage of participants obtain the worst or minimum score

What are Ceiling Effects?

When a considerable percentage of participants obtain the best or maximum score

What happens in Method of Predictive Yield (R.L. Thorndike)?

Takes into account the number of positions to be filled, projections regarding the likelihood of offer acceptance, and the distribution of applicant scores

What happens in Discriminant Analysis?

Statistical techniques are used to shed light on the relationship between identified variables and two or more naturally occurring groups