Psychological Assessment- Chapter 8: Test Development

0.0(0)
Studied by 0 people
call kaiCall Kai
learnLearn
examPractice Test
spaced repetitionSpaced Repetition
heart puzzleMatch
flashcardsFlashcards
GameKnowt Play
Card Sorting

1/38

encourage image

There's no tags or description

Looks like no tags are added yet.

39 Terms

1
New cards

An umbrella term for all that goes into the process of creating a test.

Test development

2
New cards

The process of developing a test occurs in five stages:

Test conceptualization

Test construction

Test tryout

Item analysis

Test revision

3
New cards

It is the process of setting rules for assigning numbers in measurement.

Scaling

4
New cards

He is credited for being the forefront of efforts to develop methodologically sound scaling methods.

L.L Thurstone

5
New cards

Entails judgments of a stimulus in comparison with every other stimulus on the scale

Comparative scaling

6
New cards

Stimuli are placed into one or two more alternative categories that differ quantitatively with respect to some continuum.

Categorical scaling

7
New cards

Grouping of words, statements, or symbols on which judgments of the strength of a particular trait, attitude, or emotion are indicated by the test taker.

Rating scale

8
New cards

When final score is obtained by summing the ratings across all the items.

Summative scale

9
New cards

Each item presents the test taker with five alternative responses usually on agree-disagree, or approve-disapprove continuum.

Likert scale

10
New cards

It is when presented with two stimuli and asked to compare.

Method of paired comparisons

11
New cards

Judging of a stimulus in comparison with every other stimulus on the scale.

Comparative scaling

12
New cards

Test taker places stimuli into a category; those categories differ quantitatively on a spectrum.

Categorical scaling

13
New cards

Items range from sequentially weaker to stronger expressions of attitude, belief, or feeling. All respondents who agree with the stronger statements of the attitude will also agree with milder statements.

Guttman scale (Scalogram analysis)

14
New cards

Reservoir from which items will or will not be drawn for the final version of the test.

Item pool

15
New cards

Variables such as the form, plan, structure, arrangement and layout of individual test items.

Item format

16
New cards

Type of format where test taker selects a response from a set of alternative responses.

Selected-response format

17
New cards

Type of format where test taker supplies or creates the correct answer.

Constructed-response format

18
New cards

Relatively large and easily accessible collection of test questions.

Item bank

19
New cards

Interactive, computer administered test taking process wherein items presented to the test taker are based in part on test taker's performance on previous.

Computerized Adaptive Testing (CAT)

20
New cards

The diminished utility of an assessment tool for distinguishing test takers at the low end of the ability, trait, or other attribute being measured.

Floor effect

21
New cards

The diminished utility of an assessment tool for distinguishing test takers at the high end of the ability, trait, or other attribute being measured.

Ceiling effect

22
New cards

Ability of computer to tailor the content and order of presentation of test items on the basis of responses to previous items.

Item branching

23
New cards

Test takers earn cumulative credit with regard to a particular construct.

Cumulative scoring

24
New cards

Test taker responses earn credit toward placement in a particular class or category with other test takers whose pattern of responses is presumably similar in someway.

Class/category scoring

25
New cards

Comparing a test taker's score on one within a test to another scale within that same test.

Ipsative scoring

26
New cards

Obtained by calculating the proportion of the total number of test takers who answered the item correctly "p".

Item difficulty index

27
New cards

Indication of the internal consistency of a test.

Item reliability index

28
New cards

Statistic designed to provide an indication of the degree to which a test is measuring what it purports to measure.

Item validity index

29
New cards

Measures how adequately a item separates or discriminates between high scores and low scorers.

Item discrimination index

30
New cards

Other Considerations in Item Analysis

Guessing

Item fairness

Speed tests

31
New cards

Techniques of data generation and analysis that rely primarily on verbal rather than mathematical or statistical procedures.

Qualitative method

32
New cards

Various nonstatistical procedures designed to explore how individual test item work.

Qualitative item analysis

33
New cards

Approach to cognitive assessment that entails respondents vocalizing thoughts as they occure.

Think aloud test administration

34
New cards

Revalidation of a test on a sample of test takers other than those on whom test performance was originally found to be a valid predictor of some criterion.

Cross validation

35
New cards

Decrease in item validities that inevitably occurs after cross validation of finding.

Validity shrinkage

36
New cards

Test validation process conducted on two or more tests using the same sample of test takers.

Co-validation

37
New cards

When co-validation is used conjunction with the creation of norms or the revision of existing norms.

Co-norming

38
New cards

Phenomenon wherein an items function differently in one group of test takers as compared to another group of test takers known to have the same level of the underlying trait.

Differential item functioning

39
New cards

Items range from sequentially weaker to stronger expressions of attitude, belief, or feeling.