EBD 601 Ch. 7

norm-referenced scoring

a scoring approach in which an individual’s performance on an assessment is compared to the performance of others. Also called grading on the curve

criterion-referenced scoring

a scoring approach in which an individual’s performancce on an assessment is compared to a predetermined, external standard

criterion-referenced validity

validity that is determined by relating performance on a test to performance on another criterion )a second test or measure); includes concurrent & predictive validity

Kuder-Richardson 20 (KR-20)

general formula for estimating internal consistency based on a determination of how all items on a test relate to all other items & to the total test. The Kuder-Richardson 20 (KR-20) is a special case of the Cronbach’s alpha general formula

Assessment

general term for the process of collecting, synthesizing, & interpreting info; also the instrument used for such purposes. A test is a type of assessment

self-referenced scoring approaches

a scoring approach in which an individual’s repeated performances on a single assessment are compared over time

achievement test

an instrument that measures an individual’s current proficiency in given areas of knowledge or skill

consequential validity

extent to which an instrument creates harmful effects for the user

affective test

an assessment designed to measure mental characteristics related to emotion

instrument

in educational research, a test or other tool used to collect data

split-half reliability

a measure of internal consistency that involves dividing a test into two equivalent halves & correlating the scores on the two halves

interjudge reliability

the consistency of two or more independent scorers, raters, or observers

predictive validity

the degree to which a test is able to predict how well an individual will do in a future situation; a form of crtierion-related validity

intrajudge reliability

consistency of one individual’s scoring, rating, or observing over time

ratio variable

a ratio variable has equal intervals in rank order & its measurement scale has a true zero point. Height, weight, time, distance, & speed are examples of ratio scales

ordinal variable

An ordinal variable not only classifies persons or objects, it also ranks them according to some criteria. The numerical value of ordinal scales indicates a ranking in order from highest to lowest or from most to least.

attitude scale

A measurement instrument used to determine what a respondent believes, perceives, or feels about self, others, activities, institutions, or situations.

cognitive characteristic

A mental characteristic related to intellect, such as mathematics achievement, literacy, reasoning, or problem solving.

predictor

In a prediction study or analysis of concurrent or predictive validity, the variable on which the prediction is based.

equivalence

The degree to which two similar forms of a test produce similar scores from a single group of test takers. Also called equivalent-forms reliability or alternate-forms reliability.

construct validity

The degree to which inferences are warranted from the observed persons, settings, and cause and effect operations included in a study to the constructs that these instances might represent

affective characteristic

A mental characteristic related to emotion, such as attitude, interest, and value.

sampling validity

The degree to which a test samples the total content area of interest

semantic differential scale

An instrument that requires an individual to indicate his or her attitude about a topic (e.g., property taxes) by selecting a position on a continuum that ranges from one bipolar adjective (e.g., fair) to another (e.g., unfair).

response set

The tendency of an assessed individual to respond in a particular way to a variety of instruments, such as when a respondent repeatedly answers as he or she believes the researcher desires even when such answers do not reflect the respondent’s true feelings; also, the tendency of an observer to rate the majority of observees the same regardless of the observees’ behavior

equivalent-forms reliability

The degree to which two similar forms of a test produce similar scores from a single group of test takers. Also called equivalent-forms reliability or alternate-forms reliability

dependent variable

The change or difference in a behavior or characteristic that occurs as a result of the independent or grouping variable. Also called effect, outcome, or posttest

reliability

The degree to which a test (or qualitative research data) consistently measures whatever it measures.

standardized test

A test that is administered, scored, and interpreted in the same way no matter where or when it is given.

raw score

The numerical calculation of the number or point value of items answered correctly on an assessment.

independent variable

A behavior or characteristic under the control of the researcher and believed to influence some other behavior or characteristic. Also called experimental variable, manipulated variable, cause, or treatment.

measurement scale

A system for organizing data so that data may be inspected, analyzed, and interpreted.

data

(sing. datum) Pieces of information.

test

A formal, systematic, usually paper-and-pencil procedure for gathering information about people’s cognitive and affective characteristics.

criterion

The predicted variable that must be a valid measure of the performance to be predicted.

construct

An abstraction that cannot be observed directly; a concept invented to explain behavior.

item validity

The degree to which test items are relevant to the measurement of the intended content area.

face validity

The degree to which a test appears to measure what it claims to measure.

concurrent validity

The degree to which the scores on a test are related to the scores on a similar test administered in the same time frame or to some other valid measure available at the same time; a form of criterion-related validity.

aptitude test

A measure of potential used to predict how well an individual is likely to perform in a future situation.

performance assessment

A type of assessment that emphasizes a respondent’s performance of a process or creation of a product. Also called authentic assessment or alternative assessment.

nominal variable

A nominal variable is also called a categorical variable because the values include two or more named categories, for example, employment status (full-time, part-time, unemployed).

test-retest reliability

The degree to which scores on a test are consistent, or stable, over time. Also called test–retest reliability.

interval variable

An interval variable has values that are ranked in order, but its values also represent equal intervals. Scores on most tests used in educational research, such as achievement, aptitude, motivation, and attitude tests, are treated as interval variables.

Cronbach’s alpha

The general formula for estimating internal consistency based on a determination of how all items on a test relate to all other items and to the total test. The Kuder-Richardson 20 (KR-20) is a special case of the Cronbach’s alpha general formula.

Likert scale

An instrument on which individuals respond to a series of statements by indicating whether they strongly agree (SA), agree (A), are undecided (U), disagree (D), or strongly disagree (SD) with each statement.

bias

Distortion of research data that renders the data suspect or invalid; may occur due to characteristics of the researcher, the respondent, or the research design itself.

internal consistency reliability

internal consistency reliability is the extent to which items in a single test are consistent among themselves & w/ the test as a whole

measurement

The process of quantifying or scoring performance on an assessment instrument.

stability

The degree to which scores on a test are consistent, or stable, over time. Also called test–retest reliability.

content validity

The degree to which a test measures an intended content area; it is determined by expert judgment and requires both item validity and sampling validity.

standard error of measurement

An estimate of how often one can expect errors of a given size in an individual’s test score.

rating scale

A measurement instrument used to determine a respondent’s attitude toward self, others, activities, institutions, or situations.

cognitive test

An assessment designed to measure intellectual processes.

diagnostic test

A type of achievement test that yields scores for multiple areas of achievement to facilitate identification of a student’s weak and strong areas.