kin 3502 exam 1

test

a written, oral, physiological, psychological, or mechanical instrument or tool

what does a test assess?

affective, cognitive, and psychomotor aspects

measurement

the act of assessment

quantitative

numeric data, uses tools and gadgets, and uses statistics for analysis

qualitative

non-numeric data, uses observations and interviews, and themes and descriptions for analysis

evaluation

a statement of quality, goodness, merit, value, or worthiness about what has been assessed

norm-referenced standards

a report of human performance compared to others

criterion-referenced standards

comparison of human performance relative to a standard or criterion

formative assessment

Assessment used throughout teaching of a lesson and/or unit to gauge students' understanding and inform and guide teaching

summative assessment

testing that follows instruction and assesses achievement

placement, diagnosis, prediction, motivation, achievement, and program evaluation

6 purposes of evaluation

placement

a test or evaluation to group individuals by ability, usually used early on; an initial evaluation used to determine group assignment

diagnosis

used to identify/determine weakness or deficiencies

prediction

predicting future events from present of past data, typically difficult

motivation

used to help challenge/stimulate someone to achieve a goal

achievement

a set of objectives that must be established to evaluate, requires summative evaluation

program evaluation

used to demonstrate achievement of program objectives, used to justify treatment, instruction, or training programs

knowledge, comprehension, application analysis, synthesis, evaluation

taxonomy of cognitive domain

receiving, responding, valuing, organizing, characterizing by a value complex

taxonomy of the affective domain

reflexive movements, fundamental movements, perceptual abilities, physical abilities, skilled movements, and nondiscursive movements

taxonomy of the psychomotor domains

program evaluation

epidemiologists are interested in testing the effectiveness of extensive physical activity only on the weekend and still achieving health benefits and reducing risk; their activities reflect which purpose of measurement?

CPR certification exam

example of a criterion-referenced standard

predicting future academic success

What is the purpose of measurement for the GRE?

they may actually be the same data in certain situations

what is true about data collected in formative and summative evaluations?

people

what are typically compared using a norm-referenced approach?

obtaining relevant information

what is the most important element in making effective decisions?

descriptive statistics

numerical data used to measure and describe characteristics of groups. Includes measures of central tendency and measures of variation; mathematics used to organize, summarize, and describe data

ratio, interval, ordinal, and nominal

scales of measurement in descriptive statistics

nominal scale

data used to label variables without using quantitative data; cannot be ordered or measured

ordinal scale

A scale of measurement using ranks rather than actual numbers; 1st, 2nd, and 3rd

interval scale

a scale of measurement in which the intervals between numbers on the scale are all equal in size, the difference between two values is meaningful and equal, and the presence of zero is arbitrary

ratio scale

measurement that has a natural, or absolute, zero and therefore allows the comparison of absolute magnitudes of the numbers

categories, ranking, arbitrary zero, positive scores

all data is:

ratio

Professional tennis player, Sam Groth, holds the record for the fastest tennis serve ever recorded at 163.4 miles per hour. Serve speed is an example of what type of measurement scale?

False

True or False: Ordinal scale variables can be added, subtracted, multiplied, or divided?

frequency

rate at which something occurs

distribution

how is the data spread; where is the data

histogram

A graph of vertical bars representing the frequency distribution of a set of data.

frequency polygon

graph of a frequency distribution that shows the number of instances of obtained scores, usually with the data points connect by straight lines

percentiles

represents the percent of observations at or below a given score, has a range from 0 to 100, and is norm-referenced

better

in the 26.2 percentile means you scored (better/worse) than 26.2% of people

sum of x / n

mean formula

median

the middle score of a range of values, or 50th percentile

average the two middle numbers

how to find the median when the n value is even

mode

the most frequently observed score

homogeneity

lower standard deviations indicate more \_________

nominal

political party affiliation is an example of which measurement scale?

skewness

shape on a histogram is indicative of \________

kurtosis

peakedness

Variability

the spread of dispersion of scores in a data set; the result of scores not all being identical

range

found by subtracting the low score by the high score; unstable

variance (s^2)

spread of scores based on squared deviation from mean; the most stable measure of variability

x - M(mean)

how to find the deviation score

observed, true, error, sample, between-subject, within-subject

types of variance

standard deviation

square root of the variance; takes into account every score

standard score

standardizing a set of observations/scores around a mean and standard deviation to allow for direct comparison

z-score

most fundamental standard score; have a mean score of 0 and a standard deviation of 1; expresses distance a score is from the mean

z\= X-M/s

how to find the z-score

percentiles

a z-table uses z-scores to find \__________

normal

a distribution around a given mean with a standard deviation that is mesokurtic, with no skewness

0

what is the variance if everyone in a classroom scores the same on the exam?

skewness; kurtosis

terms used to describe the shape or symmetry of a distribution and the peakedness of a distribution

correlation

a measure of relationship between two variables

correlation coefficient

denoted by r; an index of the linear relationship between two variables, which includes the magnitude and direction of the relationship

coefficient of determination

proportion of shared variance between two measures; the percentage of variance in one variable accounted for or shared by another variable

curvilinear relationship

an association among variables that can best be depicted by a curve

prediction

estimating the value of one variable from one or more variables; x predicts y to some degree

independent variable

the variable manipulated or controlled

dependent variable

the variable being tested and measured

error

represents the inaccuracy of our prediction of y based on the prediction equation

standard error of estimate (SEE)

reflects the average amount of error in predicting y from x

direction and strength

what does a correlation coefficient describe about the relationship between two variables?

subtracting predicted y from measured y

in a simple linear prediction, how do you find residual scores?

1. its a pure measure of a trait with the predictor statistically removed

why are residual scores important?

2. lack of fit, the independent variable does not predict the dependent variable

why are residual scores important?

3. pure error of the estimation or prediction

why are residual scores important?

1. truthful validity

how to select the best test:

2. consistent reliability

how to select the best test:

3. equal objectivity among observers

how to select the best test:

4. appropriate relevance

how to select the best test:

5. realistic feasibility

how to select the best test:

reliability

the degree to which repeated measurements of the same trait are reproducible under the same conditions

performer, test, testing situation, measurement process, evaluator(s), mode of statistical estimation

factors that affect reliability:

test-retest reliability, inter-rater reliability, intra-rater reliability

three main types of reliability:

test-retest reliability

measure of reliability for a specific measure when there are at least two data points

inter-rater reliability

also referred to as "objectivity", a measure of agreement between two or more raters

Objectivity

ensures data is collected without bias, depends on clarity of scoring system and degree to which judge can score accurately

Intra-rater reliability

measure of stability for one rater's scores when conducted on multiple assessments

a correlation (r) or intraclass correlation (ICC)

reliability is most commonly reported as:

1.0

in reliability, a score closer to \______ is best

validity

degree to which a test measures what it is meant to measure; degree of soundness or truthfulness; the most fundamental consideration in developing and evaluating tests

validity

\_______ is predicted on reliability

content validity

evidence of truthfulness based on logical decision making and interpretation; the use of an expert panel can help to establish this form of validity

criterion validity

evidence that a test has a statistical relationship with the trait being measured

concurrent validity

validity established by measuring the same construct using two different measures at the same time

predictive validity

validity established by examining the relationship between results at one point and results measured at some point in the future

construct validity

highest form of validity; combines logic with statistical evidence of validity to determine the existence of the theoretical construct being measured; the construct is typically observable

reliable

a valid test is \______

reliability; objectivity

\______ relates to consistency of scores, whereas \________ relates to consistency of scorers

false

True/False: a test can be unreliable and valid