Exam 3 QA

Reliability A reliable survey is free from measurement error.

Validity The degree to which the survey reflects or assesses the concept that a researcher is attempting to measure.

Measurement Error Errors associated with how a survey performs in a particular population.

Random Error Random errors are those that are unpredictable.

Scientific Method A process that scientists use to generate knowledge.

Survey Surveys are instruments used to collect important information from individuals.

Survey (Expanded) Surveys are research tools that collect information that enable us to describe and compare people’s attitudes, knowledge, and behaviors.

Response Rate The number of individuals who responded to the survey divided by the total number of individuals to whom the survey was sent.

External Validity Extent to which the survey results obtained from a sample are generalizable to a larger population.

Meta-analysis Combines the results of multiple studies into a single, larger analysis.

Synthetic Validity Statistically combines validity coefficients from tests measuring a variety of job-related attributes to estimate their combined validity in a new job.

Transportability A case is made that because a test has been shown to be valid for a particular use, it can be presumed to also be valid for another, similar use.

Adverse Impact Exclusion of a disproportionate number of persons in a group protected by federal law.

Construct Concept that a test is designed to measure.

Testing Universe Body of knowledge or behaviors that the test represents.

Target Audience Group of individuals who will take the test.

Test Purpose What the test will measure and how test scores will be used.

Cognitive Tests Assessments that measure mental capabilities.

Integrity Tests Tests that measure honesty and integrity.

Survey vs Psychological Test (Survey) Focus on group outcomes; results reported at the question level.

Survey vs Psychological Test (Psychological Test) Focus on individual outcomes; results reported as overall or scaled scores.

Scientific Method Step 1 Ask a question.

Scientific Method Step 2 Form a hypothesis.

Scientific Method Step 3 Conduct research or experiment.

Scientific Method Step 4 Analyze data.

Scientific Method Step 5 Draw conclusions.

Survey Phase 1 Define the problem.

Survey Phase 2 Design the survey.

Survey Phase 3 Collect the data.

Survey Phase 4 Code, enter, and analyze the data.

Survey Phase 5 Present the findings.

Content Validity Extent to which a test covers the full domain of the construct.

Construct Validity Extent to which a test measures the theoretical construct.

Criterion-Related Validity Extent to which a test predicts an outcome.

Face Validity Extent to which a test appears to measure what it is supposed to measure.

Internal Validity Extent to which the study accurately measures what it intends within the study.

Test-Retest Reliability Extent to which scores remain stable over time.

Split-Half Reliability Extent to which two halves of a test are consistent.