Exam 3 QA

What does a reliable survey mean?

A reliable survey is free from measurement error.

Define validity in the context of surveys.

The degree to which the survey reflects or assesses the concept that a researcher is attempting to measure.

What are measurement errors in a survey?

Errors associated with how a survey performs in a particular population.

What are random errors?

Random errors are those that are unpredictable.

What is the scientific method?

A process that scientists use to generate knowledge.

What are surveys used for?

Surveys are instruments used to collect important information from individuals.

What do surveys help to describe?

Surveys collect information that enable us to describe and compare people’s attitudes, knowledge, and behaviors.

How is the response rate calculated?

The number of individuals who responded to the survey divided by the total number of individuals to whom the survey was sent.

What is external validity?

Extent to which the survey results obtained from a sample are generalizable to a larger population.

What is a meta-analysis?

Combines the results of multiple studies into a single, larger analysis.

What is synthetic validity?

Statistically combines validity coefficients from tests measuring a variety of job-related attributes to estimate their combined validity in a new job.

Define transportability in testing.

A case is made that because a test has been shown to be valid for a particular use, it can be presumed to also be valid for another, similar use.

What is adverse impact?

Exclusion of a disproportionate number of persons in a group protected by federal law.

What is a construct in testing?

Concept that a test is designed to measure.

What does the testing universe refer to?

Body of knowledge or behaviors that the test represents.

Who is the target audience for a test?

Group of individuals who will take the test.

What is the purpose of a test?

What the test will measure and how test scores will be used.

What do cognitive tests measure?

Assessments that measure mental capabilities.

What do integrity tests assess?

Tests that measure honesty and integrity.

How do surveys and psychological tests differ?

Surveys focus on group outcomes; psychological tests focus on individual outcomes.

What is the first step of the scientific method?

Ask a question.

What is the second step of the scientific method?

Form a hypothesis.

What is the third step of the scientific method?

Conduct research or experiment.

What is the fourth step of the scientific method?

Analyze data.

What is the fifth step of the scientific method?

Draw conclusions.

What is the first phase of a survey?

Define the problem.

What is the second phase of a survey?

Design the survey.

What is the third phase of a survey?

Collect the data.

What is the fourth phase of a survey?

Code, enter, and analyze the data.

What is the fifth phase of a survey?

Present the findings.

What is content validity?

Extent to which a test covers the full domain of the construct.

What is construct validity?

Extent to which a test measures the theoretical construct.

What is criterion-related validity?

Extent to which a test predicts an outcome.

What is face validity?

Extent to which a test appears to measure what it is supposed to measure.

What is internal validity?

Extent to which the study accurately measures what it intends within the study.

What is test-retest reliability?

Extent to which scores remain stable over time.

What is split-half reliability?

Extent to which two halves of a test are consistent.

What are the six methods of acquiring knowledge?

Include tenacity, intuition, authority, rationalism, empiricism, and the scientific method.

What is tenacity?

Tenacity refers to the persistent grip or determination to hold onto a belief or idea despite challenges.

What is intuition?

Intuition is acquiring information without reasoning, often based on personal belief.

What is authority?

Authority refers to the power or right to make decisions and enforce rules.

What is rationalism?

Rationalism is the belief that knowledge is gained through reason and logical deduction.

What is empiricism?

Empiricism is the theory that knowledge comes from sensory experience.

Purpose of experimental research techniques

To create a test that may determine cause and effect.

Purpose of descriptive/correlation-based research techniques

To describe relationships between variables without establishing causation.

What are operational definitions?

They are specific behaviors that represent the purpose.

What are non-sampling measurement errors?

Errors associated with the design and administration of the survey

Types of probability sampling

Include simple random sampling, stratified random sampling, and cluster sampling

What is one example of non-probability sampling?

Convenience sampling.

Homogeneity of the population

How similar the people in your population are to one another.

3 primary reasons to develop a new test?

To improve measurement accuracy, to address new constructs, and to enhance relevance for current populations.

First step in test development includes

Defining the Testing Universe, defining the Target Audience, and defining the Test Purpose