Senior sem exam 1

Which type of criterion-based validity is made when two measures of the same variable are obtained within a close period of time? _____________________________

concurrent validity

The extent to which a test or test item measures what it is supposed to measure is the definition of _____________________.

validity

____________ is a measure of the degree of consistency or repeatability of a test.

reliability

The degree to which small differences can be detected is known as __________________.

sensitivity

The degree to which a study can establish a cause-and-effect relationship between the treatment and the observed outcome is known as __________________.

internal validity

The extent to which the results of a study may be generalized to other populations, settings, or treatments is known as ________________________.

external validity

____________________________ is a threat to internal validity referring to the loss or dropout of subjects in a study.

experimental mortality

Which type of validity is established when attempting to measure the extent to which how well a test measures a theoretical attribute that cannot be directly observed (e.g. motivation, fear, enthusiasm)? ____________________.

construct validity

When a measurement is made on a subject, the result is called an _________________, which is a combination of the _____________________ that represents the subject’s real score and the ______________________, due to any mistake in data collection.

observed score; true score; error score

__________________________ is a measure of reliability used to determine the consistency of scores obtained by 2 or more different test administrators, illustrating uniformity among the data collection procedures.

inter-rater reliability

When a control group receives a false treatment while the experimental group receives the real treatment, the control group has been given a _______________.

placebo

Administering the same test on 2 or more occasions is a way of establishing which subset measure of reliability? ____________________________

inter-rater reliability

Which threat to internal validity refers to the behavioral effect introduced on research subjects when they know they are being observed? ___________________________

Hawthorne effect

Which type of criterion-based validity is made when estimating the occurrence of some future event through the present use of a test or instrument? _________________________

predictive validity

The _____________________ refers to the threat to internal validity when a researcher has some expectation about the performance of a subject.

Halo Effect

A _________________________ study occurs when both subject and researcher do not know who receives a given treatment.

Double blind

________________ variables are uncontrolled factors other than the independent variable that that may influence the measures of the dependent variable, thus negatively impacting internal validity.

Confounding

The chance placement of subjects into groups so that the groups do not differ at the beginning of the experiment is known as ____________________________.

Randomization

A group of subjects that is similar to the experimental group except that they do not receive the experimental treatment is known as the _________________________.

control group

_______________________________ is the threat to internal validity in which an extreme performance on a test is followed by a less extreme performance.

Statistical regression

_________________ refers to the consistency of the test administrator during data collection.

objectivity

The _____________________ is the detrimental effect on health produced by psychological or psychosomatic factors such as negative expectations of treatment or prognosis.

Nocebo Effect

The most accurate & definitive measure of a variable is known as the __________________.

criterion measure

_____________________ is the threat to internal validity that refers to the physiological processes occurring within the participants that could account for any changes in their behavior.

maturation

___________________________ is a measure of the day to day stability of the same test administrator, illustrating the consistency of data collection procedures.

intra-rater reliability

The gold standard study design that is most robust and least prone to bias is the ______________________________.

randomized controlled trial

At the top of the research/evidence hierarchy are ____________________, which collect, review, and summarize all empirical evidence that fits pre-specified eligibility criteria, and ___________________, which is a statistical procedure for combining data from multiple studies.

systematic reviews; meta-analyses

This type of longitudinal/prospective observational study design tracks the same groups of people over an extended period of time

cohort study

This type of observational study is retrospective, starting with an end point and works backward, figuring out what might have caused that outcome.

case-control study

This type of observational study assesses information about a population at one point in time _________________

cross-sectional study

When a measurement is made on a subject, the result is called an _________________, which is a combination of the true score that represents the subject’s real score, and the error score, due to any mistake in data collection. 

Observed Score

his threat to external validity occurs when the unique characteristic of the subjects in a study makes the treatment effective only for those that possess that trait.

subject and treatment interaction

The extent to which the results of a study may be generalized to different conditions or subjects is known as ________________________.

external validity

__________________________ is a measure of reliability used to determine the consistency of scores obtained by 2 or more different test administrators, illustrating uniformity among the data collection procedures. 

inter-rater reliability

The extent to which an instrument measures what it is intended to measure is known as

validity

____________ is a measure of the degree of consistency or repeatability of a test. 

reliability

_______________ validity is the weakest type of validity because all that can be said is that it appears to be obvious that the test or device is measuring what it is supposed to measure.

Face

This threat to external validity occurs when a research introduces more than one experimental variable, risking the treatments inhibiting or enhancing each other.

Multiple Treatment Interference

The most accurate & definitive measure of a variable is sometimes referred to as the __________________, aka the gold standard

criterion measure

This threat to external validity is concerned with when pre-testing subjects, it may alter their perception of the experimental treatment and motivate them to perform better than if they had not been exposed to the pre-test.

reactive effects of pre-testing

___________________________ is a measure of the day to day consistency of the same test administrator, illustrating the consistency of data collection procedures. 

intra-rater reliability

This threat to external validity is whether a subject will perform in the same manner under experimental conditions as they would in the real world.

artificial nature of experimental condition

Administering the same test on 2 or more occasions via the test-retest method, is a way of establishing which subset measure of reliability? ____________________________ 

stability

True or false, a test can be reliable, but not valid.

True

__________________________ is a type of statistical validity in which a proposed test is compared to a criterion standard within a close period of time to establish its accuracy

concurrent

______________________________  is the extent to which a score on a scale or test predicts scores on some criterion measure.

Predictive validity

_________________ refers to the consistency of the test administrator during data collection. 

objectivity

_________________________ of measurement is the degree to which small differences can be detected

Sensitivity

_______________ is the extent to how well a test measures a theoretical attribute that has no definitive criterion, is difficult to measure, or cannot be directly observed.

construct validity

True or False, If a measurement is valid, its scores will be reliable.

True

Measures of ____________________________ are established when the results of one test are compared with the results obtained when using an accepted standard or criterion.

Criterion-based validity

The degree to which a study establishes the cause-and-effect relationship between the treatment and the observed outcome is known as ______________

internal validity

The chance placement of subjects into groups so that the groups do not differ at the beginning of the experiment is known as ____________________________.

Randomization

_______________________ is the threat to internal validity in which an extreme performance on a test is followed by a less extreme performance.

Regression to the mean

An in-depth analysis of a unique condition or situation to reach a greater understanding about other similar situations is known as a _________________.

Case study

The major difference between an experimental and an observational study is that an experimental study can determine cause and effect, whereas an observational study cannot

True

The conscientious, explicit and judicious use of best current evidence in
decision making is known as what?

evidence-based practice

Which of the following would be given the rank of the highest form of evidence?

Experimental research

If a practitioner wishes to be evidence-based, the three major areas needed to integrate are 1) best research evidence 2) clinical expertise, and 3) patient values and preferences

True

The major limitation to non-experimental studies is that they cannot determine cause and effect.

True

True or False? An observational study design has less potential for bias than a randomized controlled trial (RCT).

False

The extent to which the results of a study can be attributed to the treatments used in the study is the definition of what kind of validity?

internal

In evaluating the method section of a research report, which is a very important question to keep in mind?

Did the author provide enough information that the study could be repeated?

A _____________________ is a proposed explanation for a phenomenon made as a starting point for further investigation.

hypothesis

The generalizability of the results pertains to what kind of validity?

External

The ability of an entire experiment or study to be duplicated, either by the same researcher or by someone else working independently is known as ________________.

replication

A _________________________ is a well-substantiated explanation, acquired through the scientific method, that has been repeatedly tested and confirmed through observation and experimentation.

Theory