2.1 - PSY121
Chapter Two: Reading and Evaluating Scientific Research
2.1 Principles of Scientific Research
Five Characteristics of Quality Scientific Research
Objectivity of Measurements:
Measurements must be objective, valid, and reliable.
Example: Weight is measured in pounds or kilograms, ensuring consistency.
Generalizability:
Research findings can be applied to broader contexts beyond the specific sample studied.
Minimization of Bias:
Techniques must be employed to reduce bias in the research process.
Public Access:
Research findings should be made public for scrutiny and further study.
Replicability:
Other researchers should be able to replicate the findings under similar conditions.
Importance of Scientific Research:
Aims to foster critical thinking and enable individuals to differentiate between sound research and flawed studies.
He's a method for assessing claims made by various entities in society: media, corporations, etc.
Objectivity in Research
Scientific research strives for objectivity, defined as the ability of different observers to agree on recorded observations.
Subjectivity occurs when interpretations are influenced by personal beliefs or emotional states.
Scientific Measurement Definitions
Variables: Objects, concepts, or events that are controlled, manipulated, or measured—e.g. anxiety.
Operational Definitions: Precise definitions of variables that clarify how they will be measured; for example, defining depression using a specific score on a recognized questionnaire.
Validity and Reliability
Validity: The extent to which an instrument measures what it claims to measure.
Reliability: The consistency and stability of measurements over time across different instances (e.g., Test-retest reliability and alternate forms reliability).
Inter-Rater Reliability: Consistency among different scorers or observers rating the same outcome.
Generalizability of Results
Generalizability: Refers to how well research results apply to broader populations.
Use of a Random Sample ensures that every member of a population has an equal chance of being included, enhancing generalizability.
Research should have Ecological Validity, meaning that the results are applicable to real-life settings.
Sources of Bias
Researcher Bias: Bias from the individual's treatment of participants can skew results.
Subject Bias: Influences from participants who might act differently due to awareness of being observed (e.g. Hawthorne Effect).
Social Desirability: The tendency of participants to respond in a manner that would be viewed favorably.
Demand Characteristics: Cues from the experimenter that indicate how participants are expected to behave.
2.2 Scientific Research Designs
Descriptive Research
Involves observing and describing the behavior of a subject without manipulation.
Case Studies
Intense analysis of an individual, group, event, or situation to gain insights and understanding regarding complex phenomena.
Correlational Research
Examines the relationship between two variables to understand how they may influence each other; does not imply causation.
Experimental Research
Involves manipulating one variable to determine if changes cause alterations in another variable; establishes causal relationships.
Random assignment is often employed to control for confounding variables.
2.3 Ethics in Psychological Research
Welfare of Research Participants
Ethical considerations prioritize the well-being and rights of participants in research.
Informed consent is essential for participation, ensuring that volunteers understand their rights and the nature of the study.
Animal Models of Disease
Ethical treatment in research involving animals includes minimizing pain and distress.
Data Management
Ethical collection, storage, and reporting of data are critical to safeguard participant confidentiality and integrity of research data.
2.4 A Statistical Primer
Descriptive Statistics
Statistics that summarize and describe the characteristics of a data set.
Hypothesis Testing
A systematic method to determine if the research findings support the hypotheses. Includes setting a significance level (such as p < 0.05).
Statistical Significance
A mathematical measure of how likely it is that an observed result could have occurred by chance alone.
Findings are considered statistically significant when the probability of a result happening by random chance is lower than a pre-determined threshold (often 0.05).
Learning Objectives
Learning Objective 2.1a
Understand key terminology associated with scientific research principles.
Learning Objective 2.1b
Comprehend the five characteristics of quality scientific research:
Measurements are objective, valid, and reliable.
Research can be generalized.
Research employs techniques to reduce bias.
Findings are made public.
Results can be replicated.
Learning Objective 2.1c
Recognize how biases might influence research outcomes.
Demand characteristics often affect participant honesty in responses.
Learning Objective 2.1d
Apply reliability and validity concepts to real scenarios, assessing measurement quality.
Learning Objective 2.1e
Evaluate the reliability of anecdotal evidence, authority claims, and common sense.
Anecdotes are not sufficient proof unless supported by solid research data.
Five Characteristics of Poor Research
Untestable Hypotheses: Claims that cannot be proven false.
Anecdotal Evidence: Individual stories or testimonies without scientific basis.
Biased Selection of Data: Cherry-picking data that supports a claim while ignoring contradicting information.
Appeal to Authority: Relying on expert opinion without evidence.
Common Sense Appeals: Claims based on assumptions without scientific support.
Conclusion
Engage with scientific research critically and skeptically, especially concerning claims made by media, corporations, and authorities.