PSYC-2018 LEC 1: Comprehensive Psychology Research Methods and Critical Thinking Notes

Course Purpose and Rationale

• The course emphasizes foundational knowledge to read and evaluate psychology research critically.

• Core skill: ability to think about what makes research good or weak, and to explain research processes with discipline-specific terminology.

• This skill, paired with statistics, is what employers value in psychology graduates.

• Even for students not pursuing psychology careers, the course builds critical thinking about information in everyday life to avoid being duped by unsupported or biased claims.

Course Goals and Learning Outcomes

• Understand how psychological research is conducted to answer questions about human behavior and thoughts.

• Learn to evaluate a simple research scenario and identify the variables involved, including the importance of operational definitions.

• Assess whether findings are trustworthy and meaningful.

• Discuss advantages and disadvantages of different research designs.

• Develop the ability to think critically about research in psychology and communicate findings clearly.

Core Course Values (Four Key Principles)

• Well-being matters for learning:

  • If you’re hungry, sleepy, or overwhelmed, learning is hindered. Prioritize sleep, food, social connections, and some exercise.

  • The instructor has built flexible expectations (e.g., assignment windows; deadlines around ten-to-ten Fridays) to support student well-being.

• Compassion and respect: treat others with kindness and assume best intentions, while maintaining high personal standards.

• Accountability: research variability is normal; mistakes happen. Own up to errors and learn from them.

• Engagement and active learning: expect interactive lectures, polls, activities, labs, and opportunities to discuss ideas in smaller groups. Your participation is essential to learning. Resources are provided to support growth, not punishment.

Course Structure and Assessments

• Course includes two lab assignments during regularly scheduled lab hours; assignments are graded for completion to encourage testing knowledge and identifying gaps.

• Short answer questions on exams may take various forms: fill-in-the-blank, data tables, or evaluation of a snippet of a research article.

• Active learning activities weekly, varying by week and format (some during lectures, some during labs).

• Activities submitted via CrowdMark with a Blackboard link each week.

• Ethics training (required for researchers in Canada) will be completed; ethics content is covered after the first midterm.

• Labs provide smaller-group interaction opportunities to deepen understanding.

Research Foundations: How We Acquire Knowledge

• External validity: does the finding generalize beyond the specific study’s context (time, place, population)? We will examine whether results hold outside the original study.

• Demonstrate that there cannot be another explanation for a observed effect unless the study design accounts for it.

• Third-variable problem (confounds): two variables may appear related because both are related to a third variable.

• An example often discussed in class: ice cream production and drowning deaths rise together; the underlying third variable is the season (summer).

  • This illustrates that correlation does not imply causation because of potential confounds.

  • Formal framing: if two variables X and Y co-vary due to a third variable Z, then X and Y may appear related even if there is no direct causal link.

• A key term introduced: third variable (Z) as a confound or lurking variable.

Evaluating Evidence and Skepticism in Psychology

• Readers should question claims presented as research findings and assess supporting data rather than accepting statements at face value.

• A key contrast: intuition vs. evidence. Intuition can be fast but biased; data-driven conclusions require systematic evaluation.

• The role of authorities:

  • People may be trusted for reasons unrelated to expertise (popularity, attractiveness, etc.).

  • Even experts can fall prey to biases; critical evaluation remains essential.

• Illusory correlation: the mistaken belief that two things are related when they are not, often due to biased processing or selective attention.

• Kids and trust: children may trust popular figures or in-group members, illustrating that credibility judgments can be biased by popularity rather than evidence.

• Experience alone is insufficient for establishing truth because it may not test alternative explanations.

• Logic vs. intuition:

  • Logic provides a clear, reproducible path from premises to conclusions and is easy to critique because steps are explicit.

  • Intuition is harder to critique because it can be abstract and subjective, though it can be compelling.

The Scientific Method in Psychology

• The scientific method offers objectivity and repeatability but is not perfect; research can be constrained by budgets, resources, and design limitations.

• Typical trajectory of psychological research from idea to publication is long:

  • It often takes $2-5-10$ years from concept to journal publication due to literature reviews, pilot testing, multiple iterations, handling non-normal data, and refining analyses.

• Research process overview:

  • Develop idea and conduct literature review.

  • Design study and run it; if initial results fail to support hypotheses, revise and rerun.

  • Consider alternative explanations and test them with additional analyses.

  • Conduct advanced analyses as needed to handle distributional issues (e.g., non-normal data).

  • Write the paper; submit to a journal; the publication process can add years.

• Article structure: the paper typically includes an abstract, introduction, methods, results, discussion; the introduction should restate the research question and summarize general findings; a well-written paper aligns the abstract and introduction with the study’s aims.

• The course emphasizes recognizing that there are many places in a paper where previews or summaries of the research question and findings appear, and that a reader can consult various sections to extract the same information.

Examples to Ground Concepts

• Hinge study example: research on dating apps suggests that liking specific profile elements (e.g., particular pictures or prompts) plus adding a comment increases compatibility and dating success more than liking a profile in general.

  • This example highlights the type of claims researchers may ask you to evaluate and the importance of examining what is being claimed and what evidence supports it.

• The role of claims about intuition and expertise:

  • Intuition can be biased by prejudices and quick judgments that may be wrong.

  • The authority bias cautions us to consider whether popular or attractive sources truly have the best evidence.

• The logic example: Venn diagram-style reasoning to illustrate subset relations:

  • If all mammals are animals and all humans are mammals, then all humans are animals.

  • Symbolically: if $ext{Humans} \subseteq ext{Mammals} \subseteq ext{Animals}$, then $ext{Humans} \subseteq ext{Animals}$.

• The abstract nature of logic is contrasted with the concrete, real-world ease of jumping to gut feelings, underscoring the value of structured evidence.

Operational Definitions and Variables

• Operational definitions: specify exactly how variables will be measured or manipulated in a study so that others can replicate the work.

• Variable identification: the course teaches you to identify independent, dependent, and control variables in research scenarios and to assess how well these variables capture the intended concepts.

Practical Implications and Real-World Relevance

• The course helps you:

  • Read research critically and identify the strengths and limitations of studies.

  • Communicate about research findings clearly using discipline-specific terminology.

  • Conduct basic investigations and possibly contribute to further research in the future.

  • Prepare for future course work that requires reading and evaluating scholarly articles.

Ethical Considerations

• Ethics training is mandatory for researchers in Canada and will be completed during the course (post-first midterm).

• Emphasis on treating research participants with respect and on reporting findings accurately and responsibly.

Connections to Foundations and Real-World Relevance

• The syllabus connects to foundational principles of scientific inquiry: falsifiability, replication, and critical appraisal of evidence.

• Emphasis on applying these principles to everyday information, media claims, and consumer technology claims (e.g., dating apps, social influence).

Examination Preparation Tips

• Expect short answer questions: definitions, concept explanations, and interpretation of snippets from research.

• Be able to explain:

  • Operational definitions, independent vs. dependent variables, and study design trade-offs.

  • External validity and potential third-variable confounds.

  • The difference between intuition-based judgments and evidence-based conclusions.

  • The stages of the research process from idea to publication, including typical timelines.

• Review the Hinge example, illusory correlation, and the mammal/animal subset logic example to illustrate key points.

Quick Reference Terms and Concepts

• External validity: $ext{generalizability of findings beyond the study context}$

• Third variable (confound): a variable that influences both the purported cause and the effect, potentially creating a spurious association.

• Illusory correlation: the mistaken perception of a relationship between two variables where none exists.

• Operational definition: precise, replicable description of how a variable is measured or manipulated.

• Independent variable (IV) and dependent variable (DV): core components in experimental design.

• Competing explanations: alternative hypotheses that must be tested to rule out non-causal accounts.

• Logic in science: a structured, transparent sequence of reasoning steps from premises to conclusions.

• Scientific method: the systematic process of inquiry, including planning, data collection, analysis, and reporting, with recognition of real-world constraints.

• Academic publishing timeline: typically lengthy due to literature review, replication, data analysis, writing, peer review, and revisions.

• Ethics training: mandatory governance for responsible conduct of research.

Note: The above notes mirror the key ideas, examples, and instructional emphases from the transcript, including specific examples (ice cream and drowning, Hinge study), core concepts (external validity, third-variable problem, illusory correlations), logical structures (subset relationships), and practical course logistics (labs, assignments, deadlines, and ethics training). If you’d like, I can convert these notes into a printable study guide or create a condensed revision sheet focused on exam-ready definitions and short-answer prompts.

Course Purpose

• To develop foundational knowledge for critically evaluating psychology research.

• Core Skill: Analyzing research quality and explaining processes using discipline-specific terminology.

• Valuable for careers in psychology and for critical thinking in everyday life.

Course Goals & Learning Outcomes

• Understand research methods in psychology.

• Evaluate research scenarios, identify variables, and use operational definitions.

• Assess research findings for trustworthiness and meaning.

• Discuss advantages and disadvantages of different research designs.

• Develop critical thinking and clear communication about psychological research.

Core Course Values

1. Well-being matters for learning:

   • Prioritize sleep, food, social connections, and exercise.

   • Flexible expectations (e.g., assignment windows) support student well-being.

2. Compassion and respect:

   • Treat others kindly, assume best intentions, maintain high personal standards.

3. Accountability:

   • Errors are normal; own mistakes and learn from them.

4. Engagement and active learning:

   • Expect interactive lectures, polls, activities, labs, and group discussions.

   • Participation is essential; resources support growth.

Course Structure and Assessments

• Lab Assignments:

  • Two assignments during lab hours, graded for completion.

• Exams:

  • Short answer questions (fill-in-the-blank, data tables, research article evaluation).

• Active Learning Activities:

  • Issued weekly (lectures/labs), submitted via CrowdMark link on Blackboard.

• Ethics Training:

  • Required for Canadian researchers; completed after the first midterm.

• Labs:

  • Provide smaller-group interaction and deeper understanding.

Research Foundations: Knowledge Acquisition

• External Validity:

  • Does a finding generalize beyond the study context (time, place, population)?

• Third-Variable Problem (Confounds):

  • Two variables (X, Y) may appear related because both are linked to a third variable (Z).

  • Example: Ice cream production and drowning deaths rise together; the confound (Z) is the season (summer).

  • Correlation does not imply causation due to potential confounds.

  • Formal framing: If X and Y co-vary due to Z, they may seem related without a direct causal link.

  • Key Term: third variable (Z) as a confound or lurking variable.

Evaluating Evidence & Skepticism

• Question Claims:

  • Assess supporting data; don't accept statements at face value.

• Intuition vs. Evidence:

  • Intuition: fast, but biased. Evidence: data-driven, systematic.

• Role of Authorities:

  • Trust can be based on popularity/attractiveness, not expertise.

  • Experts can have biases; critical evaluation remains crucial.

• Illusory Correlation:

  • Mistaken belief that two unrelated things are connected, often due to biased processing.

  • Children may trust popular figures over evidence.

• Experience Alone:

  • Insufficient for truth; may not test alternative explanations.

• Logic vs. Intuition:

  • Logic: clear, reproducible (easy to critique step-by-step).

  • Intuition: abstract, subjective (harder to critique, but can be compelling).

The Scientific Method in Psychology

• Principles:

  • Aims for objectivity and repeatability (not perfect; constrained by resources).

• Typical Trajectory (Idea to Publication):

  • Often takes $2-5-10$ years due to literature reviews, pilot testing, iterations, data handling, and analysis refinement.

• Research Process Overview:

  1. Develop idea, conduct literature review.

  2. Design and run study (revise/rerun if hypotheses unsupported).

  3. Consider and test alternative explanations.

  4. Conduct advanced analyses for distributional issues (e.g., non-normal data).

  5. Write paper, submit to journal (publication process adds years).

• Article Structure:

  • Abstract, Introduction, Methods, Results, Discussion.

  • Introduction restates research question and summarizes general findings.

  • Abstract and introduction should align with study aims.

  • Readers can extract information from various sections.

Examples to Ground Concepts

• Hinge Study:

  • Liking specific profile elements + adding comment increases dating success (highlights evaluating claims and supporting evidence).

• Intuition & Expertise:

  • Intuition can be biased by prejudices.

  • Authority Bias: Cautions regarding popular/attractive sources (do they have the best evidence?).

• Logic Example (Venn Diagram):

  • If $\text{Humans} \subseteq \text{Mammals} \subseteq \text{Animals}$, then $\text{Humans} \subseteq \text{Animals}$.

  • Contrasts abstract logic with concrete, intuitive leaps (underscores value of structured evidence).

Operational Definitions & Variables

• Operational Definitions:

  • Specify how variables are measured/manipulated for replication.

• Variable Identification:

  • Learn to identify independent, dependent, and control variables.

  • Assess how well variables capture intended concepts.

Practical Implications

• Critically read research and identify strengths/limitations.

• Communicate research findings clearly using discipline-specific terminology.

• Conduct basic investigations.

• Prepare for future coursework requiring scholarly article evaluation.

Ethical Considerations

• Mandatory ethics training for Canadian researchers (post-first midterm).

• Emphasizes respect for participants and accurate reporting of findings.

Connections to Foundations

• Links to scientific inquiry principles: falsifiability, replication, critical appraisal of evidence.

• Apply principles to everyday information, media, and consumer claims.

Examination Preparation Tips

• Expect short answer questions:

  • Definitions, concept explanations, interpretation of research snippets.

• Be able to explain:

  • Operational definitions, IV vs. DV, study design trade-offs.

  • External validity, third-variable confounds.

  • Intuition-based vs. evidence-based conclusions.

  • Stages of the research process and timelines.

• Review specific examples:

  • Hinge study, illusory correlation, mammal/animal logic example.

Quick Reference Terms and Concepts

• External validity: $\text{generalizability of findings beyond the study context}$.

• Third variable (confound): A variable influencing both purported cause and effect, creating a spurious association.

• Illusory correlation: Mistaken perception of a relationship where none exists.

• Operational definition: Precise, replicable description of how a variable is measured or manipulated.

• Independent variable (IV) and dependent variable (DV): Core components in experimental design.

• Competing explanations: Alternative hypotheses that must be tested.

• Logic in science: Structured, transparent reasoning from premises to conclusions.

• Scientific method: Systematic inquiry process (planning, data collection, analysis, reporting), recognizing constraints.

• **Academic publishing timeline