Notes on Critical Thinking & Research Methods

Critical Thinking and Research Methods: Comprehensive Notes

• Introduction to critical thinking

  • Critical thinking involves questioning why we do what we do in different circumstances.
  • Example: Why do we shake hands as a greeting?
  • Purpose: to greet people.
  • Justification: it's considered respectful.
  • Potential critique: hands can be dirty; questioning the origin of this practice.
  • Devil’s advocate exercise: historical origins of social practices can be arbitrary and subject to change.
  • Cross-cultural greetings: in France, people kiss as a greeting; some cultures do not touch at all (e.g., during COVID, six feet rule).
  • Core idea: many everyday routines are historically contingent and not always deeply understood in modern contexts.

• Ethical and practical implications of practices in science

  • In science, animal studies are common, especially to understand diseases and test treatments.
  • Common practice: induce diseases in animals (e.g., cancer, brain disorders) to study symptoms and potential cures for humans.
  • Ethical tension: involves harming animals for potential human benefits; described as a possible “necessary evil.”
  • The dialogue invites weighing human benefits against animal welfare and broader ethical considerations.
  • Some argue that humans value humans over animals; others challenge this with religious or philosophical reasoning (e.g., dominion over Earth in the Bible) and contemporary bioethics.
  • Real-world relevance: laws and regulations governing animal research change with public policy and voting; strict welfare protections exist and most animals are well protected.
  • Practical data about rats in research:
  • In the wild, rats have an average lifespan of about
    $2 ext{ years}$, not the exaggerated number discussed in the talk. (The speaker initially says ten years, then corrects that rats typically live about two years in the wild; laboratory rats live somewhat longer, around $3 ext{ years}$ on average.)
  • Key takeaway: animal research has saved millions of human lives, but it requires ongoing ethical scrutiny and regulatory compliance.
  • Broader questions to consider: should we pursue advanced modeling (e.g., AI) and experimentation on animals given evolving laws and ethical standards?
  • The talk emphasizes critical evaluation: look to what experts say, not just gut feelings, and be aware of biases when interpreting controversial topics.

• The scientific method: parallels to everyday reasoning

  • Core stages:
  • Observation: identifying phenomena of interest (e.g., dating, attractiveness).
  • Theory: seeking explanations to predict outcomes.
  • Hypothesis: testable statement derived from the theory.
  • Operational definitions: precise, measurable definitions of variables used in research.
  • Replication: ensuring results are reproducible across studies.
  • The process aims to build a body of literature; multiple studies support robust conclusions.
  • The session emphasizes checking sources, avoiding overreliance on gut feelings, and verifying information with expert evidence.
  • Important related concerns:
  • Deepfakes and misinformation: increasing prevalence of fake videos and misleading claims; emphasizes the need for critical evaluation before acceptance.

• Descriptive research (describing phenomena)

  • Key methods:
  • Case studies: in-depth analyses of unique or rare cases (e.g., Victor the Wolf Boy; Anna Freud’s historical work). Often cannot be replicated exactly; used to generate hypotheses.
  • Naturalistic observation: observing behavior in natural settings without manipulation (e.g., Jane Goodall’s chimpanzee studies).
  • Surveys: questionnaires and interviews to gather data from a sample; careful wording is critical to avoid biased responses.
  • Important methodological considerations:
  • Wording effects: question phrasing can steer responses; avoid jargon that is not widely understood (grandparents’ literacy and language changes matter).
  • Sampling: avoid bias from using only friends/family; aim for diverse, representative samples to avoid the false consensus effect.
  • False consensus effect: the bias where people assume others share their beliefs more than they actually do.
  • Population scope: decide whether to study a specific subgroup (e.g., East Texas) or a broader population (e.g., all of America) and use random sampling when possible.
  • Anthropomorphism and observer bias: naturalistic observers may project human traits onto animals; acknowledge bias and report objective observations.
  • Practical applications and caveats:
  • Case studies can provide rich, qualitative insights but lack generalizability.
  • Surveys provide breadth but depend on careful design and sampling.
  • Naturalistic observations require rigorous note-taking and bias minimization; observer bias can color interpretations of animal and human behavior.
  • Relevance to critical thinking: descriptive research helps generate ideas and hypotheses that can later be tested with correlational or experimental designs.

• Correlational research (relationship between variables)

  • Purpose: determine how related two variables are and how well they predict each other.
  • Example used: entrance exams (ACT/SAT) predicting college performance. Note: not perfect; some individuals perform well in college despite lower standardized test scores.
  • Positive correlation: as one variable increases, the other tends to increase (e.g., higher ACT/SAT scores often correlate with better college performance).
  • Data representation: scatter plots visualize relationships among data points (each dot represents a participant or observation).
  • Important caveat: correlation does not imply causation.
  • Illusory correlations: people may perceive a relationship where none exists (e.g., thunder souring milk; or a superstition that wearing lucky underwear improves performance).
  • Superstitions and confirmation bias:
  • People may engage in rituals (lucky underwear, specific pre-game actions) and perceive them as affecting outcomes, though no causal link exists.
  • Confirmation bias: tendency to seek or interpret information in a way that confirms preexisting beliefs; important to seek alternative explanations and evidence.
  • Pattern-seeking in randomness: humans often look for order in random events (chaos theory mention); patterns can be spurious.
  • Example data interpretation:
  • A scatter plot of arm strength vs grip strength shows a general positive trend, but it is not a perfect one-to-one mapping; some individuals excel in one measure and not the other.
  • Key caution: beware illusory correlations and biases when interpreting relationships; remember that prediction does not require causation.

• Experimental research (causal inference)

  • Core aim: determine whether an independent variable (IV) causes a change in a dependent variable (DV).
  • Experimental design essentials:
  • Manipulate one or more IVs while holding other factors constant.
  • Include a control group to compare against the experimental group.
  • Random assignment: participants are assigned to groups by chance to minimize preexisting differences.
  • The importance of impartiality and randomization: avoid pre-selecting groups to maintain fairness and validity.
  • The tickling and laughter example:
  • IV: whether tickling is applied (tickling vs no tickling).
  • DV: laughter or squirming response.
  • Demonstrates the need for control and randomization to infer causality about tickling causing laughter.
  • Double-blind design (gold standard):
  • Neither the researcher nor the participant knows who is in which condition.
  • Prevents experimenter bias and expectations from influencing results.
  • Example scenario: happiness pill study where researchers’ expectations could bias responses unless both groups and researchers are unaware of assignments.
  • Placebo effect:
  • Belief in treatment can produce perceived or real improvements even without an active ingredient.
  • Typical placebo effect baseline cited: about $33\%$ of participants may report improvement just due to belief.
  • To demonstrate the drug’s true efficacy, results should surpass the placebo baseline by a substantial margin (e.g., into the 70–80% range).
  • Key terms in experimental design:
  • Independent variable (IV): the manipulated factor (e.g., tickling, drug vs placebo).
  • Dependent variable (DV): the measured outcome (e.g., laughter, mood).
  • Random assignment: equal chance of being in any group.
  • Control condition: baseline condition without the active manipulation.
  • Experimental condition: condition with the active manipulation.
  • Double blind: both participants and researchers are unaware of group assignments.
  • Practical takeaways:
  • The double-blind design helps counteract the placebo effect and researcher bias.
  • In human research, ethical considerations, risk-benefit analysis, and informed consent are essential.

• Class activity (research methods practice)

  • Structure: students are divided into groups and assigned different research methods.
  • Case study group
  • Naturalistic observation group
  • Survey group
  • Experimental group
  • Topic for the exercise: social anxiety and dating.
  • Tasks for each group:
  • Write a research question appropriate to the assigned method.
    • Descriptive methods (case study, naturalistic observation) typically yield descriptive questions.
    • Surveys and experiments can yield more formal research questions.
  • Develop a theory explaining the topic.
    • The theory should be broad (e.g., social anxiety impacts dating likelihood).
  • Formulate a testable hypothesis linked to the theory.
    • Hypothesis should be specific and testable within the chosen method (e.g., for an experiment, specify the manipulation and expected outcome).
  • Examples of theoretical framing and hypotheses:
  • Reward theory of attraction (theory): people feel attracted when they receive rewards in a relationship.
    • Hypothesis example (testable): individuals who report that their partner’s love language is words of affirmation will show higher relationship satisfaction when compliments are frequent.
  • Case study example: a single individual with extreme social anxiety (Andy) who rarely leaves his house touches on dating outcomes; hypothesis might involve whether Andy’s behavior predicts dating attempts.
  • Guidance on alignment:
  • Ensure research questions and hypotheses align with the assigned method (descriptive questions for case studies and naturalistic observation; more formal questions for surveys and experiments).
  • Distinguish between a theory (broader explanation) and a hypothesis (specific prediction to test).
  • Classroom reality check:
  • The instructor emphasizes that theories are broad explanations; hypotheses are specific, testable predictions.
  • Example refinement: The reward theory of attraction would be tested with specificity about what constitutes reward and how it affects dating outcomes.
  • Process recap:
  • Generate a research question relevant to social anxiety and dating.
  • Propose a theory that would explain potential relationships.
  • Draft a hypothesis that tests a concrete aspect of the theory using the group’s assigned method.
  • Observational and ethical considerations in the activity:
  • Naturalistic observation requires careful note-taking and avoidance of interference with subjects.
  • Case studies require careful consent and protection of privacy when dealing with sensitive topics like social anxiety.

• Miscellaneous insights and practical notes

  • The importance of verifying information with expert sources rather than relying on hearsay or memes (e.g., deepfakes, celebrity rumors).
  • The role of cultural norms in behaviors such as greetings and dating practices; historical contingencies shape modern behaviors.
  • The balance between human welfare and animal welfare in biomedical research remains a contested area requiring ongoing ethical analysis and policy development.
  • The value of diverse viewpoints in research design and interpretation; seeking feedback from others helps sharpen one’s own thinking (to counter false consensus and confirmation bias).
  • Foundational concepts touched upon: observation, theory, hypothesis, operational definitions, replication, descriptive, correlational, and experimental designs, random sampling, random assignment, control groups, dependent and independent variables, placebo effect, double blind.

• Quick reference to key terms and concepts (definitions in brief)

  • Critical thinking: systematic evaluation of information to form reasoned judgments.
  • Observation: systematic noticing of phenomena of interest.
  • Theory: a broad explanation of phenomena that helps predict outcomes.
  • Hypothesis: a specific, testable prediction derived from a theory.
  • Operational definition: precise definitions of variables for measurement.
  • Descriptive research: studies that describe characteristics or conditions of a population or phenomenon (case studies, naturalistic observation, surveys).
  • Correlational research: investigates the relationships between variables and their predictive power without asserting causality.
  • Experimental research: tests causal relationships by manipulating IVs and controlling extraneous factors.
  • Random sampling: selecting participants so every member of the population has an equal chance of inclusion.
  • Random assignment: randomly placing participants into conditions to equalize groups.
  • Placebo effect: improvement resulting from participants’ belief in treatment rather than the treatment itself.
  • Double blind: both participants and researchers are unaware of group assignments.
  • False consensus effect: overestimating how much others share our beliefs.
  • Illusory correlation: perceiving a relationship between variables even when none exists.
  • Anthropomorphism: attributing human traits to nonhuman entities; a source of observer bias in naturalistic studies.
  • Chaos theory: the study of seemingly random systems that exhibit underlying patterns or order.

• Connections to broader themes

  • Ethical reasoning: balancing scientific progress with moral responsibility toward animals and humans alike.
  • Policy impact: scientific findings inform laws, ethics committees, and research funding decisions.
  • Real-world relevance: improving dating and social functioning through understanding psychological processes; evaluating what makes research credible in an era of misinformation.
  • Philosophical implications: what counts as “necessary evil” in research? How do we weigh ends against means? Who decides the boundaries of acceptable risk?

• Formulas, numbers, and explicit references (LaTeX)

  • Average lifespan discussions:
  • Laboratory rat lifespan example mentioned: approximately $3\,\text{years}$ (in contrast to wild lifespan around $2\,\text{years}$; the transcript also references an exaggerated claim of ten years).
  • Placebo effect baseline mentioned: $33\%$ of participants may report improvement due to belief.
  • Correlation concepts (general): not a causal claim; relationship magnitude often described by a correlation coefficient $r\in[-1,1]$, with r>0 indicating positive association and r<0 indicating negative association (the transcript explains the concept qualitatively rather than providing a specific formula for r, but this is the standard interpretation).
  • Example of a simple causal inference setup:
  • Independent variable (IV): manipulated condition (e.g., tickling vs no tickling).
  • Dependent variable (DV): measured outcome (e.g., laughter).
  • Probability and sampling concepts can be represented with standard statistical notation when formalizing the research questions and hypotheses, e.g., random assignment ensures treatment groups are statistically comparable at baseline.

• Summary takeaway

  • The lecture emphasizes critical thinking as an ongoing habit: question assumptions, assess evidence, recognize biases, and differentiate between correlation and causation.
  • A solid foundation in descriptive, correlational, and experimental methods enables rigorous investigation of social phenomena (e.g., dating and social anxiety) while highlighting ethical considerations and methodological safeguards (randomization, control groups, and double-blind procedures).