Notes on Scientific Thinking, Hypotheses, Theories, and Sampling

Scientific thinking and the scientific method

• Focus of psychology: study mind, brain, and behavior through research; evidence-based therapy and knowledge; understanding mind–brain–behavior relations via research.
• Evidence-based practice and real-world relevance: research underpins how we interact, make decisions (relationships, internships, careers, politics).
• Pseudoscience vs science:
  • Pseudoscience refers to practices that appear scientific but do not use the scientific method to reach conclusions.
  • It can be pseudoscientific in any field (psychology, biology, sociology, physics).
• Amiable skepticism:
  • Be open to new ideas, curious, and willing to challenge beliefs, but demand evidence.
  • Systematically question and evaluate information; assess whether studies are well-done, whether findings are robust, and whether conclusions follow from the data.
• Reasons to reject myths in mind/brain/behavior:
  • Myths can cause indirect harm (wasting money/time, wrong beliefs about disorders, etc.).
  • Example harms: spending on questionable subliminal learning programs; relying on unverified memory recall or polygraph claims.
• Psychological myths discussed in class:
  • 10% brain myth: common belief that humans use only 10% of their brain.
  • Hypnosis for memory retrieval; polygraphs determine truthfulness.
  • These myths illustrate the need for evidence and critical evaluation.
• What to ask about any claim:
  • What is the evidence behind the claim? How was the evidence obtained? Can we legitimately generalize from the research?
  • Are we drawing inferences beyond what the data support?
• Why study mind–brain–behavior scientifically:
  • To reduce error, avoid harm, and improve decision making in everyday life and in policy.
• Real-world example of critical thinking in action:
  • Consider products or services promising easy language learning (e.g., subliminal CDs). Evaluate evidence, avoid indirect damage, and rely on research-based approaches.
• Chapter and module context:
  • Chapter 2 (Scientific Thinking, Research, and Psychology).
  • First module covers critical thinking, the scientific method, hypotheses, theories, and how to evaluate evidence.
• What science is not:
  • Not pseudoscience; science uses the scientific method to reach conclusions.
• The goal of the SmartBook activity:
  • Practice evaluating claims, understanding the scientific method, and applying these concepts to psychology.

The scientific method and six basic processes

• The six basic processes by which scientists conduct research:

  1. Observation
  2. Formulation of a hypothesis/prediction
  3. Testing the prediction (through descriptive, correlational, or experimental research)
  4. Analyzing and interpreting the data
  5. Communicating the findings
  6. Replicating the study (to ensure reliability across researchers and settings)

• The conceptual flow:

  • Start with an observation about the world.
  • Develop a prediction/hypothesis: $ext{If } A ext{ occurs, then } B ext{ occurs}$
  • Test via data collection and analysis; determine whether the data support the hypothesis.
  • Communicate results and seek replication.

• Key definitions:

  • Hypothesis: a specific, informed prediction that is testable.
  • Theory: a set of related assumptions that guide and explain observations and allow testable predictions to be made; not just a hunch.
  • Replicability: the ability for other researchers to repeat the study and obtain similar results.

• Common student poll results (illustrative):

  • On the question of what a theory is, about 90% answered that it is a set of related assumptions that guide and explain observations and allow testable predictions to be made.
  • On a question about replication, about 88% answered that study results should be replicable.

• The idea of continual science:

  • Science is a continual, self-correcting process; science does not “settle” on a single answer (e.g., not final for COVID or climate debates).

• Step-by-step recap of the process:

  • Observation → Prediction/Hypothesis → Test (descriptive/correlational/experimental) → Interpretation → Communication → Replication

Hypotheses, theories, and falsifiability

• What is a scientific theory?
  • A big idea about how the world works; based on observations and research; grounded in data; provides predictions.
  • Answer chosen in class: a theory is a set of related assumptions that guide and explain observations and allow testable predictions to be made.
• What is a hypothesis?
  • A specific, testable prediction about the relationship between variables, often in the form: $ext{If } X ext{ occurs, then } Y ext{ occurs}.$
• What makes a good hypothesis?
  • Falsifiable: there must be a possible observation that could disconfirm it.
  • Parsimonious (parsimony): the simplest explanation with the fewest assumptions that can account for the observations.
• Examples illustrating falsifiability and parsimony:
  • A Bigfoot hypothesis is not parsimonious or falsifiable if it relies on a lack of disconfirming evidence rather than positive testable predictions.
  • A hypothesis that “an airplane is responsible for the object in the sky” is parsimonious and falsifiable if supported by observable data (e.g., flight patterns, radar, eyewitness data).
• The process of testing the hypothesis:
  • Form a testable hypothesis from an observation.
  • Collect data (on Friday and Monday in class examples).
  • Interpret results to support or refute the hypothesis.

Variables, operational definitions, and measurement

• What is a variable?
  • A characteristic that varies across individuals or situations; it can be measured or manipulated.
  • Example: height is a variable; people vary in height and it can be measured.
• Operational definition:
  • A precise, concrete definition of how a construct will be measured or observed in a study.
  • Essential for clarity and reproducibility when studying abstract concepts like love, intelligence, or aggression.
• Example: testing “smart” between groups (e.g., University of Arkansas vs. Mizzou students):
  • Possible operational definitions of smart:
  • Test scores: higher average test scores for one group.
  • GPA: higher GPA for one group.
  • Curiosity or engagement measures.
  • The operational definition should be explicit so others can replicate the measurement.
• Practical point:
  • Researchers often use multiple operational definitions (biological, behavioral, and social measures) to capture a construct comprehensively.

Population, samples, and representativeness

• Population:
  • The group the researcher is interested in studying (e.g., all University of Arkansas students or all college students in a region).
• Sample:
  • A subset of the population that is studied to draw inferences about the population.
  • Why not study everyone? Practical limits (time, money, access).
• Representativeness:
  • A sample should resemble the population in key aspects to generalize findings.
• Sampling types:
  • Convenience sample: a group chosen because it is easy to study (e.g., undergraduates who volunteer for a study).
  • Random sample: every member of the population has an equal chance of selection; aims to produce a representative sample.
  • Representative sample: a sample that sufficiently resembles the population from which it is drawn.
• How to achieve representativeness:
  • If done well, simple random sampling can yield a representative sample; however, other methods (stratified, systematic) may also be used to improve representativeness.
• Population vs. sample example:
  • Population could be all students at a university; a sample might be 300–500 students with a mix of majors, genders, years, and backgrounds.

Real-world implications, myths, and critical thinking applications

• Why this matters in daily life and decision-making:
  • The ability to detect myths protects individuals from wasting time and money and helps in making informed choices in relationships, careers, and politics.
• Practical implications of research quality:
  • Poorly designed studies or misleading statistics can lead to incorrect beliefs and poor decisions.
• The role of replication and transparency:
  • Replication across labs and settings strengthens confidence in findings; lack of replication weakens claims.
• Ethical and practical implications:
  • Careful methodology reduces harm and increases reliability of conclusions.
  • Psychological research informs clinical practices and public policy; thus, rigor is essential.

Quick recall and study-oriented takeaways

• Core questions to ask about any claim:
  • What is the evidence? How was it obtained? Can we legitimately generalize from it?
  • Is the hypothesis falsifiable? Is it parsimonious (simple) or overly complex?
• Remember the six steps of the scientific method:
  1) Observation
  2) Hypothesis/prediction
  3) Testing (descriptive, correlational, experimental)
  4) Data interpretation
  5) Communication
  6) Replication
• Remember key definitions:
  • Hypothesis: a specific, testable prediction.
  • Theory: a well-supported set of assumptions guiding observations and predictions.
  • Variable: a characteristic that varies and can be measured or manipulated.
  • Operational definition: explicit criteria for measuring a construct.
  • Population: the group of interest.
  • Sample: a subset of the population studied.
  • Parsimony: simplicity in the explanation.
  • Falsifiability: the possibility of disproving the hypothesis.