What Is Science? Logic, Method, and Falsification in Political Science

Fundamental Nature and Definition of Science

• Comparative politics is the subfield of political science that focuses primarily on politics within countries.

• Political science is defined as the study of politics in a scientific manner.

• Science is a strategy for understandinmig and explaining the social and natural world that emphasizes the use of statements that can be examined to see whether they are wrong.

• Science is first and foremost a method, but it is also a culture characterized by critical inquiry, humility, and self-reflection.

• The foundational culture of science is captured by historical philosophical perspectives:

  • Sir Karl Popper (The Logic of Scientific Discovery): "The wrong view of science betrays itself in the craving to be right; for it is not his possession of knowledge, of irrefutable truth, that makes the man of science, but his persistent and recklessly critical quest for truth."

  • Socrates (Plato's Apology): "So I left him, saying to myself as I went away: Well, although I do not suppose that either of us knows anything really beautiful and good, I am better off than he is—for he knows nothing, and thinks that he knows. I neither know nor think that I know. In this latter particular, then, I seem to have slightly the advantage of him."

  • Saint Paul (First Letter to the Thessalonians): "Test everything. Keep what is good."

Five Common Misconceptions About Science

Many widespread beliefs regarding science are incorrect:

1. Misconception: Science is a collection of facts that tell us what we know about the world.

   • Correction: Science is not merely a static body of knowledge or factual repository; it is a method for provisionally understanding the world.

2. Misconception: A scientific theory is one that has been proven.

   • Correction: Scientific theories can never be proven; knowledge in science remains inherently tentative and provisional.

3. Misconception: "The sun revolves around the earth" is not a scientific statement.

   • Correction: "The sun revolves around the earth" is a scientific statement because it is falsifiable, despite being empirically false.

4. Misconception: If my theory is correct, then I should observe that rich countries are more likely to be democracies. I do observe that rich countries are more likely to be democracies. Therefore, my theory is correct.

   • Correction: This argument is logically invalid because it commits the formal fallacy of affirming the consequent.

5. Misconception: Politics cannot be studied in a scientific manner.

   • Correction: Politics can be studied scientifically through the generation and testing of falsifiable hypotheses using logic and empirical evidence.

Epistemology and Falsifiability

• Epistemology is the study of knowledge and addresses the central question: "How do we know what we know?"

• The scientific answer to epistemology is: "Because we have subjected our ideas to the scientific method."

• Science is distinguished from nonscience by falsifiability:

  • Scientific statements must be falsifiable—there must be some imaginable observation or set of observations that could falsify or refute them.

  • Falsifiability requires that a statement be potentially testable; it does not require that the statement has already been tested or that technical tools currently exist to test it.

• Nonfalsifiable statements are excluded from science:

  • Tautologies: A tautology is a statement that is true by definition (e.g., "Strong states are able to overcome special interests in order to implement policies that are best for the nation"). Unless a strong state can be identified independently of its ability to overcome special interests, the claim is nonfalsifiable.

  • Inherently unobservable phenomena: Claims such as "God exists" or "God created the world" cannot be tested or falsified. Nonfalsifiable claims are not nonsense or meaningless, nor are they necessarily false; they simply do not form a part of science.

The Five Steps of the Scientific Method

• The scientific method describes the systematic process by which scientists learn about the world.

Step 1: Question

• The scientific process begins by observing the world and identifying a puzzle or surprising observation.

• An observation becomes a puzzle only when it conflicts with a prior expectation or theoretical belief about how the world works.

• All observations are mediated by prior expectations; without prior theories, observations would never cause surprise.

Step 2: Theory or Model Building

• A theory (also referred to interchangeably as a model or explanation) is a set of logically consistent statements that tell us why the things that we observe occur.

• Theoretical statements must be logically consistent; logically inconsistent theories cannot produce clear empirical predictions and are impossible to test.

• Scientific theory construction relies on the principle of the uniformity of nature:

  • The principle of the uniformity of nature asserts that nature's operating mechanisms are unchanging in the sense that if $X$ causes $Y$ today, then it will also cause $Y$ tomorrow and in the future.

  • Rejecting this principle implies that events happen without cause or explanation ("just happen").

• Social science divides observed human behavior into systematic and unsystematic components, focusing explicitly on explaining the systematic elements.

• Theoretical modeling is a process of speculative creation:

  • A model represents a prior world that, had it existed, would have generated the puzzling observation.

  • Theoretical innovation requires imagination constrained by existing knowledge ("imagination in a straightjacket").

  • Models are simplified pictures of the world; descriptive accuracy is not a core value in model building.

  • Good models include only elements necessary to explain the target phenomenon and exclude superfluous details to maintain clarity and facilitate falsification.

Step 3: Implications (Hypotheses)

• Researchers must deduce logical implications from the model other than the original observation that the model was created to explain.

• Testing a model using the same observations used to build it leads to circularity; falsification requires finding new, unexamined implications.

• Characteristics of strong models:

  • Fertility: Fertile models yield many distinct logical implications, creating multiple opportunities for potential falsification and encouraging the synthesis of knowledge across distinct domains.

  • Surprise: Models should produce surprising implications that reveal unexpected relationships, though in moderate amounts.

Step 4: Observe the World (Testing Hypotheses)

• Researchers examine whether the deduced implications are consistent with empirical observations.

• Scientific testing seeks to actively falsify theories rather than dogmatically defend them; confidence grows only when theories survive rigorous refutation attempts.

• Tests should be as severe and demanding as possible.

• Comparison of competing models requires conducting a critical test:

  • A critical test allows the analyst to use observation to distinguish between two or more competing explanations of the same phenomenon.

  • Critical tests identify points of direct conflict where competing models make contradictory predictions about the real world.

Step 5: Evaluation

• If empirical observations align with theoretical implications, the theory is corroborated.

• Corroboration does not mean a theory is proven or verified; it indicates only that the theory has not yet been falsified.

• Scientific explanations remain provisionally true and always tentative.

Case Study: Smart Female Athletes

• Puzzling Observation: Female student-athletes frequently perform better academically in college classes than average students, despite routinely missing classes for out-of-state competitions.

Initial Conjectures and Refinements

1. Conjecture 1: Female athletes are smart.

   • Problem: Simply restates the observation without providing an explanatory mechanism.

2. Conjecture 2: Athletes are smart.

   • Problem: More general, but lacks a causal process and borders on a tautology.

3. Model 1: Work Ethic Theory

   • Formulation: Activities with clear, immediate rewards to hard work (such as athletics with coaches, structured training, and explicit feedback) instil a habit of hard work. Individuals transfer this work ethic to non-athletic domains such as academics.

Alternative Competing Models

1. Model 2: Excellence Theory

   • Formulation: Individuals who achieve success in one domain (such as athletics, potentially based on natural talent) develop a taste for success and a competitive drive. This motivation encourages them to seek success in other areas, including academics.

2. Model 3: Gender Theory

   • Formulation: Gender-specific athletic environments allow female athletes to develop autonomy, potential, and efficacy free from stultifying gender bias present in mixed settings. This heightened sense of efficacy boosts their academic confidence and performance.

Critical Tests and Empirical Predictions

To distinguish between the Work Ethic Theory, Excellence Theory, and Gender Theory, researchers identify questions where the models yield conflicting predictions:

• Test Question 1: Will athletics help women academically more than men?

  • Gender Theory Prediction: Yes (men do not suffer the same stultifying gender bias in general environments).

  • Excellence Theory Prediction: No (both male and female athletes gain a taste for success).

  • Work Ethic Theory Prediction: No (work ethic develops identically in male and female sports).

• Test Question 2: Is academic success associated with success in other nonacademic areas of life (e.g., music)?

  • Gender Theory Prediction: No.

  • Excellence Theory Prediction: Yes.

  • Work Ethic Theory Prediction: Yes.

• Test Question 3: Are female athletes more successful at board games than non-athletic women?

  • Gender Theory Prediction: Yes.

  • Excellence Theory Prediction: Yes (driven by a generalized competitive drive).

  • Work Ethic Theory Prediction: No (board games require no long-term physical or disciplined work ethic training).

Summary Matrix of Critical Tests

• Degree of Corroboration: A theory's strength depends on the severity of the tests survived rather than the sheer number of repeated easy tests.

• Evaluating Disconfirming Evidence: Single negative observations do not automatically discard a theory due to measurement error or probabilistic human behavior. Theory rejection involves judgment and typically requires an alternative theory ("it takes a theory to kill a theory").

Categorical Logic and Argument Structure

• An argument is a set of logically connected statements, typically in the form of a set of premises and a conclusion.

• A premise is a statement that is presumed to be true within the context of an argument leading to a conclusion.

• A conclusion is a claim that is thought to be supported by the premises.

• Argument Validity:

  • Valid argument: An argument in which, if you accept the premises, you are compelled to accept the conclusion.

  • Invalid argument: An argument in which, if you accept the premises, you are free to accept or reject the conclusion.

• Categorical Syllogism: A specific type of argument consisting of:

  1. Major Premise: A conditional statement of the form "If $P$, then $Q$". The "if" component ($P$) is the antecedent; the "then" component ($Q$) is the consequent.

  2. Minor Premise: A claim affirming or denying either the antecedent ($P$) or the consequent ($Q$).

  3. Conclusion: The logical claim deduced from the major and minor premises.

Set-Theoretic Representation of the Major Premise

• The major premise "If $P$, then $Q$" specifies that the set of cases where $P$ occurs forms a proper subset of the set of cases where $Q$ occurs ($P \thinspace \text{is inside} \thinspace Q$).

The Four Formats of Conditional Arguments

1. Affirming the Antecedent (Valid)

• Structure:

  • Major Premise: If $P$, then $Q$ (If a country is wealthy, then it will be a democracy).

  • Minor Premise: $P$ (The country is wealthy).

  • Conclusion: Therefore, $Q$ (Therefore, the country will be a democracy).

• Logical Status: Valid. Since $P$ is entirely contained within $Q$, observing $P$ compels the conclusion $Q$.

2. Denying the Antecedent (Invalid)

• Structure:

  • Major Premise: If $P$, then $Q$ (If a country is wealthy, then it will be a democracy).

  • Minor Premise: Not $P$ (The country is not wealthy).

  • Conclusion: Therefore, not $Q$ (Therefore, the country will not be a democracy).

• Logical Status: Invalid. A case outside $P$ can still reside within $Q$. Wealth is not specified as the only path to democracy (e.g., India is a nonwealthy democracy).

3. Affirming the Consequent (Invalid)

• Structure:

  • Major Premise: If $P$, then $Q$ (If a country is wealthy, then it will be a democracy).

  • Minor Premise: $Q$ (The country is a democracy).

  • Conclusion: Therefore, $P$ (Therefore, the country is wealthy).

• Logical Status: Invalid. Confuses sufficiency with necessity. Observing $Q$ does not compel $P$, because $Q$ contains areas outside $P$.

4. Denying the Consequent (Valid)

• Structure:

  • Major Premise: If $P$, then $Q$ (If a country is wealthy, then it will be a democracy).

  • Minor Premise: Not $Q$ (The country is not a democracy).

  • Conclusion: Therefore, not $P$ (Therefore, the country is not wealthy).

• Logical Status: Valid. If a case is outside $Q$, it is strictly impossible for it to lie inside $P$.

Summary of Conditional Argument Validity

Logic of Scientific Testing: Falsificationism vs. Induction

Testing Theoretical Implications

• Consider the hypothesis: "Rich democracies survive longer than poor democracies."

  • Major Premise: If theory $T$ is correct, then implication $I$ will be observed.

Confirming Outcome (Affirming the Consequent)

• Major Premise: If theory $T$ is correct, then implication $I$ will be observed.

• Minor Premise: Implication $I$ is observed (Rich democracies live longer than poor democracies).

• Conclusion: Therefore, theory $T$ is correct.

• Logical Evaluation: Invalid Argument (Affirming the Consequent). Alternative unstated mechanisms could generate the same observed implication $I$. Confirmation does not prove a theory.

Disconfirming Outcome (Denying the Consequent)

• Major Premise: If theory $T$ is correct, then implication $I$ will be observed.

• Minor Premise: Implication $I$ is not observed.

• Conclusion: Therefore, theory $T$ is incorrect.

• Logical Evaluation: Valid Argument (Denying the Consequent). A negative empirical finding logically compels the rejection of theory $T$ (assuming error-free observation).

The Logical Asymmetry of Science

• There is a fundamental logical asymmetry between confirmation and disconfirmation:

  • Confirming observations show only that a theory may be correct; they can never verify or prove it.

  • Disconfirming observations logically demonstrate that a theory is incorrect.

• Scientific knowledge is inherently tentative and provisional.

Falsificationism vs. Inductive Approaches

• Falsificationism: An approach to science in which scientists generate testable hypotheses from theories designed to explain phenomena of interest, emphasizing rigorous refutation attempts.

• Deductive Approach: Involves formulating an expectation about what ought to be observed in light of a theory, then observing the real world to test it (Theory precedes Observation).

• Inductive Approach: Starts with empirical observations and attempts to discern patterns to generate theories (Observation precedes Theory).

• Flaws of Induction:

  1. Induction relies logically on affirming the consequent (observing patterns first means theories are not exposed to potential falsification).

  2. Pure induction is impossible because observation requires prior theoretical criteria to select which facts to observe and which to ignore.

The Comparative Method (Mill's Methods)

• The comparative method (also known as Mill's methods) is an inductive research strategy based on formal rules defined by John Stuart Mill (A System of Logic, 1872).

Method of Agreement

• Method of Agreement: Compares cases that "agree" in regard to the political phenomenon to be explained.

• Target Outcome: Identifying necessary conditions.

  • Necessary condition: A circumstance in whose absence the phenomenon in question cannot occur.

  • Sufficient condition: A circumstance in whose presence the phenomenon in question must occur.

Empirical Application (Method of Agreement)

• Analytical Deductions:

  • Ethnic homogeneity is not necessary for democracy (Belgium is ethnically heterogeneous yet democratic).

  • A parliamentary system is not necessary for democracy (United States is presidential yet democratic).

  • Wealth survives as a potential necessary condition across these cases.

Method of Difference

• Method of Difference: Compares cases that "disagree" (differ) in regard to the outcome to be explained.

• Requires examining nondemocracies alongside democracies to evaluate sufficient conditions.

Empirical Application (Method of Difference)

• Analytical Deductions:

  • Wealth is not sufficient for democracy (Mexico pre-1990 was relatively wealthy but nondemocratic).

  • Ethnic homogeneity is neither necessary (Belgium) nor sufficient (Mexico) for democracy.

  • Parliamentary system is not necessary (United States), but remains a potential sufficient condition (United Kingdom, Belgium).

Critical Evaluation and Assumptions of Mill's Methods

• The comparative method underpins "most similar systems" (equivalent to Method of Difference) and "most different systems" (equivalent to Method of Agreement) research designs.

• Restrictive Assumptions:

  1. Causal Determinism: Assumes a single, deterministic cause for the phenomenon.

  2. Complete Causal Identification: Assumes all potential causes have been identified.

  3. Independence of Factors: Assumes causal factors operate independently without interaction effects.

  4. Error-free Measurement: Assumes perfect observational data.

• Mill's Warning: John Stuart Mill explicitly warned against applying his methods to complex social and political phenomena.

• Core Limitations:

  • Empirical/Descriptive Nature: Mill's methods establish correlation or spatial co-occurrence, not causation. They lack a theoretical process explaining why factors covary.

  • Affirming the Consequent: Because hypotheses are derived from existing data, theories built via Mill's methods cannot be falsified by those same data.

Four Common Myths About Science

1. Myth 1: Science proves things and leads to certain, verifiable truth.

   • Science provides tentative statements. Scientific progress represents the systematic evolution of ignorance rather than absolute proof.

2. Myth 2: Science can be done only when experimental manipulation is possible.

   • Science requires falsifiability/potential testability, not physical experimental manipulation (e.g., studies of extinct dinosaurs or Einstein's 1905 General Relativity theory, tested in 1919).

3. Myth 3: Science is value-neutral.

   • Scientific research interacts directly with policy and human choices. High evidentiary bars are appropriate before adopting policies with irreversible real-world impacts.

4. Myth 4: Politics cannot be studied in a scientific manner.

   • Political science generates falsifiable hypotheses tested via logic and empirical data.

Analytical Exercises and Logic Problems

Part 1: Categorical Syllogisms

1. Argument 1:

   • Major Premise: If a country has a strong economy, the government will be popular.

   • Minor Premise: The government is not popular.

   • Conclusion: Therefore, the country does not have a strong economy.

   • Evaluation: Valid argument. Form: Denying the Consequent.

2. Argument 2:

   • Major Premise: If the president commits a criminal act, then he can be impeached.

   • Minor Premise: The president does not commit a criminal act.

   • Conclusion: Therefore, the president cannot be impeached.

   • Evaluation: Invalid argument. Form: Denying the Antecedent.

3. Argument 3:

   • Major Premise: If a country employs proportional representation electoral rules, it will have many parties.

   • Minor Premise: The country does not employ proportional representation electoral rules.

   • Conclusion: Therefore, the country does not have many parties.

   • Evaluation: Invalid argument. Form: Denying the Antecedent.

4. Argument 4:

   • Major Premise: If theory $T$ is correct, all rich countries will be democracies.

   • Minor Premise: All rich countries are democracies.

   • Conclusion: Therefore, theory $T$ is correct.

   • Evaluation: Invalid argument. Form: Affirming the Consequent. To demonstrate theory $T$ is wrong, one must observe a rich country that is not a democracy.

Part 2: Evaluating Scientific Statements

5. Falsifiability Analysis:

   • "Smoking increases the probability of getting cancer.": Scientific (falsifiable by empirical health data).

   • "A square is a two-dimensional figure with four equal straight sides and four right angles.": Nonscientific (tautology / true by definition).

   • "The sun revolves around the earth.": Scientific (falsifiable and proven empirically false).

   • "It always rains in England during the winter.": Scientific (falsifiable by weather observations).

   • "Education spending increases under left-wing governments.": Scientific (falsifiable by budget data).

   • "Iceland is a country.": Nonscientific (tautological definition based on international political consensus).

   • "Religious faith assures a person a place in the afterlife.": Nonscientific (inherently unobservable).

   • "Democracies are less likely to go to war than dictatorships.": Scientific (falsifiable by historical conflict data).

6. Examples of Nonscientific Statements:

   • Tautology: "Unsuccessful political campaigns fail to win enough votes to secure victory."

   • Unobservable Phenomenon: "Invisible, undetectable spirits guide political decision-making."

7. Definitional Dependence on Falsifiability:

   • Statement: "All mainstream U.S. senators agree that the House bill is unacceptable."

     • If "mainstream" is defined by whether a senator finds the House bill unacceptable: Tautological and nonscientific.

     • If "mainstream" is defined independently by ideological placement/voting scores: Scientific and falsifiable.

   • Statement: "All good students get high grades."

     • If "good" is defined by receiving high grades: Tautological and nonscientific.

     • If "good" is defined independently by enthusiasm or attendance: Scientific and falsifiable.

Part 3: Necessary and Sufficient Conditions

8. Classification of Bolded Factors:

   • "If a person contracts measles, then she was exposed to the measles virus.": Necessary condition.

   • "If a democracy is rich, then it will stay a democracy.": Sufficient condition.

   • "A country cannot maintain a democratic form of government unless it has a culture that promotes civic participation.": Necessary condition.

   • "Countries have many parties only when they employ proportional electoral rules.": Necessary condition.

   • "Countries always have few parties when they employ majoritarian electoral rules.": Sufficient condition.

Part 4: Model Building Exercises

9. Student Seating Patterns (Rear Hall Preference):

   • Minimum Effort Theory vs. "Coolness" Theory:

     • Predictions for Minimum Effort Theory: Students entering from rear doors sit in the back; if entry doors are placed at the front, students will fill the front rows first.

     • Predictions for "Coolness" Theory: Students sit in the back regardless of entry door placement; students sitting in front perform better academically or interact more with instructors.

     • Critical Test: Observe seating patterns in a hall where the main entrance is located at the front. If students still move to the rear, "Coolness" Theory is corroborated; if they fill front seats, Minimum Effort Theory is corroborated.

10. Democratic Peace (Democracies Do Not Fight Each Other):

    • Model 1 (Institutional Constraints): Democratic leaders face institutional checks and voter accountability, making declaration of war slow and difficult.

    • Model 2 (Shared Norms): Democracies share norms of peaceful conflict resolution and mutual respect.

    • Critical Test: Observe disputes between democracies and newly transitioned, weak democratic states. Institutional Theory predicts peace if formal checks exist; Normative Theory predicts conflict if shared norms have not fully developed.

11. Government Treatment of Citizens:

    • Model 1 (Electoral Accountability): Governments treat citizens well when citizens hold competitive voting rights to remove abusive leaders.

    • Model 2 (Resource Dependence): Governments treat citizens well when state revenues depend on taxation of productive citizens rather than natural resource rents (oil).

    • Critical Test: Observe non-democratic states lacking elections but highly dependent on income taxation. If citizens are treated well, Resource Dependence Theory is corroborated; if treated poorly, Electoral Accountability Theory is corroborated.