Measurement - Kellstedt and Whitten

Political scientists focus on discovering causal relationships between concepts, which involves examining statistical associations between variables.
Importance of having a clear understanding of concepts for valid and reliable measurement.
Example discussed: Political tolerance; its existence varies among individuals but poses challenges in measurement.
Quote by Justice Potter Stewart on identifying obscenity vs. the subjective nature of measurements.
Quote by Nigel Tufnel on the amplification or measurement of concepts (e.g., volume).

Role of theory in political science is emphasized; causal relationships are key to understanding political phenomena.
Theories should be causal, general, and parsimonious; should withstand four causal hurdles from previous discussions.
Understanding theories requires empirical evidence evaluation to move from abstract to measured variables.
Operationalization: The process of moving from abstract concepts to measurable variables is essential for hypothesis testing.

Measurement challenges exist across all sciences; while physical sciences focus on instrumentation, social sciences face issues of agreement and predictability due to human behaviors.
Social scientists often deal with elusive concepts; as a result, there is notable variability in their measurement strategies.

Economic Output:
- Defined as the total sum of goods and services produced in a time period, representations of GDP (Gross Domestic Product) are straightforward and widely accepted.
- Controversies arise in measuring poverty; definitions vary based on income cutoffs that adjust for family size, head of household’s age, etc.
Problematic aspects include understanding what “minimally decent” consumption looks like and accounting for welfare transfers.

Psychology deals with highly abstract concepts such as depression, which resists straightforward measurement.
- DSM-IV outlines depression with mood, behavioral, cognitive, and somatic symptoms; measuring its presence is crucial for understanding treatment efficacy.

Political science varies in measurement challenges.
- Subfields like political economy are relatively clear-cut, while political psychology faces traditional measurement issues akin to social psychology.

Judicial Activism: Measuring the role judges play in policy-making is evaluatively complex and subjective.
Congressional Roll-Call Liberalism: Detecting shifts towards or away from liberalism over time in Congress is methodologically intricate.
Political Legitimacy: Evaluating governmental authority relies on citizen perceptions; legitimacy can be subjective.
Political Sophistication: Distinguishing politically knowledgeable citizens from unsophisticated ones raises measurement concerns.
Social Capital: Measuring societal interconnectedness poses challenges and is compared over time or among different societies.

Key steps for proper measurement include:
  1. Achieving conceptual clarity.
  2. Settling on an appropriate level of measurement.
  3. Ensuring that measures are valid and reliable.

Clarity of concept is essential for effective measurement; complexity can arise even in seemingly straightforward cases like measuring income.
Considerations must be made about household definitions and income sources.

Reliability refers to the consistency of a measure; repeated measurements should yield the same results.
Example: A bathroom scale demonstrating weight variability could indicate unreliability.
Consistency across coders performing quantitative assessments for events or text is crucial; reliable coding rules lead to consistent findings.

Measurement bias reflects systematic inaccuracies, although it typically does not negate theoretical testing fundamentally, especially when pursuing general patterns.

Validity measures whether a measure accurately captures the intended concept.
Diverse methods assess validity, including: - Face Validity: Does it appear to measure the intended concept? - Content Validity: Are all critical elements of the concept included, while excluding irrelevant factors? - Construct Validity: Is the measure related to other theoretical constructs as expected?

A reliable measurement can still fail to be valid and vice versa; however, for practical applications in hypothesis testing, both reliability and validity are necessary.

Democracy is not strictly binary; it exists on a continuum from democracy to totalitarianism.
Challenges arise in defining democracy's core attributes; key elements per Robert Dahl include competition and participation.

This measure assigns countries a score from -10 (autocratic) to +10 (democratic), capturing components such as executive recruitment regulation, competitiveness, openness, and constraints.
Example of Pakistan's variable democracy is visualized through Polity scores, showcasing democratic fluctuations over time.

Political tolerance exists on a spectrum; individuals cannot self-identify as tolerant or intolerant transparently without bias.

Samuel Stouffer's research during the Red Scare measured civil liberties tolerance with authoritarian figures; substantial intolerance was uncovered.
John Sullivan’s revised approach focused on identifying opposition as political tolerance's core, leading to a different understanding and new major predictors of intolerance.

Inadequate measurement undermines the validity of hypothesis testing; misalignment between observed variables and theoretical concepts can lead to faulty conclusions.

Effective measurement is integral to understanding political science concepts.
Measurement strategies impact conclusion validity and should align with the theoretical purpose of the research endeavor.