POSC 318 Exam 1 Comprehensive Study Guide: Public Opinion, Representation, and Survey Methodology

The Electoral Connection

main idea: elections serve as a structural mechanism for holding electoral officials accountable. Citizens utilize elections to reward or punish representatives based on their actions, decisions, and overall performance

causal chain

public opinion —> elected officials —> government decisions

polarization

the public is divided into strongly opposing poltical groups making representation complex and contentious

gerrymandering

district boundary manipulation can prevenyt political minorities from exerting meaningful electoral influence

fragile majorities

districts can be very closely divided, meaning a small shift in public opinion can alter the outcome

broader democratic question

resolves around how much elected officials ought to respond to public opinion and whether the general public posseses sufficient inofrmation to guide government decisions

classical democratic theory

main idea: maintains exceptionally high expectations regarding citizens and their capacity to participate directly in governance

key characteristics of classical democratic theory

• High expectations regarding citizen political competence.

• Full potential participation across the public.

• Direct support for foundational democratic principles, including freedom of assembly and freedom of expression.

• Strong belief in the general will and the common good.

• Preference for direct democracy where citizens participate directly in political decision-making.

general will

the shared common interest or common good that a oublic can collectively idnetify

Jean-Jacques Rousseau

emphasized popular soveignty, asserting that poltical authority ultimately resides with the people and that ;aws must reflect the general will

limitations (general will)

functions most effectively in small, relatively homogenous societies composed of highly engaged and educated citizens. modern societies are large and divers, making the identification of a single general will difficult

Democratic elitism

main idea: officials and poltical elites should pay a predominant role in governing, rather than citizens directly making every poltical decision

Joseph Schumpter

defined democracy as an instiuttional arrangement where individuals acquire decision-making power via a competitve struggle for the people’s vote

democratic elitism process

citizens vote —> elites compete —> elected elites govern

underlying assumptions

based on a pessimistic view of the electorate, assuming ordinary citizens lack the time, information, or capacity to make every poltical decision

trustee model

an elected official who relies on their own judgement to decide what is best for the constituency and nation

justification

citizens elect representatives because they trust their judgment and decision-making capacity

delegate model

an electoral official who acts strictly according to the expressed desires of their constuents

justification (delegate)

the representatives primary job is carrying oit public preferences

domestic pluralism

main idea: interest groups serve as essential intermediaries between the general public and elected officals

functions of interest groups

• Gather specialized information.

• Represent organized public interests.

• Monitor government activities.

• Lobby elected officials.

• Elevate key issues to public attention

utility

highly effective in large, diverse socities where individual citizens cannot be experts on every policy issue

“fire alarm” oversight

interest griups continuously monitor government operations and alert memebrs and the public when policy or action goes awry

“fire alarm” oversight sequence

government action —> interest group notice —> alert to memebers/public —> public response

limitations/citicisms (democratic pluralism)

magnifies polticla inequality because interest groups differ substantially in money, memberhsip size, resources, and direct poltocal access. As famously noted, the pluralist heaven has a strong upper-class accent

participatory democracy

main idea: broadening poltical participation creates a more equitable poltical system by systematically dismantling barriers to engagment

practical application (participatory democracy)

implementation of policies designed to make voting easier, promote civic engagement, remove participation hurdles, and increase overall voter turnout

ideological nature (participatory democracy)

nonpartisan concept aimed strictly at maximizing participation regarless of candidates or party choice

compulsory voting

legally requiring citizens to vote, often enforced via monetary fines for non-compliance

core debate (compulsory voting)

questioning whether mandated participation produces superior election outcome sor if individuals retain a right to abstain from poltics

qualitative research

the collection and systematic analysis of textual, detailed descriptive data regarding individual experiences, opinions, attitudes, and cognitive reasoning

qualitative methodological examples

in-depth interviews, focus groups, and ethnographic research

qualitative key characteristics

• Small sample sizes.

• Open-ended questioning formats.

• Textual data output.

• Thematic analysis techniques.

• Inductive and exploratory approach.

• Reliance on non-probability sampling.

qualittaive core goals

• Achieving thick description.

• Mapping cognitive structures of respondents.

• Uncovering underlying justifications for political opinions.

• Generating and refining theoretical frameworks.

• Establishing deep, nuanced context

qualitative advantages

• Yields rich, detailed responses.

• Permits participants to explain underlying logic and reasoning.

• Exposes internal cognitive structures and context.

• Directly answers the "why" behind public opinion.

• 
  

qualitative disadvantages

• Highly time-consuming.

• Unrepresentative of broader populations by design.

• Analytically labor-intensive and complex.

• Susceptible to social dynamics during data collection.

• Less transparent data analysis relative to quantitative metrics.

• Inability to statistically generalize findings to larger populations.

quantitative research

the collection and statistical analysis of numerical data to wuantify opinions, behaviors, and trends

quantitative methodological example

a traditional opinions survey asking 1,000 respondents “do you approve or disapprove of the presidents job performance?”

quantitative key characteristics

• Highly time-consuming.

• Unrepresentative of broader populations by design.

• Analytically labor-intensive and complex.

• Susceptible to social dynamics during data collection.

• Less transparent data analysis relative to quantitative metrics.

• Inability to statistically generalize findings to larger populations.

quantitative advantages

• Ability to obtain representative samples.

• Enables generalizability to full target populations.

• Quantifies sampling uncertainty mathematically.

• Facilitates efficient data aggregation and statistical analysis.

• High level of methodological transparency

sample

a defines ubset of a traget population analyzed to make inferences about the whole population

census

an exhaustive attempt to meausre every single unit within an entire target population (e.g., questioning every resident of a country)

probability based sampling

main idea: every memeber of the target population has a known, non-zero probability of selection (ideally equal probability)

probability based structural requirement

• Clearly defined target population.

• Fully identifiable sampling frame.

• Known probability of selection for every element

samplling frame (probability based sampling)

the specific list, index, or operational system used to identify population memebers eligible for selection

coverage error (probability based sampling)

arises when the sampling frame fails to encompass all memebrs of th elargest population, introducing systemic bias

simple random sampling

every element in the smapling frame posses an equal probability of sleection (e.g., drawing names from a hat)

random digit dialing (RDD)

computerized random generation of telephone numbers based on area codes, exchange prefixes, and random final digits. Frequently deployed in hore-race polling

stratified sampling

the population is divided into mutually exclusive subgroups (strata) based on key characteristics, followed by independent random sampling within each stratum

stratified sampling with oversamples

subgroups are deliberately sampled at rates higher than their actual proportion in the overall population

post-data adjustment

data is weighted during analysis to restore correct population proporties

cluster sampling

random selection of intact natural groups or clusters rather than individual respondents

if subgroups do not matter

a simple random sample is sufficient

if subgroups do matter

utilize stratified sampling, stratified sampling with oversamples, or cluster.multistage approaches to gaurentee adequate subgroup representation

non-probability sampling

main idea: individual selection probabilities are unknown; selection relies on convenience or non-random mechanisms

common methods (non-probability sampling)

convenience sampling, opt-in internet sirveys, snowball sampling, quota sampling, and voluntary public comment periods

advantages (non-probability sampling)

inexpensive, logistically simple, highly feasible, and practical when probability frames are unobtainable

disadvantages (non-probability sampling)

systematic divergence from true population parameters, severely limited generalizability, and inability to calculate a valid margin of sampling error

quota sampling

non-random recruitment designed to meet predetermined numerical counts across specified demographic categories

random error

unpredictable, chance fluctuations that tendd to cancel out when aggregated. It impatcs precision but yields modest effects on overall point estimates

systematic error

consistient, directional error that pushes results in a particular direction away from true popualtion values. It creates bias and cannot be reduced by increasing sample size alone

coverage error

occurs when elements of the population are systematically omitted from the sampling frame

sampling error

the inherent random difference between a sample estimate and teh true population parametere caused by observing a sample rathe rthan a census

nonresponse error

occurs when sampled individuals fail to complete the survey, particularly when non-respondents systematically differ from respondents

drivers of nonresponse

lack of time, low interest in topic, absent incentives, confidentiality anxieties, and distrust of sponsoring organizations

effect of nonreponse

systematic nonreponse creates serious directional bias

Strategies for Minimizing Sampling and Survey Error:

• Deployment of probability-based sampling designs.

• Utilizing high-quality, comprehensive sampling frames to minimize coverage error.

• Maximizing response rates through refined survey design, multi-mode contact strategies, incentives, and accessible survey platforms.

• Applying survey weighting to align sample demographics with known population benchmarks.

• Oversampling small key subgroups to ensure adequate statistical power

guidelines for question formulation

survey questions must elicity truthful, accurate answers without biasing or steering the respondnets sleection

leading question

formulations that supply information or directional language promopting a preferred response

loaded question

questions incorporating emotioanlly charged, value-laden, or biase dterminology

double-barreled questions

items that combine two distinct subjects into a single response prompt

open-ended questions mechanism

repondents construct original verbal or written answers

open-ended advantages

detailed self-explanation, individualized responses, and discovery opf unanticipated perspectives

open-ended disadvantages

difficult to code, labor-intensive, time-consuming, and hard to aggregate statistically

closed-ended questions

mechanism: respondnets sleect from fixed, predetermined reponse options

closed-ended advantages

fast administration, easy data aggregation, straightforward sattistical processing, and quick completion

close-ended disadvantages

can misrepresent actual nuanced opinions and force complex attotudes into artifical categories

question wording effects

subtle alterations in phrasing alter responses

priming

early survey questions activate specific cognitive considerations that influence subsequent answers

social desirability bias

mechanism: respondents report socially accepted opinions rather than genuine beliefs, especially on sensitive topics

mitigation

absence of live interviewers increases self0reporting honestly

list experiments

an unobtrusive, nonreactive measurement technique designed to quantify sensitive attitudes while eliminating social desirability bias

expressive responding mechanism

respondents exaggerate or misstake beliefs to signal political loyalty or partisan identity

expressive responding dynamics

involves group signaling (supporting the in-group, attacking the out-group, demonstarting loyalty)

expressive responding consequence

generates partisan inflation, making public opinion appear significantly more polarized than underlying attitudes warrant

non-attitudes

offering a definitive opinion on an issue despite lacking knowledge or a preexisting belief

non-attitude consequence

researchers misinterpret random responses as authentic poltical preferences

multi-item scales

method of combining multiple related survey items into an index to measure complex, broader concepts accurately

cognitive interviewing

a wualitative evalutaion technique assesing whether repsondnets interpret wuestions as intende dby researchers

cognitive interviewing process

conversational evaluation using small non-probability samples to detect misinterpretation, confusing phrasing, or unexpected response paths

think-aloud technique

respondnets narrate their complete real-time thought processes out loud while ansering questions without interruption

probing technique

interviewers ask target follow-up questions regarding prompt comprehension (e.g., “what did you mean when you selected that answer?)

piloting

pre-testing the survey instrument under operational conditions before full deployment

interviewer training

standardizing administration to eradicate interviewer induced variance

data cleaning

screening data to identify and address invalid, incomplete, or suspect responses

translation protocols

rigorous translation across languages/dialects avoiding idoms, incorporating local experts, and accounting for cultural nuances

sensitivity analysis

testing whether analytical conclusions remain robust across varying assumptions and methodological decisions

external validation

comparing survey distributions against adminstrative benchmarks and applying post-stratification weighting

Margin of Sampling Error (MOSE)

quantifies mathematical uncertainty originating exclusively fro random sampling error in probability samples

MOSE exclusions

does not capture coverage error, nonrepsonse error, question wording effects, or other systematic errors