PA 10/28

Annotated Videography - Key Announcements

  • Upcoming Guest Lecture

    • Date: November 6, 2023 (Next Thursday)

    • Speaker: Professor Steve Slick

    • Position: Professor of Practice, LBJ School

    • Role: Director of Intelligence Studies Project at UT

    • Importance of Readings:

    • Assigned readings will enhance understanding of lecture material; however, they will not be part of the syllabus or tested.

    • Professor Slick has significant expertise, having worked at the CIA for nearly 30 years, making it essential to engage with the readings.

  • Early Voting Announcement

    • Location: LBA School for registered voters in Travis County

    • Note: Students outside of Travis County should check their registration and options for voting in their respective counties (e.g., absentee ballots).

Lecture Warm-Up on Policy Analysis

  • Scenario for Discussion:

    • Position: Policy analyst for the City of Austin

    • Task: Determine the effectiveness of a youth employment program for ages 14-17 after one year.

  • Discussion Points in Small Groups:

    • Assessing program success through various methods, such as:

    • Quantitative Measures:

      • Youth employment rate (change over time compared to previous averages).

      • Retention rates of employed youth.

      • Employers’ willingness to hire youth.

      • Average weekly working hours of employed youth.

    • Qualitative Measures:

      • Interviews with participants about their experiences.

      • Feedback from employers regarding the program's impact on hiring.

  • Focus on Methods:

    • Importance of integrating quantitative and qualitative research methods for comprehensive policy analysis.

Quantitative Methods in Policy Research

  • Definition:

    • The use of numerical data to identify patterns, describe populations, and test relationships between variables.

  • Key Concepts:

    • Unit of Analysis: Individuals, communities, schools, etc., depending on the research focus.

    • Measurements:

    • Translating abstract ideas into observable and comparable indicators.

    • Examples: Unemployment rates as proxies for job availability.

Measurement Fundamentals
  • Importance:

    • Measurement allows researchers to convert abstract concepts into quantifiable variables.

  • Concept to Indicator Process:

    • Identify a concept (e.g., poverty)

    • Determine variables (e.g., household income)

    • Establish indicators (e.g., percentage of households below the federal poverty line)

Types of Variables
  • Categorical:

    • No inherent order (e.g., school type: public, private, charter).

  • Ordinal:

    • Ordered categories but without precise differences (e.g., educational levels).

  • Continuous:

    • Numeric values with meaningful differences (e.g., household income).

Descriptive Statistics
  • Definition:

    • Summaries related to data presented clearly (e.g., mean, median, percentages).

  • Correlations:

    • Examining relationships between variables (e.g., comparing youth employment before and after a program).

Limitations of Quantitative Research
  • Measurement Challenges:

    • Difficulty in quantifying abstract concepts like trust or social cohesion.

  • Contextual Understanding:

    • Limited explanation of why phenomena occur, as it primarily shows correlations.

  • Subjectivity in Measurement:

    • Even quantifying objective data introduces subjectivity.

  • Potential Data Quality Issues:

    • Polls and surveys can suffer from inaccuracies and biases.

Qualitative Methods in Policy Research

  • Definition:

    • Systematic collection and interpretation of non-numerical data to gain insights into experiences and contexts.

Data Collection Techniques
  • Interviews:

    • Guided conversations to explore participant experiences (structured or semi-structured).

  • Focus Groups:

    • Group discussions that explore shared experiences and views.

  • Participant Observation:

    • Observing subjects in their natural environment.

  • Case Studies:

    • Detailed analysis of specific instances or programs for broader insights.

  • Document Analysis:

    • Analyzing text, speeches, or historical records.

Coding Qualitative Data
  • Coding Process:

    • Organizing data into categories based on emerging themes or pre-defined codes.

  • Inductive vs. Deductive Coding:

    • Inductive: Codes derived from data.

    • Deductive: Pre-defined codes applied to the data.

Strengths and Limitations of Qualitative Research
  • Advantages:

    • Deeper understanding of motivations, experiences, and contexts.

    • Flexibility in exploring complex issues.

    • Provides context to quantitative findings (e.g., explaining survey results).

    • Amplifies underrepresented voices and narratives.

  • Challenges:

    • Subjectivity in interpretation and analysis.

    • Time-intensive data collection and analysis processes.

    • Difficult to generalize findings to larger populations.

Mixed Methods Research

  • Definition:

    • Combination of quantitative and qualitative methods in a single study to provide a comprehensive analysis.

  • Designs:

    • Explanatory Sequential Design:

    • Quantitative data collected first, followed by qualitative data to explain findings.

    • Exploratory Sequential Design:

    • Qualitative data collected first to inform subsequent quantitative research.

    • Convergent Parallel Design:

    • Both methods are used simultaneously to enrich the analysis.

  • Key Principles:

    • Purposeful integration of methodologies to provide richer insights.

    • Triangulation to confirm findings or explore discrepancies between quantitative and qualitative results.

    • Development to ensure qualitative insights inform quantitative data interpretations.