Notes on Defining and Measuring Crime: Data Sources and Statistics (Study Notes)
2: Defining and Measuring Crime — Data Sources and Statistics (Study Notes)
2.1 Dark or Hidden Figure of Crime
- Concept: the dark figure of crime refers to crimes that occur but are not captured in official statistics because they never come to the attention of the criminal justice system.
- Key statistic (illustrative): on average, more than half of the nation’s violent crimes went unreported to the police between 2006 and 2010, i.e., about violent victimizations per year remained unreported (according to a Bureau of Justice Statistics report).
- Common reasons crimes are not reported (three broad sources of crime statistics are discussed later):
- Official statistics: crimes known to police or arrests made.
- Self-report statistics: crimes individuals admit to having committed (even if not reported to police).
- Victimization statistics: crimes reported by victims in surveys.
- Three general sources will be elaborated (pros, cons, and use cases) to understand how to obtain an accurate picture of crime and trends.
- Practical implication: accurate crime statistics enable evaluation of policies and programs (e.g., whether incarcerating drug offenders is effective); introduces the idea of the risk principle (classifying offenders by risk level to tailor interventions).
- Personal example (story): a rural-to-suburban mindset about property (unlocked doors, no visible burglary) can lead to underreaction to property crime; victims may not contact police due to feeling it’s their fault or because they need to move on with daily life. This illustrates how underreporting and victim/offender dynamics affect official counts.
- Reasons people may not report crimes (6 items):
- The victim may not know a crime occurred.
- The offender is a family member, friend, or acquaintance.
- The victim thinks it is not worth reporting.
- The victim may fear retaliation.
- The victim may have committed a crime themselves.
- The victim does not trust the police.
- Foundational references cited in the material: works by Biderman & Reiss (1967) and Brantingham & Brantingham (1984).
2.2 Official Statistics
- Definition: official statistics are gathered from criminal justice agencies (police, courts) and represent the crimes reported to police or arrests made by those agencies.
- Important caveats:
- Officer discretion can affect whether a crime is recorded or an arrest is made; non-arrested cases may not appear in official counts.
- Changes in data collection techniques can create apparent changes in trends (e.g., newly added questions about prescription drug abuse may inflate apparent rates simply because the question is new).
- FBI Uniform Crime Reports (UCR): the largest, most common data source on crime.
- UCR program details:
- Primary objective: generate reliable information for law enforcement administration, operation, and management.
- Four annual publications; data come from > agencies (city, county, state, tribal, federal).
- Started by the International Association of Chiefs of Police in 1929; FBI tasked with collecting/publishing in 1930.
- Four data collections within UCR:
- National Incident-Based Reporting System (NIBRS)
- Summary Reporting System (SRS)
- Law Enforcement Officers Killed and Assaulted (LEOKA) Program
- Hate Crime Statistics Program
- UCR also publishes special reports on topics like Cargo Theft, Human Trafficking, and NIBRS topical studies; National Use-of-Force Data Collection planned.
- National Incident-Based Reporting System (NIBRS):
- Improves data quality by collecting data on crimes reported to police and incidents with multiple crimes (e.g., a robbery escalates to rape).
- Collects information on victims, known offenders, relationships between victims and offenders, arrestees, and property involved.
- Hate Crime Statistics:
- Established by the Hate Crime Statistics Act (28 U.S.C. § 534) in 1990.
- Data on biases such as Race/Ethnicity/Ancestry, Religion, Sexual Orientation, Disability, Gender, and more (extensive bias categories listed in the material).
- Purpose: aid law enforcement, inform lawmakers, provide credible information to the media, and support victims.
- LEOKA (Law Enforcement Officers Killed and Assaulted) Program:
- Provides data and training to help keep officers safe; emphasizes why an incident occurred (context and prevention) rather than just what occurred.
- Exclusions: deaths due to natural causes; deaths attributed to personal situations (e.g., domestic disputes) while on duty; some job roles are not included (e.g., corrections officers, bailiffs, federal judges, etc.).
- Practical notes:
- Official statistics offer a broad view of reported arrests and incidents but must be interpreted with awareness of reporting practices and policy changes.
2.3 Victimization Studies
- National Crime Victimization Survey (NCVS): the primary source of information on criminal victimization in the U.S.; administered by the U.S. Census Bureau.
- Design and scope:
- Sample: about households and persons.
- Coverage: nonfatal personal crimes (rape/sexual assault, robbery, aggravated and simple assault, personal larceny) and household property crimes (burglary, motor vehicle theft, other theft).
- Captures both reported and unreported incidents to fill gaps in official statistics.
- Collects extensive demographic info (age, sex, race, Hispanic origin, marital status, education, income) and detailed crime characteristics (time/place, weapons, injury, economic consequences), plus whether it was reported to police and reasons for reporting or not.
- Tools for data exploration:
- NCVS data can be analyzed via the BJS analysis tools to generate national estimates of victimization (numbers, rates, percentages) from 1993 to the most recent year.
- Quick Tables show trends in crime and reporting; Custom Tables allow deeper analysis by victim, household, and incident characteristics.
- Challenges and limitations:
- Recall bias: respondents may forget incidents or misdate them.
- Trauma can blur events (e.g., years misremembered).
- Social desirability or mistrust can lead to underreporting, while fear or shame can cause misreporting.
- Bounding and methodological techniques aim to mitigate these issues, but limitations persist.
- Role and value:
- Fills gaps left by UCR/NIBRS by capturing crimes not reported to police, including some victimless or less-crime categories.
- Practical application: use NCVS to examine trends in victimization and reporting, informing policy decisions and resource allocation.
2.4 Self-Report Statistics
- Concept: statistics based on information provided directly by individuals about their own past behavior.
- Monitoring the Future (MTF): a long-running, annual study of the behaviors, attitudes, and values of American youth and young adults (high school students, college students, and young adults).
- Sample: about students across 8th, 10th, and 12th grades each year; includes annual follow-up questionnaires for some cohorts.
- Conducted at the University of Michigan’s Survey Research Center; funded by NIH.
- Focus: identify emerging problems (e.g., substance use) and track trends to inform policy and intervention strategies.
- Data collected and topics:
- Self-reported drug use, vaping, etc., including victimless or low-kept-crime activities (e.g., underage drinking, shoplifting).
- Emphasis on confidentiality to encourage truthful reporting.
- Strengths:
- Can reveal problems not captured by official statistics (e.g., vaping among teens, underreported or victimless crimes).
- Helps identify broad trends and risk factors across populations.
- Limitations:
- Potential for exaggeration or underreporting; honesty depends on respondents.
- Sampling coverage matters (e.g., school-based surveys may miss students who are suspended, absent, or homeschooled).
- Practical implications:
- Self-report data can illuminate issues that may not have a clear criminal justice footprint, such as drug use or other non-victim crimes.
- References discussed in the material include the Monitoring the Future overview reports (Johnston et al.) and foundational works on delinquency measurement.
2.5 Misusing Statistics
- Theme: statistics can be misused to promote myths about crime or to mislead the public, whether intentionally or accidentally.
- Common misuses include:
- Limiting public access to critical information.
- Presenting false or misleading information.
- Using deceptive formats to present data.
- Example prompt included in the material:
- Find a news article demonstrating apparent misuse of statistics or demonstrating the pursuit of accurate information about crime.
- Example referenced: Myanmar (Rohingya) genocide discussions; contrasts between government labeling and international recognition; the Washington Post article on genocide terminology and reporting (as a case study for mislabeling and data interpretation).
- References cited for misuses and methodological critique:
- Kappler, V., & Potter, G. (2018). The Mythology of Crime and Criminal Justice (5th ed.). Waveland Press.
- Pedagogical exercise goals:
- Analyze how an article may misuse statistics or provide reliable information.
- Discuss why the article was chosen and what makes it a misuse or a responsible representation of data.
- Conceptual takeaway:
- Distinguishing fact from opinion and recognizing the role of sources, context, and measurement in interpreting crime statistics.
- Related ethical and practical implications:
- Misuse can shape public fear, policy priorities, and resource allocation; responsible data literacy is essential for informed citizenship.
Connections, concepts, and practical implications
- Triangulation: The chapter emphasizes using multiple data sources (official stats, victimization surveys, and self-report studies) to obtain a more complete and reliable picture of crime.
- Policy and evaluation: Statistics are used to evaluate criminal justice policies (e.g., deterrence, incarceration, and intervention strategies) and to inform patrol allocation, rehabilitation services, and prevention programs.
- Temporal trends: Longitudinal data (e.g., NCVS, MTF) enable assessment of trends over time and the impact of policy changes, policing strategies, or societal factors.
- Reliability and validity: Differences in data collection methods affect reliability and validity; researchers must be cautious when comparing across sources or over time.
- Ethical considerations: Ensuring confidentiality (e.g., MTF) and addressing biases in reporting are crucial for ethical data collection and interpretation.
- Real-world relevance: Understanding the strengths and limitations of each data source helps in making informed decisions about crime policy, resource allocation, and public communication.
Quick reference: key numerical and structural details
- Underreporting of violent crime: approximately >0.5 (more than half) of violent crimes go unreported in some periods; 3.4 million annual violent victimizations unreported (2006–2010) →
- UCR agencies: the program includes > participating agencies.
- Data collections under UCR: NIBRS, SRS, LEOKA, Hate Crime Statistics Program.
- NCVS sample size (yearly): about 135,000 households; about 225,000 persons.
- MTF scale: ~50,000 students per year across 8th, 10th, and 12th grades.
- Key dates: UCR started in 1929; FBI assumed data handling in 1930; Hate Crime Statistics Act passed in 1990; MTF ongoing since the late 20th century with annual reports.
Note on study focus and exam relevance
- Be able to explain:
- What each data source measures (official, self-report, victimization).
- Strengths and limitations of each source.
- Scenarios where each data source is most appropriate for studying different crimes or policy questions.
- How data collection changes can affect trend interpretation.
- How to critically assess statistics and avoid misuses in real-world reporting.
Connections to foundational principles in criminology and public policy
- Measuring crime is as important as defining crime; without accurate measures, policy cannot be effectively tailored to reduce crime and protect the public.
- Evidence-based practice relies on triangulated data and transparent reporting of limitations.
- Ethical data use entails protecting respondent confidentiality (as with MTF and NCVS) and avoiding sensationalism or misrepresentation of statistics.
Formulas and explicit numbers (LaTeX formatting)
- Proportion of unreported violent crimes (illustrative):
- Estimated annual violent victimizations unreported (example): per year for 2006–2010.
- UCR participating agencies: > agencies.
- NCVS sample: households; persons.
- Monitoring the Future annual sample: about students.
Suggested study prompts from the material
- Compare and contrast official statistics, self-report statistics, and victimization statistics in terms of what they measure, how they are collected, and what biases they may introduce.
- Discuss how the dark figure of crime influences policy decisions and how triangulation across data sources can mitigate misunderstandings.
- Explain how data collection changes (e.g., new survey questions) can create artificial shifts in crime trends and how researchers should interpret such changes.
- Analyze a hypothetical policy evaluation (e.g., incarceration of a drug offender) using the risk-principle framework and the available data sources to determine which data would best inform conclusions.
Summary takeaway
- Measuring crime is inherently complex due to underreporting and reporting biases.
- A robust understanding requires using multiple data sources, recognizing their limitations, and carefully interpreting trends to inform policy and practice.
- Ethical data use and critical analysis are essential to avoid misleading conclusions and to support evidence-based criminal justice.