Comprehensive Study Notes: Topic 2 – Sociological Research Methods (Education Context)
2.1 Researching Social Life
Objective of sociology in Chapter 1 context: balance between objective research and theory-building; research is complex with pitfalls.
Major issues that arise in sociological research:
Topic selection repetition and neglect: Why do some topics recur (e.g., young people and offending) while others are rarely explored (e.g., ecological rule-breaking by multinational companies)? Possibilities:
Socially important or interesting topics to sociologists
Funding biases: resources may flow to issues that threaten powerful groups’ interests
Method choice: Why do sociologists choose certain methods over others? Range from large-scale questionnaires with statistical analysis to long-term participant immersion with groups.
Question: Are there any violations of the research project by choosing one method over another?
The chapter promises to address ethical and theoretical debates around research methods and how these affect reading education research practically and theoretically.
The Choice of Research Area (before starting a study): several factors influence topic selection:
1) Researcher’s values and social position (e.g., gender, class, ethnicity) may lead to choosing issues perceived as important or interesting to the researcher.
2) Researchers’ professional interests: career progression, peer respect, job security; funding bodies (e.g., ESRC in Britain) channel money, which is government-influenced; this shapes which subjects get attention (e.g., standard proving in education) vs. less attention (e.g., student protests).
3) Sociologists’ alignment with broader sociological developments and societal needs; topics become fashionable or deemed important in particular eras (e.g., feminism influencing research on gender in education; new policies like academies/free schools influencing interest in those topics).
4) Practicalities: research that is impractical, expensive, or time-consuming is less likely; more practical, cheaper research is preferred.
5) Ethical considerations: areas with serious ethical difficulties are avoided; e.g., sexuality in schools vs. exam performance data availability; choosing a topic can reflect and reinforce prejudices about groups.
6) Theoretical stance: some researchers feel drawn to certain societal perspectives (e.g., Feminist, Marxist, or functionalist) which guide topic choices.Focus on how debates about topic importance relate to broader issues of power, representation, and social justice.
Emphasis on the interaction of values, professional incentives, societal developments, practicality, ethics, and theory in shaping research topics.
Practical implications for the educational research context: drive to study issues that link to policy and classroom practice, while balancing ethical concerns and methodological fit.
Key Concepts Introduced in 2.1
Reliability vs Validity: reliability concerns whether results would be the same if the study were repeated under the same conditions; validity concerns whether the study measures what it intends to measure and captures the truth about the social world.
Representativeness and Generalisability: representativeness asks whether the sample reflects a cross-section of the population; generalisability concerns whether findings apply to the wider population beyond the sample.
Objectivity: researchers’ values should not bias the design or execution; complete objectivity is unrealistic, but avoiding deliberate bias is essential.
Distinction between common sense and sociological research: common sense is often biased, limited, and non-systematic; sociological research seeks evidence-based understanding that can be tested and questioned.
Triangulation and methodological pluralism: using multiple methods to study the same issue to improve reliability and validity; combining quantitative and qualitative approaches.
Critical and interpretive approaches: different stances on whether sociology should be neutral or oriented toward uncovering injustice; examples include Marxism and feminism.
Ethical considerations in research: obtaining informed consent, avoiding harm, confidentiality, and safeguarding; especially salient in educational contexts with pupils and staff.
Examples, Connections, and Practical Implications
Reference to ESRC and government influence on funding and focus areas; link to policy-driven research in education.
Real-world relevance: research on education, equality, and access (e.g., how funding shapes what gets studied and how findings influence policy).
Conceptual link to previous chapters: the relationship between theory and method, how theoretical commitments guide method choice, and how ethics constrain design.
2.2 Choices in Research Methods, Practicalities, Ethics and Theories
Two broad epistemological positions:
Positivism (Quantitative, scientific approach): assumes objective social facts that can be measured with statistics; seeks correlations and laws; views human behavior as driven by external stimuli and social structures; emphasizes replicable, testable results using methods like surveys and official statistics.
Interpretivism (Qualitative, human-centric): emphasizes understanding meaning, motives, and interpretations from the perspective of individuals; uses qualitative data to understand social action, with focus on meanings and social processes; tends to favor qualitative methods like participant observation and in-depth interviews; less emphasis on generalizable statistics.
Theoretical orientations and their influence on research design:
Structural approaches (e.g., Marxism, functionalism): focus on how society is organized; use statistical methods to uncover general patterns; tend toward positivist methods.
Action/interpretive approaches (e.g., symbolic interactionism): focus on meanings and motives; favor qualitative methods; view social reality as constructed by people.
The role of triangulation and methodological pluralism: many sociologists mix methods to compensate for the limitations of any single method; triangulation helps build a more robust understanding and can address reliability and validity concerns.
Practical issues affecting method choice:
Money: larger samples cost more; travel, incentives, data processing can be expensive; sometimes cheaper options (e.g., online surveys) are chosen.
Time: longer studies require more resources and may delay results; researchers may be under time pressures to publish.
Access: gaining consent and access to participants can be challenging (schools, workplaces, government bodies, etc.); some populations are difficult to access (e.g., senior management meetings, cabinet meetings).
Ethical constraints: research must avoid harm; issues of confidentiality and potential career harm to participants; need to consider whether certain observations (e.g., in staff rooms) can be conducted ethically.
The relationship between practice, ethics, and theory:
Ethical considerations can limit what researchers can do (e.g., access, deception, covert observation).
Theoretical commitments influence what is considered ethical or acceptable in a given study; e.g., sensitivity to child protection issues in educational research.
Examples of research design elements in education:
Reay et al. (2010/2011) study on higher education choices among non-school-leavers from traditional middle-class backgrounds: used 502 questionnaires and 53 interviews; some qualitative data were not representative of the broader sample; emphasized issues of self-definition and representativeness; questions about ethnicity and class were used as variables; researchers used Registrar-General categories and omitted one group to simplify analysis; posed questions about improvements to research design.
Mac an Ghaill (Ethnographic studies in inner-city schools): used participant observation to understand racism and culture in education; adopted a Black perspective to reinterpret underachievement as coping with a racially structured institution; reflexivity about researcher’s position and its effects on objectivity.
Ethical and practical issues in educational contexts:
Gaining access to educational staff can be constrained by schedules, hierarchies, and potential job risk; DBS checks may be required for working with children; observational methods raise concerns about consent and the Hawthorne effect (presence of observer changing behavior).
Observing pupils in classrooms may distort behavior; interviews with teachers can be limited by professional scrutiny; sampling may be non-representative due to access constraints.
Theoretical debates and applications to education research:
How different theoretical approaches shape questions about schooling, equality, and opportunity; e.g., feminist theories focusing on gender inequalities; Marxist critiques focusing on power and class dynamics; functionalist focus on socialization and shared values.
2.3 Quantitative Research Methods
Core aims of quantitative research in sociology:
To gather statistical data about social life that can be tested for reliability and validity; to identify correlations and, where possible, causal relationships; to test theories using numerical data.
Common quantitative methods used in sociology:
Surveys: standardized data collection from large samples via questionnaires or structured interviews; data analyzed statistically; aims include factual description, attitudinal differences, and explanatory accounts.
Case studies (quantitative flavor): detailed numerical data on a limited number of cases; can be used to explore patterns across larger populations when aggregated.
Experiments: controlled testing of hypotheses with manipulation of independent variables and measurement of dependent variables; replication possible; limited use in sociology due to ethical and practical constraints.
Comparative methods: comparing differences across groups or societies to identify key factors; Durkheim’s suicide study is a classic example; similar logic to experiments but in real-world settings with variables not fully controllable.
Surveys: three main aims
1) Factual surveys: describe the population (e.g., how many people have internet access).
2) Antheirical surveys: uncover differences in values and attitudes (e.g., youth views on the Internet).
3) Explanatory surveys: explain aspects of social life (e.g., why some apply to university). Example: British Social Attitudes Survey; Longitudinal components like the Longitudinal Study of Young People in England.Longitudinal vs cross-sectional surveys:
Cross-sectional: snap-shot at one point in time; faster but may miss changes.
Longitudinal: study the same people over time (e.g., Longitudinal Study of Young People in England, started in 2004, with >15{,}000 participants initially; follow-ups annually). Problems: high cost and time, attrition as respondents drop out, possible behavior change due to participation.
Sampling and representativeness in quantitative research:
Random sampling: equal chance for each unit; large samples improve representativeness but are not guaranteed; sampling frames must be accurate.
Systematic sampling: e.g., every 10th name.
Stratified random sampling: population divided into strata (e.g., by gender, class), then random samples drawn within strata; ensures proportionate representation.
Quota sampling: quotas set for specific characteristics; non-random selection within quotas; useful for large populations when a sampling frame is hard to obtain.
Snowball sampling: identify one participant who then names others; useful for hard-to-reach groups but non-representative.
Theoretical sampling (Glaser & Strauss): select cases based on developing theory, often focusing on atypical cases to generate theory.
Reliability and validity in quantitative surveys:
Reliability: whether repeating the study yields the same results; replication enhances reliability; questionnaires designed well tend to produce stable results; systematic data collection reduces interpretive variation.
Validity: whether the methods measure what they intend to measure; validity and reliability do not always align (e.g., truthful responses on sensitive topics may be reliable but not valid).
Data types in quantitative research:
Primary data: produced by researchers (surveys, interviews, observations, experiments).
Secondary data: produced by others (official statistics, historical documents, government reports, media data).
Strengths and limitations of quantitative methods in education:
Strengths: ability to analyze large samples; statistical testing; potential generalizability; replicability.
Limitations: may overlook meanings, motives, and contextual factors; potential for measurement error; operationalization can distort complex social realities.
Conceptual issues related to data:
Construct validity: how well a measure captures the intended concept (e.g., crime statistics measure crimes recorded by police, not all crime).
Ecological validity: whether findings reflect natural behavior outside laboratory settings.
The Hawthorne effect and observer effects in observational components of quantitative research: the presence of researchers can alter behavior.
Notable quantitative educational studies and instances:
Longitudinal Study of Young People in England (started 2004) with over 15{,}000 participants initially; annual interviews.
The British Crime Survey (BCS) and Crime Survey for England and Wales (CSEW) as longitudinal or cross-sectional crime data sources.
Rosenthal & Jacobson (1968) discussed in the qualitative/experimental sections (labelling in education) to illustrate issues with causality and measurement.
Experimental methods in sociology (education context):
Common in natural sciences; less common in sociology due to ethical, practical, and validity concerns (e.g., lab settings cannot capture long-term social processes; Hawthorne effect; ethical constraints in schools and youth studies).
Field experiments (e.g., Rosenthal & Jacobson-type interventions) face access and ethical issues; replication challenges often occur, leading to debates about reliability and validity.
2.4 Qualitative Research Methods
Core belief: qualitative research aims to understand social life from the inside, focusing on meanings, motives, emotions, and social processes.
Forms of qualitative research include:
Observational studies (ethnography): intensive study of a group by observing daily life; can be participant (the researcher joins in) or non-participant; overt (group knows they are being studied) or covert (researcher hides their role).
Informal or unstructured interviews: open-ended conversations that explore respondents’ views in depth.
Focus groups: groups discuss a topic under researcher guidance; responses are jointly constructed.
Other qualitative methods include video/audio recordings and in-depth diaries.
Observational research: key distinctions
Participant vs non-participant observation:
Participant: researcher joins the group, may influence behavior; can yield deeper insights but risks going ‘native’ or losing objectivity.
Non-participant: observer watches without joining; less risk of bias but may yield shallower insights.
Overt vs covert observation:
Overt: group is aware of the research; ethical and practical benefits (consent, trust) but may alter behavior (Hawthorne effect).
Covert: researcher hides involvement; offers access to authentic behavior but raises ethical concerns about deception and consent.
The Chicago School and participant observation
Emphasis on seeing social life from subjects’ points of view; link to symbolic interactionism; researcher studies social meaning through participation and observation.
Advantages of qualitative observation
Rich, naturalistic data; ability to observe processes over time; potential to generate new theories and insights; can capture meanings and motives not accessible via questionnaires.
Disadvantages and challenges
Time-consuming and expensive; access issues; reactivity (observer effect); potential bias from the researcher; problems with reliability and replicability; generalizability limitations.
Ethnography in education: examples
Mac an Ghaill’s ethnographies of inner-city schools among African Caribbean and Asian minority groups; shift from cultural deficit explanations to racism-centered explanations; importance of Black perspectives.
Qualitative interviewing
Semi-structured vs unstructured vs fully structured; collaborative interviewing (Oakley) emphasizes rapport and mutual benefit; aggressive interviewing (Becker) can reveal sensitive views but risks ethical issues.
Focus groups in education
Useful for exploring group norms, attitudes, and shared meanings; risks include domination by certain participants and potential pressure on quieter members.
Ethical and theoretical issues in qualitative research
Gaining access and informed consent; confidentiality; potential harm to participants; staying objective vs researcher’s involvement; issues about representation and bias; potential ‘going native’ risk.
Hawthorne effect in classroom observations
The presence of the observer can alter how teachers and pupils behave; researchers must consider this when interpreting findings.
2.5 Asking Questions: Questionnaires and Interviews
Questionnaires: a key quantitative tool that can reach many respondents with minimal direct researcher involvement
Advantages: broad reach, relatively low cost, quick data collection, ability to generate statistical data, replicable with fixed questions, useful for testing theories.
Disadvantages: limited depth, potential lack of nuance for complex issues; risk of misinterpretation of questions; potential for low response rates and non-representative samples; not ideal for exploring meanings or motives.
Types of questions:
Closed questions: fixed responses (e.g., yes/no, scales); easy to code and analyze; good for reliability but limited for depth.
Open-ended questions: respondents write or describe in their own words; rich qualitative data but harder to code and analyze; favored by interpretivists.
Administration modes and trade-offs:
Face-to-face: higher response rates, clarifications possible; more expensive and time-consuming; potential interviewer bias.
Postal: cheaper, broader geographic reach; potentially low response rate; risk of biased samples.
Telephone: decent response rates; interviewer presence can influence answers; limited to those with phones.
Internet: cost-effective and broad reach; digital divide concerns; data quality varies.
Interview methods: flexible data collection that can yield rich information
Structured interviews: identical questions and order; easier to compare and analyze statistically; favored by positivists for replicability.
Semi-structured interviews: pre-planned but flexible questioning; balance between comparability and depth; common in education studies.
Unstructured interviews: open-ended, exploratory conversations; fullest depth; favored by interpretivists for understanding meanings and motives; harder to compare across respondents.
Interviewer effects and bias
Interviewer characteristics (age, ethnicity, gender, appearance) can influence responses.
Leading questions and interviewer tone can bias answers.
Interviewer bias can be reduced by careful training and standardized procedures, but cannot be eliminated entirely.
Group vs individual interviews
Group interviews (focus groups) allow interaction and idea generation but may be dominated by certain voices; individual interviews reduce peer influence but lack group dynamics.
Notable qualitative interviewing styles and contributions
Becke’s aggressive interviewing to reveal hidden attitudes; Oakley’s collaborative interviewing emphasises ethical engagement and participant involvement; Becker’s challenging questioning approach used with Chicago school teachers to uncover hidden views.
Coding and data analysis in interview data
Open-ended responses often require coding to identify themes; coding helps convert qualitative data into analyzable categories; interpretivists caution against imposing researcher’s categories; reliability can be aided by triangulation and transparent coding schemes.
Ethical considerations in interviewing
Ensuring consent, protecting confidentiality, minimizing harm; especially with vulnerable groups (pupils, minors); the need to balance research aims with participants’ welfare; confidentiality may override disclosure duties in sensitive contexts.
Example study: Stephen Frosh et al. (2002) Youth Lifestyles Study
Used group interviews and informal interviews to investigate masculinity among boys; included both qualitative and quantitative data; questions covered identity, ethnicity, and social experiences; demonstrated mixed-methods potential within qualitative-focused research.
Focus on research in education: Stephen Frosh et al.; Stephen Frosh’s qualitative interviews on masculinity; Frosh’s design showed structured yet exploratory inquiry into youths’ conceptions of masculinity and its educational implications.
Ethical and practical issues in interviewing teachers and pupils
Teachers often operate under professional scrutiny; interview data can affect careers; children have limited ability to understand and respond to questions; consent and DBS checks; timing and access considerations in schools.
The “PARENTS AND MATHEMATICALLY GIFTED CHILDREN” study (Brenda Bicknel, 2014)
Unstructured questions and interviews with parents; 15 mathematically gifted children; 23 questions; parent responses rated on a 5-point Likert-type scale across categories: Motivator, Resource provider, Monitor, Maths content advisor, Maths learning counsellor.
Questions focus on parental involvement in mathematics education and home supports; analysis involves operationalization of concepts and coding of responses for reliability.
Evaluative questions for students to engage with interview methods
Students are asked to compare types of questioning, discuss reliability and validity, and reflect on ethical considerations (e.g., with head teachers, parents, and pupils).
2.6 Secondary Sources of Data
What are secondary sources?
Data produced by others, used by researchers to answer new questions; can be quantitative, qualitative, or mixed; may be public or private; can include official statistics, historical documents, media content, diaries, letters, and online content.
Reasons for using secondary sources
Saves time and money; data already exists; supports analysis of long-term trends; enables study of past societies where primary data cannot be collected; access data that researchers cannot gather themselves ( 규모, scope).
Problems and limitations of secondary sources
Source bias: the original creator may have had a specific purpose; data may be selective or framed to support a particular view; classifying categories may not align with sociologists’ theories; definitions and categories may change over time (e.g., poverty, unemployment);
Data quality and methodological limitations: original data may lack rigor; sampling frames and measurement may not align with researchers’ needs; some statistics are crude and may misrepresent complex social phenomena.
Types of secondary data
Quantitative examples: official statistics; census data; government reports; labour force surveys; historical datasets.
Qualitative examples: official documents (policies, minutes); private documents (emails, diaries); life documents (letters, biographies); novels and autobiographies; media content; private letters and diaries; interviews and speeches.
Official statistics and their debates
Positivist view: official statistics can be valid and reliable social facts, used to identify correlations and possible laws (Durkheim’s approach to suicide data).
Interpretivist view: official statistics are interpretations produced by state agencies; data may be constructed via categorization and normalization; some events may be under/over-counted; e.g., crime statistics can reflect policing practices and definitions rather than pure social reality.
Radical and feminist critiques: statistics may reflect power inequalities; governments may define categories to minimize visible problem magnitudes; crimes of the powerful are underreported, while crimes of the poor are intensified in statistics.
Meta-analysis and secondary data synthesis
Meta-analysis aggregates multiple studies to enhance statistical power and generalizability; challenges include heterogeneity of studies and comparability of variables.
Qualitative secondary sources
Documents, transcripts, life documents, diaries, newspapers, film and TV; historical sources; public documents versus private documents; issues of representativeness and authenticity.
The internet and secondary data
The internet provides vast secondary data, including official reports, discussions, and user-generated content; advantages include breadth and accessibility; disadvantages include questions about reliability, credibility, and representativeness; need careful source evaluation.
Media content analysis as secondary data
Content analysis can be quantitative (counting occurrences, coding for themes) or qualitative (thematic or textual analysis); advantages include accessibility and low cost; disadvantages include subjectivity in interpretation and potential bias in selection of material; examples include Glasgow Media Group analyses on media bias.
Practical ethics with secondary data
Public domain data are typically less ethically fraught; private documents require consent and careful consideration of confidentiality and potential harm; researchers must assess why documents were produced and their intended audience.
Institutional example: The Equality and Human Rights Commission (EHRC) report How Fair is Britain?
Relied largely on existing studies and secondary sources to assess equal opportunities across health, justice, employment, and education; included data from Youth Cohort Study, ONS, HEA, and Department for Education; focused on adult lifelong learning participation using Labour Force Survey items.
Questions for study include: why rely on existing studies; strengths and weaknesses of adult education questions; range of inequalities addressed; potential improvements with primary data.
Key Concepts in 2.6
Meta-analysis: synthesis of multiple studies to increase statistical power and generalizability; issues: comparability of variables; heterogeneity across studies.
Content analysis (mass media): systematic analysis of media content; can be quantitative (counting occurrences) or qualitative (thematic analysis); main advantage: cheap, accessible, good for tracking biases; disadvantage: interpretation can be subjective.
Primary vs Secondary data: Primary data are data you collect yourself; secondary data are data collected by others; researchers must assess limitations and bias.
The internet and online data: mass data available online; critical assessment of credibility and authority of sources; the open nature of online content requires caution about reliability.
Public vs private documents: public documents are more readily accessible; private documents require consent and raise additional ethical issues about confidentiality and sensitivity.
GCSE league tables and value-added metrics: used to measure school performance, but controversial due to sampling, background factors, and potential manipulation by schools; contextual value-added metrics attempt to adjust for student background but have limitations.
Connections Across the Chapter
The chapter as a whole emphasizes how research design must balance practicalities, ethics, and theoretical commitments to produce credible, useful knowledge in education.
It links methodology to theory (positivist vs interpretivist) and to policy/real-world implications (funding, accountability, and educational equity).
It stresses that no single method provides all the answers; triangulation and mixed methods offer robust ways to approach complex educational questions.
It highlights specific real-world studies and contexts (e.g., Reay et al. on higher education choices; Mac an Ghaill on ethnography in schools; Frosh et al. on masculinity; Big Brother as a social-inquiry example) to illustrate methodological choices and their consequences.
Quick Reference: Key Terms and Concepts
Reliability: repeatability of results under the same conditions; replication improves reliability.
Validity: truthfulness of findings; different forms include construct validity and ecological validity.
Representativeness: sample reflects the population; generalisability concerns applying results beyond the sample.
Objectivity: minimizing researcher bias; acknowledging unavoidable subjectivity while striving for credible conclusions.
Positivism: emphasis on objective, measurable social facts; use of quantitative methods; search for laws and correlations.
Interpretivism: emphasis on meanings, motives, and interpretations; use of qualitative methods; bottom-up understanding.
Triangulation: using multiple methods to study the same phenomenon to cross-check results.
Operationalization: turning abstract concepts into measurable indicators; coding open-ended responses into categories for analysis.
Covert vs overt observation: whether participants know they are being studied; ethical considerations.
Gatekeepers: people who control access to groups or settings; important for gaining entry.
Meta-analysis: statistical combination of results from multiple studies.
Content analysis: systematic analysis of media content; can be quantitative or qualitative.
Value-added metrics: attempts to adjust for student background when judging school performance.
Notable Examples to Recall
Reay et al. (2010–2011): 502 questionnaires + 53 interviews; ethnicity/self-definition issues; use of Registrar-General categories; some sampling representativeness concerns.
Mac an Ghaill (1990s): ethnography in inner-city schools; shift from cultural deficit to racism-centered interpretation; emphasis on Black perspectives.
Frosh et al. (2002): qualitative group and informal interviews with 78 boys; masculinity and schooling.
Wilis (1977): Paul Willis study of anti-school boys using observation and group interviews.
Stephen Frosh et al. (2002) Youth Lifestyles Study: both qualitative and quantitative elements; group interviews and quantitative survey components.
Venkatesh (2009): Gang leader study; mixed methods with participant observation; ethical considerations around trust and illegal activity.
The Equality and Human Rights Commission (2011–2012): How Fair is Britain? relying on secondary sources and a mixture of public data sources.
Longitudinal Study of Young People in England: started in 2004; >15{,}000 initial participants; annual follow-ups; cost and attrition concerns.
Key Formulas and Numeric References (LaTeX)
Longitudinal study durations and sizes:
Longitudinal data up to 20 ext{ years}
Longitudinal Study of Young People in England: initial sample > 15{,}000
British Crime Survey frequency: ext{every } 2 ext{ years}
Case study samples and interview counts:
Reay et al.: nq = 502, ni = 53
Sullivan (2001) study: n = 465
Frosh et al. (2002): n = 78
Youth Lifestyles Survey (1998–1999): n = 4{,}800
Focus groups and qualitative samples:
Qualitative studies often use smaller samples; focus groups vary in size but typically involve several participants.
Various percentages:
YouGov sample: 50egin{cases} ext{ ext{% male}} \ 50 ext{% female} \ ext{oversampling of class A} \ ext{Black and minority groups ~} 12 ext{%} \ ext{school pupils in NZ sample context} \ ext{parents represented in sample} \ ext{design specifics vary} \
ext{(approximate summary)}
ext{Note: exact percentages vary by study; see case details.}
Notable quantitative data examples:
4 grades in GCSE league tables (crude performance measure)
ightarrow 4 ext{ grades}2,000 hours of video footage used in Educating Yorkshire case: 2{,}000 ext{ hours}$$