Study Notes on Measuring Bias

Measuring Bias in Ourselves and Others

Introduction

  • The discussion focuses on how to measure biases present in ourselves and in others, featuring insights from Delhi Chook from NYU.

Experiment Overview

  • Conducted an experiment involving the sending of emails to real professors at various universities.

  • Sample Size: 6,500 professors from 260 American universities were randomly selected.

  • Email Content: The emails were crafted to appear authentic, soliciting a meeting to learn more about a Ph.D. program.

  • Experimental Variation: The fictional sender’s name varied to reflect gender (male or female) and race (white, Chinese, Hispanic, Indian, or Black).

Findings

  • Responses Based on Identity:

    • Professors responded significantly more to emails from individuals with names that sounded white male compared to other identities.

    • This suggests a disparity in responsiveness based on racial and gender identity.

  • Interpretation of Findings:

    • There may exist explicit racism in some cases; however, it is suggested that many professors might be acting out of unconscious bias due to overwhelming workloads.

    • Subconscious Decision-Making: Professors may subconsciously decide whom to respond to, thus revealing inherent biases.

  • Bias Nature: Research emphasizes that racial biases are more about whom we choose to help rather than whom we choose to ignore.

    • Individuals tend to assist those who are perceived as similar to themselves.

Self-Audit for Bias

  • Recognizing the need for individuals to assess their own biases, methods include:

    1. Online Bias Tests:

    • A well-known test is available online, designed to evaluate personal biases.

    1. Data Audit:

    • Individuals can conduct personal audits using formal data (such as professional statistics) or informal data (anecdotal evidence).

    1. Example of Self-Audit:

    • An executive in Silicon Valley worked towards gender balance in teams despite evident male dominance in the tech industry.

    • He reviewed his professional social network on platforms like Twitter and LinkedIn to identify areas needing improvement.

  • Relevance of Self-Audits:

    • While not scientifically rigorous, such self-assessments can still provoke significant insights and assist in bias reduction.

Practical Steps for Recognizing Bias

  • Take Online Tests:

    • Explore online resources to take tests that can help identify individual biases.

  • Observe Email Interactions:

    • Analyze the emails one chooses to reply to and the potential biases therein.

  • Peer Observation:

    • Solicit an observer’s perspective on interactions, particularly useful for educators to review whom they engage with in class settings.

    • Encourage colleagues or friends to monitor their interactions and patterns of engagement.

  • Friendship Inventory:

    • Advise compiling a list of acquaintances and friends to analyze social circles for patterns reflective of biases.

    • This can serve as a form of self-assessment and help one identify imbalances in social networks.

Conclusion

  • Conducting a personal audit for biases, involving both self-reflection and third-party observation, is critical for understanding and addressing one's biases.

  • These practical steps can help foster a more equitable environment in personal and professional contexts.