Is science dangerous? - Medawar Lecture 1998 (Notes)

Page 1

• The Medawar Lecture 1998 by Lewis Wolpert, titled “Is science dangerous?” discusses the deep-seated cultural fear of science and the claim that science provides the best way to understand the world. It distinguishes science from technology and argues that scientific knowledge is value-free and does not carry moral or ethical value by itself.
• Key idea: Scientists are not responsible for how discoveries are used; their obligation is to publicize social implications and potential applications of their work. A notable exception cited is eugenics as an immoral misuse of science.
• Media representations distort genetics into “genetic pornography,” a phenomenon that sensationalizes imagery and headlines (e.g., a human ear on a mouse) to grab attention. Wolpert notes that such sensationalism sells newspapers but distracts from real societal issues.
• Despite public fear, science remains the best method for reliable, logical, quantitative, testable, and elegant understanding of the world. Science is central to culture, yet many find scientific explanations counterintuitive to common sense (e.g., heliocentrism, Darwinian evolution).
• Opening motifs include ancient and literary imagery: Adam and Eve and the Tree of Knowledge, Milton’s Paradise Lost, Shelley’s Frankenstein, Goethe’s Faust, and Huxley’s Brave New World. These convey long-standing anxieties about scientists meddling with nature and the perception of scientists as male-dominated, power-seeking figures.
• The lecture raises questions about whether science is dangerous and what social responsibilities scientists have. It also notes the irony that science enables us to recognize risks (e.g., global warming, BSE) that the public fears or misunderstands.
• The chapter concludes with a note on the public understanding of science and the ongoing challenge to improve communication about science to the public.

Keywords: genes; technology; trust; bioethics; social responsibility; public understanding

Quotes and references to cultural works:

• “Adam and Eve were forbidden to eat from the Tree of Knowledge.”
• “the serpent addresses the Tree as the ‘Mother of Science’”
• “archangel Raphael advises Adam to be lowly wise”
• Literature and media portrayals (Frankenstein, Faust, Brave New World) shape public perception of scientists.

Page 2

• The author reiterates the central claim: science is dangerous in culture-specific ways, yet science remains the best way to understand the world. He emphasizes the distinction between science and technology early on and notes the irony that science also enables us to know about risks in society.
• Important distinction: science is not technology. Science provides ideas about how the world works; technology uses those ideas to create usable objects. Technology predates modern science and has its own historical evolution (early crafts like agriculture and metalworking). The steam engine and cathedrals often operated without much input from modern science.
• Galileo’s telescope illustrates that invention can be serendipitous rather than the product of science alone; innovations often arise from imaginative trial and error, not a direct application of new theory.
• Modern technology is the arena where ethical issues arise (e.g., cloning, GM foods, nanotechnology). The relationship between science, innovation, and technology is complex and not a simple linear pipeline from discovery to application.
• Basic scientific research is driven by curiosity and is not inherently moral or value-laden; ethical issues arise when science is applied to create technology or when the conduct of science itself raises questions (e.g., experiments on humans or animals, safety concerns in GM foods).
• The drift from science to technology introduces ethical issues, while science itself remains neutral; debates about social responsibility center on how scientific knowledge and its applications are governed and who bears responsibility for outcomes.
• A critical point: there is no straightforward route from basic science to new technology. Marketing, business, and power dynamics influence whether ideas become practical applications.
• The chapter introduces the idea that even if science is neutral, its social implications may be profound in selected domains (e.g., human and plant genetics). The public understanding of science is essential for making informed decisions about these implications.
• The section concludes by noting that public understanding of science programs are necessary, but we still do not know how best to implement them.

Page 3

• Section 2: Technology
  • Core distinction between science and technology is reiterated: science yields ideas about how the world works; technology yields usable objects.
  • History: technology predates science; early human crafts arose without scientific insight. The steam engine and Renaissance cathedrals are cited as examples of technological feats accomplished largely through trial-and-error rather than science.
  • The five-minute theorem is mentioned as a heuristic for structural checks: if supports are removed and a building stands for five minutes, it is assumed to last forever (an anecdotal traditional rule, not a scientific principle).
  • Galileo’s telescope is highlighted as an instance where invention preceded scientific theory.
  • Modern technology raises ethical issues, from motor cars to cloning, and much modern technology rests on fundamental science, though the relationship is complex.
  • The linear model (science leads directly to technology) is incorrect; innovation also requires marketing, business acumen, and resources beyond the science itself.
  • Science is described as value-free, telling us how the world is; ethical considerations arise through the application of science in technology, including GM foods and potential nanotechnology hazards.
• Section 3: Social Responsibility
  • The lecture discusses whether scientists should advocate for the social uses of science. Sir Joseph Rotblat proposed a Hippocratic oath for scientists, arguing that scientists cannot remain neutral about application and that they should assess ethical implications and reliability of their work.
  • Rotblat’s oath emphasizes not using education to harm humans or the environment and to consider ethical implications throughout one’s career. The oath is controversial because it blurs the line between knowledge and application and assumes scientists have the capacity to anticipate social outcomes.
  • Wolpert argues that scientists cannot predict social or technological implications with precision; cloning is given as an example of unintended consequences from basic research.
  • The quote from Paul Valéry: ‘We enter the future backwards’ captures the unpredictability of how current research will be used. Scientists cannot account for all outcomes, but they do have a responsibility to communicate reliability and to consider social implications.
  • The social obligation of scientists is to publicize the implications and reliability of their work and to contribute to democratic deliberation about science. Yet, the actual power to decide on applications rests with policymakers, funders, and governments, not solely with scientists.
  • The argument emphasizes public understanding of science as essential to informed decision-making. The public should be able to evaluate the evidence and demand responsible actions; science education and public discourse are crucial.
• The page underscores that scientists should not become mere tools of government or industry; they should engage with public concerns and maintain independence.

Page 4

• Section 4: Eugenics
  • Eugenics defined by Francis Galton (1883) as improving the human stock by favoring certain hereditary traits. The phrase “good in birth” originates from Greek. The movement posited that many undesirable traits were inheritable, including criminality, prostitution, and pauperism, and advocated selective breeding or sterilization.
  • The eugenic program flourished in the early 20th century. Between 1907 and 1928, approximately $9000$ people were sterilized in the USA on grounds of perceived feeblemindedness. Prominent scientists supported eugenics: Huxley, Haldane, Hogben, Jennings, and others. American eugenicists linked human traits to specific races and even urged immigration controls to protect the genetic “germ plasm.”
  • The Nazi regime’s use of eugenic ideas culminated in state-sponsored sterilization laws in 1933 and the atrocities of concentration camps. Konrad Lorenz and other scientists are cited as having endorsed eugenic ideologies, illustrating how scientific narratives can become morally perverted when linked to political aims.
  • The moral lesson: scientific knowledge should be neutral; when it is entangled with political or social aims, it can be perverted and used to justify terrible crimes.
  • Despite this dark history, Wolpert concedes a paradoxical positive turn: modern eugenics aims to prevent and cure genetic disabilities, leveraging advances in genetics and prenatal diagnosis to reduce suffering (e.g., prenatal testing and selective termination of affected pregnancies). He cites Cyprus’s program to reduce thalassemia as an example of ethically commendable use of genetic knowledge.
  • The line between encouraging cure and endorsing abortion, or between therapy and eugenics, is nuanced. The discussion invites sympathy for curing genetic diseases while distinguishing it from coercive or biased social policies.
  • The speaker argues for supporting medical advances that can alleviate genetic diseases (e.g., muscular dystrophy, cystic fibrosis) while cautioning against conflating genetic determinism with social outcomes. The broader ethical point is to separate the value-laden social goals from neutral scientific knowledge and prevent it from being weaponized for discriminatory purposes.
• The text also notes the risk of misusing genetic claims (e.g., attributing complex behaviors to single genes) and the importance of avoiding reductionist interpretations in genetics.

Page 5

• Section 5: Reproduction: Cloning, Genes and Stem Cells
  • The Mary Shelley reference frames the public imagination: cloning evokes fear of meddling with human life, yet media sensationalism has often exaggerated the threat (Dolly the sheep, cloning debates). Jeremy Rifkin and others have called for bans or penalties, claiming moral panic, but Wolpert critiques this stance as lacking substantive ethical specifics.
  • Cloning raises questions about individuality, kinship, and the environment. Identical twins, for example, are natural clones and already exist without ethical panic. The fear of cloning a specific person (e.g., cloning Richard Dawkins) is a rhetorical exercise that highlights the complexity of personhood and identity when genetic sameness exists alongside different developmental environments.
  • The main ethical issue is how the child will be cared for and raised, not merely the act of cloning. The potential to abuse parental power is real, and the broader social harms of parenting (including abuse rates) weigh on the discussion of cloning and reproductive technologies.
  • The “designer baby” concept is criticized as an overblown ethical issue. The argument is that the real concerns lie in how children are raised and cared for, not solely in whether parents can select genetic traits.
  • The speaker distinguishes between genuine risks (e.g., high risk of abnormalities in animal cloning) and speculative fears about cloning; he argues that the ethical focus should be on the welfare of the child and the societal implications of parentage and autonomy rather than sensational doom.
  • The text addresses “bioethics” as a growing field, often dominated by speculative fears, and argues for a balanced approach that emphasizes procreative autonomy and rights to make reproductive choices, as long as there is a compelling public justification for limiting those rights.
  • Gene-dosage and the complexity of genes are discussed: there is no single gene for traits like intelligence or sexuality. Traits are polygenic and depend on developmental context. The language of “the gene for X” is misleading. A faulty gene can disrupt development, but most traits involve many genes and environmental input.
  • The Nuffield Council on Bioethics (1998) is cited as emphasizing a holistic view of persons, though Wolpert critiques potential over-anti-reductionism in response to complex traits like mental disorders. He defends a broadly reductionist view of science while acknowledging the limits of simplistic interpretations of genetics.
  • Gene therapy is acknowledged as promising yet carrying risks (e.g., safety, insurance, testing). The concept of “procreative autonomy” is raised, with references to Dworkin (1993).
  • Embryology and stem cells are discussed in depth: embryonic stem cells offer potential to repair damaged tissues (heart damage, paralysis), but their derivation usually involves the destruction of embryos; some oppose this ethically on grounds of embryo status. Therapeutic cloning to generate patient-m compatible stem cells is discussed as a potential route to avoid immune rejection, though it remains ethically contested.
  • The text contrasts embryonic stem cells with adult stem cells and argues that embryonic sources are not morally distinguishable from IVF-derived embryos in terms of ethical status. The environment and developmental context matter for the embryo, but the embryo’s moral status is a central ethical debate.
  • The section ends by reiterating the balance between scientific potential and ethical safeguards, stressing that advances in embryology and genetics have the potential to alleviate suffering while requiring careful public scrutiny and regulatory oversight.
• The section concludes by tying together the themes of reductionism, medical promise, and ethical governance in reproductive technologies.

Page 6

• Section 6: Politics
  • The literature is invoked: John Carey notes that the real antithesis of science may be politics—science seeks understanding and consensus, while politics relies on rhetoric, opinion, and coercion. Politics is about power and directing how lives are affected; science aims for universal explanations about how the world works.
  • Surveys show distrust of scientists, especially when connected to government or industry (e.g., BSE, GM foods). Wolpert asks whether people would refuse a medicine derived from a GM organism or reject a GM tomato that could prevent heart disease or reduce costs, highlighting that distrust does not always translate into behavior when it would affect one’s health.
  • He argues that ethical debates around new medical treatments and technologies (e.g., therapeutic cloning, embryology) require regulatory oversight and rationing. He contends that there should be a principled framework for evaluating which technologies to adopt, rather than blanket bans.
  • The debate over genetic bases of intelligence and race is flagged as a dangerous potential topic for political misuse. George Steiner’s warning about truths that could destabilize social relations is cited as a cautionary note about letting politics dictate scientific inquiry.
  • Wolpert’s stance is that there are no inherently dangerous areas of research that must be proscribed, provided scientists fulfill their social obligations and maintain openness about the reliability and implications of their work. He argues against censorship and for continued openness in scientific exploration.
  • Jefferson is quoted: “I know no safe depository of the ultimate powers of the society but the people themselves,” underscoring the need for public empowerment and education to enable responsible decision-making. The emphasis is on public literacy and democratic engagement rather than suppressing knowledge.
  • The main claim: better understanding of the world improves the chance of a just society and better living conditions. All technologies can be misused, but censoring knowledge is a dangerous slippery slope.
  • The public should be educated and involved to ensure that decision-making is democratic and informed, not controlled solely by elites.

Page 7

• Public engagement and governance
  • The conclusion foregrounds how to ensure that public concerns influence science policy: involve parliament, a free press, affected groups, and scientists themselves. Public understanding of science programs are essential, but their best methods remain unresolved.
  • The law regulating human embryo experiments is presented as a model of public debate and legislative action (the Human Embryology and Fertilization Authority). This demonstrates how public deliberation can shape policy.
  • Wolpert emphasizes that scientists must learn to interact with the public and avoid becoming mere tools of government or industry. He argues for ongoing dialogue between scientists, policymakers, and citizens to align scientific progress with democratic values.
  • The closing message is a call for openness, critical public engagement, and responsible use of science in society. The goal is to empower society to evaluate risks and benefits, rather than to lose control to technocratic or political gatekeepers.

References (as cited in the talk)

• Basalla, G. 1988 The evolution of technology. Cambridge University Press.
• Carey, J. 1995 The Faber book of science. London: Faber and Faber.
• Dworkin, R. 1993 Life’s dominion. London: Harper Collins.
• Kevles, D. J. 1985 In the name of eugenics. Berkeley: University of California Press.
• Muller-Hill, B. 1988 Murderous science. Oxford University Press.
• Nuffield Council on Bioethics 1998 Mental disorders and genetics: the ethical context. London: Nuffield Council on Bioethics.
• Rhodes, R. 1986 The making of the atomic bomb. New York: Simon & Schuster.
• Wolpert, L. 1992 The unnatural nature of science. London: Faber and Faber.