Chapter 18: Forming a Judgment - Comprehensive Study Notes

Judgments and Evaluation

  • Judgments: conclusions arrived at through examination of evidence and careful reasoning; products of thinking, not spontaneous feelings. They may include intuitive elements, but those must be weighed and evaluated first.
  • Truth and knowledge: a judgment’s value isn’t guaranteed; there can be foolish or wise judgments, and superficial or penetrating ones.
  • Purpose of the critical-thinking strategy: promote thoughtful judgments by knowing ourselves, clarifying issues, conducting inquiry, and evaluating evidence.
  • Resolving conflicts in evidence: experts don’t always agree; people may view the same event differently; eyewitness reports can conflict even if honest.
  • Misconceptions about science: more scientific procedures do not remove the need for evaluation; data must be classified and interpreted to be meaningful.
  • Illustrative case: ancient burial in central China (about 21002100 years ago) shows evaluation is essential even with mass of data.
    • Burial details: airtight coffin with a special fluid; encased in five larger boxes lined with five tons of charcoal; unit buried in a 6060-foot hole and surrounded by white clay.
    • Autopsy and analyses performed (hair, stomach, muscles, bones, lungs, gallbladder, intestines; X-rays of bones) but interpretation was necessary to derive conclusions (e.g., she bore children, ate a melon shortly before death, and likely died from an obstructed coronary artery).
  • Takeaway: evaluation plays a critical role across disciplines; in less clear information or more conflict, the quality of a judgment can depend even more on evaluation.

Evaluating Evidence

  • Evaluating evidence involves asking and answering the right questions. The discussion here summarizes earlier chapters (Chapter 6).
  • The Kind of Evidence:
    • Personal experience (yours or others)
    • Unpublished report
    • Published report
    • Eyewitness testimony
    • Celebrity testimony
  • The Questions to Ask About Evidence:
    • Are the experiences typical or atypical?
    • Are they sufficient in number and kind to support the conclusion?
    • Where did the story originate?
    • How can I confirm that the version I heard is accurate?
    • Are the sources of important items of information cited?
    • Does the author have a reputation for careful reporting?
    • Does the publisher or broadcaster have a reputation for reliability?
    • Which statements might a thoughtful person challenge?
    • How well does the author answer the challenges?
    • What circumstances could have distorted the eyewitness’s perception?
    • What circumstances since the event could have affected his or her recollection?
    • For advertisements or infomercials, is the celebrity a paid spokesperson?
    • For talk show comments, does the host ask for such support?
    • For other categories (e.g., headlines), are there caveats or biases to consider?
  • A universal question for all kinds of evidence: Is this evidence relevant to the issue under consideration? If not, it deserves no consideration, regardless of its other strengths.

Evaluating Your Sources’ Arguments

  • In addition to evaluating the evidence you have, examine the arguments others advance. (See Chapter 7 for a fuller method.)
  • How to assess an argument’s support:
    • Expert opinion, experiment, statistics, survey, formal observation, research review, celebrity, offer – does the source provide supporting references?
    • Does the expert have specific expertise in the issue?
    • Does the expert support the view with references to current research?
    • Do other authorities agree or disagree?
    • For a lab experiment, has it been replicated? For a field experiment, have findings been independently confirmed?
    • Is the source of statistics reliable? Was the sample representative?
    • Were survey questions clear and unambiguous? Was there nonresponse bias?
    • Do other surveys corroborate findings?
    • Could observer presence have distorted outcomes?
    • Was the observation of sufficient duration?
    • Do conclusions overgeneralize? Has the reviewer omitted relevant research?
  • Note: See Chapter 7, pages 89–9489–94.

Summaries as Tools for Evaluation

  • Condensing arguments into a summary can simplify evaluation, but each sentence requires scrutiny.
  • The example: a summary of a Chapter 17 exercise (sentences numbered 1–5) with corresponding evaluative questions (1–5).
  • The Summary:
    1. One of the biggest obstacles to learning—in grade school, high school, and college—is grades.
    2. The fear of bad grades hangs over learners from ages ~
    • summarized: five- to twenty-something.
    1. Anxiety over grades can eliminate natural joy in learning.
    2. Conscientious students view schoolwork as oppressive drudgery; marginal students may cheat.
    3. The author argues that grades should be abolished at all levels of education.
  • The Questions:
    1. Are grades an obstacle to learning? Do they affect all levels?
    2. Do all young people fear bad grades? Is it serious?
    3. Is there natural joy in learning? Do grades cause anxiety? Across all subjects or only some?
    4. Do conscientious students view schoolwork as oppressive drudgery? Are some influenced by grades more than others? Do some cheat because of grades?
    5. Would abolishing grades solve all problems? Could it create others? Would effects differ by educational level?
  • Additional example: Joyce Brothers’ response to a reader’s question is presented with a background note; the Summary (Brothers’ Response) and Analysis follow, illustrating how summaries and analyses expose assumptions and alternative interpretations.
  • The Analysis section questions whether the husband’s homophobia claim is certain, considers alternative explanations, and asks what further information would clarify the case.

Benefits of Asking Appropriate Questions

  • Taking time to ask questions yields several benefits:
    • Prevents hasty judgments based on first impressions.
    • Enables evaluation of each part of an argument, identifying strengths and weaknesses.
    • Provides a structure for organizing thoughts and responses.
  • The Answers you develop form your response to the argument, and you can present them in the order of your questions or in a different coherent pattern.

Making Important Distinctions

  • Six kinds of distinctions frequently necessary to avoid faulty evaluations:
    1. Between the person and the idea.
    • Ideas should be evaluated independently of who holds them; admirable people can be wrong and despicable people can be right.
    • A person’s gender, color, nationality, or religion is not a proper basis for judging ideas.
    1. Between what is said and how it is said.
    • Style does not guarantee truth; eloquence does not guarantee sound ideas. As Saint Augustine said: "Our concern with a man is not with what eloquence he teaches, but with what evidence."
    1. Between why people think as they do and whether what they think is correct.
    • Motives can be unworthy, but the soundness of an idea depends on how well it fits the reality, not on the mover’s motives.
    1. Between the individual and the group.
    • The individual may differ from the group; do not attribute group characteristics to an individual or vice versa.
    1. Between matters of preference and matters of judgment.
    • Preferences are tastes; judgments concern interpretations of facts and theories.
    1. Between familiarity and correctness.
    • Familiar ideas are not necessarily correct; evaluate ideas on their merits, not on how familiar they are.

Expressing Judgments

  • Expressing a judgment can alter it; it’s best to be precise in words.
  • Guidelines for expressing judgments effectively:
    1. Strive for a balanced view.
    2. Deal with probability.
    3. Make your subject appropriately specific.
    4. Make your predicate exact.
    5. Include all appropriate qualifications.
    6. Avoid exaggeration.

Strive for a Balanced View

  • A balanced view reflects the issue’s complexity; avoid fashionable but one-sided positions.
  • Example: Rushdie’s The Satanic Verses sparked a widening debate about freedom of expression vs. respect for religious beliefs.
    • Western literary communities defended freedom of expression; yet balanced views recognized the need for deference to religious beliefs.
  • Another example: self-esteem in education—recognize that self-esteem can sometimes hinder achievement if it is not earned; distinguished between “earned” self-esteem and “feel-good-now” self-esteem.
  • The key to balance: seek neglected angles and avoid denying important related principles.

Deal with Probability

  • In controversial issues, certainty is often unattainable; it is intellectually honest to acknowledge uncertainty.
  • If certainty isn’t possible, indicate what probability the evidence supports: what relationship or conclusion is suggested by the evidence rather than proven beyond doubt.
  • Examples: cigarette smoking and lung cancer; viewing television violence and harm—both have sufficient evidence to justify judgments about probable causal relationships, even if not absolute certainty.

Make Your Subject Appropriately Specific

  • The subject of a judgment should be precisely delimited.
  • Example progression (the subject grows more specific):
    • Today’s college students are less proficient in grammar and usage than their counterparts were ten years ago.
    • Today’s U.S. college students are less proficient than counterparts ten years ago.
    • Today’s U.S. two-year college students are less proficient than counterparts ten years ago.
    • Today’s students at this college are less proficient than counterparts ten years ago.
  • If the evidence covers only a particular college, only the last judgment is sound.

Make Your Predicate Exact

  • The predicate must state exactly what you mean.
  • Examples of varying meaning:
    • Peace has been achieved.
    • Peace can be achieved.
    • Peace must be achieved.
    • Peace should be achieved.
    • Peace could be achieved.
    • Peace will be achieved.
  • The meaning difference is crucial; a slogan like "God is dead" can be interpreted in many ways; without clarifying which meaning is intended, the audience remains ignorant and misled.

Include All Appropriate Qualifications

  • Saying something usually happens is different from saying it frequently happens or happens in a specific condition.
  • Qualifications should specify time, place, and conditions; many judgments require careful qualifiers to be defensible.
  • Example: Americans men over forty who never attended college tend to oppose the idea of women’s liberation championed by NOW.
    • This statement includes time, place, and demographic qualifications.

Avoid Exaggeration

  • People often use hyperbole; such embellishment reduces credibility when evaluating others’ reports.
  • To maintain credibility, especially with distant audiences, avoid exaggeration and, when uncertain, err on the side of understatement.
  • The principle: if unsure, prefer cautious interpretation over sensational claims.

The Critical Thinking Strategy (Chapter Summary)

1) Know yourself and be mindful of how your habits of mind undermine issue treatment.
2) Be observant and reflect on what you see and hear.
3) When you identify an issue, clarify it by listing its aspects and posing probing questions about each.
4) Conduct a thorough inquiry, obtaining relevant facts and informed opinions.
5) Evaluate your findings, then form and express your judgment.

  • This serves as a practical checklist to refer to when examining issues.

Applications

  • Analyze two of the following summaries using the demonstrated method; go beyond first impressions and address errors in thinking from Chapter 13.
    a) Feeling and intuition are better guides to behavior than reasoning; immediate answers are preferred over slow reasoning; follow feelings and intuition instead of thoughts to achieve individuality.
    b) The Golden Rule and altruism: self-interest should be curbed for social harmony; however, the claim that altruism is the primary driver of conflict may be mistaken; pursuing one’s own interests could reduce hypocrisy and promote understanding.
  • The exercise emphasizes evaluating the argument structure, identifying assumptions, and offering reasoned judgments about validity and relevance.

Notable Numerical References and Examples (for quick recall)

  • Ancient burial case: 21002100 years ago, in a6060-foot hole, five tons of charcoal, five large boxes.
  • The body’s preservation allowed autopsy analyses across multiple tissues, demonstrating the need to interpret data rather than simply collecting it.
  • Population and sample considerations in evaluating statistics and surveys (refer to Chapter 7 discussion on representativeness and response rates).
  • Cross-chapter references: Chapters 6, 7, 8–13, 17; especially “The Kind of Evidence” and summarization techniques; the notes encourage drawing connections back to foundational principles from earlier sections.

Connections to Foundational Principles and Real-World Relevance

  • The chapter reinforces core critical thinking practices: clarify issues, evaluate evidence, consider alternative interpretations, and avoid cognitive biases.
  • Ethical implications: maintaining openness to other beliefs and avoiding ad hominem judgments is necessary for constructive discourse.
  • Practical implications: in professional contexts (science, journalism, law, education), robust evaluation of evidence and careful articulation of judgments improve decision quality and public trust.
  • Philosophical implications: distinguishing between evidence, interpretation, and inference is central to epistemology and to resolving disputes about truth and belief.

Summary of Core Principles (Quick Reference)

  • Judgments require evaluation and reasoning; intuition can inform but must be weighed.

  • Evidence must be evaluated on its relevance, reliability, and sufficiency; consider sources, methods, and potential biases.

  • When evaluating arguments, consider the strength of support across different kinds of evidence and whether conclusions generalize beyond the data.

  • Use summaries and structured questions to avoid first-impression bias; distinguish between person and idea, why someone thinks something, and the content itself.

  • Express judgments with balance, probabilistic reasoning, specificity, precise predicates, and appropriate qualifications; avoid exaggeration.

  • Always aim for a balanced view, acknowledge uncertainty, specify the subject and predicate, and justify limitations.

  • Use a clear process: know yourself, observe, clarify, inquire, evaluate, and articulate.

  • End of notes.