Topic 10: Problem Solving
Foundational Principles and Definition of Problem Solving
Core Definition of Problem Solving: Problem solving is the goal-directed cognitive process of bridging the gap between an initial state of affairs and a desired goal state when no single operator, routine, or predetermined strategy is immediately available to the cognitive agent.
Essential Criteria Defining a Problem Situation:
Dual Distinct States: An individual currently occupies an initial state and desires to attain a distinctly different goal state (e.g., currently not possessing a winning lottery ticket versus possessing a winning lottery ticket).
Absence of Immediate Path: The specific sequence of actions required to bridge the distance between the two states is not immediately apparent to the agent.
Consciously Guided Multi-Step Execution: Resolving the gap demands a consciously guided, multi-step sequence of transformations wherein the solver decomposes the macro-goal into manageable sub-problems and applies intermediate operators.
Problem Solving Versus Memory Retrieval:
When an adult is confronted with arithmetic tasks such as or , the task does not constitute a problem; the solution ( or ) is automatically retrieved from long-term memory without search.
For a -to--year-old child who is acquiring arithmetic concepts, or represents an authentic problem requiring conscious procedural rules, counting strategies, and intermediate stages.
For a -year-old child, the presentation of cannot be instantiated as a problem because the child lacks the semantic representations and domain knowledge required to register the task or comprehend the goal.
For an adult, calculating a non-retrievable operation such as instantiates an authentic problem requiring multi-step algorithmic execution.
Systemic Cognitive Context: Problem solving operates alongside reasoning and decision-making to transform internal representations after information has entered the cognitive architecture via perception, undergone categorization, and entered working memory and long-term storage.
The Gestaltist Tradition and Perceptual Restructuring
Countermovement to Behaviorism: Emerging in the early twentieth century (Wertheimer, , , ; Koffka, ; Katona, ; Duncker, ; Köhler, ), the Gestalt perspective opposed Edward Thorndike's () associationist doctrine, which asserted that animals and humans resolve difficulties exclusively through blind, reproductive, trial-and-error reinforcement.
Holistic Structure and "Gute Gestalt": Gestalt psychology conceptualized thinking as a meaningful endeavor to perceive the fundamental nature and affordances of a problem situation as a whole. Problem solving is the process of transforming a structurally deficient, disturbed Gestalt into a harmonious "good Gestalt" (gute Gestalt) by clearing existing barriers to fulfill a goal.
Wolfgang Köhler's Primate Studies on Tenerife ():
Köhler tested whether chimpanzees (notably Sultan) solved spatial problems through intelligent perception or blind trial and error.
Sultan was presented with a banana positioned outside his enclosure, beyond the reach of his arms. Two hollow bamboo sticks were placed inside the enclosure, neither of which was sufficiently long to reach the reward independently.
After unsuccessful attempts, Sultan purposefully inserted the narrower stick into the wider stick to produce an extended tool, smoothly fishing the banana into the cage.
Köhler maintained that this behavior demonstrated sudden insight into the functional affordances of the environment rather than incremental behavioral conditioning.
Max Wertheimer: Productive Versus Reproductive Thinking:
Reproductive Thinking: Characterized by rote application of previously mastered, mechanical habits, drill, or unthinking associative recall.
Productive Thinking: Driven by structural insight into the relational properties of the problem constituents, leading to genuine restructuring.
Wertheimer's Triangle Problem:
Solvers must compute the area of an isosceles triangle given side length , an apex right angle (), altitude , and base .
A reproductive approach attempts to calculate the segments and to satisfy the conventional area formula , resulting in cumbersome mathematical labor.
A productive approach restructures the triangle by rotating it , recognizing that it constitutes exactly one-half of a square of side along diagonal . The area is instantly computed via the restructured formula .

Young Gauss's Enumeration Problem:
Asked by his schoolteacher to sum consecutive integers from to (), the young Carl Friedrich Gauss avoided blind addition.
Gauss re-clustered complementary pairs from opposite extremes (, , , , ), yielding clusters of , yielding .
This structural insight generalizes to the universal arithmetic progression equation: , where denotes the series length.

Karl Duncker's Stepwise Navigation and Problem Protocols ():
Duncker's monograph On Problem-Solving unified restructuring with stepwise procedural navigation across an internal problem space, anticipating subsequent computational models.
The Inoperable Stomach Radiation Problem: A patient has an inoperable stomach tumor. Rays of sufficient intensity destroy human organic tissue, yet low-intensity rays leave tissue unharmed. The task requires destroying the deep tissue tumor without damaging the surrounding healthy stomach walls.
The Radiation Solution: Direct multiple rays of weak intensity toward the body from divergent angles so that they intersect simultaneously at the locus of the tumor, superimposing their intensity precisely at the tumor site.
Think-Aloud Protocols: Duncker pioneered the "think-aloud" protocol, instructing participants to verbalize intermediate thoughts continuously as they attend to them. Unlike Wilhelm Wundt's classical introspection, think-aloud verbalizations provide a concurrent record of working memory contents, serving as raw data for cognitive models without requiring subjects to theorize about their own mental operations.
Functional Value Tree: Duncker categorized attempts according to their functional value (the underlying principle or "sense" of a proposed move), demonstrating bidirectional search where individuals move forward from the start state or backward from hypothesized goal states.
Cognitive Impediments to Productive Restructuring:
Functional Fixedness: Mental fixation on the customary, learned function of an object to the exclusion of novel uses. In Duncker's Candle Problem, participants receive a candle, matches, and a pasteboard box filled with thumbtacks, tasked with mounting the candle to a wall so no wax drips on the table. Solvers routinely fail because they conceptualize the box exclusively as a container. Emptying the box and placing the tacks separately on the table emphasizes the platform affordance, markedly increasing solution rates.
Mental Set (Einstellung Effect): The rigid mechanization of problem-solving habits induced by repetitive reinforcement. Abraham Luchins () demonstrated this using Water Jug Problems:
Participants are given three jugs of set capacities (, , and ) to obtain an exact volume.
In training trials, participants learn the complex algorithm (e.g., given Jug , Jug , and Jug , they compute ).
When presented with a subsequent test problem solvable by a simple subtraction (; such as Jug , Jug , Jug , goal ), trained participants persist in the convoluted formula , whereas naive control groups deploy the direct subtraction immediately.
Information Processing Theory and the Problem Space Hypothesis
Historical Foundation: Emerging at the Dartmouth Conference, Allen Newell, Herbert Simon, and J. C. Shaw introduced the General Problem Solver (GPS), establishing Information Processing Theory (IPT) and asserting that human cognitive activity can be modeled as computational symbol manipulation.
The Tripartite Cognitive Architecture:
Information Processing System (IPS) / Physical Symbol System (PSS): A physical architecture incorporating short-term memory, long-term memory, external memory stores, an active central processor, sensory receptors, and motor effectors.
Psychological Constraints: Severe temporal and capacity bottlenecks in working memory coupled with sequential (serial) processing limitations.
Meta-Theoretical Constraints: Combinatorial syntax and semantics along with structure-sensitive processing rules (Fodor & Pylyshyn, ).
This structural organization anticipated Alan Baddeley's () multi-component working memory framework by more than two decades.
Task Environment: The objective external realm comprising the problem statement, goals, contextual boundaries, physical affordances, and ambient conditions.
Problem Space: An internal computational space forged by the interaction between the constraints of the IPS and the task environment.

Structural Components of the Problem Space:
States: Distinct configurations consisting of the start/initial state, intermediate states generated during exploration, and the target goal state.
Operators: Permissible legal transformations applied to change one state into an adjacent state.
Evaluation Functions: Internal metrics that evaluate whether an intended transition brings the system closer to or farther from the goal.
Control Strategies: Global search regimes that select which operator to apply at each node.
The 8-Tile Puzzle Exemplar: A grid housing eight sequentially numbered tiles and one open slot. Operators are defined either as sliding a numbered tile into the vacancy (left, right, up, down) or, symmetrically, translating the empty space. Systematically applying operators generates an exhaustive, branching state graph leading from arbitrary initial scrambles to canonical orders.
The Tower of Hanoi Exemplar:
A puzzle consisting of three vertical pegs (, , and ) and a variable number of central disks of graduated diameters stacked in descending order.
Three Rigid Constraints: (1) Only one disk may be transported per move; (2) Disks not in transit must rest upon a peg; (3) A larger disk may never be placed on top of a smaller disk.
Goal-Subgoal Conflicts: Solvers regularly attempt to move the smallest disk to the middle peg to keep the destination peg empty for the largest disk, precipitating an impasse requiring backward steps.

Three Strategies for Solving the Tower of Hanoi:
Simple Perceptual Strategy: Focuses on moving single disks to clear impediments sequentially. Highly intuitive, but exerts heavy short-term memory loads to track blocked pegs and enters infinite recursive loops whenever disk count .
Goal Recursion Strategy: Redefines the operator from "moving a disk" to "moving a pyramid" of size . To move an -disk pyramid from the source to the target peg: (1) move disks to the auxiliary peg; (2) move the largest disk directly to the target peg; (3) move the pyramid from the auxiliary peg to the target peg. Decomposes recursively until . Demands minimal working memory beyond maintaining the current decomposition index.
Move Pattern Strategy (Simon, ): An unreasoned perceptual heuristic that requires almost zero working memory beyond move parity:
On odd-numbered moves, displace the smallest disk.
On even-numbered moves, manipulate the next-smallest unblocked disk.
If the total number of disks is odd, circulate the smallest disk sequentially: source peg target peg auxiliary peg source peg.
Isomorphic Puzzles: The Missionaries and Cannibals Problem (transporting three missionaries and three cannibals across a river via a two-person vessel without permitting cannibals to outnumber missionaries on either bank) shares an isomorphic state-space structure with the Tower of Hanoi, despite superficial narrative differences.
Search Strategies, Means-Ends Analysis, and Production Systems
Weak Universal Search Methods: Domain-independent, content-free search algorithms that guarantee systematic problem space exploration, but scale with high computational cost:
Breadth-First Search (British Museum Algorithm): Evaluates every sibling node horizontally at the current depth level before descending deeper. Guarantees discovery of the shortest path, but rapidly overflows working memory capacity.
Depth-First Search: Explores a single vertical trajectory down to its terminal state, backtracking upward only when an impasse or cycle is reached.
Generate-and-Test: Chooses operators stochastically or opportunistically; requires low memory, but risks infinite cycling through previously explored nodes.
Heuristic Knowledge Systems: Domain-specific, content-rich knowledge that circumvents combinatorial search explosions by selecting critical paths directly:
The Paris Airport Payphone Dilemma: An individual at Charles de Gaulle Airport lacking French currency and credit-card access must procure a proprietary phonecard within a tight -minute layover. A weak universal search (entering every airport store sequentially) exhausts time and fails. Acquired heuristic knowledge—that phonecards are sold exclusively at tobacconist shops (bureaux de tabac)—bypasses exhaustive search entirely, guiding the traveler straight to the goal.
Unlike universal search, heuristics are not universally transferable; knowledge regarding Parisian tobacconists has zero utility in cities with alternative retail structures (e.g., London, Toronto, or New Delhi).
Means-Ends Analysis (MEA):
The core algorithmic engine of Newell and Simon's General Problem Solver, modeling human intentional planning through recursive difference reduction.
Procedural Steps:
Evaluate the distance between the current state and the target goal state to detect the most substantial discrepancy .
Search the problem space for an operator qualified to eliminate difference .
If operator cannot apply because its preconditions are unmet, establish an active subgoal to eliminate the precondition difference, pushing it onto a goal stack.
Recursively execute this subgoaling loop until an operator becomes applicable, execute the move, pop the completed subgoal from the stack, and re-evaluate the macro-goal.
Commuting Exemplar: An individual located at home must travel to a university campus away. The primary difference is spatial distance; the operator selected is driving an automobile. The car requires keys and fuel, spawning secondary subgoals (locating keys, driving to a filling station, avoiding highway 401 rush-hour congestion) before the primary transit operator executes.
Production System Architecture: Problem-solving procedures can be formalized as modular production systems comprising conditional
IF <condition> THEN <action>rules:Rule : If the goal is to transform current state into target state, determine the largest difference and spawn a subgoal to eliminate .
Rule : If the goal is to eliminate difference , identify an operator capable of reducing and instantiate the application of as a subgoal.
Rule : If the conditions for operator conflict with the current state, establish subgoals to resolve the precondition difference and apply .
Rules and : When all precondition discrepancies are resolved, execute the primitive domain action .
The Robot Moving Problem:
Demonstrates how formal production systems implement MEA.
Permissible Primitive Operators:
push(object, location),carry(object, location),walk(location),pick_up(object),put_down(object),place(object1, object2).Operator Preconditions:
pushrequires that the robot be co-located with the object, that the object be large and clear of clutter, and that the robot's arms be empty.Difference Table Matrix: Specifies that moving an object requires either
pushorcarry; moving the robot requireswalk; clearing a surface requirespick_up; emptying the gripper requiresput_down.Trace of Subgoaling: Moving a desk supporting two computers from Room 1 to Room 2 cannot execute until a clearing operator is chosen. The robot subgoals to clear Computer 1 (
walk,pick_up,walk,put_down), subgoals to clear Computer 2, descends back topush(desk, Room 2), and subsequently executes subgoals to fetch and replace both computers onto the desk surface in Room 2.
Well-Structured Versus Ill-Structured Problems
Walter Reitman's Foundational Taxonomy (): Reitman classified problem types by the distribution of information across the components of a problem vector: the start state, the goal state, and the transformation function (operators).
Well-Structured Problems: Every vector component is fully specified. The initial conditions are articulated, the goal criteria are explicit, and allowable operators are bounded (e.g., Tower of Hanoi, chess, 8-tile puzzle).
Ill-Structured Problems: Information across one or more vector components is missing, ambiguous, or underspecified (e.g., designing an aircraft, drafting an academic thesis, planning a dinner party for new acquaintances).
The Dinner Party Illustration:
Initial State: Indeterminate (ambiguity regarding the degree of guest hunger, budget, social expectations).
Goal State: Vague and unquantified (what qualifies as a "successful meal"? Impressing neighbors, reaffirming friendships, accommodating dietary preferences, deciding on three versus four courses).
Transformation Function: Underspecified (cooking fresh salmon, ordering catering, barbecue outdoors versus dining indoors).
The Simon () Versus Goel () Debate:
Simon asserted that the ill-structured/well-structured dichotomy is merely quantitative. Solvers simply retrieve domain-specific background knowledge from long-term memory to fill informational voids, rendering the problem space standardly computational.
Goel argued that ill-structured and well-structured problems exhibit profound qualitative, architectural, and cognitive dissociations.
Contrasting Dimensions Between Problem Types:
Dimension | Well-Structured Problems | Ill-Structured Problems |
|---|---|---|
Nature of Constraints | Logical and constitutive of the task. Violating a rule is impossible within the game (e.g., placing a larger disk on a smaller one breaks the game itself, constituting cheating). | Intentional (social, political, cultural, economic) and Nomological (laws of physics). Social rules are breakable or negotiable; physics rules dictate minimum criteria (e.g., beam width in bridge design). |
Evaluation of Solution | Clear, binary, right or wrong answers. Definitive termination tests exist. | No absolute right or wrong answers; only "better or worse" non-binary qualitative outcomes (Rittel & Webber, ). |
Modularity and Interconnectivity | Few components with high, tight, logical interconnectivity (e.g., every column in cryptarithmetic dictates carry-overs). | Massive modularity with sparse, contingent interconnectivity. Solvers decide which connections to prioritize. |
Feedback Loops | Immediate, unambiguous feedback provided directly by the external task environment. | Delayed or absent external feedback; solvers must generate their own internal evaluative feedback. |
Cost of Errors | Minimal, negligible, or transient laboratory consequences. | Severe, expensive, or catastrophic real-world costs (e.g., structural collapse, bridge failure, academic disqualification). |
Problem Space Structuring | Structure is predetermined and presented fully formed to the solver. | The solver must allocate substantial cognitive effort to structuring the problem space before solving it. |
Symbol Systems | Bounded, formal, precise symbol systems (numerical arrays, logical operators). | Multiple, heterogeneous symbol systems (freehand sketching, scribbling, prose, diagrams), many of which are computationally non-tractable. |
Developmental Trajectory and Student Misconceptions: Novices, teenagers, and young adults often struggle with ill-structured assignments (such as an open essay topic). They frequently demand rigid, artificial constraints (e.g., precise word counts, font sizes, line spacing, reference counts) in an effort to transform the ill-structured task into an artificial well-structured exercise. Success requires the prefrontal maturity to navigate ambiguity and exercise independent judgment.
Four Progressive Phases of Real-World Problem Solving (Goel, ):
Problem Scoping: Delineating the global envelope, contextual variables, and intentional limits of the design problem.
Preliminary Solutions: A fluid phase of conceptual way-finding where abstract kernel ideas are formulated, sustained by a low degree of commitment, coarse detail, and ill-structured mental representations.
Refinement: Consolidating selected kernel ideas, increasing detail, and evaluating constraints.
Detailing: Final specification of operational plans where commitments are fixed and propagated throughout the design space.

Lateral Versus Vertical Cognitive Transformations:
Lateral Transformations: Associative transitions between structurally divergent ideas (), widening the problem space. Underpinned by ill-structured representations characterized by ambiguity, vagueness, overlapping states, and semantic density. Supported by non-PSS cognitive computation.
Vertical Transformations: Rule-governed transitions from an abstract conceptualization to a more detailed, concrete manifestation (), deepening the problem space. Underpinned by well-structured, disjoint, unambiguous, articulate representations. Implemented via classical PSS symbol manipulation.
Neuroanatomical Dissociation: Lateral transformations in ill-structured spaces engage the right prefrontal cortex, whereas structured, vertical processing recruits the left prefrontal cortex (Goel, ).
Insight Problem Solving, Impasse, and Representational Change
The Insight Problem Paradox: Insight tasks typically possess small formal problem spaces and are occasionally solvable via a single operation; nevertheless, solvers routinely experience prolonged failure, entering a persistent cognitive impasse.
The "Nothing Special" Account (Kaplan & Simon, ):
Asserts that insight tasks do not require non-computational cognitive mechanisms. Insight problems are difficult because the solver's initial representation incorporates excessive irrelevant information, creating an unmanageably vast problem space coupled with an absence of constraining heuristics.
The Mutilated Checkerboard Problem (Wickelgren, ):
Solvers are shown an checkerboard ( squares) with two diagonally opposite corner squares removed, leaving squares intact.
The task asks whether the remaining squares can be fully covered by two-square dominos, or to prove why it is impossible.
The task is notoriously intractable via random trial-and-error search. The proof of impossibility rests on noticing an invariant: a single domino must cover two adjacent squares of opposite colors (one black, one white). Because the two diagonally opposite removed squares share the identical color, the board retains squares of one color and only of the other, rendering coverage by dominos impossible.
When the board's alternating colors are replaced by the semantic pairs "Bread" and "Butter," solution rates surge because the semantic representation emphasizes the pairing invariant.
The Representational Change Account (Ohlsson, ; Knoblich et al., ):
Proposes that insight problems trigger automatic, unconscious, self-imposed constraints derived from prior experience, restricting the problem space into an unworkable sub-region.
The Impasse: A cognitive state wherein active problem-solving attempts cease and the solver perceives the challenge as impossible.
Restructuring Mechanisms:
Chunk Decomposition: Disassembling tightly integrated, automatic perceptual chunks into their fundamental constituents.
Constraint Relaxation: Unconsciously discarding self-imposed, artificial rules that block legitimate paths.
Temporal Problem-Solving Stages: (1) Before Impasse: Search guided by standard long-term knowledge; (2) Within Impasse: Behavioral cessation and representational deadlock; (3) Restructuring: Chunk decomposition or constraint relaxation modifies the state space; (4) After Impasse: Conventional weak methods (like MEA) execute the solution.
Correspondence to Graham Wallas's () Four-Stage Model:
Preparation: Initial information gathering and unsuccessful attempts.
Incubation: Deliberate disengagement from the problem (e.g., sleeping, bathing, walking), allowing conscious fixation to decay.
Illumination: Sudden representational shift accompanied by an affective "Aha!" or Eureka experience.
Verification: Conscious validation that the restructured solution satisfies task criteria.
Katona's Matchstick Triangle Problem ():
Solvers must arrange six identical matchsticks to construct four equilateral triangles.
Participants uniformly experience impasse because they unconsciously adopt a two-dimensional planar constraint. Moving into three dimensions allows the matchsticks to form a regular tetrahedron, resolving the task.

Attentional Guidance in Duncker's Radiation Task (Grant & Spivey, ):
Eye-tracking revealed that solvers who successfully cracked the radiation problem spent significantly more duration fixating on the outer skin border rather than the central tumor.
Fixating exclusively on the tumor reinforces an over-constrained search around the locus of the effect.
In a second experiment, subtly pulsing/flickering the peripheral skin line doubled solution rates without participants consciously realizing their attention had been steered, demonstrating that shifting perceptual attention induces constraint relaxation.
Integrative Perspectives on Insight: The Nine-Dot Problem:
Solvers must connect a matrix of nine dots with four connected, straight lines without lifting the pen or retracing paths.
Standard Gestalt theory argued that visual perceptual grouping (closure, figural integrity) imposes a virtual square boundary that blocks strokes outside the grid.
Weisberg and Alba () challenged this claim: providing participants with a pre-drawn line extending outside the perimeter did not reliably yield solutions, showing that perceptual fixation alone is an incomplete explanation.
Kershaw and Ohlsson () established an integrative multi-factor model showing that difficulty stems from the compound interplay of:
Perceptual Factors: Gestalt laws of figural grouping and closure.
Conceptual Constraints: Over-constrained representations regarding non-turning line turns.
Process Demands: Look-ahead capacity limits and heavy working memory loads.

Creativity Frameworks, Divergent Thinking, and Theoretical Limits
Insight as Distal Shifts Within Well-Structured Spaces:
Insight problems can be characterized as a specialized subset of well-structured spaces wherein the goal state resides in a remote, unconnected, or invisible region relative to the solver's current position.
The solver feels an abrupt jump from the initial node to a distal node adjacent to the goal state, after which standard convergent thinking completes the task.
Three Candidate Mechanisms for the Distal Shift:
External Cueing: Environmental cues unconsciously guide the solver across semantic boundaries. Illustrated by the mechanics of humor: In the joke, "Why don't sharks bite lawyers?", initial search activates marine biology concepts (lawyers do not swim in the ocean); the punchline, "Professional courtesy," acts as a distal external cue, forcing an immediate semantic jump to an unconnected region of social behavior (predatory conduct).
Thermodynamic / Boltzmann Agitation: Drawing on artificial neural network models (Boltzmann machines), stochastic, thermodynamic-like noise or conceptual "heating" agitates the network, occasionally bouncing activation across energy barriers to a remote node cluster by chance.
Unconscious Semantic Abstraction: The solver unconsciously abstracts away from specific node properties upward to a higher-level taxonomic node in the semantic network that possesses wider branching connectivity, descending into a new functional cluster without conscious awareness of the intermediate abstraction.
Divergent Thinking Versus Insight:
Creativity in psychology is partitioned into insight problems and divergent thinking tasks, which operate under distinct mechanisms:
Feature | Insight Problems | Divergent Thinking Tasks |
|---|---|---|
Structural Classification | Subset of well-structured problems with remote goals. | Subset of ill-structured problems. |
Task Format | Single, convergent target (e.g., Radiation, Candle, Matchsticks). | Alternate Uses Task (e.g., list uses for a hammer, brick, paperclip, or rock). |
Cognitive Transformations | Convergent, representational shifts. | Divergent, lateral transformations (widening the problem space). |
Affective Phenomenology | Abrupt, sudden "Aha!" experience following impasse. | Gradual, continuous concept accretion without a Eureka moment. |
Evaluative Metric | Binary correctness. | Fluency, originality, flexibility, and breadth of semantic spread. |
Attentional Mechanism | Focused search modulated by impasse and relaxation. | Defocused attention facilitating widespread activation across semantic memory. |
Comprehensive Limits of Information Processing Theory:
The classical computational paradigm spearheaded by Newell and Simon successfully accounts for closed-world, well-structured puzzle environments (such as the Tower of Hanoi or chess) through heuristic search, goal decomposition, and physical symbol manipulation.
It falters when confronted with:
Real-world ill-structured tasks characterized by non-constitutive, breakable constraints, fluid representations, and non-computational symbol manipulations.
Insight problems where the challenge is not searching a pre-existing space, but restructuring and generating the appropriate space itself.
Creative divergent thinking dependent on widespread semantic diffusion rather than serial goal reduction.
A unified theory of human thinking must transcend the classical computational metaphor by integrating neurocomputational architectures capable of processing ambiguous representations alongside structured symbol-manipulating engines.