In-depth Notes on Cognitive Science and Language Processing

Cognitive Science Overview

Cognitive Science is an interdisciplinary field that studies human intelligence. The primary disciplines involved include:

  • Psychology

  • Linguistics

  • Philosophy

  • Computer science

  • Neuroscience (often referred to as Cognitive Neuroscience)

Psycholinguistics

Psycholinguistics examines how individuals acquire, produce, and comprehend language. It serves as a psychological discipline that intersects with Cognitive Psychology and Cognitive Neuroscience. This field is influenced by insights from Linguistics regarding the structure of language and from Computer Science concerning computational aspects of language.

Language as a Cognitive Ability

Language is viewed as a cognitive ability, made up of various linguistic capacities within individual brains. When these capacities are utilized, speakers can recreate the mental models of their interlocutors based on sensory inputs.

Mental Representations and Processes

Understanding how sound corresponds to meaning is a key goal in language comprehension and production. This involves:

  • Subconscious knowledge about what constitutes a well-formed sound-meaning mapping.

  • Processes for uncovering meaning from sound during comprehension and for generating sound from meaning during language production.

Adjectival Modifiers and Language Processing

Examples with the phrase "the hair stylist combed the hair" illustrate how adjectives can serve different grammatical functions:

  • Adjectival Modifier: "straight" modifies "hair," indicating the type of hair.

  • Resultative: "straight" indicates a state resulting from the event of combing.

  • Object Depictive: "wet" refers to the hair's state while combing occurred.

  • Subject Depictive: "drunk" describes the stylist's state during the event.

Syntax Influence

The shift between modifiers like resultatives is significantly influenced by syntax, particularly the position of phrases in sentence structure (pre-nominal vs post-nominal). For instance:

  • Pre-nominal: "combed the red hair"

  • Post-nominal: "combed the hair red"

The meaning assigned to an adjective depends on whether it plausibly describes a state resulting from the event or a property relevant during the event.

Language Structure

Key components of language include:

  • Sound categories: Basic building blocks of phonetics and phonology.

  • Morphemes: The smallest units of meaning.

  • Syntax: Structure of sentences.

  • Semantics: Meanings of expressions.

The Study of Language

Major Areas

  • Phonetics: Study of speech sounds.

  • Phonology: Abstract categories of speech sounds.

  • Morphology: Internal structure of words.

  • Syntax: Internal structure of sentences.

Mental Representations

Cognitive psychology introduces the concept of mental representations (MR) necessary for explaining various cognitive processes, including language comprehension. Key points include:

  • MRs are information-bearing structures that encode, transform, and store knowledge.

  • Many MRs operate outside of conscious awareness.

Example of Mental Computation

Consider adding the numbers:
431+296=727431 + 296 = 727
This task requires intermediate representations for each digit, showcasing how mental representations are used in arithmetic operations.

Historical Context of Cognitive Science

Cognitive Science has evolved over the last 150+ years:

  1. Introspectionism (1879): Introduced by Wilhelm Wundt, who set up the first psychology lab.

  2. Behaviorism (1913): Led by John B. Watson, it emphasized observable behavior over introspection.

  3. Cognitive Psychology (1935, 1959): A shift towards internal mental processes and problem-solving.

Key Figures in Early Psychology

  • Wilhelm Wundt: Established experimental psychology; students like Stanley Hall and Edward Titchener advanced his ideas.

  • B.F. Skinner: Introduced operant conditioning and radical behaviorism.

Limitations of Behaviorism

Challenges to behaviorism arose, pointing out the inefficacy of stimulus-response models in explaining language learning and cognitive processes (e.g., poverty of the stimulus argument).

Experiments as Reverse Engineering

Experiments in cognitive science are often viewed as reverse engineering where:

  • Information extraction is gathering relevant data.

  • Modeling combines this data into a framework.

  • Review tests the model for validity.

CHATGPT vs Human Language Processing

Similarities:

  • Both systems analyze syntax, semantics, and context.

Differences:

  • Humans have a biological basis with deep emotional connections, while ChatGPT relies on algorithms and lacks true understanding or consciousness.

Marr’s Levels of Analysis

David Marr proposed three levels of analysis for cognitive processes:

  1. Computational Level: What is the goal and why?

  2. Representational Level: How are the computations expressed?

  3. Implementation Level: How are the representations physically realized in the brain or a computer?

Language Production Process

Language production involves several stages, including:

  • Conceptual Preparation

  • Grammatical Encoding

  • Phonological Encoding

  • Articulation

Understanding language production helps in modeling cognitive processes in language processing and can highlight executive control mechanisms as demonstrated in tasks like the Stroop Effect.