Comprehensive Notes on Intelligence, Measurement, and Educational Assessment (Summary)

INTELLIGENCE AND ITS MEASUREMENT

Intelligence as a multifaceted capacity that manifests across the life span.
- Abilities included: acquire and apply knowledge; reason logically; plan effectively; infer perceptively; make sound judgments and solve problems; grasp and visualize concepts; pay attention; be intuitive; find words and thoughts with facility; cope with, adjust to, and make the most of new situations.
Historical perspectives on intelligence thinkers and definitions
- Francis Galton (1822-1911): believed the most intelligent people have the best sensory abilities.
- Alfred Binet (1857-1911): argued that solving a particular problem involves interacting abilities; cannot be separated cleanly.
- David Wechsler (1896-1981): intelligence is the aggregate/global capacity to act purposefully, think rationally, and deal effectively with the environment.
- Jean Piaget (1896-1980): intelligence as evolving biological adaptation; cognitive skills increase adaptation; mental trial-and-error replaces physical trial-and-error.
Perspectives on intelligence (theoretical orientations)
- Interactionism: heredity and environment interact to influence intelligence development.
- Factor-analytic theories: identify underlying abilities that constitute intelligence.
- Information-processing theories: identify specific mental processes that constitute intelligence.
Factor-Analytic Theories
- Factor Analysis: statistical techniques to uncover underlying relationships between variables (e.g., test scores).
- Charles Spearman: observed correlations among intelligence measures; proposed a two-factor theory.
- Two-Factor Theory of Intelligence
- $g$ : general intelligence – the portion of variance common to all intelligence tests.
- $s$ : specific abilities contributing to individual tests; plus error components $e$ .
- Group Factors: intermediate factors common to a group of activities but not all.
- Gardner's theory of multiple intelligences (seven identified; last three described here):
- Interpersonal Intelligence
- Intrapersonal Intelligence
- Emotional Intelligence
Major contemporary models of cognitive abilities
- Raymond B. Cattell and Horn: two major types of cognitive abilities
- Crystallized Intelligence: $Gc$
- Fluid Intelligence: $Gf$
- Horn proposed several broad factors:
- Visual Processing: $Gv$
- Auditory Processing: $Ga$
- Quantitative Processing: $Gq$
- Speed Processing: $Gs$
- Reading/Writing Facility: $Grw$
- Short-Term Memory: $Gsm$
- Long-Term Storage and Retrieval: $Glr$
- Some abilities (e.g., $Gv$ ) are vulnerable; others (e.g., $Gq$ ) maintained.
- Carroll’s Three-Stratum Theory of Cognitive Abilities
- Top stratum: $g$ (general intelligence)
- Second stratum: eight broad abilities/processes
  - Fluid Intelligence: $Gf$
  - Crystallized Intelligence: $Gc$
  - General Memory and Learning: $Y$
  - Broad Visual Perception: $V$
  - Broad Auditory Perception: $U$
  - Broad Retrieval Capacity: $R$
  - Broad Cognitive Speediness: $S$
  - Processing/Decision Speed: $T$
- Three-stratum model is hierarchical: lower-level abilities are subsumed by higher strata.
- CHC model (Cattell–Horn–Carroll) combines CHC broad/narrow abilities; McGrew–Flanagan CHC model notes no provision for a general intellectual ability factor ( $G$ ).
- Psychoeducational and Cross-Battery Assessment considerations (information-processing focus).
Information-Processing Theories
- Focus on mental processes that constitute intelligence (e.g., attention, memory, processing speed, problem-solving strategies).
- PASS Model (Planning, Attention, Simultaneous processing, Successive processing) as an example of an information-processing framework.
Measuring Intelligence: Tests and domains
- Commonly used tests and subtests include:
- Comprehension, Similarities, Arithmetic, Vocabulary, Receptive Vocabulary, Picture Naming, Digit Span, Letter-Number Sequencing, Picture Completion, Picture Arrangement, Block Design, Object Assembly, Coding, Symbol Search, Matrix Reasoning, Word Reasoning, Picture Concepts, Cancellation.
- Standford-Binet Intelligence Scales: Fifth Edition (SB5)
- History traced to Standford University and the 1916 translation of Binet-Simon by Lewis Terman.
- Key concepts: Alternate Item, Mental Age, Ratio IQ, Intelligence Quotient, Deviation IQ, Point Scale, Test Composite, Routing Test, Teaching Items, Floor Level, Ceiling Level, Basal Level.
- Wechsler scales (Wechsler Scales, e.g., WAIS, WISC): developed for multilingual, multinational, multicultural populations; includes Core Subtests and Supplemental Subtests.
- Short forms of intelligence tests
- Abbreviated lengths to reduce administration time while retaining construct coverage.
- Group Tests of Intelligence
- Army Alpha (for literate/english-speaking), Army Beta (nonverbal).
- Used during World War I for rapid screening.
- Other measures related to intellectual abilities
- Cognitive style (e.g., convergent thinking vs divergent thinking).
  - Convergent Thinking: deductive reasoning from facts.
  - Divergent Thinking: generate multiple solutions.
- Culture and intelligence
- Culture-Free Intelligence Test; Culture Loading; Culture-Fair Intelligence Test; Flynn Effect (rise in IQ scores across populations over time).
CULTURE AND MEASURED INTELLIGENCE
- Culture-Free Intelligence Test: designed to minimize cultural loading.
- Culture Loading: extent to which culture influences test performance.
- Culture-Fair Intelligence Test: aims to be less culturally biased.
- Flynn Effect: observed rise in IQ scores over generations.
ASSESSMENT FOR EDUCATION: LEARNING OUTCOME AND TESTING ROLE
- The Role of Testing and Assessment in Education: key questions guiding educational assessment
- How well have students learned and mastered the subject matter?
- To what extent can students apply learning to novel contexts?
- Which students can progress to the next level of learning or independent living?
- What obstacles hinder mastery, and how can they be overcome?
- How effective are teachers at facilitating mastery of curriculum goals?
- Do passing scores truly reflect mastery? Do failing scores truly reflect lack of mastery?
- The Common Core State Standards (CCSS)
- Achievement Tests
- Aptitude Tests
- Diagnostic Tests
- Psychoeducational Batteries
THE ROLE OF TESTING AND ASSESSMENT IN EDUCATION: TYPES OF TESTS AND RESPONSIBILITIES
- Achievement Assessment: measures what has been learned in specific domains.
- Coverage across academic areas with multiple subtests; may include locator/pretests to determine suitable difficulty level.
- Curriculum-Based Assessment (CBA) and Curriculum-Based Measurement (CBM)
- Local norms used to evaluate performance on curriculum-based tasks.
- Fact-Based Items vs Conceptual Items
- Aptitude Tests vs Achievement Tests
- Aptitude tests focus on informal learning or life experiences; achievement tests focus on learning from structured instruction.
- Examples by level
- Preschool: Apgar Number (contextual placeholder in notes), informal evaluation.
- Elementary: Metropolitan Readiness Test 6th edition (MRT6).
- Secondary: SAT, ACT, NAT, PEPT, NAT, NCAE.
- College and beyond: GRE, MAT, various college entrance tests (e.g., UPCAT, ACET, DLSCET, USTET, PNUAT, PUPCET, ATBulSU).
DIAGNOSTIC TESTS
- Binet and Simon’s concept of “mental orthopedics”: intelligence test data used to improve learning.
- Diagnostic vs evaluative uses of testing
- Evaluative: used for diagnostic purposes; Diagnostic Information used to pinpoint a student’s difficulties for remedial purposes.
- Diagnostic tests identify areas of deficit to target for intervention.
- Reading and Math diagnostics mentioned: WRMT-III, SDMT-4, KeyMath-3DA.
PSYCHOEDUCATIONAL TEST BATTERIES
- Test kits that measure both academic-success-related abilities and achievement in reading/arithmetic.
- Examples:
- Kaufman Assessment Battery for Children (K-ABC)
- Kaufman Assessment Battery for Children, Second Edition (KABC-II)
- Woodcock-Johnson IV (WJ IV)
OTHER TOOLS OF ASSESSMENT IN EDUCATIONAL SETTINGS
- Performance Task; Performance Assessment; Portfolio; Portfolio Assessment; Authentic Assessment; Peer Appraisal; Sociogram
ASSESSMENT OF PERSONALITY AND CULTURE
- Personality Assessment and culture
- Foundational definitions and culture-context discussions
- Historical definitions of personality (McClelland, 1951; Menninger, 1953; Goldstein, 1963; Sullivan, 1953; Byrne, 1974; Hall & Lindzey, 1970)
- Personality defined as an individual’s unique constellation of psychological traits that are relatively stable over time.
- Personality Assessment defined as measurement/evaluation of traits, states, values, interests, worldview, acculturation, sense of humor, cognitive/behavioral styles, etc.
- Traits, Types, and States
- Allport (1937): Traits as bona fide mental structures.
- Holt (1971): Real structures inside people that determine behavior.
- Cattell (1950): Traits as mental structures, not necessarily physical.
- Guilford (1959): Definitions of personality trait as a distinguishable, enduring way individuals vary.
- Myers-Briggs Type Indicator (MBTI): People have definite preferences in perception/communication.
- John Holland’s six personality types (Artistic, Enterprising, Investigative, Social, Realistic, Conventional) with Self-Directed Search (SDS).
- Type A vs Type B (Friedman & Rosenman).
- Personality Profile: representation of target traits/states/types.
- Self-referent questions in personality assessment: self-concept, self-concept differentiation (role-based variability).
- Other-Referent concerns: leniency, severity, central tendency, halo effects; response styles (acquiescence).
- Response Styles: tendency to respond in a characteristic way regardless of item content; impression management; validity scales.
- Locus of control: internal vs external perspectives on the source of events.
DEVELOPING INSTRUMENTS TO ASSESS PERSONALITY
- Data Reduction Methods: factor analysis and cluster analysis used to develop instruments (e.g., NEO PI-R).
- Revised NEO Personality Inventory (NEO PI-R): five-factor model; 30 facets.
- Criterion Groups: standard/reference groups sharing characteristics for item development (empirical criterion keying).
- MMPI family: MMPI, MMPI-2, MMPI-2-RF, MMPI-A.
- Acculturation and values in personality assessment: instrumental/terminal values; worldview; identity.
APPLICATION OF STATISTICS
- Two major concerns of statistics:
- Descriptive (or Deductive) Statistics: summarization, presentation, computation, interpretation of data features.
  - Examples: population-based statements about fires, vaccines, class performance, etc.
- Inferential (Inductive) Statistics: draw inferences about populations from samples.
  - Examples: trend in popularity, price changes, population projections.
- Terminology:
  - Population: total observation set of interest.
  - Sample: subset/representative portion of population.
  - Parameter: numerical value describing a population
  - Statistic: numerical value describing a sample
  - Data: facts/observations
  - Variable: characteristic that differentiates members of a population or sample
- Types of data:
  - Qualitative (categorical)
  - Quantitative (numerical)
- Types of variables:
  - Discrete: finite, countable values
  - Continuous: infinite values within an interval
- Example classifications provided.
RESEARCH METHODS AND VARIABLES
- Phenomenon varies along quantitative measures; focus on dependent vs independent variables
- Independent Variable: manipulated; predictor of changes in dependent variable(s).
- Example phrasing: a quantitative correlational study of locus of control on problem-solving appraisal towards unemployment youth during a pandemic (illustrative).
- Dependent Variable: outcome affected by the independent variable.
- Qualitative vs Quantitative methods (overview): descriptions, data collection methods, analysis approaches, and typical uses.
QUALITATIVE METHODS
- Empirical, natural setting inquiry with interpretations in light of meanings held by participants.
- Roles of the researcher:
- Observer (fly on the wall): unobtrusive; participants unaware.
- Observer as participant: limited interaction; neutral role.
- Participant as observer: engaged with participants; risk of reactivity.
- Complete participant: fully embedded in activity.
- Common qualitative methodologies:
- Phenomenological studies; Ethnographical research; Grounded Theory; Narrative Research; Case Study; Critical Theory.
- Data gathering methods (qualitative):
- Interviews (structured, semi-structured, elite, key informant), Focus Groups, Delphi, Document Review, Library/Online Research, Observation (participant and non-participant).
QUANTITATIVE METHODS
- Descriptive Research: basic descriptions and summaries; examples include simple observation and survey methods; data analysis includes descriptive statistics.
- Correlational Research: examines relationships between variables; correlation does not imply causation; predictor/criterion variable terminology.
- Experimental Designs: manipulate variables; use control and experimental groups; aim to establish causal relationships; cautions about relying on correlational studies for instructional procedures.
- Data gathering in quantitative research: structured questionnaires (survey); document analysis; data mining; experiments with various group designs.
- Data analysis in qualitative vs quantitative methods provided as categories.
MIXED METHODS
- Combines qualitative and quantitative elements for depth, breadth, triangulation, corroboration.
- Designs include sequential mixed methods (qual → quant or quant → qual), concurrent designs, and designs varying by integration points.
METHODOLOGY, METHODS, INSTRUMENTS, AND TECHNIQUES
- Methodology: structure, logic, approach, and theoretical basis for data collection/analysis.
- Methods: the processes used to collect data.
- Technique: specific procedures.
- Instrument: tools used in data collection (e.g., tests, questionnaires).
RESEARCH ETHICS
- Core principles: non-maleficence; beneficence; autonomy; justice; informed consent; voluntary participation; confidentiality.
SAMPLING AND DATA COLLECTION
- Probability Sampling (methods):
- Simple Random
- Systematic
- Stratified
- Cluster
- Multi-Stage
- Non-Probability Sampling (methods):
- Purposive
- Convenience
- Quota
- Snowball
- DATA COLLECTION METHODS: QUALITATIVE
- Interviews (group, elite, key informant)
- Focus Group Discussion
- Delphi Method
- Document Review; Library/Online Research
- Observations (participant vs non-participant)
- DATA COLLECTION METHODS: QUANTITATIVE
- Survey
- Data Sets
- Experiment – Intervention (one group pre- and post-test, etc.; random or non-random)
DATA ANALYSIS APPROACHES
- QUALITATIVE DATA ANALYSIS
- Qualitative Content Analysis; Thematic Analysis; Discourse Analysis; Conversation Analysis; Grounded Theory (coding); Narrative Thick Description
- QUANTITATIVE DATA ANALYSIS
- Descriptive Statistical Analysis; Inferential Statistical Analysis; Ecometrics; Policy Analysis; Quantitative Content Analysis
ADDITIONAL NOTES AND CONNECTIONS
- Many sections emphasize the continuum from theory (g, Gf/Gc, CHC, Gardner) to measurement (SB5, WAIS/WISC, KABC, WJ IV) to application in education (achievement vs aptitude, CCCSS, CBM, DT). This reflects the integrated nature of intelligence research, psychometrics, and educational assessment.
- Ethical and cultural considerations recur across sections (culture loading, culture-free/testing fairness, acculturation, worldview, and the impact on test development and interpretation).
- Practical implications: understanding whether a test measures general ability vs specific skills affects educational placement, diagnostic decisions, and intervention planning (e.g., RTI framework, dynamic assessment).
KEY TERMS AND DEFINITIONS (glossary)
- Intelligence: multifaceted capacity to think and adapt across contexts.
- $g$ : general intelligence factor (Spearman).
- $s$ : specific ability components; part of the two-factor theory.
- $e$ : error component in the variance not explained by $g$ or $s$ .
- $Gc$ : Crystallized Intelligence.
- $Gf$ : Fluid Intelligence.
- $Gv$ : Visual Processing.
- $Ga$ : Auditory Processing.
- $Gq$ : Quantitative Processing.
- $Gs$ : Speed Processing.
- $Grw$ : Reading/Writing Facility.
- $Gsm$ : Short-Term Memory.
- $Glr$ : Long-Term Storage and Retrieval.
- $Y$ : General Memory and Learning.
- $V, U, R, S, T$ : Broad visual, broad auditory, broad retrieval, broad cognitive speediness, processing/decision speed (Carroll).
- RTI: Response to Intervention.
- SLD: Specific Learning Disability.
- CCSS: Common Core State Standards.
- CBM: Curriculum-Based Measurement.
- CBA: Curriculum-Based Assessment.
- MMPI: Minnesota Multiphasic Personality Inventory.
- NEO PI-R: Revised NEO Personality Inventory (Five-Factor Model).
- MBTI: Myers-Briggs Type Indicator.
- SDS: Self-Directed Search.
- PNUAT, USTET, PUPCET, SAT, ACT, GRE, MAT, MRT6: example standardized or college/admission tests.
- Deliberations on culture, bias, and fairness across tests are central to modern testing practices.
CONNECTIONS TO PREVIOUS LECTURES/FOUNDATIONAL PRINCIPLES
- The evolution from early psychometrics (galtonian sensory theories) to modern multifactor models (g, Gf, Gc, CHC) illustrates the shift from single-ability views to composite models that better predict real-world performance.
- The distinction between achievement, aptitude, and diagnostic testing links educational objectives to assessment design and interpretation.
- The RTI framework integrates assessment, intervention, and progress monitoring to inform instructional decisions.
PRACTICAL AND ETHICAL IMPLICATIONS
- Selecting appropriate tests and understanding test bias/cultural loading affects equitable identification of learning disabilities and placement decisions.
- Use of appropriate data collection methods and ethically reporting results protects student/participant rights and supports valid inferences.
- Mixed-methods designs offer robust insights by triangulating qualitative depth with quantitative generalizability.
FORMULAS AND EXPRESSIONS INCLUDED
- General intelligence and specific abilities:
- Two-Factor Theory: the total variance is partitioned into $g$ (general) and $s$ (specific) components, with additional error $e$ components.
  - This can be summarized as: total variance = $Var(T) = Var(g) + Var(s) + Var(e)$ (conceptual representation).
- CHC broad abilities can be denoted using their standard abbreviations (e.g., $Gf, Gc, Gv, Ga, Gq, Gs, Grw, Gsm, Glr, Y, R, S, T, U, V$ ).
- Carroll’s third-stratum structure lists eight second-stratum abilities, including $Gf, Gc, Y, V, U, R, S, T$ , all subsumed under the top-level $g$ .
NOTE
- The content above mirrors the material provided in the transcript and is organized to function as a comprehensive study aid. For exam preparation, focus on understanding the relationships among theories (e.g., Spearman’s $g$ and $s$ , Gardner’s multiple intelligences, CHC/Carroll models), the range of measurement instruments and their purposes, and the different research paradigms (qualitative, quantitative, mixed).