Testing and Evaluation of Pronunciation

Topic Overview: It is noted that little focus is given to testing and evaluation in the literature on teaching pronunciation, particularly in comparison to reading, listening, and speaking skills.
Rationale: This is partly due to the extensive body of literature on language assessment applying equally to pronunciation but also because of unique characteristics that influence evaluation and feedback.
Unique Characteristics of Pronunciation: - Involves rule application (e.g., pronunciation of -s endings) and features of perception and production. - Important for teachers to understand distinct diagnostic and feedback processes.
Aim of the Chapter: To explore diagnostic evaluation procedures, ongoing feedback, evaluation strategies, and classroom testing concerning pronunciation.

Purpose: Diagnostic evaluation assesses learners’ proficiency, typically for screening (to determine task capabilities) or placement (to assign appropriate class levels).
Benefits: It assists in establishing curricular objectives and identifying individual needs, enabling tailored instruction.
Process: Includes both global assessments of class and individual learners’ perception and production abilities.

Importance: Diagnosing a learner’s ability to distinguish sounds is crucial for developing intelligible speech.
Test Formats: - Consonant-Vowel Discrimination: - Method: Use minimal-pair discrimination exercises. - Example: "Don't (slip / sleep) on the floor"; students mark the words they hear. - Word Stress Recognition: - Testing Recognition: Learners identify the stressed syllables in words/phrases. - Example: Directions involve marking the syllable receiving the main stress in sentences. - Prominence Recognition: - Method: Learners mark the most prominent elements in sentences based on stress. - Intonation Tests: - Types: Learners identify rising vs. falling intonation patterns. - Example: Checking intonation patterns for assertions or questions. - Shade of Meaning Assessments: - Learners interpret the meaning behind different stress and intonation patterns. - Reduced Speech: - Format: Cloze passage formats requiring missing words from reduction examples.

Initial Samples: - Standardized Reading Sample: Learners read from a diagnostic passage to assess pronunciation features. - Free Speech Sample: Spoken responses on familiar topics to exhibit typical speech patterns.
Diagnostic Passage Aspects: - Includes various pronunciation features (segmental/suprasegmental) for accurate assessment. - Practice is encouraged before recording! - Purpose of Sampling: Find natural speech and confirm the need for focused instruction, often done in a language lab.

General Overview: Many existing tests evaluate overall oral proficiency but do not separate components like pronunciation.
Key Examples: - Test of Spoken English (TSE): Administered in settings similar to TOEFL, includes assessment of several skills with a particular focus on pronunciation. - ILR Oral Proficiency Interview: Evaluates pronunciation and fluency with trained raters providing holistic scores. - Additional Tests: Include SPEAK Test, diagnostic passages, and self-evaluation techniques like transcribing and peer feedback.

Purpose: To monitor learners’ progress and provide individualized instruction or curriculum revision.
Self-Monitoring and Correction: - Learners must identify and correct their pronunciation errors. - Underscored Importance: Self-directed learning reinforces student accountability and autonomy. - Principles include: defining learning objectives, selecting methodologies, and assessing progress themselves.

Peer Interaction: Valuable for fostering an environment where learners assist each other and practice listening skills.
Teacher’s Role: - Providing unobtrusive correction without disrupting speech fluency. - Recommended to keep records to allow for constructive feedback post-activity.
Recording Feedback: Using cassettes can enhance the listening and correction processes.

Differences: Classroom tests are narrower in scope than diagnostic tests and are used throughout the course to assess learned material.
Assessment Types: - Designed to evaluate what has been specifically taught, aiding in measuring progress within the course.

Prototype Tests: Designed to evaluate sound discrimination and other competencies.
Test Designs: Incorporate various assessment types, such as discrimination tasks for consonants and vowels, stress patterns, intonation contours, etc.

Additional Assessments: Appropriate for practical phonetics courses, testing students on applying learned rules through application tasks and understanding.

Final Thoughts: Ongoing evaluation plays a crucial role in effective pronunciation teaching, necessitating systematic feedback for learners’ self-correction.
Key Goals: Creating autonomous learners who can repair mispronunciations and monitor their own speech patterns effectively.

Key Terms to Define: Diagnostic evaluation, screening, placement, diagnostic passages, etc.
Discussion Questions: Consider varying approaches to testing across different learner contexts.
Activities: Engaging in direct responses to evaluations and peer performance observations to derive beneficial feedback promptly.