1/187
Looks like no tags are added yet.
Diagnostic assessment
a form of assessment designed to provide teachers with information about students' prior knowledge and misconceptions before beginning a learning activity
Formative
Takes place during learning and is used to plan or modify instruction
Summative Assessment
Assessment data collected after instruction to evaluate a student's mastery of the curriculum objectives and a teacher's effectiveness at instructional delivery. Final Exam or Final Project
What is the purpose of assessment OF learning
To gather evidence about what learners know and can do to differentiate and personalize instruction-done by teacher (summative assessment)
What is the purpose of assessment FOR learning
To generate data and feedback that learners use to monitor individual progress adjust personal learning approaches reflect on learning and set learning goals done by the teacher formative
What is the purpose of assessment As learning
To summarize learning at any given point in time or communicate achievement or competency done by student self monitor reflect
What are the 6 assessment STRATIGES?
Competency based, Criterion referenced, Ipsative, Norm referenced, Standards based, Traditional
What are the 6 assessment METHODS?
Comprehensive type, Discussion board, Direct, Indirect, Project Based, Reflection Focus
What are the 3 Domains or categories of educational activities that Bloom identified?
Cognitive-Mental Skills, Affective Attitude- Emotions, Psychomotor skills-Physical skills
POUR
Perceivable, Operable, Understandable, Robust
Perceivable
Text Alts, Read out loud, Lrg text size, Captions for audio content
Operable
Keyboard accessible and easily navigated to find content
Understandable
Text is readable and understandable the language is simple
Robust
The content is compatible with different browsers ,assistive technology and multiple devices.
Indirect Assessment
Information gathered from other sources such as LMS systems, Attendance, and Log IN DATA, Time on task, Surveys and Prior knowledge-Pre-tests
Direct Assessment
Evaluate a learners work produced by a learner. Example: Formative assessments, weekly quizzes, worksheets and summative assessments, presentations, essays and capstone projects.
Factual
Basic elements a student must know to be acquainted with discipline or solve problems on it.(LIST,SUMMARIZE,RESPOND,SELECT, CHECK,GENERATE)
Conceptual
The interrelationships among the basic elements within a larger structure that enable them to function together.(RECOGNIZE,CLASSIFY,PROVIDE,DIFFERENTIATE,DETERMINE,ASSEMBEL)
Procedural
How to do something methods o inquiry and criteria for using skill techniques and methods. (RECALL, CLARIFY,CARRY OUT,INTERGRATE,JUDGE,DESIGN)
Metacognitive
Knowledge of cognition in general, as well as awareness and knowledge of one's own cognition. (IDENTIFY,PREDICT,USE TECHNIQUES,DECONSTRUCT,REFLECT,CREATE)
Descriptive Analytics
________________________Analytics and data that describe past performance and history. Analytics are used to determine what happened and works well with item analysis of comprehensive, m/c questions and statements using data measurements such as current score, time spent on task or frequency of access.
Diagnostic Analytics
"WHY did this happen?" Information that attempts to determine causal relationships, answers the question
Predictive Analytics
ASKS the question " WHAT is likely to happen?"Extracts information from data and uses it to predict future trends and identify behavioral patterns.
Prescriptive Analytics
ASKS the question "WHAT should be DONE?"The set of analytical techniques that yield a best course of action. Solves the problem
Quantitative Analysis
Analysis is based on an objective numerical data and statistics.
Qualitative Analysis
based on non-numerical information such as observations, reflections and interviews.
Competency-Based
assessment strategies are constructed via scenarios or simulations that students must complete to demonstrate their critical thinking and mastery of learning. (presentation with rubric) Learners deliver a training talk on student-centered learning for first year teachers
Criterion Referenced:
assessment strategies are designed for learners to demonstrate a master in a learned skill measured by a specific criterion reference to prove competency. (Criterion based rubric) (Advanced placement test) Learners will be able to apply the basics of calculus.
Ipsative:
assessment strategies are designed to measure students past knowledge or performance against their current knowledge. (compares previous work to current progress) (point A-point B) Learners will increase reading and comprehension skills. Journal use is a way for students to reflect on learning to assess advancement and compare prior abilities.
Norm-Referenced:
assessment strategies are designed to compare one learners progress compares to the class average. (Bell-Curve) Learners will be able to identify and solve engineering problems that may occur in the field.
Standards:
assessment strategies are designed to see if a learner can meet a specific requirement to demonstrate mastery of a predetermined standard. (WA-Sate Standardized testing, SAT's ACTs) Learners will master grade-level mathematics.
Traditional:
assessment strategies are designed to see if a learner can meet the requirements based on memorization of data, dates and facts. (MC/T/F test) Learners will be able to describe and identify parts of the human nervous system.
Direct
methods use something that the learner has created for evaluation. Direct assessments are used to evaluate learner's understanding of a concept, achievement of a learning objective or completion of a goal. Instructor evaluates the learner's work to reach a conclusion about the learner's achievements. Example: a cake, capstone projects, presentations, essays, and tests (essay analyzing a play)
Indirect
are determined by the learner or an observer to assess if the learner has met the requirements. LMS: attendance is recorded to and logged in data and time on task. Allows learning designers to establish patterns in the data Example: a presentation or demonstration, surveys (course survey), confidence-based assessment. (a course survey will provide information that affect student learning but does not measure student knowledge or skills.)
Understand
Objective test items such as fill-in-the-blank, matching, labeling or m/c questions all require learners to recall or recognize terms, facts and concepts.
Bloom's Taxonomy identifies three domains of learning.
Which domain includes knowing?
Cognitive Level
Why does the cognitive level of Bloom Taxonomy include knowing?
Knowing is included in the cognitive domain because it involves using the mind to remember and recognize facts and concepts.
An instructor wants to develop an authentic assessment where students demonstrate the Create level of Bloom's revised taxonomy.
Which assessment aligns to this cognitive level?
Design a new traffic plan for a downtown shopping district that is about to undergo major street repairs.
An instructor wants to develop an authentic assessment where students demonstrate the Understand level of Bloom's revised taxonomy.
Which assessment align to this cognitive level?
Summarize the benefits of the company's insurance policy.
An instructor wants to develop an authentic assessment where students demonstrate the Understand level of Bloom's revised taxonomy.
Which assessment align to this cognitive level?
Clarify the insurance premium and payout options for a potential client.
In a course that teaches academic literacy skills to adult learners without a high school diploma, the instructor wants to assess students' ability to accurately summarize an assigned reading.
Which assessment aligns to this learning objective?
Write a paragraph that addresses the reading's key points.
Correct: The ability to identify the key points of a reading and synthesize those into a paragraph would demonstrate the skill of summarization.
A learning experience designer is asked to help an instructor design a summative assessment for a lesson. The course design calls for the summative assessment to be at higher cognitive level based on the Revised Bloom's Taxonomy and to employ either conceptual or procedural knowledge dimension.
Which assessment activity is both at higher cognitive level and is also aligned to one of the required knowledge dimensions?
Write a pedagogical analysis of a lesson plan and its steps by applying two of the five learning theories learned in a unit.
Match the learning objective with embedded assessment task to the aligned Revised Bloom's Taxonomy level.
In a medical course, the learner will be able to explain the clinical signs of obesity to a patient in a treatment context by playing the role of a clinician in a scenario-based discussion post.
Understand
Apply
In a guidance counseling course, the learner will be able to provide advice based on the learner's own experience to high school seniors about choosing whether to attend college.
Create
In a woodworking course, the learner will be able to demonstrate the ability to use three of ten possible types of joints by building a bookcase, table, or storage chest.
Evaluate
In a culinary arts course, the learner will be able to determine whether a dish was properly prepared by tasting and rating the dish.
An instructor is planning to teach a third-grade science unit on the states of matter. The learning goal is "Students will be able to identify examples of liquids, solids, and gases."
Which type of assessment should this instructor use to determine what students already know about the states of matter prior to receiving instruction?
Diagnostic
Seventh-grade students in a French class complete a unit focused on colors with the learning goal of "Students will be able to identify the colors of the rainbow using French vocabulary words."
How should the instructor assess whether students met this learning goal using a traditional assessment strategy?
Have students complete a matching worksheet that includes the colors in both English and French
An instructor presents business ownership concepts to a group of business students, including the different types of business ownership. The learning objective is "Compare the major forms of business ownership."
Which direct assessment method aligns with this learning objective?
Developing a presentation about business ownership
In a senior internship course, one of the learning objectives requires students to be able to evaluate their growth throughout the semester.
Which weekly assessment method would align with this objective?
Composing a reflection essay
In a graduate business course, one of the learning objectives is, "Students will be able to facilitate a meeting using presentation software."
How should an indirect assessment method be used to support students in meeting this objective?
By having students critique each other's recorded meetings and offer suggestions
The objective of a high school art unit is, "Students will be able to make artwork using mixed media."
How could a project-based assessment method be used to determine whether students have met this learning objective?
Students could create a portfolio with samples of their artwork.
How can learning analytics be used to encourage student success?
By developing student awareness to support self-reflection
Which type of learning analytics should a learning experience designer begin with as a first step toward optimizing learning in K-12, higher education, and workforce development?
Descriptive
The teacher has gathered the learning data of a fifth-grade world history class throughout an entire school year. The school seeks a 10 percent improvement in student learning and wants to use the data from this year as a benchmark for comparison to students who take history next year. The school principal has asked the teacher to use the data to establish learning growth benchmarks based on the current year's data.
To establish the desired benchmark, _____________ analytics should be used.
Descriptive
Which scenario is an example of how prescriptive analytics can be used in a K-12 setting?
For the past five years, the number of students reading at grade level has declined. The school would like to know what actions should be taken to break the five-year decline in the number of students reading at grade level.
A university learning experience designer wants to encourage students to take ownership of learning. What are two ways the designer can use learning analytics to achieve this goal?
Let students see how often and long classmates are accessing each learning resource in the course. and Provide students access to a program that tracks personal course progress.
A student on an academic scholarship that only covers a certain number of credit hours has signed up for a course not required for a degree. Scholarship students taking unnecessary courses is a repeated issue for the university, as it impacts students' ability to graduate on time and costs extra money. The university wants to eliminate the problem of students signing up for unneeded courses and provide the correct courses for students based upon their major, the courses they have already taken, and the number of credits they need to graduate.
The university can implement _________ analytics to correct this issue, so students can focus more time and effort on courses needed for graduation.
Predictive
A supervisor wants to know if the new training program designed to increase production is successful or needs to be revised. How should the supervisor apply learning analytics to measure the effectiveness of the training?
Track employees' performance during training.
How can predictive analytics be used to improve the effectiveness of training in a workforce development setting?
Tracking data through training so that learning programs are aligned with employee performance
Students are consistently dropping an introduction to psychology course after the third unit. The university wants to discover why this keeps happening. Which type of analytics should the university use?
Diagnostic
The supervisor of an accounting team wants to collect data on junior accountants' errors to reduce errors and increase quality. Why should this data be collected?
To identify employees who need additional training
How can professors use diagnostic learning analytics in the classroom to understand why learners struggle with the learning resources in a particular unit?
Professors can compare the time students spend on learning resources to individual test results to see if a lack of reading is causing low scores.
A trainer is responsible for teaching the features and capabilities of a proprietary software system to large groups of new employees with widely varying technology skill levels.
How can this trainer use prescriptive learning analytics to enhance individual employees' learning experiences?
By developing personalized learning at scale
Middle school students watch a video with embedded quizzes for a social studies assignment.
How could the students' teacher use descriptive learning analytics with the purpose of determining individual student progress with the presented content?
By examining student engagement with the video and quiz question responses.
A trainer in a large organization teaches evidence-based selling techniques to sales agents after they have completed their first year of employment. Following the first unit of training, participants access an online module that reviews the content presented and captures participant responses to related questions. After reviewing the participants' responses, the trainer determines that most participants have not correctly answered the questions associated with the unit's learning objective. The trainer is required to show that 80% of the participants correctly respond to 80% of each unit's questions.
How could the trainer use prescriptive learning analytics with the purpose of presenting a modified version of the unit that will have a greater impact on this same group of participants?
By using the identified weaknesses in the participants' collective performance to adapt the first unit of training
A general education chemistry course is taught by a professor who has a reputation of failing most students every semester. The professor has been asked to conduct a review to identify areas in which students struggled so student performance can be improved.
What type of learning analytics data could this professor use for the purpose of identifying areas that need improvement for students to be more successful?
The mean score for each assessment in the course
How can prescriptive learning analytics data from course evaluations in higher education be used for the purpose of making improvements to a course?
Critical comments can be analyzed to determine areas in the course that may need revision.
At the end of a grammar unit for second-grade students, a teacher administers an assessment to determine the students' ability to write complete sentences. Learning analytics show that 25% of all students do not demonstrate competency.
How could this instructor use prescriptive learning analytics in order to customize instruction and address this problem?
By determining individual skills that need reteaching by categorizing common errors
Administrative support staff in an organization are learning how to prepare digital presentations through an online course. The course is mostly self-paced; content is delivered by a learning management system (LMS) but facilitated by a trainer. Two months after the course ends, the organization's human resources (HR) department asks participants to describe how their participation has enhanced their ability to prepare digital presentations.
What should the trainer do to determine whether the longer training period and enhanced coaching are valuable to employees and the organization?
Examine total course hours per participant and associated participant feedback collected by HR
In a business management course, students must research and write a paper analyzing the founders of modern management principles. To ensure students approach the assignment as intended, the course instructor requires students to submit an outline of their papers. The instructor reviews each outline and provides feedback to help students develop a complete, clear analysis.
Which feedback provides students with formative guidance?
In a business management course, students must research and write a paper analyzing the founders of modern management principles. To ensure students approach the assignment as intended, the course instructor requires students to submit an outline of their papers. The instructor reviews each outline and provides feedback to help students develop a complete, clear analysis.
Which feedback provides students with formative guidance?
Written comments in each student's outline identifying the student's progress and opportunities for enhancement
Students are instructed to predict what will happen if they attempt to grow bean seeds without direct sunlight for a specified growth period. One student group hypothesizes that their bean seeds will not grow without sunlight.
Which instructor feedback statement would be meaningful?
"Explain how your prior learning, scientific theories, or other information led you to this hypothesis."
A teacher uses a rubric to assess students' political cartoon assignments in three areas: message, content, and visual presentation. One student scored four points for the message, four points for the content, and three points for the visual presentation. In addition to providing a score of 11 out of 12 points, the teacher included the following feedback for the student in a comment box: "Please review your classmates' political cartoons."
Is this an example of quality feedback?
No, the feedback does not include specific, actionable statements relative to the learning goal.
Students are required to work together in groups to find a solution to a problem. The teacher observed one group and provided the following feedback to the group:
"I observed that for the majority of the time, you listened to one another. I heard you encourage each other and ask each other for help. We will work in groups again on Friday. On Friday, all of you should work together to ensure everyone agrees on a solution."
Is this quality feedback?
Yes, because it includes details about the observation and provides the next steps
A middle school science teacher evaluates the online lab reports of students and provides feedback consisting of only numerical scores and letter grades. However, the teacher wants to modify the feedback to improve its effectiveness.
What should this teacher provide in addition to the scores and letter grades?
Information about the students' progress toward the learning goal
Students in a virtual reading group are asked to read four sentences aloud. One student's read-aloud sounded choppy, with several pauses. The teacher responded, "You seem distracted. Is there something bothering you?"
Which modified feedback statement would be more effective for this learner?
"If you are feeling distracted during your read-aloud, it is OK to stop, ask for a brief pause, regain your composure, and start fresh."
Students are learning how to crop an image in half using a provided step-by-step instructional document. One student submits an uncropped, rotated image. The initial feedback from the teacher is, "It does not appear that you understand the definition of crop. Instead, you have rotated the image."
Which modified feedback statement would be more effective for this student?
"It appears you have rotated this image rather than cropped it. For this exercise, follow the provided steps on the board, and then resubmit your task."
A high school history teacher has taught the same group of students all year. The teacher is familiar with the work habits of each student and, at times, has been able to guess the score that each student will receive on an assignment based on its level of difficulty. For their final project, students are required to submit a research paper that highlights a historical event or figure. Students have two weeks to submit the paper.
Which scoring bias issue may be a concern in this situation?
The teacher may score the assignment based on prior knowledge of the students.
A fifth-grade health teacher forgets to make paper copies of the midsemester multiple-choice assessment. The teacher is required to administer the test by the end of the day; consequently, the teacher decides to project the assessment using the class smart board and have the students write their answers on notebook paper.
What is a test administration concern for this assessment?
Accessibility
A teacher assigns an essay during the first week of school to assess students' writing abilities. The teacher provides the following prompt: "Share what you did during summer vacation by describing one of the following: (1) a long-distance trip you took, (2) a fancy restaurant you visited, or (3) a major league sporting event you attended."
How is this assessment biased?
It does not consider socioeconomic differences among the students.
Each week in an organizational management course, students are required to view recorded simulations of conflict resolution scenarios and evaluate the manager's performance in each scenario. The recorded simulations offer transcripts of the dialogue.
Which modification would improve accessibility?
Providing audio descriptions that present the visual-only content in the videos
Students in an introduction to marketing course took an online assessment requiring them to discuss the marketing techniques demonstrated in a set of statements. The assessment had to be completed within a specific period of time and without access to resources. More than half of the students inaccurately discussed the technique associated with the following statement: "You must rely on the esoteric interests of a group to place your product."
How could this assessment be modified to reduce bias?
By using language suited to the students' level of knowledge and experience
Grades are due at the end of the week, and a teacher realizes that the students in their class still need to take an end-of-chapter quiz, a unit test, and a midterm exam. The teacher explains to the students that they should study hard each night because they will be taking these three assessments over the next three days.
How could this assessment plan be modified to improve the students' experience?
Consolidate the content to lessen the cognitive load and alleviate student stress
Students in an online humanities course are assigned to listen to and compare samples of three types of music: opera, classical, and jazz.
What should be provided to students with hearing loss to increase the accessibility of this assignment?
A description of each sample
In an online college speech course, an instructor encourages students to work with their peers to develop speech topics and to rehearse their speeches. How could this instructor use diagnostic learning analytics to determine whether students are participating in group work?
By identifying the number and type of student interactions
A teacher of a first-year German class is interested in determining the impact of using online learning games on vocabulary knowledge. How could this teacher use learning analytics with the purpose of determining the efficacy of the learning games?
By comparing assessment scores from students who did and did not use the online learning games
Employees in an organization are not completing a training course on their first attempt, resulting in additional costs for the organization. A training manager wants to anticipate the likelihood of participants' failure while participants are engaged in the course and recommend customized remediation that is embedded throughout participants' first attempt at the course and is based on each participant's needs. Which type of learning analytics should this trainer use to suggest various actions to participants to help them complete the course successfully on their first attempt?
Prescriptive
A history curriculum department for a K-12 school district has created a history fair project: Sixth-grade students will present a historically significant character as part of a living museum. To determine how prepared students are for this project, teachers in the district have asked students to demonstrate their speeches before the fair. The teachers use a rubric to assess each student's presentation as meets expectations or below expectations in four categories: accuracy, presentation, scope, and bias. The scores are entered into a learning management system (LMS) for review by a history department coordinator to determine which schools need additional support. Which type of learning analytics does this process represent?
Descriptive
A data analyst for a school district is asked to provide information to the district's superintendent on how each school in the district performed on the math portion of a state standardized test. Specifically, the superintendent wants to know which schools had fifth-grade students solve two-step math word problems with at least 70% accuracy on the test. The data analyst plans to summarize the schools' performance data using graphs. Which type of learning analytics does this assignment represent?
Diagnostic
A special education school administrator is concerned that students with special needs are not making adequate progress in developing literacy skills. The administrator sets a goal that the literacy scores of students with disabilities will increase by 12% by the end of the following school year. Which type of learning analytics should this special education administrator use when reviewing performance levels during the year?
Descriptive
A fourth-grade teacher is piloting an enrichment unit on fractions with like and unlike denominators for remote learners. The modules are accessed through a learning management system (LMS) and are arranged in a specific instructional sequence. The teacher is uncertain whether the modules are effectively sequenced. Which data measure should be used to determine if the learning modules are effectively sequenced?
Current scores from end-of-module quizzes
Freshman college students are required to take a course that introduces them to the college experience during their first semester. The course includes an initial assessment that measures how the students' knowledge of resources supports their academic performance. The assessment is administered online and includes questions that require students to press and hold the Control key while selecting answers in a drop-down menu. Specific directions are provided for these items. Additionally, a graphic that demonstrates the process is provided. Which high-level principle of functional accessibility is a concern in this assessment?
Operable
A high school chemistry teacher has developed several assessments that measure four different objectives. The teacher plans to use the assessments in the upcoming year to measure the students' preparedness for the summative state chemistry assessment. What is a construct-validity bias issue with this plan?
It has not been determined that the created assessments measure the students' knowledge of the objectives.
The Learning Goal Identify the factors which influence the start of World War I
What traditional assessment strategy can the instructor use to determine if the goal was met?
Have students write a summary of the factors of World War I using supporting details.
Data measures that determine learning modules are effectively sequenced
Current scores from end of module quizzes
Remembering
Recognizing and recalling company policies and procedures.
Understanding
Explaining company culture, products and services
Applying
Identifying patterns and issues in workplace scenarios
Analyzing
Identifying patterns and issues in workplace scenarios