1/44
Looks like no tags are added yet.
error
deviation from an intended goal or target
2 ways to get error
noise
bias
outcomes are accurate when they are…
consistent and correct
outcomes are noisy when they are…
inconsistent
outcomes are biased when they are…
consistent but incorrect
outcomes are biased and noisy when they…
are consistently incorrect in one direction with some random scatter
3 steps for designing for error
assume errors will be made by humans interacting with it
detection/audit
remedy
what 2 questions does the detection/audit step of designing for error address?
how detectable are the errors?
who has the resources to detect errors?
what question does the remedy step of designing for error address?
who fixes the detected problem
3 types of human errors
slips
mistakes
value bias
slips are errors that occur due to… (3 things)
inattention
impulses
accidents
3 types of slips
capture slip
description slip
memory-lease slip
capture slip
performing more habitual/familiar activies instead of the intended ones
description slip
performing the right action on the wrong object
memory-lapse slip
unconsciously forgetting to do something or forgetting a step
are slips noisy or biased and why?
noisy, because they are situational errors
the amount of slips increase with… (2 things)
stress
speed
what is one way of preventing slips with design?
forcing functions
forcing functions
logical/physical constraint that prevents from proceeding until a previous step is completed properly
do humans or machines slip more and why?
humans, because machines are more consistent and have less noise
what do mistakes do?
produce the wrong outcome
how do mistakes produce the wrong outcome?
when the goal or plan is inappropriate
what are 2 ways to prevent mistakes with design?
warnings
attestations
value bias
preference for an unjust outcome
what are 2 types of value biases?
intentional
unexamined uninentional
what 2 things cause humans to make mistakes?
biased intentions
biased cognition
are humans making mistakes biased, noisy, or both?
both biased and noisy
what 2 things cause machines to make mistakes?
training
inputs
are machines making mistakes biased, noisy, or both?
biased only
are humans or machines more reliable and why?
machines, because they inherit mistakes and bias from humans
correctability
how difficult it is to correct slips or mistakes
is it easier to correct humans or machines and why?
machines, because only one correction is needed for them to update reliably
what is a limitation of correcting machines?
only owners and developers of the software or system are able to correct it
detectability
how easy and through what means errors can be identified
what does system bias require to be detected?
a statistical audit
how is a statistical audit performed?
by gathering a large number of cases and comparing directly to a truthful standard
what are 3 implications of statistical audits?
require access to a large number of cases
require computing power and analytical skill
anecdotal evidence is irrelevant or unconvincing
who does system bias work against and who does it work for? why?
works against affected users
works for system provider
because there is information asymmetry between those who have control over the system and those who don’t
how can human bias be assessed?
via judgments of moral character
moral character
a person’s inner workings that lead them to make consistent judgments and perform consistent behaviors
why can an individual’s character be inferred from their behaviors?
humans are consistent in their virtues and flaws
why do people tend to infer others’ characters from their behaviors?
to maintain trust
whose character are humans not able to make inferences about? (2 things)
algorithms
AI agents
why can’t you infer the character of algorithms or AI?
their actions provide no information for detectability or on their consistency
what are 2 ways designs can be changed to reduce errors?
make products more usable
make systems less biased