1/93
Looks like no tags are added yet.
test
objective and standardized procedure for measuring a psychological construct using a sample of behavior
attributes to be assessed —> content
ways to assess attributes —> process
refrain from coaching on tests (makes a better test taker, not a better worker)
establishing rapport with employees can reduce anxiety on tests
meaning of a test score
norming and norm groups used to interpret and give meaning to a test score
test users and test interpretation
importance of training test administrators to correctly understand and interpret results
test battery
collection of tests assessing variety of different attributes
ethics
a test is different than a survey (survey provides anonymity), and can be an invasion of privacy
confidentiality is an extension of privacy
topics to stay away from
gender/marriage/family
citizenship/nationality
age
religion
interviews
value of interviews
universal in its appeal
criterion-related validity
serves other personnel functions achieved through its use
situational interviews
situational (hypothetical) questions
degree of structure (structured vs unstructured)
which would have more validity?
interview issues/errors
confirmation bias
we tend to seek confirmation of our beliefs rather than testing them
fundamental attribution error
making an assumption about a person’s character/strengths/weaknesses versus their actual character/strengths/weaknesses
overemphasis on intra-individual qualities
bad questions
not directly related to the job
unstructured/open-ended
tell me about yourself
what college class did you like the best?
where do you want to be in 5 years?
biggest weakness?
non-verbal cues
more eye contact and more smiling both led to higher interview score
dishonesty
lying on resumes is increasing
2010: 44% of HR managers reported resume falsifications have increased
2010: 30% of college seniors admitted to falsifying information
best way to check for dishonesty is to contact references
reducing bias
interviewer training
structured interview questions
situational judgement test (SJT)
identify specific KSAOs
identify which are best assessed in an interview
create questions that specifically address each KSAO
situational judgement test development
critical incidents interview
rewrite incidents into situations
create possible responses to the situation (from good to bad)
rate each response
assess reliability and validity
creation of the final form
skill based
past focused
future focused
administrative test categories
speed vs power tests
speed tests have rigid and demanding time limits
provide greater variability among candidates
issue of relevance to job
may increase the risk of legal challenges
power tests have no rigid time limits
group vs individual tests
individual tests useful in assessing a candidate’s style of problem solving
group testing is valuable in reducing costs
paper and pencil vs performance tests
performance tests assess skill in performing tasks and knowledge of how to carry out actions
the big 5 factor model (OCEAN)
openness/intellect
conscientiousness
extroversion/introversion
agreeableness/disagreeableness
neuroticism/emotional stability
evidence for model (replicated in different languages, cultures, age groups)
Myers-Briggs
Carl Jung (person is collection of bipolar opposites)
developed by Isabel Briggs and her mom Katherine Briggs
over 2 million tests sold a year
four components
introversion (I) -extroversion (E) (flow of energy)
sensing (S) -intuition (N) (gathering information)
thinking (T) -feeling (F) (processing information)
judging (J) -perceiving (P) (deciding)
problems with Myers-Briggs
poor reliability and validity
only a 50% chance you’ll be categorized with same type after 5 weeks (Howes and Carskadon, 1979)
poor concurrent validity (like Buzzfeed quizzes)
not intended for use in hiring decisions
MBTI does not have significant predictive validity for who will excel in a given job
typological instead of a continuum
people can fake their results
good personality tests
look for personality tests that
are reliable
based on continuums instead of binary differences
have predictive validity/are also KSAO based
are based in the Big 5 or other validated personality constructs
other personality traits
dark triad
Machiavellianism, narcissism, psychopathy
Machiavellianism: manipulative strategy of social interactions that uses other people as tools for personal gain
grit
found to just be conscientiousness over time
intelligence
dimensions
single factor composite “g” intelligence
two factor (Raymond Cattell)
fluid intelligence: mental efficiency; adapt to new situations (adapting to new experiences)
crystallized intelligence: what you know; socially dependent (obtained throughout life/experience)
three factor (Robert Sternberg)
analytical, practical (street smarts), creative
multiple intelligence theory (Gardner)
linguistic
logical-mathematical
spatial (classical music only temporarily boosted this, not intelligence as a whole)
kinesthetic
interpersonal
intrapersonal
musical
naturalistic
testing and culture
“no such thing as neutral knowledge” Andrew Kirchweier
bias: situation in which a given test results in greater statistical errors of prediction for certain subgroups
fairness: value judgement about actions or decisions based on test scores
culture: system in which individuals share meanings and common ways of viewing events and objects
influence of culture and subculture on test scores
ex. CRUST (cultural/regional uppercrust savvy test) Aiken, 1996
other controversial methods of assessment
polygraph/lie detection
not really detecting lies
CIA teaches employees how to beat polygraph
test of emotional intelligence
highly controversial and still not well established
measurement issues
response sets
acquiescence
yes sir/ma’am even if you aren’t able to do the task
extreme responding
1 or 10, no in between
white and black, no grey area
social desirability
integrity testing
faking
social desirability
answering according to expectations; pressure to answer in a certain way
two views
SD represents distortion and should be eliminated or reduced
SD is a valid part of other desirable personality traits, such as agreeableness, and should be studied
integrity testing
assess whether a person is generally honest or dishonest
combination of high conscientiousness, high agreeableness, and low neuroticism
faking
faking good
faking bad
to lower corporate expectations, workload, etc.
letters of recommendation
commonly used selection method but least valid: restricted range
primary value if negative information about candidate is revealed
overview and evaluation of predictors
four major evaluative standards
validity: predictive accuracy
fairness: differential predictive accuracy across different groups
applicability: interview highest applicability and most universally used
cost: subjective and arbitrary, but highly relevant to organizations
organizational strategy and staffing
strategy: how an organization seeks to accomplish its goals
strategy is basis for how much is spent on human resources
fast food industry vs medical field
talent acquisition
onboarding
recruitment
changes in how recruitment of employees takes place
prospecting vs mating theories
influence of social validity on applicant reaction to recruiting and assessment procedures
regression
how do we predict job performance based on our selection instrument?
regression equation
regression to predict outcomes
criterion validity
selection decisions
cutoff scores
specified point in distribution of scores below which candidates are rejected
strategy for determining cut score depends on the situation
no universal method accepted as best
best practice: Modified Angoff Scores
Modified Angoff Scores/Angoff Method
SMEs look at each item on a test
provide them with KSAO job analysis data
estimate percentage of minimally qualified applications that would get items correct
reduce cutoff score by 1, 2, 3 standard error measurements
reducing possibility for adverse impact
sometimes MAS also takes multiple rounds to get good inter-rater reliability between SMEs
using 7 or more helps
determination of the cutoff score
three guidelines in determining cutoff score
two types of errors: too high versus too low
banding: alternative to low cut-off scores
tries to meet dual objectives (able candidates vs adverse impact)
individuals with similar test scores can be grouped together in a category (a score band)
score banding is controversial
sliding bands (moves back after first applicant is chosen)
subgroup norming is not allowed
selection detection issues
false positive
false negative
true positive
true negative
false positive
applicant accepted but performed poorly
false negative
applicant rejected but would have performed well
true positive
applicant accepted and performed well
true negative
applicant rejected and would have performed poorly
diversity-validity dilemma
individuals from all groups do not score equally on personnel selection tests
workforce productivity vs equal opportunity remains a dilemma
dilemma cannot be resolved by use of different cutoff scores
organizational learning
personal training experiences
types of learning
needs assessment
etc.
types of learning
learning experience changes our knowledge or skill
declarative knowledge phase: memorizing/basic understanding
ex. read manual and recite procedures
knowledge compilation phase: combining cognitive/motor processes
ex. demonstrating knowledge memorized, trial and error
procedural knowledge phase: automatized, can be used for problem solving
ex. doing something without thinking about it, automatic process
training needs assessment
what do they (employees/managers) need to know?
do they need training?
if yes, what
are the training objectives?
are the methods you will use?
is the best way to evaluate the training?
levels of analysis
organizational: will training be helpful for the entire organization? should training only apply to certain departments?
task: what types of tasks are performed on the job? what tasks are essential?
physical fidelity: match between training and work environment
psychological fidelity: make the training programs link to the relevant KSAOs
person: who needs to be trained? what do they need to learn?
training model
Goldstein and Ford, 2002
needs assessment —> training and development —> evaluation —> training validity levels
training methods
computer based
distance learning
programmed instruction
intelligent tutoring
interactive multimedia training
virtual reality
issues with physical fidelity
non-computer-based
role playing
behavior modeling
business games
training programs
cultural diversity training
goal: to reduce barriers that constrain minority culture members
surface level versus deep level diversity
many diversity training programs focus on diversity awareness to
increase trainee knowledge
privilege walk (can be anonymous or not) (cons: unfair burden on less privileged, may lead to exposure of private information)
find common ground
challenge belief systems/debunking stereotypes
perspective taking
what can allies do?
difficult to change formal policies
who are the “gatekeepers?”
allies can help set new norms
ex. confederates expressed views either condemning or condoning discrimination, and participants followed suit
expatriate training
expatriates serve in overseas assignments
global business results in greater numbers of expatriates
expatriates can experience cultural adjustment problems
training focus should include:
an understanding of different customs, etiquette, gestures
family members
sexual harassment training
EEOC definition of sexual harassment
unwelcome sexual advances
interferes with ability to do work
quid pro quo vs. hostile-environment harassment
qpq: if you do something for me, I do something for you
heh: (how it sounds); including inappropriate jokes
sexual harassment
sexual behavior can blur into sexual harassment
sexual harassment training programs
sensitivity to others’ values
cultural differences
workplace romances
personalized differences and preferences
ex. social media can facilitate harassment beyond the workplace
management development issues
excellent companies develop managers
career velocity
derailment and underutilization of skills
mentoring
executive coaching
mentoring
facilitating management development (mentor-protege)
four states of the mentor relationship
relationship initiation
cultivation
separation
redefinition
three factor model of mentoring
frequency of meetings
scope: breadth of subjects
strength of influence
benefits for mentoring proteges
career-related support
psychological support (leads to satisfaction)
differences in cultural acceptance of mentoring
ex. power distance
executive coaching
coach helps executive learn adaptive new skills
types of skills can be learned/improved
interpersonal
communication
cognitive
leadership
self-management
geared specifically to individual problems and needs
people vary in their levels of “coachability”
coaching is related to substantial improvements
coach comes from outside the organization
active learning approach
put trainees in control of their learning
based on assumption that learning occurs inductively (logically)
Error Management Training
Self Regulatory training
Error Management Training
theoretical benefit of learning from mistakes
ex. person makes harmful joke, learns it’s not welcome in the workplace, takes this to heart and improves but has slip ups
even well-intentioned people can have slip ups
keep trying until you improve, even if things are constantly changing
Self-Regulatory Training
prompting trainees to monitor and adjust their actions and reactions
self-efficacy (belief in your ability to be able to do something) and attribution (do, think, feel)
transfer of training
people must be motivated and supported for training to transfer
generalization (new skills exhibited)
maintenance (continued to use over time)
overcoming limitations in the post-training environment
supervisory support
opportunities to apply what’s learned
organization’s social support systems
post-training evaluations
Kirkpatrick’s Levels of Evaluation Criteria (1976)
reaction: what did you think of training? (face validity)
learning: did you learn and retain new information?
behavioral change: transfer of training
results: utility analysis, how does training impact bottom line?
performance management vs performance appraisal
continuing, on going process vs one time event
rather informal vs formal
importance of alignment
appraisal should be aligned with management (no surprises)
the performance management process
define performance
evaluate performance
review performance
provide performance consequences
purposes of performance management systems
six purposes (Aguinis, 2009)
strategic (getting to the top of a ranking)
administrative (organization/structure)
communication (formal and informal)
developmental (using study skills across classes)
organizational maintenance (replacement, training)
documentation (keeping track of complaints and communicate with employees)
performance appraisal and the law
legal problems come from:
negligence: breach of duty to conduct appraisals with due care
defamation: disclosure of untrue unfavorable performance information that damages the reputation of an employee
misrepresentation: disclosure of untrue favorable performance information that presents a risk of harm
rater errors and biases
serial position errors: primacy vs recency effect
contrast error: comparisons against others vs against set standards (grading employees against themselves)
halo errors: halo vs horn effect (halo: attractiveness, friend; horn: irritating, rubs you the wrong way)
leniency errors: positive vs negative leniency (severity)
central-tendency error: avoidance of extreme ratings
absence of these errors does not equal accuracy
rating scales
graphic rating scale: 5-7 point scale
employee comparison methods
behavioral checklists and scales
behaviorally anchored rating scales (BARS)
employee comparison methods
rank order: high to low
paired comparison: each employee compared with every other employee; best used with small samples
forced distribution: 5-7 categories (normal distribution assumption); employees must be distributed across all categories; best used with large samples; top-grading (rank/yank)
behavioral checklists and scales
critical incidents
record of good and poor performance behaviors
not usually quantified (3 complaints does not equal 3 times worse)
behaviorally anchored rating scales (BARS)
combines behavioral incident and rating scale method
time consuming/expensive
difficult to reach agreement
job/task specific
rater training
rater error training
taught to make fewer errors
does not necessarily result in increased accuracy
rating person one question at a time reduces primacy and recency effects
frame of reference training
particularly promising
calibrates raters, showing them what to look for
“common reference standards”
rater motivation
some environments more conducive to accuracy ratings
factors in organizations inhibit accurate evaluations
willingness vs capacity (information necessary) to rate
conscious rating distortion
numerous reasons to inflate/deflate ratings
ex. appraisal politics (ex. “it was their turn” “they’ve been here for a while” or not electing an unopposed candidate)
incentives for accuracy
teachers cheating on students’ exams to keep jobs
real estate agents making “good sales” versus person wanting to make an excellent sale
peer and self assessments
peer assessments
three types
peer nomination
peer ratings
peer ranking
biased by friendship
better for developmental (vs admin) purposes
for improvement vs promotion or money
self assessments
individuals have poor understanding of their strengths and weaknesses
positive leniency is a problem
self-serving bias
360 degree feedback
supervisor, peer, subordinate, and self ratings
ex. camp counselor loved by campers may not be loved by other counselors; supervisor may know other things
based on two key assumptions
awareness of rating discrepancies enhance self-awareness
enhanced self awareness is key to maximum performance
disagreement among raters: error to potentially valuable information?
rater bias is a big factor
supervisor ratings tend to be more predictive of success (Scullen et al., 2000)
if you don’t know person, this also impacts ratings
disagreement can be both across and/or within raters
training can help (Scullen et al., 2000, Bracken et al., 2016)
what if everyone has high scores?
problem?
yes, results have less meaning
everyone has areas where they can improve (all good results don’t make it seem this way)
grade inflation and self-esteem
private schools and getting a B (WTF?)
how do high ratings affect managers?
up for promotion
ex. teacher: harder class normal distribution, easier class all A’s; harsher vs nicer student evaluations
discussing 360 degree feedback
how should it be used?
developmental purposes only?
administrative (hiring, firing, etc.)?
most benefits when 360 degree feedback is developmental
cultural differences
how might power distance impact who provides meaningful feedback?
feedback in performance management contexts
giving feedback
essential, but supervisors dislike doing it
difficulties in giving negative feedback
approximately one third of feedback results in decreased performance (DeNisi, 1996)
seeking feedback
three motives for seeking or not seeking feedback
instrumental motive: self improvement
ego based motive: defend or enhance self views
image based motive: look better to others
create culture where feedback is the norm, this will result in the best outcome
reactions to feedback
important for individuals to:
believe they have control over performance
believe system is accurate
recognize their deficiencies
those most oblivious to performance deficits are least likely to accept feedback
reactions to performance management ratings/feedback
supervisor must be perceived as trustworthy
reactions:
perceived accuracy and agreement with evaluation
employee motivation following appraisal
fairness perceptions regarding appraisal
satisfaction with the appraisal
the perceived utility of an appraisal
signs that multisource feedback is part of organization’s culture
surprisingly contemporary list from 20+ years ago (London et al., 1997)
collect ratings at regular intervals
use feedback to evaluate/make decisions
provide feedback accompanied by norms
encourage raters to offer constructive suggestions
encourage ratees to share their feedback/developmental plans with others
provide ratees with resources to promote change
reward workers with criteria consistent with feedback
track results over time
culture
the shared language, values, attitudes, beliefs, and customs of an organization
climate
shared perceptions of organizational culture
cross-cultural psychology
globalization
individualism/collectivism
Hofstede, 1980; Hui and Triandis, 1986
individual perspective vs hollsitic perspective
ex. frog vs ecosystem
horizontal vs vertical culture
Triandis, 1995
individual verticalism: person is focused on their status, upward trajectory
collective verticalism: status of group
individual horizontalism: don’t expect help so why help others
collective horizontalism: all in this together
Hofstede’s Theory of Culture
5 dimensions
more variation within cultures than between cultures
collectivist perspective
much less likely to focus on individual differences
also less likely to fall prey to self-serving bias or fundamental attribution error
Asian children taught from a young age to not display or show off individual characteristics
group/social identities are much stronger
ex. Japanese baseball players
national culture
power distance
individualism-collectivism
masculinity-femininity
uncertainty avoidance (how will things go vs all in this together)
long term-short term orientation (investment in retirement vs vacation)
indulgence-restraint (treat yourself vs hold back)
global organizations
evolution of global cultures
international —> multinational —> global
many more than Hofstede’s 5 dimensions
ex. Table 8-1
diversity of values (Marquart, 2002)
diversity leads to conflict
global organization’s core values must transcend differences to be
fair
reasonable
respectful to local culture
differences in values can be reduced to 4 key dimensions
leadership roles and expectations
individualism and groups
communications
decision making and handling conflict
how corporate cultures differ around the world
company culture
independence vs interdependence
stability vs flexibility
most salient: caring
least salient: enjoyment
across 8 cultures
organizational culture
concept of culture is a complex pattern of variables
can be seen as 3 layers of an organization’s culture
1. observable artifacts (from which deeper meaning is drawn)
symbols (physical objects, locations)
language (jargon, gossip, humor)
narratives (stories, legends)
practices (rituals, taboos, traditions)
2. espoused values
beliefs endorsed by management
can be different without anxiety
3. basic assumptions
deeply ingrained values
rarely confronted without anxiety
competing values framework
collaborative culture (clan; Tom’s)
creative culture (adhocracy; Tesla)
competition culture (market; Amazon)
controlling culture (hierarchy; Ford)
components of social systems
no formal structure apart from its functioning
have 3 informal components
roles
norms
organizational culture
roles
expectations others have about behaviors in specific positions
five aspects of roles:
impersonal
related to task behavior
difficult to pin down
learned quickly and can produce behavior changes
person in one job may have several jobs
key concepts
role conflict
role ambiguity
role overload
norms
unwritten, shared expectations define appropriate group behavior
ex. discouraging cell phone use; talking
what you “ought” to do
more obvious enforcement for “important group behaviors”
regulated internally by the group
three step process for developing and communicating norms: group must:
define and communicate
monitor and judge if being followed
reward conformity and punish non-conformity
norms can both promote or deviate form organizational goals
person-organization fit
perception of value and goal match between employee and organization
do people make the organization, or vice versa?
Schneider’s ASA Model (1987)
Attraction-Selection-Attrition
more predictive of turnover than job performance
downsizing
reduction in force
organizations eliminate jobs to reduce payroll costs
jobs are eliminated, employees not fired
outsourcing
functions performed by employees of an organization are eliminated, as functions are now performed by subcontractors or contingent personnel
offshoring
jobs are shipped overseas to cheaper-labor markets
economic impact (ex. minimum wage debate)
organizational change
forces responsible for organizational change today
technology
business based change
ex. Netflix (used to be mailing movie service)
small intentional organizational change can grow to produce unintended change
Lewin’s 3 step model enacting deliberate change within organizations
unfreezing
change
refreezing
organization development
change can be evolutionary or revolutionary
forms of OD
leadership development
survey feedback
survey results important for linkage research
team building
classical theory
how an organization is structured determines how well it accomplishes its goals
four basic components to any organization
a system of differential activities
people
cooperation toward a goal
authority
four major structural principles
functional principle
scalar principle
line/staff principle
span of control principle