Uiowa Staffing and Talent management exam 2

What is measurement? what is the goal of measurement in selection?

- measurement is the process of assigning numbers to represent quantities of an attribute.

- in the selection process, the goal is to gather and express information about candidates numerically to assess qualities relevant to job performance, such as KSAOs

What are the main types of measures?

Two main types:

1. Objective measures: these have clear right or wrong answers, such as tests

2. Subjective measures: these involve human ratings, such as interview evaluations

what do we mean when we say "standardization"? why is it important to selection?

- standardization ensures the content, administration, and scoring of a measure are consistent across all applicants

- its important to ensure fairness and compatibility of candidate scores

what is reliability?

the consistency of a measure

Internal reliability

measures consistency within a test, often assessed with Cronbach's Alpha

test-retest reliability

measures consistency over time by administering the same test to the same group on two occasions

alternate forms reliability

measures consistency between different forms of a test

interrater reliability

measure agreement between raters evaluating the same attribute

what is measurement deficiency and contamination?

- deficiency: occurs when a measure fails to capture important aspects of the construct it aims to assess

- contamination: happens when extraneous factors influence the measure, such as random errors or biases from untrained raters

what is the relationship between reliability and validity?

reliability is a prerequisite for validity; a measure must be consistent to accurately assess the intended attribute.

*reliability alone does not guarantee validity

what is validity?

the accuracy of a measure- how well it assesses what it claims to measure

content validity

ensures that the measure represents relevant attributes for the job

criterion-related validity

assesses how well scores on measure correlate with performance on relevant criteria, like job performance

concurrent validation design

involves administering the measure to current employees to see if scores correlate with existing performance data

predictive validation

involves administering the measure to applicants and later assessing if scores correlate with their job performance once hired

what is adverse impact? what is the ratio cutoff that suggests evidence of adverse impact?

- occurs when a selection measures disproportionately affects a protected group

- evidence of adverse impact is suggested if the selection ratio for one group is less than 80% of the highest group's selection ratio

what is the logic behind prediction?

- the logic of prediction is that past behaviors and experiences are indicators of future Performace.

- by assessing a candidate's previous accomplishments, behaviors, and qualifications, organizations aim to predict their likely success in a new role

what are the different types off initial selection methods?

- resumes and cover letters

- application blanks

- biographical information (biodata)

- references and background checks

- initial interviews

resumes and cover letters

-description: provides a summary of a candidate's experience, skills, and qualifications

-validity: variable, as they are self-reported and may lack objectivity

-reliability: lower reliability due to inconsistencies in content and formatting

-adverse impact: minimal, but may vary by applicant resources and access to professional writing

-applicant reactions: generally positive, as they allow candidates to present themselves in the best light

application blanks

-description: standardized forms that collect key information, verifying resume details

-validity: moderate, especially for verifying facts like education and experience

-reliability: high, due to standardized questions

-adverse impact: minimal if designed to focus on job-related information

-applicant reactions: neutral to positive, as they ensure fair and equal information collection

Biographical information (biodata)

-description: collects detailed information about a candidate's background, such as education and achievements

-validity: can be high if questions are job-related

-reliability: moderate to high, depending on the structure

-adverse impact: possible if the biodata questions indirectly favor certain groups

-applicant reactions: mixed; some may find it intrusive if personal details are collected

references and background checks

-description: references provide insights from previous supervisors, while background checks verify records

-validity: moderate, but depends on the objectivity and truthfulness of references

-reliability: moderate, as reliability depends on the consistency of references' evaluations

-adverse impact: potential for adverse impact, particularly in background checks, which can disproportionately affect minority groups

-applicant reactions: generally positive for references; background checks can be viewed negatively if perceived as invasive

initial interviews

-description: preliminary interviews (in-person or virtual) assess basic qualifications and fit

-validity: moderate; structured interviews increase validity

-reliability: higher when interviews are structures and standardized

-adverse impact: possible, depending on interview content and structure

-applicant reactions: positive, as interviews allow candidates to make a personal impression

what are the different types of substantive assessment methods?

-performance tests, work samples, and simulations

-situational judgment tests

-structured interviews

-ability tests

-tests of other individual differences

performance tests, work samples, and simulations

-description: assess job-related tasks directly through simulations or hands-on exercises

-validity: high, as they directly measure job performance

-reliability: high when standardized

-adverse impact: lower than other methods

-applicant reactions: positive, as these tests are perceived as highly relevant to the job

situational judgment tests

-description: measure how applicants respond to hypothetical job-related situations

-validity: acceptable, though it varies based on what is measured. (e.g. job knowledge, social skills)

-reliability: moderate, with some sources of error

-adverse impact: lower than ability tests, but could vary based on the scenarios presented

-applicant reactions: generally positive; perceived as relevant if scenarios align with job duties

structured interviews

-description: based on job analysis, using situational or behavioral questions scored with anchored rating scales

-validity: high, especially for predicting job performance

-reliability: high when questions and scoring are consistent

-adverse impact: minimal, as structured interviews are standardized

-applicant reactions: positive, due to perceived fairness

ability tests

-description: assess cognitive, physical, sensory or job-related abilities

-validity: high, particularly for cognitive ability, which correlates with job knowledge

-reliability: high when well-designed

-adverse impact: higher for cognitive tests, which may disadvantage some groups

-applicant reactions: mixed; cognitive tests can feel intimidating

tests of other individual differences

1. personality (the big 5)-> openness, conscientiousness, extraversion, agreeableness, and emotional stability

-validity: moderate, with conscientiousness often being the strongest predictor

-reliability: moderate to high for structured personality assessments

-adverse impact: low

-applicant reactions: generally positive; viewed as fair and insightful

2. integrity: assesses honesty and ethical behavior

-validity: moderate, depending on the job's need for ethical conduct

-reliability: high if tests are structured

-adverse impact: minimal

-applicant reactions: mixed; some may find these tests invasive

3.values: measures alignment with organizational culture

-validity: moderate to high, depending on how well values align with job requirements

-reliability: moderate

-adverse impact: minimal

-applicant reactions: positive if the test is relevant to organizational culture

what are BARS

Behaviorally Anchored Rating Scales

-rating scales that define specific behaviors associated with different performance levels.

-provides clear criteria for evaluators, making scoring more objective and reducing ambiguity.

-BARS are especially useful in structured interviews as they improve reliability and fairness in evaluating candidates

differences between external and internal selection

- external: involves identifying candidates from outside the organization to fill positions, offering opportunities for fresh perspectives but often with increased hiring costs and longer adjustment periods.

-internal: the assessment of current employees for new roles within the organization, typically through transfers or promotions. It leverages existing employee knowledge, fits with organizational culture, and can be a cost efficient way to meet staffing needs while boosting morale

talent management systems (TMSs): purpose, benefits, and limitations

-TMSs are designed to strategically anticipate and meet an organization's talent needs by sourcing, identifying, managing, and retaining talent.

-they help align talent with organizational goals, streamline HR processes, and improve decision-making on promotions or development needs.

-TMSs can be costly and may deter some organizations from implementing them especially in the face of demand uncertainty, where hiring externally may seem more flexible.

-Also, maintaining and updating TMSs requires significant resources and data management

Alternative methods to assess internal candidates

-peer assessments

-self assessments

-managerial sponsorship

-informal discussions

peer assessments

-employees evaluate each other, which can provide reliable insights on. teamwork skills and reputation but may introduce bias

-generally, peer assessments have moderate validity and reliability and may lead to positive applicant reactions due to perceived fairness

self-assessments

-employees assess their skills and competencies, providing self-reflection data, though these may lack reliability due to subjective bias.

-self assessments often rate moderately on validity and have a low risk of adverse impact, generally yielding favorable applicant reactions

managerial sponsorship

-managers endorse employees based on observed performance and potential, lending valid and reliable insights

-this method is typically well-received by employees but can risk bias if not managed objectively.

informal discussions

-casual conversations or informal reviews provide flexible insights but generally lack structured validity and reliability.

-despite this, informal discussions often positively influence applicant reactions due to a personalized approach

substantive methods for internal selection and their comparative attributes

key substantive methods used in internal selection and their impact on validity, reliability, adverse impact, and applicant reactions include:

-seniority

-assessment centers

-performance appraisals

-interviews

-promotion panels and review boards

these methods allow organizations to assess and select internal talent effectively, each with its own strengths and limitations

seniority substantive method

This method values employee tenure as a promotion criterion. It is reliable and typically free of adverse impact but often ranks lower on validity since tenure alone doesn't predict performance.

Applicant reactions are mixed, as it favors longevity over skill.

assessment centers

Involving multiple exercises to assess job-related KSAOs (knowledge, skills, abilities, and other characteristics), assessment centers are highly valid and reliable but can be costly.

While adverse impact may be present, applicant reactions are generally positive due to the comprehensive nature of this method.

performance appraisals

These reviews of an employee's job performance offer moderate validity and reliability. They may lead to some adverse impact if biases influence the appraisals, but applicant reactions tend to be favorable, particularly if feedback is constructive.

interviews

Internal interviews provide targeted insights into employee fit and readiness for new roles.

They generally have moderate to high validity, though reliability can vary depending on the structure.

Adverse impact is often low, with positive applicant reactions as interviews allow for self-representation.

promotion panels and review boards

These involve a panel of decision-makers reviewing candidates, typically offering moderate to high validity and reliability. While this approach is generally favorable in terms of applicant reactions, it may introduce adverse impact if not carefully moderated to ensure objectivity​