2nd Sem Exam 2

Which of the following are purposes of an organizational survey?

To understand the current state of a specific construct (e.g., engagement, satisfaction), to communicate desired values and behaviors through survey items, to identify areas and actions for improvement

Which of the following correctly describes the reason why you should conduct centering in moderation analysis? 

To avoid multicollinearity

Interpret the result of an analysis below. Which of the following interpretation is TRUE?

Moderator was not found.

Which of the following best explains why multiple regression cannot be used when the dependent variable is probability?

The slope of probability varies depending on values of IV, making multiple regression unsuitable for analyzing

Which of the following statements correctly interprets a 95% confidence interval (CI)?

In logistic regression, if the 95% confidence interval for an odds ratio does not include 1, the effect is considered statistically significant.

The figure below presents the results of a simple slopes analysis examining the relationship between job stress and performance at three levels of social support (−1 SD, mean, +1 SD). Based on the graph, determine whether there is evidence of moderation and justify your answer.

Note: Statistical significance is not provided. Base your answer on the pattern shown in the graph.

Yes, there is evidence of moderation. Specifically, the graph shows a buffering effect because the line -1 SD is steep whereas the line +1 SD is shallow, meaning the moderator diminishes the relationship between the IV and DV. Thus, increased levels of social support moderates the relationship between job stress and performance such that social support can buffer or mitigate against job stress negatively impacting performance. 

What is the appropriate use of Pseudo R² in logistic regression analysis?

To compare the relative fit of different logistic regression models.

Suppose you conducted a logistic regression to predict the probability of being hired by an organization, using interview results and a work sample test score (measured in one-point increments) as independent variables. The estimated odds ratio for the work sample test score is 1.44, with a 95% confidence interval of (1.24, 2.21).

Briefly interpret this odds ratio. In your answer, explain what the value of 1.44 implies about the relationship between the work sample test score and the odds of being hired, holding the interview results constant. Do not simply state whether the result is statistically significant—focus on interpreting the effect size.

The 95% CI is significant because it does not include 1. A one-point increase in work sample test scores is associated with a 44% odds increase of being hired by the organization. 

Below are the results of a mediation analysis conducted using the “mediation” package in R. To determine whether mediation is present, which statistical indicator should you examine?

ACME

Bootstrapping is particularly beneficial for datasets with a small sample size.

True

In logistic regression, which of the following statements about the Hosmer–Lemeshow (H–L) test is TRUE?

A non-significant result (p ≥ .05) indicates that the model shows adequate calibration.

When designing survey items, what is a key benefit of using an odd number of response options (e.g., 5-point Likert scale)?

It helps obtain more natural responses without forcing an opinion

The following diagram is based on the Theory of Planned Behavior (Ajzen, 1991). Which of the following best describes the role of the variable labeled “Intention” in this model?

Mediation

Which of the following can be used to assess the overall model fitness of a logistic regression model?

Likelihood Ratio Test (LRT)

What is mediation? Briefly define or explain mediation. Provide one example using variables from organizational psychology in your explanation.

Mediation helps explain how or why a relationship occurs, such that X impacts Y, but X also goes through M to impact and explain Y. For example, job satisfaction (X) impacts turnover (Y), but a mediator such as organizational identification (M) mediates this relationship so that it helps explain a possibility as to why the X ---> Y relationship works.

In a logistic regression model for predicting turnover, if the odds ratio for an independent variable is greater than 1, what can you conclude about the relationship between the independent variable and the probability of turnover?

When the independent variable increases, the probability of turnover also increases.

What is the actual interpretation of the AUC (area under the curve) in logistic regression, and what does an AUC of 0.5 indicate?

The AUC measures the model's ability to distinguish between the positive and negative classes, and an AUC of 0.5 indicates that the model is no better than random

Identify the type of poor-quality item shown below:

Do you believe the company's training program adequately prepares employees for both their current roles and potential future career growth?

Double-barreled item

The following item is part of an organizational survey:

“I have what I need to do my job well.”

Does this item have any problems as a survey measure? If yes, briefly explain why (focus on measurement quality and usefulness for organizational action).

Yes, the item has problems as a survey measure. "What I need" is not defined so that if individuals indicate no through this item, HR won't be able to identify what exactly needs to be provided in order to help employees do well on the job, making organizational action difficult (except, maybe, if the item is free-response, but even then, there is no guarantee that respondents will answer). Further how "well" the job is done is also not defined clearly, leaving it up to interpretation for the test takers.

What is the purpose of bootstrapping in statistical analysis?

To estimate the sampling distribution of a statistic

What is a key benefit of using open-ended questions in an organizational survey?

They can reveal unexpected insights that survey designers may not have considered.

Provide an example of nested data in the context of industrial-organizational (IO) psychology. Your example should include:

1. Levels of the nesting structure

2. Variables at each level

At level 1, we have the individual level where the variable is perceptions of job security. At level 2, we have a societal level where the variable is economic state/conditions. 

In moderation analysis, centering is often applied to independent variables. Which of the following best describes how centering is performed?

Subtract the mean of the variable from each observation

Which of the following best defines a loaded question in the context of a survey or interview?

A question that includes an unwarranted assumption, making it hard to answer without accepting that assumption.

Why do organizational surveys incorporate situational drivers as components?

Specifically, situational drivers are used to identify the causes of outcomes (e.g., engagement), which enables organizations to take targeted, actionable steps for improvement.

If you are responsible for designing and managing an organizational survey in HR, which of the following tasks would you typically be involved in? (Select all that apply.)

Analyzing survey data and interpreting results, Designing and reviewing survey items, Designing workshops to discuss survey results

What is the primary purpose of evaluating sensitivity and specificity in a logistic regression model?

To assess how well the model classifies cases into the correct outcome categories.

Which of the following accurately describes unstandardized regression coefficients for logistic regression?

They help determine if the independent variable (IV) contributes to predicting the dependent variable (DV).

Nested data and nested models represent distinct concepts in statistical analysis.

True

In the context of an organizational survey, what is a “situational driver”?

A workplace condition or context that can influence employee attitudes or behaviors.

In mediation analysis, why is the bootstrap method commonly used to estimate the 95% confidence interval for the indirect effect?

Because the sampling distribution of the indirect effect is often non-normal, making normal-theory confidence intervals inappropriate

Which of the following methods can be used to determine the optimal cutoff point in logistic regression classification?

Youden’s Index

When developing survey items for an organizational survey, what is the best first step?

Reviewing existing research and validated scales related to the construct

What is moderation? Briefly define/explain moderation. Provide one example using variables of organizational psychology in your explanation.

Moderation helps explain when a relationship between two variables occur and at different levels, such that X impacts Y, but Z influences that relationship at different points and times. An example to illustrate this is the diversity of a workforce (X) impacts job performance (Y), however, the level of inclusiveness within that workforce (Z) influences how this relationship is expressed such that Y depends on the levels of Z to help explain this relationship (perhaps the more inclusive a workplace is, the more that diversity will contribute to job performance).

Which of the following statements regarding logistic regression is TRUE?

DV should be binary data.

Below is the result of mediation analysis using “mediation” package. Which of the following interpretations is TRUE?

There is a partial mediator because ADE is significant.

What is the main difference between a pulse survey and an annual survey?

Pulse surveys are short and conducted frequently, while annual surveys are longer and conducted once a year.

Identify the type of poor-quality item shown below:

How satisfied are you with your improved work environment?

Leading question

The following item is part of an organizational survey conducted within a company to assess employees’ workplace behaviors and attitudes.

“I treat all of my coworkers with respect at all times.”

Why is this item likely to produce biased responses?

It encourages socially desirable responding

Identify the type of poor-quality item shown below:

I don’t disagree that my manager doesn’t lack communication skills.

Double negative