How do missing data bias estimates of within-group agreement? Sensitivity of SD WG, CVWG, rWG(J), r WG(J)* , and ICC to systematic nonresponse Article

Newman, DA, Sin, HP. (2009). How do missing data bias estimates of within-group agreement? Sensitivity of SD WG, CVWG, rWG(J), r WG(J)* , and ICC to systematic nonresponse . ORGANIZATIONAL RESEARCH METHODS, 12(1), 113-147. 10.1177/1094428106298969

cited authors

  • Newman, DA; Sin, HP

authors

abstract

  • In multilevel theory testing, estimation of group-level properties (i.e., consensus and diversity) is often complicated by missing data. Researchers are left to draw inferences about group constructs (e.g., organizational climate and climate strength) from the responses of only a subset of group members. This study analyzes the biasing impact of random and non-random missingness patterns on within-group agreement and reliability (standard deviation, coefficient of variation, rWG(J), r*WG(J), AD M, aWG , and intraclass correlation) across a range of response rates, numbers of items, and systematic missing data mechanisms. Results demonstrate biases up to 20% over- or underestimation for common response rates found in organizational research. Correction formulae are presented, which enable assessment of the sensitivity of multilevel results to survey nonresponse. © 2009 Sage Publications.

publication date

  • January 1, 2009

published in

Digital Object Identifier (DOI)

start page

  • 113

end page

  • 147

volume

  • 12

issue

  • 1