Litcius/Paper detail

Identification and Semiparametric Efficiency Theory of Nonignorable Missing Data with a Shadow Variable

Wang Miao, Lan Liu, Y. G. Li, Eric J. Tchetgen Tchetgen, Zhi Geng

2024ACM / IMS Journal of Data Science13 citationsDOIOpen Access PDF

Abstract

We consider identification and estimation with an outcome missing not at random (MNAR). We study an identification strategy based on a so-called shadow variable . A shadow variable is assumed to be correlated with the outcome but independent of the missingness process conditional on the outcome and fully observed covariates. We describe a general condition for nonparametric identification of the full data law under MNAR using a valid shadow variable. Our condition is satisfied by many commonly used models; moreover, it is imposed on the complete cases, and therefore has testable implications with observed data only. We characterize the semiparametric efficiency bound for the class of regular and asymptotically linear estimators and derive a closed form for the efficient influence function. We describe a doubly robust and locally efficient estimation method and evaluate its performance on both simulation data and a real data example about home pricing.

Topics & Concepts

Identification (biology)EconometricsVariable (mathematics)Semiparametric modelShadow (psychology)Missing dataInstrumental variableComputer scienceEconomicsStatisticsMathematicsPsychologyNonparametric statisticsBotanyMathematical analysisBiologyPsychotherapistStatistical Methods and InferenceStatistical Methods and Bayesian InferenceBayesian Methods and Mixture Models