Litcius/Paper detail

On the ‘optimal’ density power divergence tuning parameter

Sancharee Basak, Ayanendranath Basu, M. C. Jones

2020Journal of Applied Statistics72 citationsDOIOpen Access PDF

Abstract

The density power divergence, indexed by a single tuning parameter α, has proved to be a very useful tool in minimum distance inference. The family of density power divergences provides a generalized estimation scheme which includes likelihood-based procedures (represented by choice α=0 for the tuning parameter) as a special case. However, under data contamination, this scheme provides several more stable choices for model fitting and analysis (provided by positive values for the tuning parameter α). As larger values of α necessarily lead to a drop in model efficiency, determining the optimal value of α to provide the best compromise between model-efficiency and stability against data contamination in any real situation is a major challenge. In this paper, we provide a refinement of an existing technique with the aim of eliminating the dependence of the procedure on an initial pilot estimator. Numerical evidence is provided to demonstrate the very good performance of the method. Our technique has a general flavour, and we expect that similar tuning parameter selection algorithms will work well for other M-estimators, or any robust procedure that depends on the choice of a tuning parameter.

Topics & Concepts

EstimatorDivergence (linguistics)Mathematical optimizationEstimation theoryInferenceComputer scienceParameter spaceStability (learning theory)MathematicsApplied mathematicsAlgorithmStatisticsLinguisticsArtificial intelligenceMachine learningPhilosophyAdvanced Statistical Methods and ModelsStatistical Methods and InferenceStatistical and numerical algorithms