Average weighted nucleotide diversity is more precise than pixy in estimating the true value of <i>π</i> from sequence sets containing missing data
Maciej K. Konopiński
Abstract
Abstract Nucleotide diversity remains an important statistic in population genetic/genomic studies. Although recent advances in massive sequencing make generating sequence data sets cheaper and faster, currently used technologies often introduce substantial amounts of missing nucleotides in their output. A novel method of estimating π from data sets containing missing data – pixy ‐ has also recently been proposed. In this study, the pixy estimator, π pixy , was compared to average weighted nucleotide diversity, π W . The estimators were tested both on sequences simulated in fastsimcoal and real sequence sets. Both sets were modified by random insertion of missing nucleotides. Weighted nucleotide diversity performed better in all pairwise comparisons. It was characterized by a smaller error and a narrower distribution of the results. π pixy tends to overestimate the nucleotide diversity when both the proportion of missing data and the level of variation is low. Of the two estimators, only π W estimated the true nucleotide diversity in a part of the simulations. A simple formula for estimating π W allows for easy integration of the estimator in packages such as pixy, which would allow obtaining more precise estimates of nucleotide diversity either in a sliding window or for discrete genomic regions.