Challenges in interpreting SARS-CoV-2 serological results in African countries
Antoine Nkuba-Ndaye, Ana Hoxha, Joule Madinga, Joachim Mariën, Martine Peeters, Fabian H. Leendertz, Steve Ahuka Mundeke, Kevin K. Ariën, Jean-Jacques Muyembe Tanfumu, Placide Mbala Kingebeni, Veerle Vanlerberghe
Abstract
A diagnosis of COVID-19 is based on a positive PCR test for SARS-CoV-2. Over the past year, PCR testing capacity has varied globally due to the availability of tests, and testing strategies have targeted mainly symptomatic individuals. Therefore, the spread of the virus is probably wider than the numbers reported by official surveillance systems that are based on PCR results. Serology tests detect antibodies against SARS-CoV-2, which start being measurable around 1–2 weeks after infection. They are used in seroprevalence studies to estimate the proportion of people in a population that has been infected, including asymptomatic infection. These studies are of particular importance in African countries, where reported testing and incidence are among the lowest in the world. We did a cross-sectional serological survey of staff working in health-care facilities in Kinshasa, the capital of the Democratic Republic of the Congo, where the first COVID-19 case was reported on March 10, 2020, in a traveller returning from France. We preselected five health zones across the city, from which we included one hospital, two health-care centres, and one COVID-19 response team. Within each facility, health-care workers and other service staff from different departments were randomly selected. Those who provided written consent to participate were enrolled in the study and a blood sample was taken, which was further analysed in the virology laboratory of the Institut National de la Recherche Biomédicale in Kinshasa. The study was approved by ethics committees in Belgium (number B3002020000144) and the Democratic Republic of the Congo (189/CNES/BN/PMMF/2020). Between July 17 and Aug 13, 2020, 562 blood samples were collected from 562 participants and five different SARS-CoV-2 serology tests were done on each sample: two in-house Luminex IgG based assays using recombinant nucleocapsid and spike protein 1, and three commercial assays targeting the receptor binding domain on the spike protein, all validated by the manufacturers with serum samples from Europe. These three commercial assays were the EUROIMMUN IgG ELISA (EUROIMMUN, Lübeck, Germany)—a widely used assay in Europe, with sensitivity of 94·6% and specificity of 99·8%—and Quickzen IgG and IgM (Zentech, Belgium), a lateral flow test that detects IgG and IgM antibodies on a single device with a specificity of 100% and sensitivity of 68·8% for IgM and 49·2% for IgG.1Montesinos I Gruson D Kabamba B et al.Evaluation of two automated and three rapid lateral flow immunoassays for the detection of anti-SARS-CoV-2 antibodies.J Clin Virol. 2020; 128104413Crossref PubMed Scopus (214) Google Scholar The blood samples were also tested for malaria with microscopy at the same facility. The median age of participants was 42 years; 242 (43%) of 562 participants were male and 320 (57%) were female. 27 study participants declared having previously had a SARS-CoV-2 PCR test between March and July, of whom eight (30%) of 27 reported a positive result (1% of the total population). 202 samples (36%) were seropositive using the EUROIMMUN IgG, 171 (30%) using the Quickzen IgM and 72 (13%) using the Quickzen IgG. Only 46 (8%) of 562 samples were positive by all three tests. 89 (16%) samples were positive for malaria by microscopy. Two of eight participants who had previously tested positive by SARS-CoV-2 PCR were seronegative by all three commercial serology tests. The Kappa coefficient, used to measure agreement between tests,2McHugh ML Interrater reliability: the kappa statistic.Biochem Med (Zagreb). 2012; 22: 276-282Crossref PubMed Google Scholar was 0·3 for the EUROIMMUN IgG assay and the Quickzen IgG assay, which is considered a minimal agreement. Because specificity for both tests is nearly 100%, but sensitivity is very different, we assessed whether all samples that were positive with the Quickzen IgG assay would be confirmed as positive with the EUROIMMUN IgG. Only 59 (82%) of 72 samples that were positive with the Quickzen IgG assay were also positive with the EUROIMMUN IgG assay. Depending on the commercial assay used, seropositivity in health-care staff in our study varied between 13% and 36%, which is relatively high considering the low number of symptomatic and severe cases reported in Kinshasa by the end of the study period. In other African countries, SARS-CoV-2 seroprevalence has been estimated at 45·1% in frontline health-care workers in Nigeria (Elabscience ELISA IgG),3Olayanju O Bamidele O Edem F et al.SARS-CoV-2 seropositivity in asymptomatic frontline health workers in Ibadan, Nigeria.Am J Trop Med Hyg. 2021; 104: 91-94Crossref PubMed Google Scholar 40% in women attending antenatal clinics and people living with HIV in South Africa (Roche ECLIA IgG and IgM),4Hsiao M Davies M-A Kalk E et al.SARS-CoV-2 seroprevalence in the Cape Town metropolitan sub-districts after the peak of infections. National Institute for Communicable Diseases, Sept 28, 2020https://www.nicd.ac.za/wp-content/uploads/2020/09/COVID-19-Special-Public-Health-Surveillance-Bulletin_Issue-5.pdfDate accessed: February 4, 2021Google Scholar 12·3% in health-care workers in Malawi (Omega ELISA spike protein and nucleocapsid protein,5Chibwana MG Jere KC Kamng'ona R et al.High SARS-CoV-2 seroprevalence in health care workers but relatively low numbers of deaths in urban Malawi [version 2; peer review: 2 approved].Wellcome Open Res. 2020; 5: 199Crossref Google Scholar 5·6% in blood donors in Kenya (in-house ELISA IgG),6Uyoga S Adetifa IMO Karanja HK et al.Seroprevalence of anti-SARS-CoV-2 IgG antibodies in Kenyan blood donors.Science. 2021; 371: 79-82Crossref PubMed Scopus (158) Google Scholar and 3% in the general population in Ethiopia (Abbott CMIA IgG).7Kempen JH Abashawl A Suga HK et al.SARS-CoV-2 serosurvey in Addis Ababa, Ethiopia.Am J Trop Med Hyg. 2020; 103: 2022-2023Crossref PubMed Scopus (22) Google Scholar Although these studies were done in different settings and using different serological tests, all of them tend to give a higher seroprevalence than expected on the basis of surveillance data of confirmed cases in the study period. Given our observations, part of this discrepancy could be due to the assays used. One explanatory hypothesis for the higher than expected rate of seropositivity could be because of cross-reaction of the tests with other circulating viruses or parasites in the African subcontinent that could lower their specificity. The presence of pre-existing antibodies recognising SARS-CoV-2 in uninfected individuals due to seasonal coronaviruses was identified by Ng and colleagues,8Ng KW Faulkner N Cornish GH et al.Preexisting and de novo humoral immunity to SARS-CoV-2 in humans.Science. 2020; 370: 1339-1343Crossref PubMed Scopus (536) Google Scholar whereas Tso and colleagues9Tso FY Lidenge SJ Pena PB et al.High prevalence of pre-existing serological cross-reactivity against SARS-CoV-2 in sub-Sahara Africa.Int J Infect Dis. 2021; 102: 577-583Summary Full Text Full Text PDF PubMed Scopus (141) Google Scholar showed that pre-pandemic samples from sub-Saharan Africa had higher cross-reactivity against SARS-CoV-2 than those from the USA. However, these observations need to be confirmed in larger sample sizes to assess whether prevalence of pre-existing antibodies are consistently higher in African countries. Cross-reactivity between SARS-CoV-2 and acute malaria infection was observed in a study in Benin by Yadouleton and colleagues.10Yadouleton A Sander AL Moreira-Soto A et al.Limited specificity of serologic tests for SARS-CoV-2 antibody detection, Benin.Emerg Infect Dis. 2021; 27: 233-237Crossref Google Scholar Our data do not show any correlation between participants who tested positive for malaria and those testing positive with any of the commercial SARS-CoV-2 serological tests. Notably, SARS-CoV-2 emerged only 1 year ago and antibody response according to severity of infection and the duration of antibody persistence are not yet completely understood. However, sensitivities and specificities of serological assays can vary across populations, as shown in the early 1990s with HIV serological tests, for which lower specificity in serum samples from African individuals was observed than in samples from European individuals.11Van Kerckhoven I Vercauteren G Piot P van der Groen G Comparative evaluation of 36 commercial assays for detecting antibodies to HIV.Bull World Health Organ. 1991; 69: 753-760PubMed Google Scholar The potential lower specificity of SARS-CoV-2 commercial tests in African countries, together with the low reported prevalence of clinical cases, makes the interpretation of population surveys in this setting difficult. The seroprevalence results could be misleading and even report more false-positive cases than true-positive cases.12Peeling RW Wedderburn CJ Garcia PJ et al.Serology testing in the COVID-19 pandemic response.Lancet Infect Dis. 2020; 20: e245-e249Summary Full Text Full Text PDF PubMed Scopus (229) Google Scholar On the basis of the low agreement between test results of our study and the available literature, we would like to warn the research community and policy makers to interpret with caution the results of seroprevalence studies done in African countries with commercial tests validated in Europe, the USA, or Asia. To establish whether these high seroprevalences are a sign of serious under-reporting of COVID-19 cases, a milder COVID-19 clinical presentation, or a cross-reaction with other circulating pathogens, we recommend in this context the use of a combination of serological tests, targeting two or more independent antigens, adjusting the cutoff values due to the overall higher background noise, or repeated serosurveys of the same population to better understand the serological profile dynamics. It will be necessary to develop standardised testing strategies, as was done in the past for serological diagnosis of HIV, and assess assays for sensitivity and specificity on reference panels that include samples from different geographical areas, including Africa. This online publication has been corrected. The corrected version first appeared at thelancet.com/lancetgh on March 8, 2021 This online publication has been corrected. The corrected version first appeared at thelancet.com/lancetgh on March 8, 2021 We declare no competing interests. ANN and AH are joint first authors and PMK and VV are joint last authors. The study was funded by Enabel (the Belgian Development agency), GIZ (Deutsche Gesellschaft für Internationale Zusammenarbeit), and the framework agreement between the Institute of Tropical Medicine and the Belgian Development Cooperation. Additionally, AN received a doctoral scholarship from the French Institut de Recherche pour le Développement. None of the funders had a role in the design of the study, its execution, the analyses, interpretation of the data, or decision to submit the results. Correction to Lancet Glob Health 2021; published online Feb 17. https://doi.org/10.1016/S2214-109X(21)00060-7Nkuba Ndaye A, Hoxha A, Madinga J, et al. Challenges in interpreting SARS-CoV-2 serological results in African countries. Lancet Global Health 2021; published online Feb 17. https://doi.org/10.1016/S2214-109X(21)00060-7—In this Correspondence, information on the funding sources of the study was missing. This correction has been made as of March 8, 2021. Full-Text PDF Open Access