An official website of the United States government
Low and Decreasing Prevalence and Rate of False Positive HIV Diagnosis — Chókwè District, Mozambique, 2014–2017
Weekly / December 14, 2018 / 67(49);1363–1368
Daniel Shodell, MD1; Robert Nelson, MPH2; Duncan MacKellar, DrPH2; Ricardo Thompson, PhD3; Isabelle Casavant, MPH1; Didier Mugabe, MD3; Sherri Pals, PhD2; Dawud Ujamaa, MS2; Juvencio Bonzela3; Judite Cardoso4; Salvador Machava3; Carlos Lourenço, MD3; Chunfu Yang, PhD2; Bharat Parekh, PhD2; Ishani Pathmanathan, MD2; Andrew F. Auld, MD2; Stelio Tamele, MD5; Manuel Antonio Ouane, MD5; Vania Macome, MPH6; Noela Chicuecue, MD7; Guita Amane7; Luciana Kohatsu, PhD1; Nely Honwana1; Stanley Wei, MD1; Peter R. Kerndt, MD1; Edgar Monterroso, MD1; Alfredo Vergara, PhD1 (View author affiliations)
View suggested citationSummary
What is already known about this topic?
A systematic review of studies conducted in sub-Saharan Africa suggests higher than expected rates of false positive human immunodeficiency virus (HIV) diagnosis (false diagnosis) using rapid tests.
What is added by this report?
From 2014 to 2017, the rate and population prevalence of false diagnosis in Chókwè District, Mozambique, decreased from 0.66% to 0.00% and from 0.08% to 0.01%, respectively. The cumulative false diagnosis rate was 0.56%, less than one fifth the median rate (3.1%) reported in the systematic review.
What are the implications for public health practice?
Low and decreasing prevalence and rate of false diagnosis are reassuring and underscore caution in extrapolating results of the systematic review. Nonetheless, observed false diagnoses underscore the need for routine HIV retesting before initiation of antiretroviral therapy and implementation of comprehensive rapid HIV test quality management systems.
In 2017, rapid human immunodeficiency virus (HIV) testing services enabled the HIV diagnosis and treatment of approximately 15.3 million persons with HIV infection in sub-Saharan Africa with life-saving antiretroviral therapy (ART) (1). Although suboptimal testing practices and misdiagnoses have been reported in sub-Saharan Africa and elsewhere, trends in population burden and rate of false positive HIV diagnosis (false diagnosis) have not been reported (2,3). Understanding the population prevalence and trends of false diagnosis is fundamental for guiding rapid HIV testing policies and practices. To help address this need, CDC analyzed data from 57,655 residents aged 15–59 years in the Chókwè Health and Demographic Surveillance System (CHDSS) in Mozambique to evaluate trends in the rate (the percentage of false diagnoses among retested persons reporting a prior HIV diagnosis) and population prevalence of false diagnosis. From 2014 to 2017, the observed rate of false diagnosis in CHDSS decreased from 0.66% to 0.00% (p<0.001), and the estimated population prevalence of false diagnosis decreased from 0.08% to 0.01% (p = 0.0016). Although the prevalence and rate of false diagnosis are low and have decreased significantly in CHDSS, observed false diagnoses underscore the importance of routine HIV retesting before ART initiation and implementation of comprehensive rapid HIV test quality management systems (2,4,5).
Located in Gaza Province of southern Mozambique, CHDSS conducts annual demographic surveillance of approximately 100,000 residents of Chókwè District. In 2017, an estimated 25.6% of residents aged 15–59 years had HIV infection (6). During 2014–2017, staff members visited all CHDSS households in each of four surveillance rounds and offered a brief survey and HIV testing to household members aged 15–59 years. In the first surveillance round (April 2014–April 2015), all consenting participants who reported a prior HIV diagnosis were tested in accordance with the national rapid HIV test algorithm (NRTA). In subsequent surveillance rounds, consenting participants who reported a prior HIV diagnosis were offered, but not required, to test for HIV infection. Dried blood spots from participants with NRTA-negative or indeterminate results who reported a prior diagnosis of HIV infection were tested at CDC with a serologic testing algorithm followed by ultrasensitive HIV-1 gp41 total nucleic acid polymerase chain reaction, if negative by serology (Figure) (7). Before delivering CDC-confirmed HIV-negative test results, participants were reinterviewed to verify their prior HIV diagnosis and were retested a second time in accordance with the NRTA. Participants who confirmed their prior diagnosis and retested HIV-negative were informed that they had been misdiagnosed, provided counseling and psychosocial support, and disengaged from HIV care in coordination with their HIV care provider.
To estimate the prevalence of false diagnosis in the second and subsequent surveillance rounds, cases were imputed by applying the observed cumulative false diagnosis rate to nontested participants who reported a prior HIV diagnosis. Logistic regression was used to test for linear trends in the observed rate and estimated prevalence of false diagnosis across surveillance rounds, adjusting for within-household correlation. Maximum expected cases, rates, and prevalence of false diagnosis were calculated using the World Health Organization (WHO) prequalification lower 95% confidence limits for sensitivity and specificity for Determine* and Uni-Gold† rapid HIV tests (8,9). Excess cases were calculated as the difference between total estimated and maximum expected false diagnoses.
During 2014–2017, among 57,655 CHDSS residents aged 15–59 years, 43,496 (75.4%) participated in at least one round of surveillance (Table 1). Prior HIV diagnosis, based on the Mozambique national HIV testing algorithm (Figure), was reported by 8,608 (19.8%) participants, among whom 5,568 (64.7%) were tested for HIV. Of those tested, >99.0% in all demographic groups were NRTA-positive, including 4,698 (99.6%) of 4,719 participants who reported being on ART.
CDC confirmatory testing was conducted on specimens from 45 of 46 NRTA-negative or indeterminate participants who initially reported a prior HIV diagnosis. All 41 NRTA-negative participants tested HIV-negative at CDC; three of four NRTA-indeterminate participants tested HIV-positive, and one tested HIV-negative. Of 42 CDC-confirmed HIV-negative participants, 39 were recontacted, and 12 (31%) verified that they had never tested HIV-positive. Reasons for initial misclassification included interviewer error, or participant misunderstanding, perceived need to report a diagnosis to receive services, or mental illness. Among the 27 recontacted participants who confirmed their prior HIV diagnosis, all retested NRTA-negative a median of 170 days (interquartile range = 142–263 days) after their survey encounter. Overall, 31 participants were classified as having received a false diagnosis, including one participant who had insufficient specimen for confirmatory testing and three CDC-confirmed HIV-negative participants lost to follow-up (Table 2).
During 2014–2017, the observed rate of false diagnosis in CHDSS decreased from 0.66% to 0.00% (p<0.001), and estimated prevalence of false diagnosis decreased from 0.08% to 0.01% (p = 0.0016) (Table 2). The cumulative observed false diagnosis rate and estimated prevalence of false diagnosis were 0.56% and 0.11%, respectively. Compared with maximum expectations based on WHO prequalification studies, 44 excess false diagnoses were estimated overall, decreasing from 20 in the first round (2014–2015) to three in the fourth round (2017) (Table 2).
Discussion
False positive HIV diagnosis can result in severe individual and public health consequences, including separation from spouse and family, unnecessary care and treatment, and public distrust in HIV testing. Accurate estimation of the population burden and trends in false diagnosis is therefore critical for guiding rapid HIV testing policies and practices. In a high HIV prevalence district in Mozambique, among 5,568 residents who reported a prior HIV diagnosis, including 4,719 on ART, nearly all (>99.0%) tested HIV-positive with the Mozambique NRTA. Both the low observed rate (0.66%) and estimated prevalence (0.08%) of false diagnosis in the first round of surveillance (2014–2015) decreased to nearly zero by the fourth round (2017). Nonetheless, applying the estimated cumulative false diagnosis prevalence of 0.11% to the estimated 100,421 residents aged 15–64 years in Chókwè District, 110 residents might have ever received a false diagnosis.
As with all diagnostic tests that have excellent, but not perfect performance, false positive HIV diagnoses are expected even when testing is conducted in accordance with standard procedures and with approved, multitest algorithms (2,3). Compared with WHO prequalification expectations, 20 excess false diagnoses were observed in the first round of surveillance, decreasing to an estimated three cases in the fourth round. Although reasons for excess false diagnoses are unclear, findings from the CHDSS are consistent with reports suggesting that the specificity of the Determine rapid HIV test can be lower than manufacturer claims (2,3,10). Observed reductions in excess false diagnoses might be attributed to improved rapid HIV test practices and quality management systems or increased client-initiated retesting among persons who are diagnosed (4). Provider-initiated retesting before ART initiation as recommended by WHO was not routinely implemented during this period (2014–2017) and most likely does not account for observed reductions in false HIV diagnoses (2).
Notably, the observed cumulative rate of false positive HIV diagnosis in the CHDSS (0.56%) is less than one fifth the median false diagnosis rate (3.1%) reported in a recent systematic review of 30 studies (3). Findings of the low cumulative and decreasing rate of false diagnosis in the CHDSS are reassuring, and caution should be exercised in interpreting results of this systematic review. Higher rates of false diagnosis reported in many studies might be attributed to the use of suboptimal testing strategies such as a third rapid test as a tiebreaker to rule in HIV infection and lack of verification of HIV diagnostic claims (3). Lack of verification might be a particularly important limitation, as nearly one third of reinterviewed CHDSS participants who were initially classified as having had a false positive HIV diagnosis were verified to have never received an HIV diagnosis. Studies that do not include follow-up procedures to verify self-reported HIV diagnoses might substantially overreport false diagnosis.
After being informed of their misdiagnosis, nearly all contacted participants expressed relief that they were not infected and no longer needed HIV care. At the request of one participant, the psychologist and medical officer from the local health authority confirmed the client’s status with concerned family members; no other follow-up support services were requested. All contacted participants were successfully disengaged from HIV care, including 16 who were on ART. Public concerns about the accuracy of HIV testing and reductions in uptake of rapid HIV testing services in Chókwè District have not been reported.
The findings in this report are subject to at least four limitations. First, after the first round, fewer than half of participants who claimed a prior diagnosis were tested for HIV. Estimated cases and prevalence of false diagnosis, however, is conservative because imputed cases were based on the higher cumulative false diagnosis rate rather than lower round-specific rates, and participants who did not complete all testing and prior-diagnosis verification steps were assumed to have received false diagnoses. Second, surveillance of quality management system activities among facility and community rapid HIV test providers was not conducted, and the potential impact of these activities on reducing the rate and prevalence of false diagnosis is unknown. Third, it is possible that some HIV-infected participants who were receiving ART might have false negative test results because of loss of detectable antibody (2,3,7). Total nucleic acid polymerase chain reaction is not 100% sensitive, and retesting negative does not rule out HIV infection for patients on ART (7). Participants who discontinued ART are being retested periodically. Finally, this study was conducted in a high HIV prevalence district in southern Mozambique. Because the positive predictive value of diagnostic tests depends, in part, on disease prevalence, other areas and districts of Mozambique might have higher rates of false diagnosis attributed to lower HIV prevalence alone.
Low and decreasing trends in the estimated prevalence of false positive HIV diagnosis in CHDSS indicate that residents in Chókwè District have received high-quality rapid HIV testing services, and that HIV care and ART is provided near universally to only those in need. However, observed false diagnoses in Chókwè District underscore the importance of routine retesting and confirmation of HIV infection for all patients before ART initiation, and implementation of comprehensive quality management systems to ensure appropriate training, supervision, proficiency testing, and external quality assessment of rapid HIV test providers (2,4,5).
Corresponding author: Duncan MacKellar, [email protected], 404-639-6199.
1CDC Country Office, Maputo, Mozambique; 2Division of Global HIV and TB, Center for Global Health, CDC; 3Chókwè Health Research and Training Center, National Institute of Health, Chókwè, Mozambique; 4Jhpiego, Johns Hopkins University, Maputo, Mozambique; 5Chókwè District Public Health Directorate, Chókwè, Mozambique; 6FHI 360, Maputo, Mozambique; 7Mozambique Ministry of Health, Maputo, Mozambique.
All authors have completed and submitted the ICMJE form for disclosure of potential conflicts of interest. No potential conflicts of interest were disclosed.
References
- Joint United Nations Programme on HIV. AIDS info database. Geneva, Switzerland: Joint United Nations Programme on HIV; 2018. http://aidsinfo.unaids.org/
- World Health Organization. Consolidated guidelines on HIV testing services. Geneva, Switzerland: World Health Organization; 2015. https://www.who.int/hiv/pub/guidelines/hiv-testing-services/en/
- Johnson CC, Fonner V, Sands A, et al. To err is human, to correct is public health: a systematic review examining poor quality testing and misdiagnosis of HIV status. J Int AIDS Soc 2017;20(Suppl 6):21755–71. CrossRef PubMed
- Parekh BS, Kalou MB, Alemnji G, Ou CY, Gershy-Damet GM, Nkengasong JN. Scaling up HIV rapid testing in developing countries: comprehensive approach for implementing quality assurance. Am J Clin Pathol 2010;134:573–84. CrossRef PubMed
- World Health Organization. Handbook: improving the quality of HIV-related point-of-care testing: ensuring the reliability and accuracy of test results. Geneva, Switzerland: World Health Organization; 2015. https://www.who.int/hiv/pub/toolkits/handbook-point-of-care-testing/en/
- Nelson R, Casavant I, Thompson R, et al. Trends in HIV diagnostic coverage & prevalence of undiagnosed infection in a high burden district with annual home-based HIV testing: findings from the Chókwè Health Demographic Surveillance System (CHDSS), Chókwè District, Mozambique, 2014–2017 [Poster]. Presented at the International AIDS Conference (AIDS 2018); July 23–27, 2018; Amsterdam, Netherlands.
- Yang C, Li M, Cowart F, et al. Characterization of human immunodeficiency virus type-1 from HIV-1 seropositive cases with undetectable viremia. J Clin Virol 2004;30:224–8. CrossRef PubMed
- World Health Organization. WHO prequalification of diagnostic programme public report. Product: Alere Determine HIV-1/2. Number: PQDx 0033–013–00. Geneva, Switzerland: World Health Organization; 2016. https://www.who.int/diagnostics_laboratory/evaluations/pq-list/hiv-rdts/public_report/en/
- World Health Organization. WHO prequalification of diagnostic programme public report. Product: Uni-Gold HIV. Number: PQDx 0149–052–00. Geneva, Switzerland: World Health Organization; 2012. https://www.who.int/diagnostics_laboratory/evaluations/pq-list/hiv-rdts/public_report/en/
- Kroidl I, Clowes P, Mwalongo W, et al. Low specificity of determine HIV1/2 RDT using whole blood in south west Tanzania. PLoS One 2012;7:. CrossRef PubMed
FIGURE. National rapid* and CDC confirmatory HIV testing algorithms for survey participants aged 15–59 years who reported having received a prior HIV diagnosis — Chókwè Health Demographic Surveillance System (CHDSS), Chókwè, Mozambique, 2014–2017
Abbreviations: DBS = dried blood spot; EIA = enzyme immunoassay; gp41 = glycoprotein 41; HIV = human immunodeficiency virus; PCR = polymerase chain reaction.
* The Mozambique national rapid test algorithm refers to the use of Determine followed by Uni-Gold in accordance with national HIV testing guidelines. Prior HIV diagnosis is defined as reporting during the CHDSS survey of 1) ever having tested HIV-positive, 2) testing HIV-positive at the last test, or 3) currently or ever receiving HIV care.
Abbreviations: DBS = dried blood spots; HIV = human immunodeficiency virus; indet = indeterminate.
* Approximately 102,500 persons of all ages were residents in CHDSS during round 1. For each survey round, counselors visited each household in CHDSS (20,122 households in round 1) and offered all available household members aged 15–59 years the opportunity to participate in a brief survey and to test for HIV.
† Totals for sex and age groups include residents who participated in any one of four survey rounds. For these characteristics, counts are unique individuals. Survey rounds 2, 3, and 4 include some residents who participated in a prior survey round. Within each round, counts reflect unique individuals. The sum of rounds include repeat participants.
§ Reporting during the survey of ever having tested HIV-positive, testing HIV-positive at the last test, or currently or ever receiving HIV care. Percentages are of survey participants. Participants who reported a prior HIV diagnosis in more than one round are counted only once in the round in which they first reported receiving a prior HIV diagnosis. Including repeat participants, 4,778 (20%), 5,440 (22%), and 4,539 (22%) residents reported a prior HIV diagnosis in survey rounds 2, 3, and 4, respectively. Excludes 12 participants who on follow-up were verified not to have received a prior HIV diagnosis.
¶ In round 1, counselors collected a 1-mL whole blood specimen from all consenting participants who reported a prior HIV diagnosis. Specimens were tested for HIV at the CHDSS research laboratory by trained laboratory technicians in accordance with the national rapid test algorithm. In rounds 2–4, consenting participants who reported a prior HIV diagnosis were encouraged but not required to test for HIV if they had not previously tested HIV-positive as part of CHDSS. Participants who reported a prior diagnosis and who consented to test were HIV tested at home by trained counselors in accordance with the national rapid HIV test algorithm. Percentages are of participants who reported a prior HIV diagnosis.
** Four participants tested HIV-indeterminate.
†† Excludes 12 participants who on follow-up were verified not to have received a prior HIV diagnosis. Dried blood spots of participants who reported a prior HIV diagnosis and who tested HIV-negative or indeterminate by the national rapid test algorithm were shipped on dry ice and tested at CDC in accordance with a standard confirmatory testing algorithm.
§§ All had tested HIV-indeterminate by the national rapid testing algorithm.
¶¶ Of 27 (90%) persons contacted at follow-up, 27 (100%) retested HIV-negative in accordance with the national rapid HIV test algorithm a median of 170 days (interquartile range = 142–263 days) from their survey encounter.
*** Round 1: April 2014–April 2015; round 2: May 2015–January 2016; round 3: March 2016–March 2017; round 4: April 2017–November 2017.
Abbreviations: CI = confidence interval; HIV = human immunodeficiency virus.
* Includes 27 persons who reported a prior HIV-positive diagnosis and tested HIV-negative in accordance with the national rapid test and CDC confirmatory test algorithms, and at follow-up a median of 170 days (interquartile range = 142–263 days) from their survey encounter, retested HIV-negative in accordance with the national rapid HIV test algorithm, and reaffirmed that they had received a prior HIV-positive diagnosis. Also includes four participants who reported a prior HIV-positive diagnosis and tested HIV-negative in accordance with the national rapid test algorithm, but who had insufficient specimen for testing at CDC (one participant), or were confirmed HIV-negative at CDC but were lost to follow-up for retesting and confirmation of reported prior HIV diagnosis (three participants). Excludes 12 participants who on follow-up were verified not to have received a prior HIV diagnosis.
† Maximum outcomes were calculated using standard formulae and reported lower 95% confidence limits (LCL) for sensitivity (SENS) and specificity (SPEC) from World Health Organization prequalification studies: Alere Determine HIV-1/2 (D): WHO report PQDx 0033–013–00 (https://www.who.int/diagnostics_laboratory/evaluations/pq-list/hiv-rdts/160712_amended_final_public_report_0033_013_00_v5.pdf); LCL for sensitivity and specificity for Determine are 99.10 (SENSDLCL) and 97.80 (SPECDLCL), respectively. Uni-Gold HIV (U): WHO report PQDx 0149–052–00 (https://www.who.int/diagnostics_laboratory/evaluations/pq-list/hiv-rdts/171103_amended_final_pqpr_0149_052_00_v7.pdf); LCL for sensitivity and specificity for Uni-Gold are 98.70 (SENSULCL) and 99.20 (SPECULCL), respectively.
§ 1 – positive predictive value of self-reported prior HIV-positive diagnosis (PPVSRDx); PPVSRDx = (No. prior HIV diagnoses – No. observed false diagnoses)/No. prior HIV diagnoses.
¶ Includes 17 false diagnosis cases imputed for rounds 2–4, calculated by applying the overall and demographic subgroup-specific false diagnosis rates to nontested survey participants who reported having received a prior HIV-positive diagnosis. Sum of estimated cases by age group (49) does not equal total estimated cases (48) because of rounding error.
** Total false diagnoses/survey participants, weighted to CHDSS census age-group, sex, and urban/rural distribution.
†† Prior HIV diagnosis x Maximum expected false diagnosis rate, rounded up to the nearest integer. Sum of expected cases by survey round (3) does not equal total expected cases (4) because of rounding error.
§§ 1 – lowest expected positive predictive value (PPV) of national rapid test algorithm (PPVNRTA-LE). PPVNRTA-LE = (PREV*SENSNRTA-LE) / [(PREV*SENSNRTA-LE) + (1-PREV)(1- SPECDLCL)(1-SPECULCL)]; SENSNRTA-LE = SENSDLCL*SENSULCL. PREV = observed round 1 HIV prevalence: total, 27.8%; female, 30.3%; male, 23.6%; aged 15–24 years, 9.1%; aged 25–34 years, 38.5%; aged 35–59 years, 43.1%; rounds 1–4, 27.8%.
¶¶ Maximum expected false diagnoses/survey participants, weighted to CHDSS census age-group, sex, and geographic distribution.
*** Difference between total estimated and maximum expected false diagnosis cases. Sum of estimated cases by age group (45) and survey round (45) does not equal total estimated cases (44) because of rounding error.
††† Round 1: April 2014–April 2015; round 2: May 2015–January 2016; round 3: March 2016–March 2017; round 4: April 2017–November 2017.
§§§ Test for linear trend: p<0.001. Round 4 one-sided 97.5% upper confidence limit is estimated using Clopper-Pearson method. https://jamanetwork.com/journals/jama/fullarticle/385438.
¶¶¶ Test for linear trend: p = 0.0016.
Suggested citation for this article: Shodell D, Nelson R, MacKellar D, et al. Low and Decreasing Prevalence and Rate of False Positive HIV Diagnosis — Chókwè District, Mozambique, 2014–2017. MMWR Morb Mortal Wkly Rep 2018;67:1363–1368. DOI: http://dx.doi.org/10.15585/mmwr.mm6749a3.
MMWR and Morbidity and Mortality Weekly Report are service marks of the U.S. Department of Health and Human Services.
Use of trade names and commercial sources is for identification only and does not imply endorsement by the U.S. Department of
Health and Human Services.
References to non-CDC sites on the Internet are
provided as a service to MMWR readers and do not constitute or imply
endorsement of these organizations or their programs by CDC or the U.S.
Department of Health and Human Services. CDC is not responsible for the content
of pages found at these sites. URL addresses listed in MMWR were current as of
the date of publication.
All HTML versions of MMWR articles are generated from final proofs through an automated process. This conversion might result in character translation or format errors in the HTML version. Users are referred to the electronic PDF version (https://www.cdc.gov/mmwr) and/or the original MMWR paper copy for printable versions of official text, figures, and tables.
Questions or messages regarding errors in formatting should be addressed to [email protected].