Register      Login
Sexual Health Sexual Health Society
Publishing on sexual health from the widest perspective
REVIEW (Open Access)

Digital sexually transmitted infection and HIV services across prevention and care continuums: evidence and practical resources

Joseph D. Tucker https://orcid.org/0000-0003-2804-1181 A B * , Jane Hocking https://orcid.org/0000-0001-9329-8501 C , David Oladele D and Claudia Estcourt E F
+ Author Affiliations
- Author Affiliations

A Institute for Global Health and Infectious Diseases, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA.

B Clinical Research Department, Faculty of Infectious and Tropical Diseases, London School of Hygiene and Tropical Medicine, London, UK.

C Faculty of Medicine, Dentistry, and Health Sciences, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Vic., Australia.

D Clinical Research Department, Nigerian Institute of Medical Research, Lagos, Nigeria.

E School of Health & Life Sciences, Glasgow Caledonian University, Glasgow, UK.

F Sandyford Sexual Health Services, NHS Greater Glasgow & Clyde, Glasgow, UK.

* Correspondence to: jdtucker@med.unc.edu

Handling Editor: Jason Ong

Sexual Health - https://doi.org/10.1071/SH22023
Submitted: 8 February 2022  Accepted: 5 May 2022   Published online: 16 June 2022

© 2022 The Author(s) (or their employer(s)). Published by CSIRO Publishing

Abstract

Increased demand for sexual health services (including prevention and treatment) have spurred the development of digital STI/HIV services. Earlier advances in testing technologies opened the door for self-testing and self-sampling approaches, in line with broader self-care strategies. Advances in HIV management mean that many people are living well with HIV and no longer need intensive in-person monitoring, whereas those at-risk of HIV are recommended to have regular asymptomatic STI screening and pre-exposure prophylaxis. This narrative review examines the evidence and implications of digital STI/HIV services, focused on promoting testing, facilitating testing, clinical management and referrals, partner services, and prevention. We have used a prevention and care continuum to structure the review to increase utility to policy as well as practice. Digital STI/HIV services can be interwoven into existing clinical pathways to enhance face-to-face services or standalone digital STI/HIV services. A growing evidence base, including randomised controlled trials and observational studies, should help inform strategies for designing effective digital STI/HIV services. However, most studies to date have focused on high-income countries and people with smartphones, despite a substantial burden of STI/HIV in low- and middle-income countries. There are also important differences between digital STI and HIV services that require careful consideration. We discuss digital STI/HIV service evidence and implications to inform research and programs in this exciting field.

Keywords: chlamydia, clinical, digital, e-health, gonorrhoea, HIV, m-health, partner services, social media, STI.

Introduction

A person can visit a website, complete a brief survey instrument, and then be advised about self-testing or self-sampling for appropriate sexually transmitted infections (STI). Then a mailed self-test kit allows the person to test themselves and interpret the result, all from the comfort of their home. This could then provide the basis for an online automated consultation, collection of antibiotics from a community pharmacy, and refer sex partners into the health system. Although this collection of digital health services may sound like fiction, pilot programs and a growing evidence base support digital STI services.1,2 For the purposes of this review, we define digital health as ‘the field of knowledge and practice associated with the development and use of digital technologies to improve health’.3 This includes mHealth, eHealth, artificial intelligence, and related big data approaches.3 Online STI services can be standalone or they can operate as an extension of a physical clinic. Digital tools can also be used to make face-to-face services more effective and create new ways of engaging people with testing, wider prevention interventions and clinical care, including facilitating partner notification. In the context of sexual health, this includes STI clinics sending text messages to patients, software and hardware to spur healthy behaviours, remote photographic diagnosis, symptoms checkers, online treatment, and related online STI projects.

Several factors have catalysed this shift. First, self-testing and self-sampling have decentralised diagnostics so that testing can be provided outside of health facilities.4 Self-testing refers to a process in which a person collects their own samples (usually swab, urine, or blood), performs the diagnostic test and interprets their result in a place of their choice (e.g. home, clinic, work, or elsewhere). In self-sampling, the person collects their own sample (usually swab, urine, or blood) and sends it to a laboratory for processing.5 Second, increased usage of digital technologies in daily life, combined with advances in the technologies themselves such as expanding digital algorithms (e.g. machine learning6), technologies (e.g. mobile phone applications7) and services (e.g. unstructured supplementary service data (USSD), unstructured supplemental service data), have created possibilities for wholly online care. Alongside these technological trends are more supportive legislation and policies to facilitate digital services.3 Third, digital approaches can reduce STI/HIV stigma,8 highlighting the potential for greater population coverage. Fourth, the expansion of HIV pre-exposure prophylaxis (PrEP) has generated increased demand for associated STI testing.9 Fifth, conventional STI clinics have been closed or limited in scope during the coronavirus disease 2019 (COVID-19) pandemic, with patients encouraged to use available online services.10 In many settings, people living with HIV have been encouraged to avoid in-person attendance. In some cases, this has accelerated existing research on digital approaches to optimising STI services as alternatives to face-to-face care.11

Digital STI services have been introduced to meet different aims, including driving demand for essential STI services, reaching individuals who choose not to use in-person facilities, and to increase service efficiency by decreasing uncomplicated visits to in-person services in an attempt to reduce costs. They may also be able to reach individuals who cannot reach in-person facilities, including people in remote rural areas, people with disabilities, and people who do not have access to transportation. At the same time, digital services could exacerbate existing inequities by creating barriers for people with low health literacy or others,12 underlining the importance of considering these issues when planning and implementing new digital services.

Previous reviews of digital sexual health services have focused exclusively on HIV,1 pre-dated the COVID-19 pandemic,2,13,14 focused on specific populations,15,16 or focused on specific technologies.17 Within a special issue of Sexual Health, this narrative review examines the evidence and implications of digital STI/HIV services, focused on promoting testing, facilitating testing, clinical management and referrals, partner services, and prevention. Where appropriate, we reference national and professional body guidance and recommendations. We also make recommendations about priority areas for research and remaining challenges ahead in the digital STI service development process.


Methods

We used a narrative rather than a scoping or systematic review for the following reasons: there was substantial heterogeneity in the types of interventions and measured outcomes; there were marked differences in operational definitions across studies; and there was limited research for some key populations. We searched PubMed, Google Scholar, CINAHL using search terms ‘digital’, ‘social media’, ‘HIV’, ‘STI’, ‘e-Health’, ‘mHealth’, and ‘STD’. We were substantively interested in reviewing the evidence for STI services, but have included information about HIV services where appropriate. We included low-, middle-, and high-income country settings, but we only searched in the English-language and limited our included articles to English-language studies.

We have structured this review according to a prevention and care continuum because many public sector STI services use similar organisational categories,18,19 it aligns with WHO and UNAIDS metrics, and is relevant to many STI clinical contexts. Here, we will focus on engagement (including testing promotion), testing, clinical management and referrals, partner services, prevention, and surveillance. Each of these respective sections includes evidence from systematic and scoping reviews, best practice guidelines, and practical open-access resources. We prioritised evidence from systematic reviews and randomised controlled trials over other types of evidence. At the same time, given the sparse literature in many fields, we included single studies where relevant.


Results

Engagement with STI services (including STI testing)

Can digital tools engage those at risk for STIs? Engagement refers to a set of bidirectional opportunities for health workers and local community members to communicate.20 Engagement with STI services specifically focuses on education and awareness activities to generate demands for STI services, especially testing services. STI engagement activities could be entirely digital, entirely in-person, or a digital/in-person hybrid.21 Engagement strategies use text messages, social networking mobile phone applications, user support groups, and websites to increase awareness of STI services (e.g. preventive and therapeutic services available).

One systematic review found that mobile phone applications increased sexual health knowledge and sexual health service use among adolescents, but found few studies and observed substantial heterogeneity.22 Another systematic review found that crowdsourcing facilitated HIV community engagement in online and in-person settings.23 Crowdsourcing has a group of people solve all or part of a problem and then share solutions with the public.24 Crowdsourcing approaches include open calls, hackathons, and related participatory events. In the context of HIV engagement, crowdsourcing can provide a formal mechanism for stakeholder consultation, end-user involvement, public judging, and other critical elements.24,25 A review of digital media interventions for sexual health promotion among youth also found increases in knowledge related to HIV prevention.15

Several open access resources and guidance documents exist. The United States Centers for Disease Control and Prevention have open access resources and best practice guidelines on social marketing communications.26 The UNAIDS/AVAC Good Participatory Practice Guidelines provides suggestions for enhancing HIV community engagement that are relevant to digital approaches.27 The growing evidence base suggests that digital tools can enhance STI and HIV engagement with STI services, increasing knowledge and promoting awareness of STI testing options.

Digital STI testing

How can digital STI services be used to enhance access to STI/HIV testing and what is their effectiveness? Digital technologies have been used to expand access to STI testing through self-sampling (e.g. HIV, syphilis, gonorrhoea, chlamydia, human papillomavirus)2830 and self-testing (e.g. HIV,3133 syphilis,3436 and hepatitis C virus37). Digital tools cover a range of functions of varying degrees of complexity and sophistication, including booking appointments at STI clinics, ordering test kits, identifying people who would most benefit from testing (triaging), conducting online sexual health consultations, verifying completion of self-testing kits, referring people to access facility-based services, and provision of STI test results.2 In resource-limited settings, USSD has been used to promote self-testing and confirm test uptake.38

There is growing evidence to support the use of digital approaches to increase the uptake of HIV testing. One systematic review found moderate certainty of evidence (two randomised controlled trials, two observational studies) to support digital crowdsourcing methods to develop interventions that increase HIV testing compared to conventional approaches.39 A scoping review of qualitative studies40 and a scoping review of quantitative studies32 demonstrates that crowdsourcing approaches can enhance HIV test uptake. A systematic review found moderate certainty of evidence that text messages increased sexual health testing compared to conventional messages (e.g. print messages, clinic education).17 Two randomised controlled trials found that digital interventions to facilitate online self-testing increased HIV, syphilis, chlamydia, and gonorrhoea test uptake.33,41 A systematic review found that digital interventions to support HIV self-testing were feasible, acceptable, and often preferred compared to conventional services.42

Several open access resources and best practice documents can help to inform digital STI testing services. The WHO/SESH/SIHI practical guide on crowdsourcing for health and health research provides practical advice on organising crowdsourcing activities,24 and is accompanied by a Special Programme on Training and Research in Infectious Diseases consensus statement43 and systematic review.39 Public Health England created a user guide for e-sexual health services, which also provides practical advice on organising self-sampling through the internet.44 The British Association of Sexual Health and HIV released guidance on STI self-sampling packs and processes45 and online sexual health provision more broadly.46 The American Sexually Transmitted Diseases Association created a position statement on direct-to-consumer STI testing services.47 One Welsh report examined the relationship between digital technology and health inequalities.12 There is strong evidence, policy support, and open access resources outlining how digital tools can facilitate HIV self-testing.48 A growing evidence base suggests that syphilis self-testing,35 HCV self-testing, and other STI self-sampling could be useful adjuncts to traditional care in some settings.4

Digital STI services for clinical management and referral

How have digital STI services been used in STI clinical management and referral pathways and what is their effectiveness? Digital approaches have been used to increase access and adherence to a range of commonly used drugs, ranging from preventive drugs (e.g. pre-exposure prophylaxis, PrEP, among people at risk for HIV infection) to therapeutics (e.g. anti-retroviral therapy among people living with HIV infection). One UK study provided a digital pathway for management of people with chlamydia, which included an online automated consultation and electronic prescribing enabling people to collect antibiotics at a pharmacy without needing to present to conventional clinical facilities.49 This research was based on a clinical decision-making algorithm. Mobile phone text message medication reminders can increase adherence to ART.50 Digital PrEP systems could allow an individual to determine PrEP eligibility, initiate STI self-testing and self-sampling, and provide clinical consultation related to PrEP initiation. Several pilots have been developed that integrate PrEP initiation and digital technologies.51

Digital technologies have also been used to facilitate linkage to HIV services following diagnosis. One study from rural South Africa suggested that mobile phone-connected HIV testing and web-based clinical care and prevention pathways have the potential to support access to HIV prevention and care, particularly for young people and men.52

Several systematic reviews have examined digital interventions to enhance ART adherence among people living with HIV. One Cochrane systematic review50 and a subsequent systematic review53 found that scheduled short message service (SMS) text messages can increase ART adherence compared to conventional approaches. In contrast, there is much less evidence concerning use of digital interventions within STI treatment.

Digital approaches and partner services

How can digital interventions enhance partner services and what is the evidence of their effectiveness? Digital interventions can enhance partner services by assisting index patients to notify their partners (either personally or anonymously via text message or email) and facilitating sex partner management.54 This could include providing test results notification or providing postal self-testing or self-sampling kits to partners.

Several studies have examined the effectiveness of digital partner service interventions. A narrative review from this special issue provides a summary of evidence on partner services, including digital approaches. One single study showed that prototype mobile phone applications may enhance partner notification and testing.55 The US Centers for Disease Control and Prevention provide a toolkit for digital partner services56 and National Coalition of Sexually Transmitted Diseases Directors in the United States created guidelines for internet-based partner services.57 A modest evidence base suggests that digital tools may enhance HIV partner services, but less research and programs exist for other STIs.54 Further research and programs are needed in this area.

Digital approaches for STI prevention (vaccination)

How have digital approaches been used to increase uptake of vaccines for the prevention of STIs and what is their effectiveness? Digital methods have been used to increase human papillomavirus and HBV vaccinations. Some of the strategies identified below could be relevant to other STI vaccines, which may be developed in the next decade (e.g. gonorrhoea, chlamydia, syphilis). Vaccine promotion must negotiate the complex digital communication environment, especially misinformation and anti-vaccine sentiment from diverse groups.58 There is an extensive literature on how social media has been used to amplify HPV vaccine hesitancy, sew confusion, and decrease HPV uptake.59,60 One single study found that artificial intelligence can be used to examine social media discussions about HPV vaccines, with this analysis of HPV vaccine-related Twitter discussions demonstrating that social media data can inform public health communication and education programs to improve HPV vaccination rates.61

There is less evidence about the use of digital tools to support HPV vaccination. One systematic review examined how social media interventions enhance HPV vaccination services using an implementation science framework.62 Another systematic review assessed attitudes, beliefs, and knowledge from social media studies on HPV vaccination.63 The World Health Organization created HPV vaccine communication considerations with a strong focus on digital media.64 Although some pilots have examined digital tools to increase HBV vaccination,64 there is relatively less evidence. For example, a randomised controlled trial of a crowdsourced digital intervention included hepatitis B vaccination as a secondary outcome.64

Few studies and programs have used digital tools for STI prevention. The limited data available for HPV suggest that harms associated with social media are substantial and need to be considered when implementing digital HPV interventions.


Health economic evaluation of digital sexual health care

Is digital sexual health care good value for money? Although online services are often assumed to represent better value for money than more traditional modes of care delivery, there has been very little robust health economic evaluation. Individual components of care pathways may well be cheaper when delivered digitally as they tend to shift tasks from a clinician-led to a self-managed process with accompanying reduction in health care professional time and health system costs. However, it is important to evaluate health system costs in the context of whole care pathways; although it may be cheaper to diagnose asymptomatic infections using self-sampling in place of clinician-obtained samples, if it takes more resources for the service to achieve adequate downstream outcomes, such as index patient treatment or partner notification success, the net costs may be greater than traditional care. Further complexity arises as online services tend to generate new demand for testing and a shift of activity between services. One analysis found that online STI testing increased the number of STI tests, increased the overall cost of testing, and decreased the average cost per diagnosis.65 The article by Gibbs et al. in this issue provides more in-depth perspectives on health economic evaluation of digital sexual health services.


Digital sexual health and health inequalities

How do digital sexual healthcare interventions affect health inequalities? Health inequalities are systematic differences in health outcomes for people occupying different positions in society.66 STIs and HIV are socially patterned and disproportionately affect those already experiencing health inequalities, especially people marginalised based on race, gender, socio-economic disadvantage, and disability. In parallel, people from these groups may experience barriers accessing health care due to stigma and geographical inaccessibility of existing services.

Digital health interventions could be a useful tool in addressing some of these barriers and have potential to increase access to sexual health care. However, unless they are implemented in an inclusive way,67 digital interventions could reinforce existing barriers and inadvertently widen the digital health divide.12,68 This is because the ability to engage effectively with digital services often requires access to an internet-enabled device, sufficient bandwidth, and digital literacy to navigate self-management pathways.69

Within sexual health, there is limited evidence on the impact of digital sexual healthcare interventions and health disparities. Some digital crowdsourcing interventions have been designed to increase participation from women, ethnic minorities, and other under-represented groups.7072 At the same time, several studies suggest that socio-economically disadvantaged groups have lower uptake of online STI testing,73,74 whereas other studies have not reported social gradients in online testing.75 Work from the United Kingdom among people with mild learning difficulties highlighted considerable barriers to kit use and sample collection.76 These inequalities highlight the need for legal, ethical, and human rights research to better understand the broader context of digital STI interventions.72


Research priorities

Although digital services show considerable promise, gaps in the evidence base make it challenging to determine what types of digital interventions will work for whom and in which circumstances. First, there is a need for usability research that explicitly involves the end-user in the research process. Co-creation and related engagement of end-users has been shown to be effective in the development of many digital health interventions77 and is advocated by a Lancet commission on Governing Health Futures.78 Second, cost-effectiveness research and costing studies more broadly are needed to determine the circumstances in which digital interventions could be good value for money. Often, digital interventions require substantial resources for development and sometimes digital interventions assume ownership of a smartphone or other device. Research using low-cost platforms for analogue phones are needed to spur innovation focused on low-income users. Third, there is a need for legal and ethical research to consider how digital services impact health disparities. Finally, our data suggest that many digital tools have been developed for HIV and not applied to STI services. For example, although digital HIV self-testing has been widely used and is mentioned in World Health Organization guidelines, far fewer studies and programs have examined digital syphilis/other STI self-testing approaches.

Our review has several limitations. First, we only included guidelines that could be identified through a narrative review according to our specified criteria. A systematic review on the topic would likely identify more guidelines and best practice statements, but would likely encounter difficulties with the volume of disparate literature. This is particularly important for the identification of guidelines created in low- and middle-income country contexts. Second, our review excluded non-English-language studies. Although there is support for this approach from empirical studies,79 this also privileges high-income country research. Third, digital tools also contribute to a broader literature on telemedicine and telehealth, which demands a review of its own. Fourth, we acknowledge that there are substantial differences between HIV and other STI digital interventions. For example, digital interventions for people living with HIV (PLHIV) are often about long-term management (e.g. antiretroviral support), whereas STI interventions may be more focused on acute issues; however, a broader discussion of these differences is beyond the scope of this manuscript.

The evidence and open access resources identified have important implications for the public, providers, and health systems. For the public, some of the digital transitions we described present new methods for engagement prior to seeing a healthcare professional in a clinical setting. The public can and must have an important voice in shaping the development of digital STI care pathways and how they relate to in-person services. For providers, digital tools may increase overall public demand and enhance linkage to clinical services. For health systems, digital systems could save resources and create more efficient clinics, but evidence from robust health economic analyses are needed. The studies we identified underline the need for integration of both digital and in-person services so that someone can move seamlessly between digital and in-person pathways based on preferences, medical needs, and resources. People may need assistance (e.g. peer navigators) in order to facilitate these transitions and reap the full potential of digital tools. Evaluation of whole systems are needed to adequately assess their effectiveness.


Data availability

We relied on public open access databases to find relevant data. All data presented in this paper are available by contacting the corresponding author.


Conflicts of interest

Joseph D. Tucker, Jane Hocking, and Claudia Estcourt are Editors of Sexual Health, but they were blinded from the peer review process for this paper. The authors report no other conflicts of interest.


Declaration of funding

This study received support from the US National Institutes of Health (UH3HD096929, K24AI143471, R01AI158826 to JDT). JSH is supported by a National Health and Medical Research Council Senior Research Fellowship (1136117).



References

[1]  Cao B, Gupta S, Wang J, Hightow-Weidman LB, Muessig KE, Tang W, et al. Social media interventions to promote HIV testing, linkage, adherence, and retention: systematic review and meta-analysis. J Med Internet Res 2017; 19 e394
Social media interventions to promote HIV testing, linkage, adherence, and retention: systematic review and meta-analysis.Crossref | GoogleScholarGoogle Scholar | 29175811PubMed |

[2]  Cao B, Bao H, Oppong E, Feng S, Smith KM, Tucker JD, et al. Digital health for sexually transmitted infection and HIV services: a global scoping review. Curr Opin Infect Dis 2020; 33 44–50.
Digital health for sexually transmitted infection and HIV services: a global scoping review.Crossref | GoogleScholarGoogle Scholar | 31789695PubMed |

[3]  WHO. Global strategy on digital health 2020–2025. Geneva: WHO; 2021.

[4]  Kpokiri EE, Marley G, Tang W, Fongwen N, Wu D, Berendes S, et al. Diagnostic infectious diseases testing outside clinics: a global systematic review and meta-analysis. Open Forum Infect Dis 2020; 7 ofaa360
Diagnostic infectious diseases testing outside clinics: a global systematic review and meta-analysis.Crossref | GoogleScholarGoogle Scholar | 33072806PubMed |

[5]  Tucker JD, Bien CH, Peeling RW. Point-of-care testing for sexually transmitted infections: recent advances and implications for disease control. Curr Opin Infect Dis 2013; 26 73–9.
Point-of-care testing for sexually transmitted infections: recent advances and implications for disease control.Crossref | GoogleScholarGoogle Scholar | 23242343PubMed |

[6]  Marcus JL, Sewell WC, Balzer LB, Krakower DS. Artificial intelligence and machine learning for HIV prevention: emerging approaches to ending the epidemic. Curr HIV/AIDS Rep 2020; 17 171–9.
Artificial intelligence and machine learning for HIV prevention: emerging approaches to ending the epidemic.Crossref | GoogleScholarGoogle Scholar | 32347446PubMed |

[7]  Muessig KE, Pike EC, Legrand S, Hightow-Weidman LB. Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: a review. J Med Internet Res 2013; 15 e1
Mobile phone applications for the care and prevention of HIV and other sexually transmitted diseases: a review.Crossref | GoogleScholarGoogle Scholar | 23291245PubMed |

[8]  Shen K, Yang NS, Huang W, Fitzpatrick TS, Tang W, Zhao Y, et al. A crowdsourced intervention to decrease hepatitis B stigma in men who have sex with men in China: a cohort study. J Viral Hepat 2020; 27 135–42.
A crowdsourced intervention to decrease hepatitis B stigma in men who have sex with men in China: a cohort study.Crossref | GoogleScholarGoogle Scholar | 31571341PubMed |

[9]  Ong JJ, Fu H, Baggaley RC, Wi TE, Tucker JD, Smith MK, et al. Missed opportunities for sexually transmitted infections testing for HIV pre-exposure prophylaxis users: a systematic review. J Int AIDS Soc 2021; 24 e25673
Missed opportunities for sexually transmitted infections testing for HIV pre-exposure prophylaxis users: a systematic review.Crossref | GoogleScholarGoogle Scholar | 33605081PubMed |

[10]  Erausquin JT, Tan RKJ, Uhlich M, Francis JM, Kumar N, Campbell L, et al. The International Sexual Health And Reproductive Health Survey (I-SHARE-1): a multi-country analysis of adults from 30 countries prior to and during the initial COVID-19 wave. medRxiv 2021; 21263630
The International Sexual Health And Reproductive Health Survey (I-SHARE-1): a multi-country analysis of adults from 30 countries prior to and during the initial COVID-19 wave.Crossref | GoogleScholarGoogle Scholar |

[11]  Jiang H, Xie Y, Xiong Y, Zhou Y, Lin K, Yan Y, et al. HIV self-testing partially filled the HIV testing gap among men who have sex with men in China during the COVID-19 pandemic: results from an online survey. J Int AIDS Soc 2021; 24 e25737
HIV self-testing partially filled the HIV testing gap among men who have sex with men in China during the COVID-19 pandemic: results from an online survey.Crossref | GoogleScholarGoogle Scholar | 34036750PubMed |

[12]  Honeyman M, Maguire D, Evans H, Davies A. Digital technology and health inequalities: a scoping review. Cardiff: Public Health Wales NHS Trust; 2020.

[13]  Gilliam M, Chor J, Hill B. Digital media and sexually transmitted infections. Curr Opin Obstet Gynecol 2014; 26 381–5.
Digital media and sexually transmitted infections.Crossref | GoogleScholarGoogle Scholar | 25105560PubMed |

[14]  Daher J, Vijh R, Linthwaite B, Dave S, Kim J, Dheda K, et al. Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996–2017). BMJ Open 2017; 7 e017604
Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996–2017).Crossref | GoogleScholarGoogle Scholar | 29101138PubMed |

[15]  Wadham E, Green C, Debattista J, Somerset S, Sav A. New digital media interventions for sexual health promotion among young people: a systematic review. Sex Health 2019; 16 101–23.
New digital media interventions for sexual health promotion among young people: a systematic review.Crossref | GoogleScholarGoogle Scholar | 30819326PubMed |

[16]  Meiksin R, Melendez-Torres GJ, Falconer J, Witzel TC, Weatherburn P, Bonell C. eHealth interventions to address sexual health, substance use, and mental health among men who have sex with men: systematic review and synthesis of process evaluations. J Med Internet Res 2021; 23 e22477
eHealth interventions to address sexual health, substance use, and mental health among men who have sex with men: systematic review and synthesis of process evaluations.Crossref | GoogleScholarGoogle Scholar | 33890855PubMed |

[17]  Berendes S, Gubijev A, McCarthy OL, Palmer MJ, Wilson E, Free C. Sexual health interventions delivered to participants by mobile technology: a systematic review and meta-analysis of randomised controlled trials. Sex Transm Infect 2021; 97 190–200.
Sexual health interventions delivered to participants by mobile technology: a systematic review and meta-analysis of randomised controlled trials.Crossref | GoogleScholarGoogle Scholar | 33452130PubMed |

[18]  Zang X, Mah C, Linh Quan AM, Min JE, Armstrong WS, Behrends CN, et al. Human immunodeficiency virus transmission by HIV risk group and along the HIV care continuum: a contrast of six US cities. J Acquir Immune Defic Syndr 2022; 89 143–150.
Human immunodeficiency virus transmission by HIV risk group and along the HIV care continuum: a contrast of six US cities.Crossref | GoogleScholarGoogle Scholar | 34723929PubMed |

[19]  Vourli G, Noori T, Pharris A, Porter K, Axelsson M, Begovac J, et al. Human immunodeficiency virus continuum of care in 11 European Union Countries at the End of 2016 overall and by key population: have we made progress? Clin Infect Dis 2020; 71 2905–16.
Human immunodeficiency virus continuum of care in 11 European Union Countries at the End of 2016 overall and by key population: have we made progress?Crossref | GoogleScholarGoogle Scholar | 32960957PubMed |

[20]  WHO/TDR/SESH/SIHI. Public engagement and crowdfunding in health research: a practical guide. Geneva: WHO; 2021.

[21]  Taggart T, Grewe ME, Conserve DF, Gliwa C, Roman Isler M. Social media and HIV: a systematic review of uses of social media in HIV communication. J Med Internet Res 2015; 17 e248
Social media and HIV: a systematic review of uses of social media in HIV communication.Crossref | GoogleScholarGoogle Scholar | 26525289PubMed |

[22]  Palmer MJ, Henschke N, Villanueva G, Maayan N, Bergman H, Glenton C, et al. Targeted client communication via mobile devices for improving sexual and reproductive health. Cochrane Database Syst Rev 2020; 8 Cd013680
Targeted client communication via mobile devices for improving sexual and reproductive health.Crossref | GoogleScholarGoogle Scholar | 32779730PubMed |

[23]  Pan SW, Stein G, Bayus B, Mathews A, Wang C, Wei C, et al. Systematic review of design contests for health: spurring innovation and mass engagement. BMJ Innovations 2017; 3 227–37.
| 29576873PubMed |

[24]  WHO/TDR/SESH/SIHI. Crowdsourcing in health and health research: a practical guide. Geneva: WHO/TDR; 2018.

[25]  Tucker JD, Day S, Tang W, Bayus B.. Crowdsourcing in medical research: concepts and applications. PeerJ 2019; 7 e6762
Crowdsourcing in medical research: concepts and applications.Crossref | GoogleScholarGoogle Scholar | 30997295PubMed |

[26]  CDC. Social marketing. 2021. Available at https://www.cdc.gov/hiv/effective-interventions/respond/social-marketing/index.html

[27]  UNAIDS/AVACC. Good participatory practice. 2011. Available at https://www.avac.org/good-participatory-practice

[28]  Syred J, Holdsworth G, Howroyd C, Spelman K, Baraitser P. Choose to test: self-selected testing for sexually transmitted infections within an online service. Sex Transm Infect 2019; 95 171–4.
Choose to test: self-selected testing for sexually transmitted infections within an online service.Crossref | GoogleScholarGoogle Scholar | 30842345PubMed |

[29]  Aicken CR, Estcourt CS, Johnson AM, Sonnenberg P, Wellings K, Mercer CH. Use of the internet for sexual health among sexually experienced persons aged 16 to 44 years: evidence from a nationally representative survey of the british population. J Med Internet Res 2016; 18 e14
Use of the internet for sexual health among sexually experienced persons aged 16 to 44 years: evidence from a nationally representative survey of the british population.Crossref | GoogleScholarGoogle Scholar | 26792090PubMed |

[30]  Veerus P, Hallik R, Jänes J, Jõers K, Paapsi K, Laidra K, et al. Human papillomavirus self-sampling for long-term non-attenders in cervical cancer screening: a randomised feasibility study in Estonia. J Med Screen 2022; 29 53–60.
Human papillomavirus self-sampling for long-term non-attenders in cervical cancer screening: a randomised feasibility study in Estonia.Crossref | GoogleScholarGoogle Scholar | 34694179PubMed |

[31]  Tang W, Han L, Best J, Zhang Y, Mollan K, Kim J, et al. Crowdsourcing HIV test promotion videos: a noninferiority randomized controlled trial in China. Clin Infect Dis 2016; 62 1436–42.
Crowdsourcing HIV test promotion videos: a noninferiority randomized controlled trial in China.Crossref | GoogleScholarGoogle Scholar | 27129465PubMed |

[32]  Tang W, Ritchwood TD, Wu D, Ong JJ, Wei C, Iwelunmor J, et al. Crowdsourcing to improve HIV and sexual health outcomes: a scoping review. Curr HIV/AIDS Rep 2019; 16 270–8.
Crowdsourcing to improve HIV and sexual health outcomes: a scoping review.Crossref | GoogleScholarGoogle Scholar | 31155691PubMed |

[33]  Tang W, Wei C, Cao B, Wu D, Li KT, Lu H, et al. Crowdsourcing to expand HIV testing among men who have sex with men in China: a closed cohort stepped wedge cluster randomized controlled trial. PLoS Med 2018; 15 e1002645
Crowdsourcing to expand HIV testing among men who have sex with men in China: a closed cohort stepped wedge cluster randomized controlled trial.Crossref | GoogleScholarGoogle Scholar | 30153265PubMed |

[34]  Sri-Pathmanathan C, Nhamo D, Mamvuto T, Chapwanya G, Terris-Prestholt F, Mahaka I, et al. Syphilis self-testing to expand test uptake among men who have sex with men: a theoretically informed mixed methods study in Zimbabwe. Sex Transm Infect 2022; 98 197–202.
Syphilis self-testing to expand test uptake among men who have sex with men: a theoretically informed mixed methods study in Zimbabwe.Crossref | GoogleScholarGoogle Scholar | 33927008PubMed |

[35]  Wang C, Ong JJ, Zhao P, Weideman AM, Tang W, Smith MK, et al. Expanding syphilis test uptake using rapid dual self-testing for syphilis and HIV among men who have sex with men in China: a multiarm randomized controlled trial. PLoS Med 2022; 19 e1003930
Expanding syphilis test uptake using rapid dual self-testing for syphilis and HIV among men who have sex with men in China: a multiarm randomized controlled trial.Crossref | GoogleScholarGoogle Scholar | 35235573PubMed |

[36]  Wu D, Zhou Y, Yang N, Huang S, He X, Tucker J, et al. Social media-based secondary distribution of human immunodeficiency virus/syphilis self-testing among chinese men who have sex with men. Clin Infect Dis 2021; 73 e2251–7.
Social media-based secondary distribution of human immunodeficiency virus/syphilis self-testing among chinese men who have sex with men.Crossref | GoogleScholarGoogle Scholar | 32588883PubMed |

[37]  WHO. Hepatitis C virus self-testing. WHO; 2021.

[38]  Oladele D. USSD confirmation of HIV self-testing results. NIMR; 2021.

[39]  Wang C, Han L, Stein G, Day S, Bien-Gund C, Mathews A, et al. Crowdsourcing in health and medical research: a systematic review. Infect Dis Poverty 2020; 9 8
Crowdsourcing in health and medical research: a systematic review.Crossref | GoogleScholarGoogle Scholar | 31959234PubMed |

[40]  Wu D, Ong JJ, Tang W, Ritchwood TD, Walker JS, Iwelunmor J, et al. Crowdsourcing methods to enhance HIV and sexual health services: a scoping review and qualitative synthesis. J Acquir Immune Defic Syndr 2019; 82 S271–8.
Crowdsourcing methods to enhance HIV and sexual health services: a scoping review and qualitative synthesis.Crossref | GoogleScholarGoogle Scholar | 31764263PubMed |

[41]  Wilson E, Free C, Morris TP, Syred J, Ahamed I, Menon-Johansson AS, et al. Internet-accessed sexually transmitted infection (e-STI) testing and results service: a randomised, single-blind, controlled trial. PLoS Med 2017; 14 e1002479
Internet-accessed sexually transmitted infection (e-STI) testing and results service: a randomised, single-blind, controlled trial.Crossref | GoogleScholarGoogle Scholar | 29281628PubMed |

[42]  McGuire M, de Waal A, Karellis A, Janssen R, Engel N, Sampath R, et al. HIV self-testing with digital supports as the new paradigm: a systematic review of global evidence (2010–2021). EClinMed 2021; 39 101059
HIV self-testing with digital supports as the new paradigm: a systematic review of global evidence (2010–2021).Crossref | GoogleScholarGoogle Scholar |

[43]  Han L, Tang W, Ritchwood TD, Day S, Wei S, Bao H, et al. Joint international consensus statement on crowdsourcing challenge contests in health and medicine: results of a modified Delphi process. BMJ Open 2021; 11 e048699
Joint international consensus statement on crowdsourcing challenge contests in health and medicine: results of a modified Delphi process.Crossref | GoogleScholarGoogle Scholar | 34740928PubMed |

[44]  PHE. National framework for e-sexual and reproductive healthcare. Public Health England; 2021.

[45]  BASHH. Guidance for the design of self-sampling packs and associated support for self-sampling processes within sexually transmitted infection and blood borne virus testing. British Association for Sexual Health and HIV; 2021.

[46]  RSRH/BASHH. Standards for online and remote providers of sexual and reproductive health services. British Association for Sexual Health and HIV; 2019.

[47]  Exten C, Pinto CN, Gaynor AM, Meyerson B, Griner SB, Van Der Pol B, et al. Direct-to-consumer sexually transmitted infection testing services: a position statement from the american sexually transmitted diseases association. Sex Transm Dis 2021; 48 e155–9.
Direct-to-consumer sexually transmitted infection testing services: a position statement from the american sexually transmitted diseases association.Crossref | GoogleScholarGoogle Scholar | 34030157PubMed |

[48]  WHO. Guidelines on HIV self-testing and partner notification. Geneva: WHO; 2016.

[49]  Estcourt CS, Gibbs J, Sutcliffe LJ, Gkatzidou V, Tickle L, Hone K, et al. The eSexual health clinic system for management, prevention, and control of sexually transmitted infections: exploratory studies in people testing for Chlamydia trachomatis. Lancet Public Health 2017; 2 e182–90.
The eSexual health clinic system for management, prevention, and control of sexually transmitted infections: exploratory studies in people testing for Chlamydia trachomatis.Crossref | GoogleScholarGoogle Scholar | 29253450PubMed |

[50]  Horvath T, Azman H, Kennedy GE, Rutherford GW. Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection. Cochrane Database Syst Rev 2012; 2012 Cd009756
Mobile phone text messaging for promoting adherence to antiretroviral therapy in patients with HIV infection.Crossref | GoogleScholarGoogle Scholar |

[51]  Rousseau E, Julies RF, Madubela N, Kassim S. Novel platforms for biomedical HIV prevention delivery to key populations – community mobile clinics, peer-supported, pharmacy-Led PrEP delivery, and the use of telemedicine. Curr HIV/AIDS Rep 2021; 18 500–7.
Novel platforms for biomedical HIV prevention delivery to key populations – community mobile clinics, peer-supported, pharmacy-Led PrEP delivery, and the use of telemedicine.Crossref | GoogleScholarGoogle Scholar | 34708316PubMed |

[52]  Adeagbo O, Herbst C, Blandford A, McKendry R, Estcourt C, Seeley J, et al. Exploring people’s candidacy for mobile health-supported HIV testing and care services in Rural KwaZulu-Natal, South Africa: qualitative study. J Med Internet Res 2019; 21 e15681
Exploring people’s candidacy for mobile health-supported HIV testing and care services in Rural KwaZulu-Natal, South Africa: qualitative study.Crossref | GoogleScholarGoogle Scholar | 31738174PubMed |

[53]  Amankwaa I, Boateng D, Quansah DY, Akuoko CP, Evans C. Effectiveness of short message services and voice call interventions for antiretroviral therapy adherence and other outcomes: a systematic review and meta-analysis. PLoS ONE 2018; 13 e0204091
Effectiveness of short message services and voice call interventions for antiretroviral therapy adherence and other outcomes: a systematic review and meta-analysis.Crossref | GoogleScholarGoogle Scholar | 30240417PubMed |

[54]  Kachur R, Hall W, Coor A, Kinsey J, Collins D, Strona FV. The use of technology for sexually transmitted disease partner services in the united states: a structured review. Sex Transm Dis 2018; 45 707–12.
The use of technology for sexually transmitted disease partner services in the united states: a structured review.Crossref | GoogleScholarGoogle Scholar | 29771868PubMed |

[55]  Balán IC, Lopez-Rios J, Nayak S, Lentz C, Arumugam S, Kutner B, et al. SMARTtest: a smartphone app to facilitate HIV and syphilis self- and partner-testing, interpretation of results, and linkage to care. AIDS Behav 2020; 24 1560–73.
SMARTtest: a smartphone app to facilitate HIV and syphilis self- and partner-testing, interpretation of results, and linkage to care.Crossref | GoogleScholarGoogle Scholar | 31679075PubMed |

[56]  CDC. The Toolkit for technology-based partner services. US Centers for Disease Control and Prevention; 2021.

[57]  NCSD. Guidelines for Internet-based partner services. National Coalition of STD Directors; 2008.

[58]  Larson H. Stuck: how vaccine rumors start - and why they don’t go away. New York: Oxford University Press; 2020.

[59]  Dunn AG, Surian D, Leask J, Dey A, Mandl KD, Coiera E. Mapping information exposure on social media to explain differences in HPV vaccine coverage in the United States. Vaccine 2017; 35 3033–40.
Mapping information exposure on social media to explain differences in HPV vaccine coverage in the United States.Crossref | GoogleScholarGoogle Scholar | 28461067PubMed |

[60]  Jarrett C, Wilson R, O’Leary M, Eckersberger E, Larson HJ. Strategies for addressing vaccine hesitancy – a systematic review. Vaccine 2015; 33 4180–90.
Strategies for addressing vaccine hesitancy – a systematic review.Crossref | GoogleScholarGoogle Scholar | 25896377PubMed |

[61]  Du J, Luo C, Shegog R, Bian J, Cunningham RM, Boom JA, et al. Use of deep learning to analyze social media discussions about the human papillomavirus vaccine. JAMA Netw Open 2020; 3 e2022025
Use of deep learning to analyze social media discussions about the human papillomavirus vaccine.Crossref | GoogleScholarGoogle Scholar | 33185676PubMed |

[62]  Asare M, Popelsky B, Akowuah E, Lanning BA, Montealegre JR. Internal and external validity of social media and mobile technology-driven HPV vaccination interventions: systematic review using the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework. Vaccines 2021; 9 197
Internal and external validity of social media and mobile technology-driven HPV vaccination interventions: systematic review using the reach, effectiveness, adoption, implementation, maintenance (RE-AIM) framework.Crossref | GoogleScholarGoogle Scholar | 33652809PubMed |

[63]  Ortiz RR, Smith A, Coyne-Beasley T. A systematic literature review to examine the potential for social media to impact HPV vaccine uptake and awareness, knowledge, and attitudes about HPV and HPV vaccination. Hum Vaccin Immunother 2019; 15 1465–75.
A systematic literature review to examine the potential for social media to impact HPV vaccine uptake and awareness, knowledge, and attitudes about HPV and HPV vaccination.Crossref | GoogleScholarGoogle Scholar | 30779682PubMed |

[64]  Fitzpatrick T, Tang W, Mollan K, Pan X, Chan PL, Zhou K, et al. A crowdsourced intervention to promote hepatitis B and C testing among men who have sex with men in China: a nationwide online randomized controlled trial. EClinMed 2019; 16 64–73.
A crowdsourced intervention to promote hepatitis B and C testing among men who have sex with men in China: a nationwide online randomized controlled trial.Crossref | GoogleScholarGoogle Scholar |

[65]  Turner KME, Looker KJ, Syred J, Zienkiewicz A, Baraitser P. Online testing for sexually transmitted infections: a whole systems approach to predicting value. PLoS ONE 2019; 14 e0212420
Online testing for sexually transmitted infections: a whole systems approach to predicting value.Crossref | GoogleScholarGoogle Scholar | 30794589PubMed |

[66]  Graham H. Understanding health inequalities. Oxford University Press: Oxford; 2009.

[67]  Gann B. Digital inclusion and health in wales. J Consum Health Internet 2019; 23 146–60.

[68]  McAuley A. Digital health interventions: widening access or widening inequalities? Public Health 2014; 128 1118–20.
| 25458115PubMed |

[69]  WHO Regional Office for Europe. From innovation to implementation: eHealth in the WHO European Region. WHO Regional Office for Europe; 2016.

[70]  Day S, Li C, Hlatshwako TG, Abu-Hijleh F, Han L, Deitelzweig C, et al. Assessment of a crowdsourcing open call for approaches to university community engagement and strategic planning during COVID-19. JAMA Netw Open 2021; 4 e2110090
Assessment of a crowdsourcing open call for approaches to university community engagement and strategic planning during COVID-19.Crossref | GoogleScholarGoogle Scholar | 33988706PubMed |

[71]  Mathews A, Conserve D, Mason H, Alston L, Rennie S, Tucker J. ‘Informed and empowered’: a mixed-methods study of crowdsourcing contests to promote uptake of HIV self-testing kits among African Americans. J Virus Erad 2020; 6 74–80.
‘Informed and empowered’: a mixed-methods study of crowdsourcing contests to promote uptake of HIV self-testing kits among African Americans.Crossref | GoogleScholarGoogle Scholar | 32405425PubMed |

[72]  Tan RKJ, Wu D, Day S, Zhao Y, Larson HJ, Sylvia S, et al. Digital approaches to enhancing community engagement in clinical trials. npj Digit Med 2022; 5 37
Digital approaches to enhancing community engagement in clinical trials.Crossref | GoogleScholarGoogle Scholar | 35338241PubMed |

[73]  Sumray K, Lloyd KC, Estcourt S, Burns F, Gibbs J. Scoping review of online postal sexually transmitted infection services: access, usage and clinical outcomes. Sex Transm Infect 2021;
Scoping review of online postal sexually transmitted infection services: access, usage and clinical outcomes.Crossref | GoogleScholarGoogle Scholar |

[74]  Rahib D, Delagreverie H, Gabassi A, Le Thi TT, Vassel E, Vodosin P, et al. Online self-sampling kits to screen multipartner MSM for HIV and other STIs: participant characteristics and factors associated with kit use in the first 3 months of the MemoDepistages programme, France, 2018. Sex Transm Infect 2021; 97 134–40.
Online self-sampling kits to screen multipartner MSM for HIV and other STIs: participant characteristics and factors associated with kit use in the first 3 months of the MemoDepistages programme, France, 2018.Crossref | GoogleScholarGoogle Scholar | 33397802PubMed |

[75]  Gilbert M, Thomson K, Salway T, Haag D, Grennan T, Fairley CK, et al. Differences in experiences of barriers to STI testing between clients of the internet-based diagnostic testing service GetCheckedOnline.com and an STI clinic in Vancouver, Canada. Sex Transm Infect 2019; 95 151–6.
Differences in experiences of barriers to STI testing between clients of the internet-based diagnostic testing service GetCheckedOnline.com and an STI clinic in Vancouver, Canada.Crossref | GoogleScholarGoogle Scholar | 29437984PubMed |

[76]  Middleton A, Pothoulaki M, Woode Owusu M, Flowers P, Mapp F, Vojt G, et al. How can we make self-sampling packs for sexually transmitted infections and bloodborne viruses more inclusive? A qualitative study with people with mild learning disabilities and low health literacy. Sex Transm Infect 2021; 97 276–81.
How can we make self-sampling packs for sexually transmitted infections and bloodborne viruses more inclusive? A qualitative study with people with mild learning disabilities and low health literacy.Crossref | GoogleScholarGoogle Scholar | 33906976PubMed |

[77]  Li C, Xiong Y, Sit HF, Tang W, Hall BJ, Muessig KE, et al. A men who have sex with men-friendly doctor finder hackathon in Guangzhou, China: development of a mobile health intervention to enhance health care utilization. JMIR Mhealth Uhealth 2020; 8 e16030
A men who have sex with men-friendly doctor finder hackathon in Guangzhou, China: development of a mobile health intervention to enhance health care utilization.Crossref | GoogleScholarGoogle Scholar | 32130189PubMed |

[78]  Kickbusch I, Agrawal A, Jack A, Lee N, Horton R. Governing health futures 2030: growing up in a digital world-a joint The Lancet and Financial Times Commission. Lancet 2019; 394 1309
Governing health futures 2030: growing up in a digital world-a joint The Lancet and Financial Times Commission.Crossref | GoogleScholarGoogle Scholar | 31548090PubMed |

[79]  Morrison A, Polisena J, Husereau D, Moulton K, Clark M, Fiander M, et al. The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies. Int J Technol Assess Health Care 2012; 28 138–44.
The effect of English-language restriction on systematic review-based meta-analyses: a systematic review of empirical studies.Crossref | GoogleScholarGoogle Scholar | 22559755PubMed |