Register      Login
Sexual Health Sexual Health Society
Publishing on sexual health from the widest perspective
REVIEW (Open Access)

Measuring and evaluating sexual health in the era of digital health: challenges and opportunities

Jo Gibbs A * , Danielle Solomon https://orcid.org/0000-0003-4177-1832 A , Louise Jackson B , Saiqa Mullick C , Fiona Burns A D and Maryam Shahmanesh A E F
+ Author Affiliations
- Author Affiliations

A Institute for Global Health, University College London, London, UK.

B Heath Economics Unit, University of Birmingham, Birmingham, UK.

C Wits RHI, Faculty of Health Sciences, University of Witwatersrand, Johannesburg, South Africa.

D Royal Free London NHS Foundation Trust, London, UK.

E Africa Health Research Institute, Durban, KwaZulu-Natal, South Africa.

F University of KwaZulu-Natal, Durban, KwaZulu-Natal, South Africa.

* Correspondence to: jo.gibbs@ucl.ac.uk

Handling Editor: Claudia Estcourt

Sexual Health - https://doi.org/10.1071/SH22068
Submitted: 15 April 2022  Accepted: 23 July 2022   Published online: 16 August 2022

© 2022 The Author(s) (or their employer(s)). Published by CSIRO Publishing. This is an open access article distributed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND)

Abstract

Digital health has become increasingly embedded within sexual health service delivery and is now an established part of the user journey. It can support the provision of information and access to care across the sexual health continuum and facilitate the delivery of differentiated care with tailored and layered interventions that meet an individual’s and target populations’ need. However, despite advances in digital health, many challenges remain in the measurement and evaluation of sexual health. Reaching underserved populations, ensuring that both the intervention and the outcomes being measured are appropriate, and consistent collection of data (across settings and over time) are all potential obstacles to a full realisation of these opportunities. In order for digital health to improve sexual health and wellbeing, and reduce morbidity, the following need to occur: (1) ensure the necessary digital, health care, laboratory, legal and regulatory and surveillance infrastructure is in place to provide access to those with a sexual health need; (2) empowerment of end users and communities to take control of their own health through engagement in the development of interventions, and to ensure that outcomes of importance are measured; (3) tailoring and layering of interventions to provide equitable access to care; (4) integrating the digital ecosystem with the existing healthcare and external ecosystem; (5) measure and evaluate the unmet needs, gaps and quality of the experience, taking a realist evaluation approach; and (6) measure and evaluate the economic and distributional impacts associated with digital services or interventions in sexual health.

Keywords: data, digital, health services, internet, online, public health, sexual health, STIs.


References

[1]  Arie S. Can mobile phones transform healthcare in low and middle income countries? BMJ 2015; 350 h1975
Can mobile phones transform healthcare in low and middle income countries?Crossref | GoogleScholarGoogle Scholar |

[2]  World Health Organization. Global strategy on digital health 2020-2025. World Health Organization; 2021.

[3]  Daher J, Vijh R, Linthwaite B, Dave S, Kim J, Dheda K, et al. Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996–2017). BMJ Open 2017; 7 e017604
Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996–2017).Crossref | GoogleScholarGoogle Scholar |

[4]  Cao B, Bao H, Oppong E, Feng S, Smith KM, Tucker JD, et al. Digital health for sexually transmitted infection and HIV services: a global scoping review. Curr Opin Infect Dis 2020; 33 44–50.
Digital health for sexually transmitted infection and HIV services: a global scoping review.Crossref | GoogleScholarGoogle Scholar |

[5]  Kickbusch I, Piselli D, Agrawal A, Balicer R, Banner O, Adelhardt M, et al. The Lancet and Financial Times Commission on governing health futures 2030: growing up in a digital world. The Lancet 2021; 398 1727–76.
The Lancet and Financial Times Commission on governing health futures 2030: growing up in a digital world.Crossref | GoogleScholarGoogle Scholar |

[6]  Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ 2013; 347 f6753
Implementation research: what it is and how to do it.Crossref | GoogleScholarGoogle Scholar |

[7]  Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ 2021; 374 n2061
A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance.Crossref | GoogleScholarGoogle Scholar |

[8]  Nederland A– SA. Stepped Care Model: framework for youth-centered sexual reproductive health and rights information and services. Nederland A– SA; 2021.

[9]  Mustanski B, Moskowitz DA, Moran KO, Newcomb ME, Macapagal K, Rodriguez-Díaz C, et al. Evaluation of a stepped-care eHealth HIV prevention program for diverse adolescent men who have sex with men: protocol for a hybrid type 1 effectiveness implementation trial of SMART. JMIR Res Protoc 2020; 9 e19701
Evaluation of a stepped-care eHealth HIV prevention program for diverse adolescent men who have sex with men: protocol for a hybrid type 1 effectiveness implementation trial of SMART.Crossref | GoogleScholarGoogle Scholar |

[10]  Fogarty International Center @ NIH. Toolkit Part 1: implementation science methodologies and frameworks. 2022. Available at https://www.fic.nih.gov/About/center-global-health-studies/neuroscience-implementation-toolkit/Pages/methodologies-frameworks.aspx. [cited 20 July 2022]

[11]  World Health Organization. Consolidated HIV strategic information guidelines: driving impact through programme monitoring and management. 2020. Available at https://www.who.int/publications/i/item/9789240000735. [cited 13 April 2022]

[12]  Estcourt CS, Gibbs J, Sutcliffe LJ, Gkatzidou V, Tickle L, Hone K, et al. The eSexual Health Clinic system for management, prevention, and control of sexually transmitted infections: exploratory studies in people testing for Chlamydia trachomatis. Lancet Public Health 2017; 2 e182–90.
The eSexual Health Clinic system for management, prevention, and control of sexually transmitted infections: exploratory studies in people testing for Chlamydia trachomatis.Crossref | GoogleScholarGoogle Scholar |

[13]  Turbé V, Herbst C, Mngomezulu T, Meshkinfamfard S, Dlamini N, Mhlongo T, et al. Deep learning of HIV field-based rapid tests. Nat Med 2021; 27 1165–70.
Deep learning of HIV field-based rapid tests.Crossref | GoogleScholarGoogle Scholar |

[14]  Mathenjwa T, Adeagbo O, Zuma T, Dikgale K, Zeitlin A, Matthews P, et al. Development and acceptability of a tablet-based app to support men to link to HIV care: mixed methods approach. JMIR Mhealth Uhealth 2020; 8 e17549
Development and acceptability of a tablet-based app to support men to link to HIV care: mixed methods approach.Crossref | GoogleScholarGoogle Scholar |

[15]  Health Level Seven International. About HL7. 2022. Available at https://www.hl7.org/about/index.cfm?ref=nav. [cited 13 April 2022]

[16]  Nguyen K-H, Wright C, Simpson D, Woods L, Comans T, Sullivan C. Economic evaluation and analyses of hospital-based electronic medical records (EMRs): a scoping review of international literature. npj Digit Med 2022; 5 29
Economic evaluation and analyses of hospital-based electronic medical records (EMRs): a scoping review of international literature.Crossref | GoogleScholarGoogle Scholar |

[17]  Turner KME, Looker KJ, Syred J, Zienkiewicz A, Baraitser P. Online testing for sexually transmitted infections: a whole systems approach to predicting value. PLoS One 2019; 14 e0212420
Online testing for sexually transmitted infections: a whole systems approach to predicting value.Crossref | GoogleScholarGoogle Scholar |

[18]  Turner KME, Zienkiewicz AK, Syred J, Looker KJ, de Sa J, Brady M, et al. Web-based activity within a sexual health economy: observational study. J Med Internet Res 2018; 20 e74
Web-based activity within a sexual health economy: observational study.Crossref | GoogleScholarGoogle Scholar |

[19]  USAID; PEPFAR. Going virtual for provider PrEP training. PEPFAR Training Webinar, June 25th 2020. Available at https://www.prepwatch.org/wp-content/uploads/2020/06/June25_2020_PrEPLearningNetwork_GoingVirtualProviderTraining.pdf

[20]  Gibbs A, Gumede D, Luthuli M, Xulu Z, Washington L, Sikweyiya Y, et al. Opportunities for technologically driven dialogical health communication for participatory interventions: perspectives from male peer navigators in rural South Africa. Soc Sci Med 2022; 292 114539
Opportunities for technologically driven dialogical health communication for participatory interventions: perspectives from male peer navigators in rural South Africa.Crossref | GoogleScholarGoogle Scholar |

[21]  Zuma T, King R, Ngwenya N, Kasujja FX, Chimbindi N, Kawuma R, et al. Lives interrupted: navigating hardship during COVID-19 provides lessons in solidarity and visibility for mobile young people in South Africa and Uganda. Prog Dev Stud 2021; 21 419–34.
Lives interrupted: navigating hardship during COVID-19 provides lessons in solidarity and visibility for mobile young people in South Africa and Uganda.Crossref | GoogleScholarGoogle Scholar |

[22]  Rahimi K. Digital health and the elusive quest for cost savings. Lancet Digit Health 2019; 1 e108–9.
Digital health and the elusive quest for cost savings.Crossref | GoogleScholarGoogle Scholar |

[23]  Fagerlund AJ, Holm IM, Zanaboni P. General practitioners’ perceptions towards the use of digital health services for citizens in primary care: a qualitative interview study. BMJ Open 2019; 9 e028251
General practitioners’ perceptions towards the use of digital health services for citizens in primary care: a qualitative interview study.Crossref | GoogleScholarGoogle Scholar |

[24]  Reback CJ, Fletcher JB, Leibowitz AA. Cost effectiveness of text messages to reduce methamphetamine use and HIV sexual risk behaviors among men who have sex with men. J Subst Abuse Treat 2019; 100 59–63.
Cost effectiveness of text messages to reduce methamphetamine use and HIV sexual risk behaviors among men who have sex with men.Crossref | GoogleScholarGoogle Scholar |

[25]  Ouedraogo L, Nkurunziza T, Muriithi A, Asmani C, Elamin H, Zan S, et al. Research priorities for mHealth and innovative strategies in sexual and reproductive health and rights in the WHO Africa Region. Adv Reprod Sci 2021; 9 33–40.
Research priorities for mHealth and innovative strategies in sexual and reproductive health and rights in the WHO Africa Region.Crossref | GoogleScholarGoogle Scholar |

[26]  Charron J, Troude P, de La Rochebrochard E, Segouin C, Piron P. Notification of STI test results by text messaging: why do patients refuse? Cross-sectional study in a Parisian sexual health centre. Int J STD AIDS 2022; 33 257–64.
Notification of STI test results by text messaging: why do patients refuse? Cross-sectional study in a Parisian sexual health centre.Crossref | GoogleScholarGoogle Scholar |

[27]  Deb P, Norton EC. Modeling health care expenditures and use. Annu Rev Public Health 2018; 39 489–505.
Modeling health care expenditures and use.Crossref | GoogleScholarGoogle Scholar |

[28]  Friends Families and Travellers. Digital Exclusion in Gypsy and Traveller communities in the United Kingdom. Friends Families and Travellers; 2018.

[29]  Cooper J. The digital divide: the special case of gender. J Comput Assist Learn 2006; 22 320–34.
The digital divide: the special case of gender.Crossref | GoogleScholarGoogle Scholar |

[30]  Social Mobility Commission. State of the nation 2021: social mobility and the pandemic. 2021. Available at https://www.gov.uk/government/publications/state-of-the-nation-2021-social-mobility-and-the-pandemic. [cited 13 April 2022]

[31]  GSMA. The state of mobile internet connectivity report 2021 - the mobile economy. GSMA; 2021. Available at https://www.gsma.com/r/somic/. [cited 13 April 2022]

[32]  Robinson KE, Kersey JA. Novel electronic health record (EHR) education intervention in large healthcare organization improves quality, efficiency, time, and impact on burnout. Medicine 2018; 97 e12319
Novel electronic health record (EHR) education intervention in large healthcare organization improves quality, efficiency, time, and impact on burnout.Crossref | GoogleScholarGoogle Scholar |

[33]  Tideman RL, Chen MY, Pitts MK, Ginige S, Slaney M, Fairley CK. A randomised controlled trial comparing computer-assisted with face-to-face sexual history taking in a clinical setting. Sex Transm Infect 2007; 83 52–6.
A randomised controlled trial comparing computer-assisted with face-to-face sexual history taking in a clinical setting.Crossref | GoogleScholarGoogle Scholar |

[34]  Richens J, Copas A, Sadiq ST, Kingori P, McCarthy O, Jones V, et al. A randomised controlled trial of computer-assisted interviewing in sexual health clinics. Sex Trans Infect 2010; 86 310–4.
A randomised controlled trial of computer-assisted interviewing in sexual health clinics.Crossref | GoogleScholarGoogle Scholar |

[35]  Lim MSC, Hocking JS, Hellard ME, Aitken CK. SMS STI: a review of the uses of mobile phone text messaging in sexual health. Int J STD AIDS 2008; 19 287–90.
SMS STI: a review of the uses of mobile phone text messaging in sexual health.Crossref | GoogleScholarGoogle Scholar |

[36]  Erens B, Phelps A, Clifton S, Hussey D, Mercer CH, Tanton C, et al. National Survey of Sexual Attitudes and Lifestyles 3 - technical report. Natsal; 2013.

[37]  Spence T, Kander I, Walsh J, Griffiths F, Ross J. Perceptions and experiences of internet-based testing for sexually transmitted infections: systematic review and synthesis of qualitative research. J Med Internet Res 2020; 22 e17667
Perceptions and experiences of internet-based testing for sexually transmitted infections: systematic review and synthesis of qualitative research.Crossref | GoogleScholarGoogle Scholar |

[38]  Public Health Scotland. Reset and rebuild - sexual health and blood borne virus services: recovery plan. 2021. Available at https://www.gov.scot/publications/reset-rebuild-recovery-plan-sexual-health-blood-borne-virus-services/pages/2/. [cited 13 Apr 2022]

[39]  Bill and Melinda Gates Foundation. Methods for economic evaluation project: final report. Bill and Melinda Gates Foundation Methods for Economic Evaluation Project (MEEP); 2014.

[40]  Edwards RT, McIntosh EDG. Applied health economics for public health practice and research. Oxford University Press; 2019.

[41]  Bailey J, Mann S, Wayal S, Hunter R, Free C, Abraham C, et al. Sexual health promotion for young people delivered via digital media: a scoping review. Public Health Res 2015; 3 1–120.
Sexual health promotion for young people delivered via digital media: a scoping review.Crossref | GoogleScholarGoogle Scholar |

[42]  McNamee P, Murray E, Kelly MP, Bojke L, Chilcott J, Fischer A, et al. Designing and undertaking a health economics study of digital health interventions. Am J Prev Med 2016; 51 852–60.
Designing and undertaking a health economics study of digital health interventions.Crossref | GoogleScholarGoogle Scholar |

[43]  Tate DF, Finkelstein EA, Khavjou O, Gustafson A. Cost effectiveness of internet interventions: review and recommendations. Ann Behav Med 2009; 38 40–5.
Cost effectiveness of internet interventions: review and recommendations.Crossref | GoogleScholarGoogle Scholar |

[44]  Public Health England. GUMCAD STI surveillance system: data specification and technical guidance. Public Health England; 2020.

[45]  GOV.UK. CTAD chlamydia surveillance system. 2022. Available at https://www.gov.uk/guidance/ctad-chlamydia-surveillance-system. [cited 11 February 2021]

[46]  Causer L, Liu B, Watts C, McManus H, Donovan B, Ward J, et al. Hospitalisations for pelvic inflammatory disease in young Aboriginal women living in remote Australia: the role of chlamydia and gonorrhoea. Sex Transm Infect 2021;
Hospitalisations for pelvic inflammatory disease in young Aboriginal women living in remote Australia: the role of chlamydia and gonorrhoea.Crossref | GoogleScholarGoogle Scholar |

[47]  Gibbs J, Clifton S, Sonnenberg P, Blandford A, Johnson AM, Estcourt CS. Legislation and regulation in the era of online sexual health: how do we ensure provision of safe, high-quality care? Sex Transm Infect 2018; 94 550–1.
Legislation and regulation in the era of online sexual health: how do we ensure provision of safe, high-quality care?Crossref | GoogleScholarGoogle Scholar |

[48]  Krakower DS, Gruber S, Hsu K, Menchaca JT, Maro JC, Kruskal BA, et al. Development and validation of an automated HIV prediction algorithm to identify candidates for pre-exposure prophylaxis: a modelling study. Lancet HIV 2019; 6 e696–704.
Development and validation of an automated HIV prediction algorithm to identify candidates for pre-exposure prophylaxis: a modelling study.Crossref | GoogleScholarGoogle Scholar |

[49]  Marcus JL, Sewell WC, Balzer LB, Krakower DS. Artificial intelligence and machine learning for HIV prevention: emerging approaches to ending the epidemic. Curr HIV/AIDS Rep 2020; 17 171–9.
Artificial intelligence and machine learning for HIV prevention: emerging approaches to ending the epidemic.Crossref | GoogleScholarGoogle Scholar |

[50]  Keddy KH, Saha S, Kariuki S, Kalule JB, Qamar FN, Haq Z, et al. Using big data and mobile health to manage diarrhoeal disease in children in low-income and middle-income countries: societal barriers and ethical implications. Lancet Infect Dis 2021; 22 e130–42.
Using big data and mobile health to manage diarrhoeal disease in children in low-income and middle-income countries: societal barriers and ethical implications.Crossref | GoogleScholarGoogle Scholar |

[51]  Smith S, Connolly S. Re-thinking unmet need for health care: introducing a dynamic perspective. Health Econ Policy Law 2020; 15 440–57.
Re-thinking unmet need for health care: introducing a dynamic perspective.Crossref | GoogleScholarGoogle Scholar |

[52]  Edwards RT, Charles JM, Lloyd-Williams H. Public health economics: a systematic review of guidance for the economic evaluation of public health interventions and discussion of key methodological issues. BMC Public Health 2013; 13 1001
Public health economics: a systematic review of guidance for the economic evaluation of public health interventions and discussion of key methodological issues.Crossref | GoogleScholarGoogle Scholar |

[53]  Labrique AB, Wadhwani C, Williams KA, Lamptey P, Hesp C, Luk R, et al. Best practices in scaling digital health in low and middle income countries. Global Health 2018; 14 103
Best practices in scaling digital health in low and middle income countries.Crossref | GoogleScholarGoogle Scholar |

[54]  Delany-Moretlwe S, Mullick S, Eakle R, Rees H. Planning for HIV preexposure prophylaxis introduction: lessons learned from contraception. Curr Opin HIV AIDS 2016; 11 87–93.
Planning for HIV preexposure prophylaxis introduction: lessons learned from contraception.Crossref | GoogleScholarGoogle Scholar |

[55]  Colombini M, Scorgie F, Stangl A, Harvey S, Ramskin L, Khoza N, et al. Exploring the feasibility and acceptability of integrating screening for gender-based violence into HIV counselling and testing for adolescent girls and young women in Tanzania and South Africa. BMC Public Health 2021; 21 433
Exploring the feasibility and acceptability of integrating screening for gender-based violence into HIV counselling and testing for adolescent girls and young women in Tanzania and South Africa.Crossref | GoogleScholarGoogle Scholar |

[56]  Pawson R, Tilley N. Realistic evaluation. Sage; 1997. pp. 235.

[57]  Dukhanin V, Searle A, Zwerling A, Dowdy DW, Taylor HA, Merritt MW. Integrating social justice concerns into economic evaluation for healthcare and public health: a systematic review. Soc Sci Med 2018; 198 27–35.
Integrating social justice concerns into economic evaluation for healthcare and public health: a systematic review.Crossref | GoogleScholarGoogle Scholar |

[58]  Collins B, Kypridemos C, Cookson R, Parvulescu P, McHale P, Guzman-Castillo M, et al. Universal or targeted cardiovascular screening? Modelling study using a sector-specific distributional cost effectiveness analysis. Prev Med 2020; 130 105879
Universal or targeted cardiovascular screening? Modelling study using a sector-specific distributional cost effectiveness analysis.Crossref | GoogleScholarGoogle Scholar |