Evaluating environment cleanliness using two approaches: a multi-centred Australian studyBrett G. Mitchell A B D , Fiona Wilson C and Anne Wells C
A Faculty of Arts, Nursing and Theology, Avondale College of Higher Education, Wahroonga, NSW 2076, Australia.
B School of Nursing, Midwifery and Paramedicine, Australian Catholic University, Dickson, ACT 2602, Australia.
C Tasmanian Infection Prevention and Control Unit, Public Health Services, Department of Health and Human Services, Hobart, Tas. 7000, Australia.
D Corresponding author. Email: firstname.lastname@example.org
Healthcare Infection 20(4) 95-100 https://doi.org/10.1071/HI15009
Submitted: 15 April 2015 Accepted: 10 June 2015 Published: 29 June 2015
Introduction: A standardised approach to evaluating environmental cleanliness is important to ensure consistency of assessor training, allow benchmarking of results between facilities, ensure consistency of the assessment of the environment and assist in meeting national accreditation standards. This paper describes the development process and the findings of the first 12 months of data following the introduction of a standardised program for evaluating environmental cleanliness within Tasmanian healthcare facilities using two different evaluation methods.
Methods: Evaluation of environmental cleanliness was undertaken as part of a structured program and involved the use of an ultraviolet solution and fluorescent light in addition to a visual assessment. Twelve Tasmanian hospitals participated in this study.
Results: A total of 290 fluorescent light assessments and 232 visual inspections were conducted. Using the fluorescent light assessment, the percentage of correctly cleaned items increased from a baseline of 82.3% to 85.4% over the 12-month study period. Using the visual assessment, 92.5% of items were deemed acceptable during the study period.
Conclusions: Our multi-centred study identified a high baseline level of cleanliness using a fluorescent light. We identified that objects were frequently deemed to be visually acceptable, yet may not have been cleaned. The project was supported by a range of online tools for data submission, training tools and a formal assessment of auditors.
Visual cleanliness assessment may overestimate the level of environmental cleanliness.
A structured approach, supported by resources, is required to evaluate environmental cleanliness.
Evidence demonstrates that the environment plays an important part in the transmission of healthcare-associated infection,1–4 thus environmental hygiene plays a critical role in an infection prevention and control program.5–8 An environmental cleaning program and subsequent assessment (or surveillance) of cleanliness is an integral part of an infection control program, with the goal of ensuring a healthcare environment that is both aesthetically acceptable and has a reduced bioburden.5,9,10
The Tasmanian Infection Prevention and Control Unit (TIPCU) published a report in 2012 on the methodologies used locally, nationally and internationally for assessing environmental cleanliness within healthcare.11 There are two major methods of assessing the cleanliness of the healthcare environment: (1) process evaluation which evaluates the cleaning process itself and includes visual inspection and fluorescent gel and light assessment; and (2) outcome evaluation which evaluates microbial burden post-cleaning and involves the use of adenosine triphosphate (ATP) or microbial cultures. In Australia, visual assessment is commonly recommended and used as the primary method to assess environmental cleanliness. Visual assessment is also used overseas, for example in the United Kingdom.11
The findings of this report were presented to a meeting of Tasmanian stakeholders where there was a decision made that TIPCU would devise and assist in the implementation of an environmental assessment program for use within Tasmanian healthcare facilities. The consensus was that the program would be used across Tasmania in a variety of healthcare settings and would be performed in a standardised manner, by trained assessors using the two process measures identified – visual assessment and fluorescent gel assessments. These methods were chosen due to cost and ease of use. A standardised approach was important to ensure consistency of assessor training, allow benchmarking of results between facilities, ensure consistency of the actual assessment of environmental hygiene, and assist in meeting national accreditation standards, specifically Standard 3 (Preventing and Controlling Healthcare-Associated Infection) of the National Safety and Quality Health Service Standards.12
This paper describes the development process and the findings of the first 12 months of data following the introduction of a standardised program for evaluating environmental cleanliness within Tasmanian healthcare facilities using two different evaluation methods.
The standardised method to evaluate environmental cleanliness included the development of a highly structured protocol outlining the methodology for two types of assessment. The protocol included which environmental sites should be assessed, when to assess, who can assess and data entry requirements. The program also included a standardised online education training program for assessors, an online data entry tool, online resources and a ‘Frequently asked questions’ brochure.11
The four larger Tasmanian public hospitals were invited to participate in a 4-week pilot study to assess the usability and acceptability of the program. Both quantitative and qualitative feedback were sought with the majority of feedback received being positive about the protocol, education and processes. Amendments based on the pilot feedback were made to both the protocol and data collection tool.
All Tasmanian public and private hospitals were invited to participate in the program. Invitations were disseminated via email and in person when the opportunity arose. Although voluntary, participation required a hospital executive board member, the manager of environmental services and the manager of the infection prevention and control unit to all formally agree to the hospital’s participation in the program. Twelve Tasmanian hospitals participated in the program. The hospitals ranged from rural hospitals to large public and privately funded hospitals.
The evaluation of environmental cleanliness involved two elements: the use of an ultraviolet (UV) solution with fluorescent light assessments conducted quarterly in patient care areas that had undergone discharge cleans, and a visual assessment conducted at least quarterly in both patient care and general ward areas. Cleaning in participating hospitals was undertaken by cleaning staff employed by the hospital.
The UV solution and light method (Ecolab® DAZO®) involved the application of the UV solution to up to eight high-touch surfaces in patient care areas by an auditor. The solution was allowed to dry before cleaning was undertaken. As the gel is easily removed with light abrasion, an evaluation was conducted post-discharge cleaning using a UV light to determine whether the surface had been cleaned correctly. Numerous studies have shown that this procedure improves cleaning practices.13–17 The UV solution was only applied to rooms or patient care areas that were undergoing discharge cleans. The rationale for this was twofold. First, evidence suggests that prior room occupancy is a risk factor for acquisition of infectious agents.18–20 Second, the assessment is easier to implement in rooms where patients are no longer present. The objects in patient care areas to which the UV gel can be applied vary in the literature. In our study, the gel was applied to one of the sites detailed in Table 1 in each patient care area. These sites were determined following a review of the literature, the suitability of previously documented sites in the Australian hospital context and consultation with infection control professionals in Tasmania.13–15,17,21 Once a clean had been completed, the auditor returned to determine which sites had been cleaned. If any level of fluorescence was present, then it was determined that the object had not been cleaned.
Visual assessments were conducted to determine cleanliness in all areas of the hospital. These assessments were developed following a review of approaches taken in two Australian states and current practices in Tasmania.11,22,23 To allow flexibility and clarity regarding specific items, two different visual assessment tools were used in this study. The two visual areas were defined by the location in which the assessments were undertaken – the patient care areas and the general ward areas. These two areas were clearly detailed for the auditors and were specifically chosen to ensure consistency with the approaches taken in New South Wales,22 Victoria23and existing practices in Tasmania.21,24 Additionally, some sites were more specific to allow comparisons between the visual assessments and fluorescent gel method. The assessed areas were deemed ‘clean’ or ‘not clean’ based on the descriptors provided to the auditors.
To improve inter-rater reliability, only auditors who had received training and successfully completed an online exam were able to undertake assessments. The exam was developed by two experienced, credentialed Clinical Nurse Consultants. Questions in the exam related to key points of the program, including determining whether a site was clean and when to conduct assessments. To assist, the TIPCU developed training tools, including a PowerPoint presentation, videos, a quiz and a protocol.11 Training was also provided by the TIPCU to hospital hotel service managers and supervisors, as well as infection control staff. The TIPCU maintained the list of auditors and was thus able to readily communicate any changes in the processes. Figure 1 summarises the data collection methods and project.
Using an iPad or smartphone, the results of each auditor assessment were entered directly into an online database specifically designed for this process (Fig. 2). The assessments were undertaken quarterly, and the required number of assessed patient care areas was dependent on the number of beds in the hospital, equating to ~10% of hospital beds.
Patient care area: the space temporarily dedicated to an individual patient for that patient’s stay. In this study, these areas comprised inpatient bed areas, including isolation rooms, patient bays, paediatric cots and neonatal incubators and/or cots, emergency departments (where assessment or treatment is undertaken), theatres and outpatient clinics.
General ward area: an area where the assessment or treatment of patients does not occur directly. In this study, these areas comprised ward corridors, nurses’ stations, sterile stockrooms, equipment rooms and toilets, showers and bathrooms that were located off ward corridors.
The data were imported into IBM SPSS version 21.0 (IBM) for analysis. The aggregated data from the participating sites were analysed – the individual hospital results are not presented, as agreed by the participating organisations. A comparison of the variables was undertaken using independent t- tests, and the nonparametric independent data were compared using the Mann–Whitney U test. The mean percentage and 95% confidence intervals (CIs) of items deemed to be cleaned were calculated using Poisson distribution. Analysis of variance was performed to compare the differences between the variable mean scores.
Approval for this study was granted by the Tasmanian Human Research Ethics Committee.
Two Tasmanian health organisations responsible for public hospitals in two geographic regions in Tasmania and one private hospital participated in this study, equating to 12 individual hospitals. There are 25 hospitals in Tasmania. The number of overnight beds in the participating hospitals ranged from 20 to 280 beds.
A total of 290 fluorescent light assessments and 232 visual inspections were undertaken in the first 12 months of this study. Using the fluorescent light method, 1668 individual objects were assessed. The percentage of correctly cleaned items increased from 82.3% (95% CI, 78.7–85.5%) to 85.4% (95% CI, 82.4–88.0%) over the study period, with an overall average of 82.8% (95% CI, 78.8–86.2%). Figure 3 illustrates the trend data for the proportion of items deemed correctly cleaned over the 12-month period. Using the visual assessment method, 92.5% of items were determined to be acceptable during the course of the study with no overall trend during the study period. Table 2 lists the individual items that were assessed using both methods.
For the eight most frequently touched objects, the fluorescent light assessments indicated 82.8% (95% CI, 78.9–86.9%) were cleaned to an acceptable level compared with 95.9% (95% CI, 89.3–95.8%) for the visual inspection audits (P < 0.01).
Of the 290 fluorescent light assessments, 62 (21.3%) were done in rooms where the occupant was under transmission-based precautions. There was no significant difference in the proportion of individual items cleaned correctly when comparing rooms where the occupants were under transmission-based precautions with those where the occupants were not under transmission-based precautions.
Our study differed from other published works in this area as it used and compared a combination of UV gel assessments and visual assessments to assess environmental hygiene. Furthermore, we found a higher baseline level of cleanliness using the fluorescent light method than previously documented in the literature. We also assessed several high-touch sites using both visual inspections and fluorescent light assessments. The project was supported by training tools, the formal assessment of auditors and a range of online tools for data submission.
In an Australian study undertaken by Murphy et al. the authors evaluated fluorescent markings, education and feedback to assess and improve cleaning in an Australian inpatient hospital setting.17 The baseline data in this study were 34%, increasing to 53.5% before declining to 41%.17 The baseline data in our study were considerably higher than the data of this and other studies.13,15 Possible explanations for this include some minor differences in the physical locations of where the fluorescent gel was applied, the educational awareness campaign that commenced at the start of our study and our focus on discharge cleans. The locations of the gel applications were decided after reviewing the literature and their applicability to the Australian healthcare context, including public and private hospitals.13–15,21 In addition to site inspections, a survey of infection control professionals and cleaning staff in Tasmania was conducted to ensure these locations were sufficiently similar between different institutions.
The education awareness campaign we undertook was in part to ‘sell’ the study to environmental health services staff and managers. Both the importance of cleaning and the findings of existing research were explained in various settings, including at staff meetings, during staff training and informally with staff in causal settings. This may have had the desired effect of increasing awareness about cleaning before the study commenced, with follow-on positive effects on cleaning performance. It is also worth noting the high proportion of objects cleaned correctly, as assessed by the fluorescent light method, remained high and improved further over the 12-month study period.
Unlike other studies, we focused on discharge cleans only. The rationale for this decision included the availability of resources at the time, namely the fluorescent gel and lights, the availability of staff with competing interests and evidence suggesting the important role that prior room occupancy may have on future infection acquisition.25–28 From a risk assessment perspective, we deemed discharge cleans an area of priority. We did not covertly assess cleaning. The decision on which rooms would be assessed was determined by the environmental cleaning supervisors, often in conjunction with infection control professionals. Cleaners were not informed that the rooms would be assessed, but as the assessments were not undertaken in a covert manner, it is possible that cleaners were aware that assessments were taking place. This is a potential limitation from a methodological perspective; however, the end result was to improve cleaning standards and, if this limitation contributed to that, it could be argued that it was a successful approach.
In this study, we were able to compare the cleanliness of objects with a fluorescent light against what would have been deemed visually acceptable. Objects were frequently considered to be visually acceptable yet may not have been cleaned. Although obvious, this provides evidence that because something is visually clean, it does not necessarily mean it was actually cleaned. A formal study evaluating correlations between visual inspections, the fluorescent light method and other measures of environmental cleanliness, such as ATP detection, is required.29,30
Our study had several strengths. We employed methods to improve inter-rater reliability through a formal auditor assessment process. Our study was also conducted over a 12-month period at 12 different hospitals. It was supported by bedside online data entry methods using iPads and smartphones, and real-time reporting, which enabled immediate feedback to staff and the option for hospitals to access their own data. The participating hospitals were each given an iPad to assist with data entry. A dedicated webpage was developed to provide access to resources, including a manual and videos. Although difficult to quantify, we observed a tangible sense of enthusiasm from environmental health services staff. They were interested in this project and improving patient safety and we believe it could lead to greater collaboration between infection prevention and control and environmental services. In some hospitals, this project appeared to improve collegiality and communication between infection control professionals and environmental health services. The use of a collaborative or ‘bundled’ approach to environmental cleanliness is one area that could be explored in future research.
Our multi-centre study identified a higher baseline level of cleanliness using the fluorescent light method than previously documented in the literature. We also assessed several high-touch sites using both visual inspection and fluorescent light assessments. Objects were frequently deemed to be visually acceptable yet may not have been cleaned. The auditors in our study were required to complete a formal assessment process and were supported by a range of resources.
Conflicts of interest
One of the authors of this paper has an editorial affiliation with the journal. The author played no role in the peer review or decision rendering process.
No funding was received in relation to this study.
The authors acknowledge the auditors involved in data collection in addition to the environmental services, infection prevention and control teams and Executives of participating hospitals.
References Barker J, Vipond IB, Bloomfield SF. Effects of cleaning and disinfection in reducing the spread of Norovirus contamination via environmental surfaces. J Hosp Infect 2004; 58 42–9.
| Effects of cleaning and disinfection in reducing the spread of Norovirus contamination via environmental surfaces.CrossRef | 1:STN:280:DC%2BD2cvktlKisA%3D%3D&md5=ac49c73e8b2ca9ff090485b75acc0129CAS | 15350713PubMed |
 Boyce JM. Environmental contamination makes an important contribution to hospital infection. J Hosp Infect 2007; 65 50–4.
| Environmental contamination makes an important contribution to hospital infection.CrossRef | 17540242PubMed |
 Kramer A, Schwebke I, Kampf G. How long do nosocomial pathogens persist on inanimate surfaces? A systematic review. BMC Infect Dis 2006; 6 130
| How long do nosocomial pathogens persist on inanimate surfaces? A systematic review.CrossRef | 16914034PubMed |
 Wagenvoort JH, De Brauwer EI, Penders RJ, Willems RJ, Top J, Bonten MJ. Environmental survival of vancomycin-resistant Enterococcus faecium. J Hosp Infect 2011; 77 282–3.
| Environmental survival of vancomycin-resistant Enterococcus faecium.CrossRef | 1:STN:280:DC%2BC3M3itVKktA%3D%3D&md5=5f7f81433388ccafa7c504c0ffe30dd5CAS | 21288596PubMed |
 Dancer SJ. The role of environmental cleaning in the control of hospital-acquired infection. J Hosp Infect 2009; 73 378–85.
| The role of environmental cleaning in the control of hospital-acquired infection.CrossRef | 1:STN:280:DC%2BD1MjmsFOqsQ%3D%3D&md5=a49d00bbbf5108a938db0f485d235c3dCAS | 19726106PubMed |
 Dancer SJ. Hospital cleaning in the 21st century. Eur J Clin Microbiol Infect Dis 2011; 30 1473–81.
| Hospital cleaning in the 21st century.CrossRef | 1:STN:280:DC%2BC3MbnslOlug%3D%3D&md5=8c3d4d7211d7f4b567b248d30603d5f3CAS | 21499954PubMed |
 Dancer SJ, White LF, Lamb J, Girvan EK, Robertson C. Measuring the effect of enhanced cleaning in a UK hospital: a prospective cross-over study. BMC Med 2009; 7 28
| Measuring the effect of enhanced cleaning in a UK hospital: a prospective cross-over study.CrossRef | 19505316PubMed |
 Griffith CJ, Obee P, Cooper RA, Burton NF, Lewis M. The effectiveness of existing and modified cleaning regimens in a Welsh hospital. J Hosp Infect 2007; 66 352–9.
| The effectiveness of existing and modified cleaning regimens in a Welsh hospital.CrossRef | 1:STN:280:DC%2BD2svnvFGgtg%3D%3D&md5=700551034c94b6fdd52bdc75a185951aCAS | 17655976PubMed |
 Mitchell BG, Gardner A. Addressing the need for an infection prevention and control framework that incorporates the role of surveillance: a discussion paper. J Adv Nurs 2014; 70 533–42.
| Addressing the need for an infection prevention and control framework that incorporates the role of surveillance: a discussion paper.CrossRef | 23789617PubMed |
 Seto WH, Otaíza F, Pessoa Silva CL. Core components for infection prevention and control programs: a World Health Organization network report. Infect Control Hosp Epidemiol 2010; 31 948–50.
| Core components for infection prevention and control programs: a World Health Organization network report.CrossRef | 20636135PubMed |
 Tasmanian Infection Prevention and Control Unit. Evaluating Environmental Cleanliness 2014; Available at http://www.dhhs.tas.gov.au/publichealth/communicable_diseases_prevention_unit/tasmanian_infection_prevention_and_control_unit/evaluating_ environmental_cleanliness [Verified November 2014]
 Australian Commission on Safety and Quality in Health Care. National Safety and Quality Health Service Standards. Sydney: Australian Commission on Safety and Quality in Health Care; 2011.
 Carling PC, Briggs J, Hylander D, Perkins J. An evaluation of patient area cleaning in 3 hospitals using a novel targeting methodology. Am J Infect Control 2006; 34 513–9.
| An evaluation of patient area cleaning in 3 hospitals using a novel targeting methodology.CrossRef | 17015157PubMed |
 Carling PC, Briggs JL, Perkins J, Highlander D. Improved cleaning of patient rooms using a new targeting method. Clin Infect Dis 2006; 42 385–8.
| 16392086PubMed |
 Carling PC, Parry MF, Bruno-Murtha LA, Dick B. Improving environmental hygiene in 27 intensive care units to decrease multidrug-resistant bacterial transmission. Crit Care Med 2010; 38 1054–9.
| Improving environmental hygiene in 27 intensive care units to decrease multidrug-resistant bacterial transmission.CrossRef | 20081531PubMed |
 Goodman ER, Platt R, Bass R, Onderdonk AB, Yokoe DS, Huang SS. Impact of an environmental cleaning intervention on the presence of methicillin-resistant Staphylococcus aureus and vancomycin-resistant enterococci on surfaces in intensive care unit rooms. Infect Control Hosp Epidemiol 2008; 29 593–9.
| Impact of an environmental cleaning intervention on the presence of methicillin-resistant Staphylococcus aureus and vancomycin-resistant enterococci on surfaces in intensive care unit rooms.CrossRef | 18624666PubMed |
 Murphy CL, Macbeth DA, Derrington P, Gerrard J, Faloon J, Kenway K, Lavender S, Leonard S, Orr A, Tobin D, Carling P. An assessment of high touch object cleaning thoroughness using a fluorescent marker in two Australian hospitals. Healthc Infect 2011; 16 156–63.
| An assessment of high touch object cleaning thoroughness using a fluorescent marker in two Australian hospitals.CrossRef |
 Bonten MJ, Slaughter S, Ambergen AW, Hayden MK, van Voorhis J, Nathan C, Weinstein RA. The role of ‘colonization pressure’ in the spread of vancomycin-resistant enterococci: an important infection control variable. Arch Intern Med 1998; 158 1127–32.
| The role of ‘colonization pressure’ in the spread of vancomycin-resistant enterococci: an important infection control variable.CrossRef | 1:STN:280:DyaK1c3ms1yhsA%3D%3D&md5=61c0be59040d119af8ef35214ee5a06dCAS | 9605785PubMed |
 Eveillard M, Lancien E, Hidri N, Barnaud G, Gaba S, Benlolo JA, Joly-Guillou ML. Estimation of methicillin-resistant Staphylococcus aureus transmission by considering colonization pressure at the time of hospital admission. J Hosp Infect 2005; 60 27–31.
| Estimation of methicillin-resistant Staphylococcus aureus transmission by considering colonization pressure at the time of hospital admission.CrossRef | 1:STN:280:DC%2BD2M7ptV2ksg%3D%3D&md5=01d89cc43750b51b909908216e574338CAS | 15823653PubMed |
 Merrer J, Santoli F, Appere de Vecchi C, Tran B, De Jonghe B, Outin H. “Colonization pressure” and risk of acquisition of methicillin-resistant Staphylococcus aureus in a medical intensive care unit. Infect Control Hosp Epidemiol 2000; 21 718–23.
| “Colonization pressure” and risk of acquisition of methicillin-resistant Staphylococcus aureus in a medical intensive care unit.CrossRef | 1:STN:280:DC%2BD3M7js1answ%3D%3D&md5=0487ed8c6a74fb3f16b5c6d58ab74d1aCAS | 11089656PubMed |
 Mitchell B, Wilson F, Ware C, Brown S, McGregor A, Dancer SJ. Evaluating environmental cleanliness in hospitals and other healthcare settings. What are the most effective and efficient methods to use? Hobart: Department of Health and Human Services; 2012.
 Clinical Excellence Commission. Environmental Cleaning Policy. Sydney: NSW Ministry of Health; 2012.
 Quality Safety and Patient Experience Branch. 2011. Department of Health. Cleaning standards for Victorian health facilities.
 Mitchell B, Wilson F, McGregor A, Dancer S. Methods to evaluate environmental cleanliness in healthcare facilities. Healthc Infect 2013; 18 23–30.
| Methods to evaluate environmental cleanliness in healthcare facilities.CrossRef |
 Huang YC, Lee CY, Su LH, Chang LY, Lin TY. Methicillin-resistant Staphylococcus aureus bacteremia in neonatal intensive care units: genotyping analysis and case-control study. Acta Paediatrica Taiwanica 2005; 46 156–60.
| 16231563PubMed |
 Mitchell BG, Digney W, Ferguson JK. Prior room occupancy increases risk of methicillin-resistant Staphylococcus aureus acquisition. Healthc Infect 2014; 19 135–40.
| Prior room occupancy increases risk of methicillin-resistant Staphylococcus aureus acquisition.CrossRef |
 Nseir S, Blazejewski C, Lubret R, Wallet F, Courcol R, Durocher A. Risk of acquiring multidrug-resistant Gram-negative bacilli from prior room occupants in the intensive care unit. Clin Microbiol Infect 2011; 17 1201–8.
| Risk of acquiring multidrug-resistant Gram-negative bacilli from prior room occupants in the intensive care unit.CrossRef | 1:STN:280:DC%2BC3Mjgt1Cmuw%3D%3D&md5=a590dd41ffc59c751cf64cb9526e9baaCAS | 21054665PubMed |
 Otter JA. How do we tackle contaminated hospital surfaces? Healthc Infect 2013; 18 42–4.
| How do we tackle contaminated hospital surfaces?CrossRef |
 Smith PW, Sayles H, Hewlett A, Cavalieri RJ, Gibbs SG, Rupp ME. A study of three methods for assessment of hospital environmental cleaning. Healthc Infect 2013; 18 80–5.
| A study of three methods for assessment of hospital environmental cleaning.CrossRef |
 Smith PW, Gibbs S, Sayles H, Hewlett A, Rupp ME, Iwen PC. Observations on hospital room contamination testing. Healthc Infect 2013; 18 10–3.
| Observations on hospital room contamination testing.CrossRef |