Register      Login
Pacific Conservation Biology Pacific Conservation Biology Society
A journal dedicated to conservation and wildlife management in the Pacific region.
RESEARCH ARTICLE (Open Access)

Citizen science data validates aerial imagery to track the ‘rise and fall’ of woody vegetation through extremes of climate

J. E. Ling https://orcid.org/0000-0001-6801-3789 A * , P. Richardson B , J. Wiles B , J. Darling B , R. Dalton B and M. Krogh A
+ Author Affiliations
- Author Affiliations

A Biodiversity and Conservation Division, Department of Planning and Environment, PO Box 29, Lidcombe, NSW 1825, Australia.

B Friends of Thirlmere Lakes, PO Box 6105, The Oaks, NSW 2570, Australia.


Handling Editor: Mike van Keulen

Pacific Conservation Biology 29(6) 559-567 https://doi.org/10.1071/PC22032
Submitted: 11 August 2022  Accepted: 5 February 2023   Published: 24 February 2023

© 2023 The Author(s) (or their employer(s)). Published by CSIRO Publishing. This is an open access article distributed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND)

Abstract

Context: Ground truthing remotely sensed imagery for detecting changes in wetland vegetation can be time-consuming and costly for monitoring. Harnessing the resources of citizen scientists (CS) using mobile devices has been under utilised in Australia.

Aims: The project aimed to test the feasibility and practicality of using CS to collect data using mobile devices to ground truth remotely sensed imagery.

Methods: Using high-resolution aerial imagery, we detected the establishment of woody vegetation over a 20-year dry phase from 2000 to 2020 in Thirlmere Lakes National Park, NSW, Australia. To ground truth these woody species, we engaged with a local community group using a customised, freely available mobile device application.

Key results: During the dry event of 2020, CS documented well-established woody species, such as Melaleuca linariifolia (flax-leaved paperbark), amongst the Lepironia articulata grey rush. With the La Niña wet events in early 2020–22 and subsequent higher water levels, the CS documented the survival of M. linariifolia but the dieback of eucalypts, and other woody species.

Conclusions: Observations at higher temporal frequencies by CS using mobile devices, augmented with researchers’ observations, proved to be a valuable, quality-controlled method to ground truth high-resolution aerial imagery.

Implications: This case study showed that monitoring the phenology of vegetation in a peat wetland can be supplemented by the inclusion of a CS programme. This under-utilised resource can increase coverage and frequency of data observations, lower costs as well as create community awareness, capability and engagement in scientific research.

Keywords: citizen science, freshwater wetland, Friends of Thirlmere Lakes (FOTL), Melaleuca linariifolia, Open Data Kit (ODK), peatland, public participation, Thirlmere Lakes National Park (TLNP), woody encroachment.

Introduction

One of the challenges for species discrimination in mapping vegetation is the requirement for fieldwork and ground truthing of remotely sensed imagery, which is labour intensive, costly, and time consuming (Husson et al. 2016). Harnessing the value of crowdsourcing (Brabham 2013), especially with its revival in the past 20 years for collecting environmental data (Fienen and Lowry 2012) may be an under-utilised resource that scientific research, especially vegetation mapping could progress. Even though public participation in the collection of scientific data (that is, citizen science, also referred to with the more inclusive term ‘community science’) has been active for hundreds of years (Dickinson et al. 2010; Miller-Rushing et al. 2012; McInnes et al. 2020), it has more recently gained widespread support and recognition (Bonney et al. 2009, 2014, 2020; Silvertown 2009; Miller-Rushing et al. 2012; Pecl et al. 2015; Irwin 2018) with peer-reviewed publications increasing exponentially worldwide, especially in the past decade (Follett and Strezov 2015; Huddart et al. 2016; Fritz et al. 2017; McKinley et al. 2017).

While citizen science data in Australia has benefited from high-profile environmental research (e.g. Nancarrow 1996; Pecl et al. 2019; Steven et al. 2019; Pirotta et al. 2020; Roger et al. 2020; Kirchhoff et al. 2021), its use for vegetation monitoring and mapping is limited to studies in saltmarsh (Buldrini et al. 2015; Dykman and Prahalad 2018), reference image collection to assist in the qualitative assessment of vegetation condition (Roger et al. 2019), trampling (Simpson et al. 2020), or as part of more general observations for mapping the effects of fire on biodiversity (Kirchhoff et al. 2021). Overseas, citizen scientists (CS) observations, while still limited to a few studies, highlight their value for identifying and categorising plant phenology for trees and invasive weeds have been shown to complement other data applications for monitoring dryland ecosystems, mapping invasive species, habitat modelling, vegetation classification (Elmore et al. 2016; Wallace et al. 2016) and mapping the location and intensity invasive weed species (Hawthorne et al. 2015). Integrating CS observation data is also valuable in the calibration and validation of remotely sensed (RS) imagery for earth observations (Fritz et al. 2017).

One of the key benefits of CS is their ability to collect more frequent, longer-term data (Lottig et al. 2014; Blake and Rhanor 2020). It can also increase data coverage in environmental research, with the potential for volunteers to collect vastly more data than government agencies and professional researchers (Storey et al. 2016). Also, involving the community in monitoring increases not only their ability to contribute data, but also their capability to discuss their knowledge with experts (Carolan 2006). Participating community members also show increased scientific literacy, greater awareness of local ecosystems and wider environmental issues, stronger social networks including relationships with local government, and a greater interest in planning (Storey et al. 2016 and references within) that results in further community engagement with government in decision making (Roger et al. 2019). Uncertainty about the reliability of data collected by the community (Hyder et al. 2015; Roger et al. 2019) has repeatedly been shown to be unwarranted when CS programmes are appropriately supported (training, robust protocols) and augmented by professionally collected data (Kosmala et al. 2016; Storey et al. 2016; Dumakude and Graham 2017; Blake and Rhanor 2020). More recently, a key enabler for CS involvement is the ubiquitous ownership of mobile devices and smartphone technology. This technology has enabled the community to use well-designed and user-friendly apps to collect observations of the environment, which are uploaded into a cloud storage repository for the researcher to download and analyse (Herrick et al. 2017).

Continuous ground truthing of vegetation in a dynamic wetland system is rare, yet knowledge of their distribution and extent is critical as these habitats are threatened by climate change. As such, we suggest that by harnessing the willingness of the public to participate in appropriately designed scientific research, we can increase the frequency of observations and lower the costs for projects to ground truth and validate high-resolution imagery for vegetation monitoring and surveys. This is especially true in the constant financial challenges of monitoring programmes, with a lack of resources (time and money) accounting for 85% of river restoration projects lacking some form of monitoring in Australia (Brooks and Lake 2007) and globally (Huddart et al. 2016).

In this study, we examined high-resolution aerial imagery in the rush-dominated peat wetlands of Thirlmere Lakes National Park, NSW, Australia, from 1955 to 2022 and identified the encroachment of woody vegetation during a dry successional state into the herbaceous zone. Initially, as a pilot programme, the aim of the CS programme was general surveillance monitoring of wetland vegetation to validate the high-resolution aerial imagery. This further evolved to target the presence of woody vegetation during the dry event from mid−2018. However, rainfall from March 2020 to June 2021 followed by higher water levels in the lakes, changed the focus again from June 2021 to monitor the dieback of some woody species. General surveillance of multiple species has an important role to play as the first line of attack (Dickinson et al. 2010), and as evident in this evolution of this project, can illuminate unexpected trends for intensive, targeted monitoring.

This project aimed to show that CS programmes and the data they collected can augment researchers’ data to ground truth the high-resolution aerial imagery to monitor the response of woody vegetation encroachment into the wetlands of Thirlmere Lakes National Park.


Materials and methods

Study site

Thirlmere Lakes are a group of five peat lagoons (Lakes Gandangarra, Werri Berri, Couridjah, Baraba, and Nerrigorang) located within Thirlmere Lakes National Park (Fig. 1), located 100 km south-west of Sydney CBD (34°13′S, 150°32′E). They are part of the Greater Blue Mountains World Heritage Area and protected under the National Parks Act 1974 and the Sydney Water Catchment Management Act 1998 (New South Wales Department of Planning, Industry and Environment (NSW DPIE) 2019).


Fig. 1.  (a) Location map of Thirlmere Lakes National Park in south-east Australia. (b) Lake Werri Berri (WB) is the largest of the five lakes (G, Gandangara; C, Couridjah; B, Baraba; N, Nerrigorang) within the Thirlmere lakes system. Aerial imagery from 13 November 2019. Inset highlights boundary for aerial images of the northern end of Lake Werri Berri: (c) 1955 when water levels were high enough to flow from Lakes Gandangara to Werri Berri; (d) 2014 when woody vegetation is easily detectable from the aerial imagery (red arrows); (e) 2020 when another cohort of woody vegetation can be detected closer to the centre of the lake (yellow arrow); (f) 2022 when water levels were again high enough to flow between Lakes Gandangara and Werri Berri. 1955 aerial imagery sourced from NSW Department of Lands Inquiry Report July 1955, page 1811 (Riley et al. 2012). Other aerial imagery sourced from Nearmap Australia (http://maps.au.nearmap.com/, accessed May 2022).
Click to zoom

Although their water levels have fluctuated over time, declines since 2010 have caused community concern that anthropogenic activities such as nearby longwall mining and groundwater extraction might be contributing to the water level declines (Pells and Pells 2016). While significant investment by government and scientific researchers has been undertaken to better understand the geomorphology and hydrology of the system (e.g. Chen et al. 2020; Cowley et al. 2020; Forbes et al. 2021), there is limited documentation of the ecological condition and state (Black et al. 2006; Rose and Martin 2007; Ling and Jacobs 2011; Kobayashi et al. 2020; Forbes et al. 2021) of this unique wetland system. The lakes are dominated by large sedges (e.g. Lepironia articulata, Lepidosperma longitudinale, and Machaerina articulata) and support 22 threatened flora and fauna species including the wetland plants Commersonia prostrata (dwarf kerrawang) and Persicaria elatior (tall knotweed) (Daly et al. 2015; NSW Government 2016).

Calculating the area inside the woody vegetation

To highlight the establishment of woody vegetation towards the centre of the lakes during the dry phase at Thirlmere Lakes (see Fig. 1), discrete polygons were digitised by outlining the boundary of the trees and shrubs in each wetland from aerial imagery. Historical aerial imagery were derived from the NSW Department of Planning and Environment’s (DPE). Data from Spatial Imagery Services (1962–2004), Google Earth Pro (2009–2014) and Nearmap (Nearmap Australia http://maps.au.nearmap.com/, accessed 3 May 2022) (2010–2022) were collated either JP2, TIF or JFIF formats and georeferenced in ArcGIS 10.4. The 1955 aerial imagery was sourced from NSW Department of Lands Inquiry Report July 1955 (Riley et al. 2012). Older imagery were georectified using ArcGIS tools. The area (m2) inside each polygon was calculated using ArcGIS automation tools and then converted to hectares (ha) for reporting.

Open Data Kit (ODK) mobile device application

We used the Open Data Kit (ODK) tool to develop an application to use with android mobile devices. ODK is a free suite of tools developed at the University of Washington’s Computer Science and Engineering Department (https://www.google.com/earth/outreach/learn/odk-collect-and-odk-aggregate-to-store-and-manage-your-data/, accessed January 2021). The ODK allows data collection without internet service at the time of collection, and later data submission to an online server. The bespoke application for this project was designed for use by non-scientists. That is, it is user-friendly with photographs and descriptions of the common wetland plant species. The application records the photographs taken by CS to enable validation and for quality control. Once installed, users record the date, time, GPS location, plant names, and photographs.

CS volunteers were sourced from the Friends of Thirlmere Lakes (FOTL) who meet monthly at the lakes to discuss issues and attend other activities such as bushwalking and bush regeneration. Training of the application and plant species identification occurred at least three times with key volunteers, who then trained and aided fellow volunteers. While the intention was for researchers to attend multiple field trips with volunteers, travel restrictions due to the COVID-19 pandemic, floods and road closures prevented researchers from accessing the area. Regular updates of survey observations were mapped for the FOTL monthly newsletter, as was regular feedback between the project researcher and the field survey organiser.


Results

The use of high-resolution imagery highlighted the growth of woody vegetation, such as Melaleuca linariifolia (flax-leaved paperbark) established towards the centre of the lakes (Fig. 2). To highlight this establishment of woody vegetation towards the centre of the lake, the area inside the visible woody vegetation was calculated for the five lakes in Thirlmere Lakes National Park for 33 aerial imagery from 1955 to 2020. The 1955 aerial imagery clearly shows that Lakes Gandangara (LG), Werri Berri (LWB) and Couridjah (LC) are a single large waterbody (Fig. 3) and therefore used as the baseline for the maximum high-water level. Using the 1955 baseline boundary, there was a distinct decline in the digitised area within the woody vegetation in 2009 of 8–15%. By May 2020, the area inside the tree-lined polygons was nearly halved (up to 45%) (Fig. 4).


Fig. 2.  Digitised area of the lake boundary (defined within the limit of the woody vegetation) for July 1955 (baseline), April 2020 and May 2022. This shows the contraction in area over time in 2020, and subsequent expansion again by 2022. LG, Lake Gandangara; LWB, Lake Werri Berri; LC, Lake Couridjah; LB, Lake Baraba; and LN, Lake Nerrigorang.
Click to zoom


Fig. 3.  Digitised area (ha) within the woody vegetation boundary from 1955 to 2022. LG, Lake Gandangara; LWB, Lake Werri Berri; LC, Lake Couridjah; LB, Lake Baraba; and LN, Lake Nerrigorang.
Click to zoom


Fig. 4.  A total of 90 survey points were mapped as part of a trial for ground truthing wetland vegetation monitoring in Thirlmere Lakes. Survey points collected from March 2020 to February 2021 by researchers (24 records) (yellow) and CS (19 records) (green) show the established woody species. Survey points recorded from May 2021 to May 2022 show the dieback of some woody species (red) (47 records). LG, Lake Gandangara; LWB, Lake Werri Berri; LC, Lake Couridjah; LB, Lake Baraba; and LN, Lake Nerrigorang. Aerial imagery from Nearmap Australia (http://maps.au.nearmap.com/, accessed 3 May 2022).
Click to zoom

The July 2021 high-resolution imagery, and personal observation (M. Krogh, pers. comm.), showed that water levels have risen enough for water to flow between LG and LWB, although the area calculations did not change since trees were still visible.

The monitoring and ground truthing of wetland vegetation by CS validated the location of established woody vegetation within the lakes. Along with other wetland species monitoring, 90 survey points were identified (and subsequently verified) as woody species (Fig. 4) recorded from March 2020 to May 2022. Established plants closer to the centre of the lake were mainly M. linariifolia with some of the plants being over 2 m in height. Other species also included Leptospermum trinervium (flaky-barked tea-tree), Kunzea ambigua (tick bush), Casuarina cunninghamiana (river she-oak), Banksia ericifolia, Acacia spp., and Eucalyptus spp. (Fig. 4).


Discussion

This study documented the phenology of wetland vegetation in Thirlmere Lakes through cycles of climate and weather changes, such as El Niño dry phases and La Niña wet phases. It recorded the dynamic shift in the extent and location of woody vegetation during a dry successional phase, and then its dieback through a wet successional phase using data collected by CS. CS were able to record the location of woody vegetation growing within the rush-dominated zones of the wetland with high precision and accuracy using mobile devices. Initially, only the quality of the photographs was a limiting factor for validation, but this was mitigated with ongoing feedback and training sessions.

Analysis of historical aerial imagery showed the initial changes from a rush-dominated peat wetland to an alternative shrub and tree-dominated state with the establishment of woody species during a 20-year dry phase. The dry successional phase, during the Millennium Drought, provided ideal conditions for woody species to germinate and establish within the stands of Lepironia. By 2009, they were large enough to be visible on the high-resolution aerial imagery. CS data verified that these well-established woody species recorded amongst the L. articulata grey rush were mainly M. linariifolia, as well as more terrestrial woody species such as L. trinervium, Eucalyptus spp., Acacia spp., and C. cunninghamiana.

The dry weather conditions during the El Niño from 2014 to 2016, and again in 2018 (with September 2018 recorded as the driest September in 119 years of records in Australia), are reflected in the low water levels in Thirlmere Lakes (0 m; September 2018–January 2020) (WaterNSW Real Time Data https://realtimedata.waternsw.com.au/). These dry conditions continued into 2019, with rainfall the fifth-lowest on record in NSW and the driest since the severe El Niño drought of 2002 (Australian Government Bureau of Meteorology (AGBOM) 2018). As part of the Thirlmere Lakes Research Program (Department of Planning and Industry 2022), water balance predictions suggested that the lakes are climate sensitive and primarily driven by rainfall and evaporation (Chen et al. 2020). These reports also demonstrated that the low water levels in 2018–2019 were not unprecedented (Chen et al. 2020; Forbes et al. 2021), and these studies supported anecdotal reports and photographs that indicated the presence of trees in the centre of the lake in 1958–1959 that likely established during the long El Niño drought event of the 1940–1950 (World War II Drought), with water returning in 1954 (AGBOM http://www.bom.gov.au/climate/influences/timeline/, accessed 31 May 2020). This research of historical changes though sedimentology and climate highlight the dynamic (i.e. not static) nature of this system over different temporal scale, and it is repeatable, yet the variable patterns are dependant on the window of time that is examined.

Other studies have also shown that woody seedling recruitment was also highest in the dry phases (Tipping et al. 2012; Saintilan et al. 2021). The woody encroachment into graminoid freshwater wetlands has been associated with changes in water levels (Warren et al. 2007), shortened hydroperiods and drainage (Johnston et al. 2003; Duever 2005; Knickerbocker et al. 2009), altered flood regimes (Colloff et al. 2014), and cumulative changes in climate (Berg et al. 2009). In Australia, Johnston et al. (2003) found that 50% of a coastal floodplain wetland had been encroached by the native Melaleuca quinquenervia (broad-leaved paperbark) from 1942 to 1998 due to changes in water levels.

While this study could only detect woody species when they reached a size visible on the aerial imagery, the on-ground survey coupled with the validation of photographs by the CS has allowed the identification of changes to the phenology of the wetland vegetation, especially during the dry phase. Before the La Niña event of March 2021, the CS record the presence of both well-established woody vegetation, and seedlings amongst the rushes. As water levels increased (3.6 m; 4 February 2021) (WaterNSW Real Time Data https://realtimedata.waternsw.com.au/) with the La Niña in 2020–2021, the on-ground photographs document the survival of M. linariifolia established near the centre of the lakes, and demise of other terrestrial species (eucalypts, acacias and Leptospermum species). The survival of M. linariifolia is not unexpected since it can grow in moist and swampy ground as well as dry sclerophyll forests or (https://plantnet.rbgsyd.nsw.gov.au, accessed 30 November 2020). It is also known to be tolerant of either well-drained or poorly drained soils, and adaptable to a range of soil types (https://www.australianplants.com/plants.aspx?id=1113, accessed 30 March 2020). Before 2010, however, M. linariifolia had not been recorded, nor observed, in areas that were frequently inundated.

This study has documented the phenology of wetland vegetation, especially the encroachment of woody vegetation in a rush-dominated wetland as an early indicator of a regime shift to a drier successional state (extended El Niño event), and the dynamic nature of the wetland vegetation following inundation through a La Niña event. The measure of this wetland’s ecosystem resilience is its capacity to undergo an extended dry phase without loss of its ecological character. Periodic drying out of wetlands is a natural alternative state that wetland plant species can adapt to, where woody vegetation may establish during a long dry phase. However, continued surveillance monitoring may further identify whether the Melaleuca will continue to flourish after an extended wet phase.

As many as 90% of restorations in the USA, Australia, and Europe are not monitored beyond visual examination been attributed to a lack of resources; i.e. time and money (Huddart et al. 2016). Using additional resources, such as engaging CS as a supplementary tool, could potentially alleviate this knowledge gap. This study contributes another case study of a participatory tool to the broader scientific community to improve efficiencies to increase the frequency of timing of data validation points. By drawing on the universal ownership of mobile devices for georeferenced observations along with high-resolution imagery, this inclusive method of supplementing CS data supports a better understanding of plant phenology and mapping for threatened plant species, noxious non-native species, and water level mapping.

Previous studies suggest that the two biggest challenges for CS are related to the quality of the data and how to engage and retain citizen participation in the longer term (Kosmala et al. 2016; Fritz et al. 2017). Other studies have shown that CS observations are spatially biased to easily accessible sites (Tiago et al. 2017). To address these issues, we implemented the continuous monitoring of data quality (with photograph validation) and feedback to volunteers to improve quality through training over time. Communication of the project was an essential component of any CS project, with regular contributions to newsletters, presentations and websites concerning gaps in location records. This study found that ground truthed observations as part of the CS programme were an ideal method to track changes in the encroachment of woody vegetation. Given adequate professional support, this community-based wetland vegetation monitoring provided data reliable enough to augment professionally collected data, and increase the opportunities, confidence, and skills of community members.

The method used in this study has practical implications for researchers and practitioners interested in harnessing the power of public participation for the ground truthing and validation of wetland mapping. Key learnings of the project included the importance of two-way communication. For example, by publicising the science at citizen science days, scientists received essential feedback and recruitment of community members. Also given their eagerness for information, providing regular feedback loops to keep CS updated about the project through CS days, community newsletters, and through enthusiastic key leaders that can train, organise and encourage volunteers. Such feedback is critical to a project’s success (de Vries et al. 2019).

Ultimately, this project showed that monitoring the phenology of vegetation in a peat wetland that is driven by changes in climate, can be supplemented by the inclusion of a CS programme. Further, CS efforts created more insightful awareness of environmental issues, connected the local community, scientists and land managers to make scientific resources more efficient to assist in the continuous surveillance monitoring of the local wetland vegetation to collect high-frequency, longitudinal data.


Data availability

The data that support this study will be shared upon reasonable request to the corresponding author.


Conflicts of interest

No potential competing interest was reported by the authors.


Declaration of funding

This study was funded by DPE, partly under the Thirlmere Lakes Research Program.



Acknowledgements

Most importantly, we acknowledge our appreciation of the Friends of Thirlmere Lakes members and the wider community of Thirlmere Lakes. Without their support, dedication and commitment we would have a less scientific understanding of this unique National Park. We thank Ben Owers, Thirlmere Lakes Ranger NPWS, Dr Kirsten Cowley, and Drs M. Hughes and T. Pritchard for overall support.


References

Australian Government Bureau of Meteorology (AGBOM) (2018) Climate of the 2018–19 financial year. Available at http://www.bom.gov.au/climate/updates/articles/a034.shtml [Accessed 27 November 2019]

Berg, EE, Hillman, KM, Dial, R, and DeRuwe, A (2009). Recent woody invasion of wetlands on the Kenai Peninsula Lowlands, south-central Alaska: a major regime shift after 18 000 years of wet Sphagnum–sedge peat recruitment. Canadian Journal of Forest Research 39, 2033–2046.
Recent woody invasion of wetlands on the Kenai Peninsula Lowlands, south-central Alaska: a major regime shift after 18 000 years of wet Sphagnum–sedge peat recruitment.Crossref | GoogleScholarGoogle Scholar |

Black, MP, Mooney, SD, and Martin, HA (2006). A >43,000-year vegetation and fire history from Lake Baraba, New South Wales, Australia. Quaternary Science Reviews 25, 3003–3016.
A >43,000-year vegetation and fire history from Lake Baraba, New South Wales, Australia.Crossref | GoogleScholarGoogle Scholar |

Blake, C, and Rhanor, AK (2020). The impact of channelization on macroinvertebrate bioindicators in small order Illinois streams: insights from long-term citizen science research. Aquatic Sciences 82, .
The impact of channelization on macroinvertebrate bioindicators in small order Illinois streams: insights from long-term citizen science research.Crossref | GoogleScholarGoogle Scholar |

Bonney, R, Cooper, CB, Dickinson, J, Kelling, S, Phillips, T, Rosenberg, KV, and Shirk, J (2009). Citizen science: a developing tool for expanding science knowledge and scientific literacy. BioScience 59, 977–984.
Citizen science: a developing tool for expanding science knowledge and scientific literacy.Crossref | GoogleScholarGoogle Scholar |

Bonney, R, Shirk, JL, Phillips, TB, Wiggins, A, Ballard, HL, Miller-Rushing, AJ, and Parrish, JK (2014). Next steps for citizen science. Science 343, 1436–1437.
Next steps for citizen science.Crossref | GoogleScholarGoogle Scholar |

Bonney, P, Murphy, A, Hansen, B, and Baldwin, C (2020). Citizen science in Australia’s waterways: investigating linkages with catchment decision-making. Australasian Journal of Environmental Management 27, 200–223.
Citizen science in Australia’s waterways: investigating linkages with catchment decision-making.Crossref | GoogleScholarGoogle Scholar |

Brabham DC (2013) ‘Using crowdsourcing in government.’ (IBM Center for the Business of Government: Washington, DC) pp. 1–42. Available at https://www.cbs.dk/files/cbs.dk/using_crowdsourcing_in_government.pdf

Brooks, SS, and Lake, PS (2007). River restoration in Victoria, Australia: change is in the wind, and none too soon. Restoration Ecology 15, 584–591.
River restoration in Victoria, Australia: change is in the wind, and none too soon.Crossref | GoogleScholarGoogle Scholar |

Buldrini, F, Simoncelli, A, Accordi, S, Pezzi, G, and Dallai, D (2015). Ten years of citizen science data collection of wetland plants in an urban protected area. Acta Botanica Gallica 162, 365–373.
Ten years of citizen science data collection of wetland plants in an urban protected area.Crossref | GoogleScholarGoogle Scholar |

Carolan, MS (2006). Science, expertise, and the democratization of the decision-making process. Society & Natural Resources 19, 661–668.
Science, expertise, and the democratization of the decision-making process.Crossref | GoogleScholarGoogle Scholar |

Chen, S, Johnson, F, Drummond, C, and Glamore, W (2020). A new method to improve the accuracy of remotely sensed data for wetland water balance estimates. Journal of Hydrology: Regional Studies 29, .
A new method to improve the accuracy of remotely sensed data for wetland water balance estimates.Crossref | GoogleScholarGoogle Scholar |

Colloff, MJ, Ward, KA, and Roberts, J (2014). Ecology and conservation of grassy wetlands dominated by spiny mud grass Pseudoraphis spinescens in the southern Murray–Darling Basin, Australia. Aquatic Conservation: Marine and Freshwater Ecosystems 24, 238–255.
Ecology and conservation of grassy wetlands dominated by spiny mud grass Pseudoraphis spinescens in the southern Murray–Darling Basin, Australia.Crossref | GoogleScholarGoogle Scholar |

Cowley, KL, Fryirs, KA, Cohen, TJ, Marx, S, Forbes, M, and Krogh, M (2020). Upland peatlands of Eastern Australia as important water storage reservoirs. Proceedings of the Linnean Society of New South Wales 142, 67–76.

Daly, G, Owers, B, and Horton, A (2015). The distribution of the Red-crowned Toadlet Pseudophryne australis in the Nepean-Burragorang region of the Sydney Basin. Australian Zoologist 37, 535–540.
The distribution of the Red-crowned Toadlet Pseudophryne australis in the Nepean-Burragorang region of the Sydney Basin.Crossref | GoogleScholarGoogle Scholar |

de Vries, M, Land-Zandstra, A, and Smeets, I (2019). Citizen scientists’ preferences for communication of scientific output: a literature review. Citizen Science: Theory and Practice 4, 2.
Citizen scientists’ preferences for communication of scientific output: a literature review.Crossref | GoogleScholarGoogle Scholar |

Department of Planning and Industry (2022) Thirlmere Lakes – A Synthesis of Current Research. Available at https://www.environment.nsw.gov.au/-/media/OEH/Corporate-Site/Documents/Research/Our-science-and-research/thirlmere-lakes-a-synthesis-of-current-research-220164.pdf [accessed January 2023]

Dickinson, JL, Zuckerberg, B, and Bonter, DN (2010). Citizen science as an ecological research tool: challenges and benefits. Annual Review of Ecology, Evolution, and Systematics 41, 149–172.
Citizen science as an ecological research tool: challenges and benefits.Crossref | GoogleScholarGoogle Scholar |

Duever, MJ (2005). Big Cypress regional ecosystem conceptual ecological model. Wetlands 25, 843–853.
Big Cypress regional ecosystem conceptual ecological model.Crossref | GoogleScholarGoogle Scholar |

Dumakude, N, and Graham, M (2017). Assessing wetland health using a newly developed land cover citizen science tool for use by local people who are not wetland specialists. Southern African Journal of Environmental Education 33, 71–83.
Assessing wetland health using a newly developed land cover citizen science tool for use by local people who are not wetland specialists.Crossref | GoogleScholarGoogle Scholar |

Dykman, M, and Prahalad, V (2018). Tamar Saltmarsh Monitoring Program: citizen science monitoring of the tidal treasures of the Tamar River estuary, Tasmania, Australia. Australian Journal of Maritime & Ocean Affairs 10, 222–240.
Tamar Saltmarsh Monitoring Program: citizen science monitoring of the tidal treasures of the Tamar River estuary, Tasmania, Australia.Crossref | GoogleScholarGoogle Scholar |

Elmore, AJ, Stylinski, CD, and Pradhan, K (2016). Synergistic use of citizen science and remote sensing for continental-scale measurements of forest tree phenology. Remote Sensing 8, 502.
Synergistic use of citizen science and remote sensing for continental-scale measurements of forest tree phenology.Crossref | GoogleScholarGoogle Scholar |

Fienen, MN, and Lowry, CS (2012). Social. Water—A crowdsourcing tool for environmental data acquisition. Computers & Geosciences 49, 164–169.
Social. Water—A crowdsourcing tool for environmental data acquisition.Crossref | GoogleScholarGoogle Scholar |

Follett, R, and Strezov, V (2015). An analysis of citizen science based research: usage and publication patterns. PLoS ONE 10, .
An analysis of citizen science based research: usage and publication patterns.Crossref | GoogleScholarGoogle Scholar |

Forbes, M, Cohen, T, Jacobs, Z, Marx, S, Barber, E, Dodson, J, Zamora, A, Cadd, H, Francke, A, Constantine, M, Mooney, S, Short, J, Tibby, J, Parker, A, Cendón, D, Peterson, M, Tyler, J, Swallow, E, Haines, H, Gadd, P, and Woodward, C (2021). Comparing interglacials in eastern Australia: a multi-proxy investigation of a new sedimentary record. Quaternary Science Reviews 252, .
Comparing interglacials in eastern Australia: a multi-proxy investigation of a new sedimentary record.Crossref | GoogleScholarGoogle Scholar |

Fritz, S, Fonte, CC, and See, L (2017). The role of citizen science in earth observation. Remote Sensing 9, .
The role of citizen science in earth observation.Crossref | GoogleScholarGoogle Scholar |

Hawthorne, TL, Elmore, V, Strong, A, Bennett-Martin, P, Finnie, J, Parkman, J, Harris, T, Singh, J, Edwards, L, and Reed, J (2015). Mapping non-native invasive species and accessibility in an urban forest: a case study of participatory mapping and citizen science in Atlanta, Georgia. Applied Geography 56, 187–198.
Mapping non-native invasive species and accessibility in an urban forest: a case study of participatory mapping and citizen science in Atlanta, Georgia.Crossref | GoogleScholarGoogle Scholar |

Herrick, JE, Karl, JW, McCord, SE, Buenemann, M, Riginos, C, Courtright, E, Van Zee, J, Ganguli, AC, Angerer, J, Brown, JR, Kimiti, DW, Saltzman, R, Beh, A, and Bestelmeyer, B (2017). Two new mobile apps for rangeland inventory and monitoring by landowners and land managers. Rangelands 39, 46–55.
Two new mobile apps for rangeland inventory and monitoring by landowners and land managers.Crossref | GoogleScholarGoogle Scholar |

Huddart, JEA, Thompson, MSA, Woodward, G, and Brooks, SJ (2016). Citizen science: from detecting pollution to evaluating ecological restoration. WIREs Water 3, 287–300.
Citizen science: from detecting pollution to evaluating ecological restoration.Crossref | GoogleScholarGoogle Scholar |

Husson, E, Ecke, F, and Reese, H (2016). Comparison of manual mapping and automated object-based image analysis of non-submerged aquatic vegetation from very-high-resolution UAS images. Remote Sensing 8, .
Comparison of manual mapping and automated object-based image analysis of non-submerged aquatic vegetation from very-high-resolution UAS images.Crossref | GoogleScholarGoogle Scholar |

Hyder, K, Townhill, B, Anderson, LG, Delany, J, and Pinnegar, JK (2015). Can citizen science contribute to the evidence-base that underpins marine policy? Marine Policy 59, 112–120.
Can citizen science contribute to the evidence-base that underpins marine policy?Crossref | GoogleScholarGoogle Scholar |

Irwin, A (2018). No PhDs needed: how citizen science is transforming research. Nature 562, 480–483.
No PhDs needed: how citizen science is transforming research.Crossref | GoogleScholarGoogle Scholar |

Johnston, SG, Slavich, PG, and Hirst, P (2003). Alteration of groundwater and sediment geochemistry in a sulfidic backswamp due to Melaleuca quinquenervia encroachment. Soil Research 41, 1343–1367.
Alteration of groundwater and sediment geochemistry in a sulfidic backswamp due to Melaleuca quinquenervia encroachment.Crossref | GoogleScholarGoogle Scholar |

Kirchhoff, C, Callaghan, CT, Keith, DA, Indiarto, D, Taseski, G, Ooi, MKJ, Le Breton, TD, Mesaglio, T, Kingsford, RT, and Cornwell, WK (2021). Rapidly mapping fire effects on biodiversity at a large-scale using citizen science. Science of The Total Environment 755, .
Rapidly mapping fire effects on biodiversity at a large-scale using citizen science.Crossref | GoogleScholarGoogle Scholar |

Knickerbocker, CM, Leitholf, S, Stephens, EL, Keellings, DJ, Laird, H, Anderson, CJR, Fauth, JE, and Quintana-Ascencio, PF (2009). Tree encroachment of a sawgrass (Cladium jamaicense) marsh within an increasingly urbanized ecosystem. Natural Areas Journal 29, 15–26.
Tree encroachment of a sawgrass (Cladium jamaicense) marsh within an increasingly urbanized ecosystem.Crossref | GoogleScholarGoogle Scholar |

Kobayashi, T, Krogh, M, Hiroyuki II Shiel, RJ, Segers, H, Ling, J, Hunter, SJ, and Pritchard, T (2020). Zooplankton species richness and abiotic conditions in Thirlmere Lakes, New South Wales, Australia, with reference to water-level fluctuations. Australian Zoologist 41, 107–123.
Zooplankton species richness and abiotic conditions in Thirlmere Lakes, New South Wales, Australia, with reference to water-level fluctuations.Crossref | GoogleScholarGoogle Scholar |

Kosmala, M, Wiggins, A, Swanson, A, and Simmons, B (2016). Assessing data quality in citizen science. Frontiers in Ecology and the Environment 14, 551–560.
Assessing data quality in citizen science.Crossref | GoogleScholarGoogle Scholar |

Ling, JE, and Jacobs, SWL (2011). Testing and developing a wetland assessment index in southeast Australia using aquatic plants. Telopea 13, 257–275.
Testing and developing a wetland assessment index in southeast Australia using aquatic plants.Crossref | GoogleScholarGoogle Scholar |

Lottig, NR, Wagner, T, Norton Henry, E, Spence Cheruvelil, K, Webster, KE, Downing, JA, and Stow, CA (2014). Long-term citizen-collected data reveal geographical patterns and temporal trends in lake water clarity. PLoS ONE 94, .
Long-term citizen-collected data reveal geographical patterns and temporal trends in lake water clarity.Crossref | GoogleScholarGoogle Scholar |

McInnes, RJ, Davidson, NC, Rostron, CP, Simpson, M, and Finlayson, CM (2020). A citizen science state of the world’s wetlands survey. Wetlands 40, 1577–1593.
A citizen science state of the world’s wetlands survey.Crossref | GoogleScholarGoogle Scholar |

McKinley, DC, Miller-Rushing, AJ, Ballard, HL, Bonney, R, Brown, H, Cook-Patton, SC, Evans, DM, French, RA, Parrish, JK, Phillips, TB, Ryan, SF, Shanley, LA, Shirk, JL, Stepenuck, KF, Weltzin, JF, Wiggins, A, Boyle, OD, Briggs, RD, Chapin, SF, Hewitt, DA, Preuss, PW, and Soukup, MA (2017). Citizen science can improve conservation science, natural resource management, and environmental protection. Biological Conservation 208, 15–28.
Citizen science can improve conservation science, natural resource management, and environmental protection.Crossref | GoogleScholarGoogle Scholar |

Miller-Rushing, A, Primack, R, and Bonney, R (2012). The history of public participation in ecological research. Frontiers in Ecology and the Environment 10, 285–290.
The history of public participation in ecological research.Crossref | GoogleScholarGoogle Scholar |

Nancarrow J (1996) Streamwatch-Wetter than life itself. In ‘Proceedings of the 9th Biennial National Conference of the Australian Association for Environmental Education and the Marine Society of Australasia, 13–17 January 1997’. (Ed. JJ Todd) pp. 203–210. (University of Tasmania, Hobart). Available at https://files.eric.ed.gov/fulltext/ED446893.pdf#page=235

New South Wales Department of Planning, Industry and Environment (NSW DPIE) (2019) National Parks Wildlife Service. Thirlmere Lakes National Park: Plan of Management. Office of Environment and Heritage, Sydney NSW. Available at https://www.environment.nsw.gov.au/-/media/OEH/Corporate-Site/Documents/Parks-reserves-and-protected-areas/Parks-plans-of-management/thirlmere-lakes-national-park-plan-of-management-190545.pdf

NSW Government (2016) Biodiversity Conservation Act 2016. Available at https://legislation.nsw.gov.au/view/html/inforce/current/act-2016-063 [accessed November 2019]

Pecl G, Gillies C, Sbrocchi C, Roetman P (2015) Building Australia through citizen science. Australian government Office of the Chief Scientist. Occasional Paper series Issue. 11 July 2015. Available at https://apo.org.au/sites/default/files/resource-files/2015-07/apo-nid56434.pdf

Pecl, GT, Stuart-Smith, J, Walsh, P, Bray, DJ, Kusetic, M, Burgess, M, Frusher, SD, Gledhill, DC, George, O, Jackson, G, Keane, J, Martin, VY, Nursey-Bray, M, Pender, A, Robinson, LM, Rowling, K, Sheaves, M, and Moltschaniwskyj, N (2019). Redmap Australia: challenges and successes with a large-scale citizen science-based approach to ecological monitoring and community engagement on climate change. Frontiers in Marine Science 6, .
Redmap Australia: challenges and successes with a large-scale citizen science-based approach to ecological monitoring and community engagement on climate change.Crossref | GoogleScholarGoogle Scholar |

Pells P, Pells S (2016) The water levels of Thirlmere Lakes–where did the water go, and when will it return?. In ‘IAHR APD 2016: 20th Congress of the Asia Pacific Division of the International Association for Hydro Environment Engineering & Research, 28–31 August, Colombo, Sri Lanka’. Available at http://www.iahrapd2016.info/

Pirotta, V, Reynolds, W, Ross, G, Jonsen, I, Grech, A, Slip, D, and Harcourt, R (2020). A citizen science approach to long-term monitoring of humpback whales (Megaptera novaeangliae) off Sydney, Australia. Marine Mammal Science 36, 472–485.
A citizen science approach to long-term monitoring of humpback whales (Megaptera novaeangliae) off Sydney, Australia.Crossref | GoogleScholarGoogle Scholar |

Riley S, Finlayson M, Gore D, McLean W, Thomas K (2012) Thirlmere lakes inquiry – final report of the independent committee. Independent Thirlmere Lakes Inquiry Committee. Unpublished report, October 2012, 474pp. Available at https://www.environment.nsw.gov.au/research-and-publications/publications-search/thirlmere-lakes-inquiry-final-report-of-the-independent-committee [Accessed July 2021]

Roger, E, Turak, E, and Tegart, P (2019). Adopting citizen science as a tool to enhance monitoring for an environment agency. Citizen Science: Theory and Practice 4, .
Adopting citizen science as a tool to enhance monitoring for an environment agency.Crossref | GoogleScholarGoogle Scholar |

Roger, E, Tegart, P, Dowsett, R, Kinsela, MA, Harley, MD, and Ortac, G (2020). Maximising the potential for citizen science in New South Wales. Australian Zoologist 40, 449–461.
Maximising the potential for citizen science in New South Wales.Crossref | GoogleScholarGoogle Scholar |

Rose, S, and Martin, HA (2007). The vegetation history of the Holocene at dry lake, Thirlmere, New South Wales. Proceedings of the Linnean Society of New South Wales 128, 15–55.

Saintilan, N, Bowen, S, Maguire, O, Karimi, SS, Wen, L, Powell, M, Colloff, MJ, Sandi, S, Saco, P, and Rodriguez, J (2021). Resilience of trees and the vulnerability of grasslands to climate change in temperate Australian wetlands. Landscape Ecology 36, 803–814.
Resilience of trees and the vulnerability of grasslands to climate change in temperate Australian wetlands.Crossref | GoogleScholarGoogle Scholar |

Silvertown, J (2009). A new dawn for citizen science. Trends in Ecological & Evolution 24, 467–471.
A new dawn for citizen science.Crossref | GoogleScholarGoogle Scholar |

Simpson, GD, Parker, J, Gibbens, E, and Ladd, PG (2020). A hybrid method for citizen science monitoring of recreational trampling in urban remnants: a case study from Perth, Western Australia. Urban Science 4, 72.
A hybrid method for citizen science monitoring of recreational trampling in urban remnants: a case study from Perth, Western Australia.Crossref | GoogleScholarGoogle Scholar |

Steven, R, Barnes, M, Garnett, ST, Garrard, G, O’Connor, J, Oliver, JL, Robinson, C, Tulloch, A, and Fuller, RA (2019). Aligning citizen science with best practice: threatened species conservation in Australia. Conservation Science and Practice 1, .
Aligning citizen science with best practice: threatened species conservation in Australia.Crossref | GoogleScholarGoogle Scholar |

Storey, RG, Wright-Stow, A, Kin, E, Davies-Colley, RJ, and Stott, R (2016). Volunteer stream monitoring: do the data quality and monitoring experience support increased community involvement in freshwater decision making? Ecology and Society 21, .
Volunteer stream monitoring: do the data quality and monitoring experience support increased community involvement in freshwater decision making?Crossref | GoogleScholarGoogle Scholar |

Tiago, P, Ceia-Hasse, A, Marques, TA, Capinha, C, and Pereira, HM (2017). Spatial distribution of citizen science casuistic observations for different taxonomic groups. Scientific Reports 7, .
Spatial distribution of citizen science casuistic observations for different taxonomic groups.Crossref | GoogleScholarGoogle Scholar |

Tipping, PW, Martin, MR, Pierce, R, Center, TD, Pratt, PR, and Rayamajhi, MB (2012). Post-biological control invasion trajectory for Melaleuca quinquenervia in a seasonally inundated wetland. Biological Control 60, 163–168.
Post-biological control invasion trajectory for Melaleuca quinquenervia in a seasonally inundated wetland.Crossref | GoogleScholarGoogle Scholar |

Wallace, CSA, Walker, JJ, Skirvin, SM, Patrick-Birdwell, C, Weltzin, JF, and Raichle, H (2016). Mapping presence and predicting phenological status of invasive buffelgrass in southern Arizona using MODIS, climate and citizen science observation data. Remote Sensing 8, .
Mapping presence and predicting phenological status of invasive buffelgrass in southern Arizona using MODIS, climate and citizen science observation data.Crossref | GoogleScholarGoogle Scholar |

Warren, RJ, Rossell, IM, Moorhead, KK, and Dan Pittillo, J (2007). The influence of woody encroachment upon herbaceous vegetation in a Southern Appalachian wetland complex. The American Midland Naturalist 157, 39–51.
The influence of woody encroachment upon herbaceous vegetation in a Southern Appalachian wetland complex.Crossref | GoogleScholarGoogle Scholar |