CSIRO Publishing blank image blank image blank image blank imageBooksblank image blank image blank image blank imageJournalsblank image blank image blank image blank imageAbout Usblank image blank image blank image blank imageShopping Cartblank image blank image blank image You are here: Journals > Marine and Freshwater Research   
Marine and Freshwater Research
Journal Banner
  Advances in the aquatic sciences
blank image Search
blank image blank image
blank image
  Advanced Search

Journal Home
About the Journal
Editorial Structure
Online Early
Current Issue
Just Accepted
All Issues
Special Issues
Research Fronts
Virtual Issues
Sample Issue
For Authors
General Information
Submit Article
Author Instructions
Open Access
For Referees
General Information
Review an Article
Referee Guidelines
For Subscribers
Subscription Prices
Customer Service
Print Publication Dates
Library Recommendation

blue arrow e-Alerts
blank image
Subscribe to our Email Alert or RSS feeds for the latest journal papers.

red arrow Connect with us
blank image
facebook twitter logo LinkedIn


Article     |     Next >>   Contents Vol 66(2)

Quantifying uncertainty in environmental indices: an application to an estuarine health index

Melissa J. Dobbie A B and David Clifford A

A CSIRO Land and Water Flagship and Digital Productivity Flagship, Brisbane, Qld 4001, Australia.
B Corresponding author. Email: melissa.dobbie@csiro.au

Marine and Freshwater Research 66(2) 95-105 http://dx.doi.org/10.1071/MF13065
Submitted: 10 March 2014  Accepted: 22 May 2014   Published: 7 November 2014

PDF (973 KB) $25
 Export Citation

Estuaries are an important link between terrestrial and marine ecosystems, so assessing their health and what influences it can help guide future ecosystem monitoring and management. But estuaries can be complex and dynamic systems, so summarising health by a single score or grade raises questions about interpretation, variability, sensitivity and confidence. Such questions may include how variable is the score for a particular waterway, how sensitive is the score to seemingly benign decisions taken to reach that score, and how different is the B grade of one waterway to the C scored by an adjacent waterway. Focusing on a specific estuarine health index, we quantified two different sources of variation in its construction and examined how they contributed to the variability of the final score. We found that quantifying the variability in two steps of the index construction enabled us to make more informed inferences about the index and its bearing on an overall report card score for an estuary. By highlighting uncertainty in an estuarine health index, we are improving its inferential value and enabling more defensible decision-making about current and future management and amelioration of an estuary’s health and function.

Additional keywords: composite index, ecosystem health, EHMP, multi-metric, sensitivity, south-east Queensland.


Attard, M., Thompson, M., Kelly, R., and Locatelli, A. (2012). Tamar Estuary Ecosystem Health Assessment Program Monitoring Report 2012. Report to NRM North Tamar Estuary and Esk Rivers Program.

Birk, S., Bonne, W., Borja, A., Brucet, S., Courrat, A., Poikane, S., Solimini, A., van de Bund, W., Zampoukas, N., and Hering, D. (2012). Three hundred ways to assess Europe’s surface waters: an almost complete overview of biological methods to implement the water framework directive. Ecological Indicators 18, 31–41.
CrossRef |

Borja, A., and Dauer, D. (2008). Assessing the environmental quality status in estuarine and coastal systems: comparing methodologies and indices. Ecological Indicators 8, 331–337.
CrossRef |

Borja, A., Franco, J., and Pérez, V. (2000). A marine biotic index to establish the ecological quality of soft-bottom benthos within European estuarine and coastal environments. Marine Pollution Bulletin 40, 1100–1114.
CrossRef | CAS |

Bunn, S., Abal, E., Smith, M., Choy, S., Fellows, C., Harch, B., Kennard, M., and Sheldon, F. (2010). Integration of science and monitoring of river ecosystem health to guide investments in catchment protection and rehabilitation. Freshwater Biology 55, 223–240.
CrossRef |

Cade, B. S., and Noon, B. R. (2003). A gentle introduction to quantile regression for ecologists. Frontiers in Ecology and the Environment 1, 412–420.
CrossRef |

Chainho, P., Costa, J. L., Chaves, M. L., Dauer, D. M., and Costa, M. J. (2007). Influence of seasonal variability in benthic invertebrate community structure on the use of biotic indices to assess the ecological status of a Portuguese estuary. Marine Pollution Bulletin 54, 1586–1597.
CrossRef | CAS | PubMed |

Chiu, G., and Guttorp, P. (2006). Stream health index for Puget Sound Lowland. Environmetrics 17, 285–307.
CrossRef |

Clark, J. S., and Gelfand, A. E. (Eds) (2006). ‘Hierarchical Modeling for the Environmental Sciences: Statistical Methods and Applications.’ (Oxford University Press: Oxford.)

Coates, S., Waugh, A., Anwar, A., and Robson, M. (2007). Efficacy of multi-metric fish index as an analysis tool for the transitional fish component of the water framework directive. Marine Pollution Bulletin 55, 225–240.
CrossRef | CAS | PubMed |

Connolly, R. M., Bunn, S., Campbell, M., Escher, B., Hunter, J., Maxwell, P., Page, T., Richmond, S., Rissik, D., Roiko, A., Smart, J., and Teasdale, P. (2013). Review of the use of report cards for monitoring ecosystem and waterway health. Report to: Gladstone Healthy Harbour Partnership. November 2013. Queensland, Australia.

Curnutt, J. L., Comiskey, E. J., Nott, M. P., and Gross, L. J. (2000). Landscape-based spatially-explicit species index models for Everglades restoration. Ecological Applications 10, 1849–1860.
CrossRef |

Day, J. W., Crump, B. C., Kemp, W. M., and Yanez-Arancibia, A. (Eds) (2013). ‘Estuarine Ecology.’ 2nd edn. (Wiley-Blackwell: New York, NY.)

Department of Environment and Heritage Protection (2009). ‘Queensland Water Quality Guidelines, Version 3.’ ISBN 978–0-9806986–0-2.

Diaz, R. J., Solan, M., and Valente, R. M. (2004). A review of approaches for classifying benthic habitats and evaluating habitat quality. Journal of Environmental Management 73, 165–181.
CrossRef | PubMed |

Dobbie, M. J., and Dail, D. (2012). Environmental indices. In ‘Encyclopaedia of Environmetrics Second Edition’. (Eds A.-H. El-Shaarawi and W. Piegorsch.) pp. 862–864. (John Wiley & Sons Ltd: Chichester, UK.) doi: 10.1002/9780470057339.vnn157

Dobbie, M. J., and Dail, D. (2013). Robustness and sensitivity of weighting and aggregation in constructing composite indices. Ecological Indicators 29, 270–277.
CrossRef |

EHMP (2008). ‘Ecosystem Health Monitoring Program 2006–07 Annual Technical Report.’ (South East Queensland Healthy Waterways Partnership: Brisbane.)

EPA (2006). Queensland Water Quality Guidelines 2006. (Environmental Protection Agency: Brisbane.)

European Parliament and the Council of the European Union (2000). Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000 establishing a framework for Community action in the field of water policy. Official Journal of the European Communities 43, 1–73.

Fairweather, P. G. (1999). Determining the ‘health’ of estuaries: priorities for ecological research. Australian Journal of Ecology 24, 441–451.
CrossRef |

Hallett, C. S., Valesini, F. J., Clarke, K. R., Hesp, S. A., and Hoeksema, S. D. (2012). Development and validation of fish-based, multimetric indices for assessing the ecological health of Western Australian estuaries. Estuarine, Coastal and Shelf Science 104–105, 102–113.
CrossRef |

Heip, C. (1988). Biota and abiotic environment in the Westerschelde estuary. Hydrobiological Bulletin 22, 31–34.
CrossRef | CAS |

Hewitt, J. E., Anderson, M. J., and Thrush, S. F. (2005). Assessing and monitoring ecological community health in marine systems. Ecological Applications 15, 942–953.
CrossRef |

Karr, J. R. (1981). Assessment of biotic integrity using fish communities. Fisheries 6, 21–27.
CrossRef |

Koenker, R. W. (2005). ‘Quantile Regression.’ (Cambridge University Press: New York, NY.)

Koenker, R. (2012). ‘quantreg: Quantile Regression. R Package Version 4.79.’ Available at http://CRAN.R-project.org/package=quantreg (accessed 10 August 2012).

Llansó, R. J., Scott, L. C., Hyland, J. L., Dauer, D. M., Russell, D. E., and Kutz, F. W. (2002). An estuarine benthic index of biotic integrity for the mid-Atlantic region of the United States II. Index development. Estuaries 25, 1231–1242.
CrossRef |

Millward, G. E., and Glegg, G. A. (1997). Fluxes and retention of trace metals in the Humber estuary. Estuarine, Coastal and Shelf Science 44, 97–105.
CrossRef | CAS |

Nardo, M., Saisana, M., Saltelli, A., and Tarantola, S. (2005). Tools for composite indicators building. European Commission Joint Research Centre Report EUR 21682 EN.

Newell, P., Tiller, D., and Lloyd, L. N. (2012). Technical report for freshwater monitoring framework and report card for the Tamar estuary and Esk Rivers program. Report to NRM North.

OECD (2008). ‘Handbook on Constructing Composite Indicators: Methodology and User Guide.’ ISBN 978–92–64–04345–9.

Pantus, F. J., and Dennison, W. C. (2005). Quantifying and evaluation ecosystem health: a case study from Moreton Bay, Australia. Environmental Management 36, 757–771.
CrossRef | PubMed |

R Development Core Team (2012). ‘R: a language and environment for statistical computing.’ (R Foundation for Statistical Computing, Vienna, Austria.) ISBN 3–900051–07–0. Available at http://www.R-project.org/ (accessed 10 August 2012).

Raican, S. M., Wang, Y.-G., and Harch, B. D. (2013). Water quality indices from unbalanced spatio-temporal monitoring designs. In ‘Water Quality: Indicators, Human Impact and Environmental Health’. (Ed. Y.-G. Wang.) pp. 1–30. (Nova Publishers: New York, NY.)

Rider, P. R. (1960). Variance of the median of small samples from several special populations. Journal of the American Statistical Association 55, 148–150.
CrossRef |

Saisana, M., Saltelli, A., and Tarantola, S. (2005). Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. Journal of the Royal Statistical Society. Series A (General) 168, 307–323.
CrossRef |

Venables, W. N., and Ripley, B. D. (2002). ‘Modern Applied Statistics with S.’ 4th edn. (Springer: New York, NY.)

Weisberg, S. B., Ranasinghe, J. A., Dauer, D. M., Schaffner, L. C., Diaz, R. J., and Frithsen, J. B. (1997). An estuarine benthic index of biotic integrity (B-IBI) for Chesapeake Bay. Estuaries 20, 149–158.
CrossRef |

Wolter, K., and Timlin, M. S. (1993). Monitoring ENSO in COADS with a seasonally adjusted principal component index. In ‘Proceedings of the 17th Climate Diagnostics Workshop, Norman, OK, NOAA/NMC/CAC, NSSL, Oklahoma Clim’. pp. 52–57. Survey, CIMMS and the School of Meteor, University of Oklahoma.

Ysebaert, T., Herman, P. M. J., Meire, P., Craeymeersch, J., Verbeek, H., and Heip, C. H. R. (2003). Large-scale spatial patterns in estuaries: estuarine macrobenthic communities in the Schelde estuary, NW Europe. Estuarine, Coastal and Shelf Science 57, 335–355.
CrossRef | CAS |

Subscriber Login

Legal & Privacy | Contact Us | Help


© CSIRO 1996-2016