Register      Login
Marine and Freshwater Research Marine and Freshwater Research Society
Advances in the aquatic sciences
RESEARCH FRONT

New approaches to the ecological risk assessment of multiple stressors

Paul J. Van den Brink A B J , Catherine Bo Choung C , Wayne Landis D , Mariana Mayer-Pinto E , Vincent Pettigrove F , Peter Scanes G , Rachael Smith H and Jenny Stauber I
+ Author Affiliations
- Author Affiliations

A Department of Aquatic Ecology and Water Quality Management, Wageningen University, Wageningen University and Research centre, PO Box 47, NL-6700 AA Wageningen, Netherlands.

B Alterra, Wageningen University and Research centre, PO Box 47, NL-6700 AA Wageningen, Netherlands.

C Environment Canada at the Canadian Rivers Institute, Department of Biology, University of New Brunswick, 10 Bailey Drive, PO Box 45111, Fredericton, NB, E3B 6E1, Canada.

D Institute of Environmental Toxicology, Huxley College of the Environment, Western Washington University, Bellingham, WA 98225-9180, USA.

E Evolution & Ecology Research Centre, School of Biological, Earth and Environmental Sciences, University of New South Wales, Sydney, NSW 2052, Australia.

F CAPIM, Bio21 Institute, University of Melbourne, 30 Flemington Road, Parkville, Vic. 3010, Australia.

G Waters and Coastal Science Section, New South Wales Office of Environment and Heritage, PO Box A290, Sydney South, NSW 1232, Australia.

H Water Quality and Investigations, Environmental Monitoring and Assessment Science, Science Division, Department of Science, Information Technology, Innovation and the Arts (DSITIA), PO Box 5078, Brisbane, Qld 4001, Australia.

I CSIRO Land and Water, Locked Bag 2007, Kirrawee, Sydney, NSW 2232, Australia.

J Corresponding author. Email: paul.vandenbrink@wur.nl

Marine and Freshwater Research 67(4) 429-439 https://doi.org/10.1071/MF15111
Submitted: 13 March 2015  Accepted: 17 November 2015   Published: 12 January 2016

Abstract

So as to assess how emerging science and new tools can be applied to study multiple stressors at a large (ecosystem) scale and to facilitate greater integration of approaches among different scientific disciplines, a workshop was organised on 10–12 September 2014 at the Sydney Institute of Marine Sciences, Sydney, Australia. The present paper discusses the limitations of the current risk-assessment approaches and how multiple stressors at large scales can be better evaluated in ecological risk assessments to inform the development of more efficient and preventive management policies based on adaptive management in the future. A future risk-assessment paradigm that overcomes these limitations is presented. This paradigm includes cultural and ecological protection goals, the development of ecological scenarios, the establishment of the relevant interactions among species, potential sources of stressors, their interactions and the development of cause–effect models. It is envisaged that this will be achievable through a greater integration of approaches among different scientific disciplines and through the application of new and emerging tools such as 'big data', ecological modelling and the incorporation of ecosystem service endpoints.

Additional keywords: adaptive management, anthropogenic stress, aquatic ecosystems.


References

Amstrup, S. C., DeWeaver, E. T., Douglas, D. C., Marcot, B. G., Durner, G. M., Bitz, C. M., and Bailey, D. S. (2010). Greenhouse gas mitigation can reduce sea-ice loss and increase polar bear persistence. Nature 468, 955–958.
Greenhouse gas mitigation can reduce sea-ice loss and increase polar bear persistence.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3cXhsFKmu7fJ&md5=d614225d5da0cbca1252f41ee25ecaffCAS | 21164484PubMed |

Apitz, S. E. (2013). Ecosystem services and environmental decision making: seeking order in complexity. Integrated Environmental Assessment and Management 9, 214–230.
Ecosystem services and environmental decision making: seeking order in complexity.Crossref | GoogleScholarGoogle Scholar | 23281271PubMed |

Ashauer, R., and Brown, C. D. (2013). Highly time-variable exposure to chemicals: toward an assessment strategy. Integrated Environmental Assessment and Management 9, e27–e33.
Highly time-variable exposure to chemicals: toward an assessment strategy.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3sXhtVyrtLzJ&md5=179b66585758fd3f6bb200de5f55d7e6CAS | 23564608PubMed |

Augusiak, J., Van den Brink, P. J., and Grimm, V. (2014). Merging validation and evaluation of ecological models to ‘evaludation’: a review of terminology and a practical approach. Ecological Modelling 280, 117–128.
Merging validation and evaluation of ecological models to ‘evaludation’: a review of terminology and a practical approach.Crossref | GoogleScholarGoogle Scholar |

Ayre, K. K., and Landis, W. G. (2012). A Bayesian approach to landscape ecological risk assessment applied to the Upper Grande Ronde watershed, Oregon. Human and Ecological Risk Assessment 18, 946–970.
A Bayesian approach to landscape ecological risk assessment applied to the Upper Grande Ronde watershed, Oregon.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC38XhsVemtrvJ&md5=e1e9c05c56761c388f9a0b95852a6e1bCAS |

Baird, D. J., and Hajibabaei, M. (2012). Biomonitoring 2.0: a new paradigm in ecosystem assessment made possible by next-generation DNA sequencing. Molecular Ecology 21, 2039–2044.
Biomonitoring 2.0: a new paradigm in ecosystem assessment made possible by next-generation DNA sequencing.Crossref | GoogleScholarGoogle Scholar | 22590728PubMed |

Baird, D. J., and Van den Brink, P. J. (2007). Using biological traits to predict species sensitivity to toxic substances? Ecotoxicology and Environmental Safety 67, 296–301.
Using biological traits to predict species sensitivity to toxic substances?Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD2sXkvF2it74%3D&md5=550bfadef563a54f4cd7eec0f5ad0ad0CAS | 16996132PubMed |

Baird, D. J., Van den Brink, P. J., Chariton, A. A., Dafforn, K. A., and Johnston, E. L. (2016). New diagnostics for multiply stressed marine and freshwater ecosystems: integrating models, ecoinformatics and big data. Marine and Freshwater Research 67, 391–392.
New diagnostics for multiply stressed marine and freshwater ecosystems: integrating models, ecoinformatics and big data.Crossref | GoogleScholarGoogle Scholar |

Ballard, C., Compert, C., Jesionowski, T., Milman, I., Plants, B., Rosen, B., and Smith, H. (2014). ‘Information Governance Principles and Practices for a Big Data Landscape.’ (IBM Redbooks: New York.)

Barbour, M. T., Gerritsen, J., Snyder, B. D., and Stribling, J. B. (1999). ‘Rapid Bioassessment Protocols for Use in Streams and Wadeable Rivers: Periphyton, Benthic Nacroinvertebrates and Fish’, 2nd edn. EPA 841-B-99-002. (US Environmental Protection Agency, Office of Water: Washington, DC.)

Berghahn, R., Mohr, S., Hübner, V., Schmiediche, R., Schmiedling, I., Svetich-Will, E., and Schmidt, R. (2012). Effects of repeated insecticide pulses on macroinvertebrate drift in indoor stream mesocosms. Aquatic Toxicology 122–123, 56–66.
Effects of repeated insecticide pulses on macroinvertebrate drift in indoor stream mesocosms.Crossref | GoogleScholarGoogle Scholar | 22721787PubMed |

Biron, P. A., Massarin, S., Alonzo, F., Garcia-Sanchez, L., Charles, S., and Billoir, E. (2012). Population-level modeling to account for multigenerational effects of uranium in Daphnia magna. Environmental Science & Technology 46, 1136–1143.
Population-level modeling to account for multigenerational effects of uranium in Daphnia magna.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3MXhsFWktb%2FK&md5=2f1945c8db3ad27ed050f1bca221fbefCAS |

Branch, T. A., Watson, R., Fulton, E. A., Jennings, S., McGilliard, C. R., Pablico, G. T., Ricard, D., and Tracey, S. R. (2010). The trophic fingerprint of marine fisheries. Nature 468, 431–435.
The trophic fingerprint of marine fisheries.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3cXhsVeis7vL&md5=1f25116b629d249a7511f874eea56455CAS | 21085178PubMed |

Brock, T. C. M. (2013). Priorities to improve the ecological risk assessment and management for pesticides in surface water. Integrated Environmental Assessment and Management 9, e64–e74.
Priorities to improve the ecological risk assessment and management for pesticides in surface water.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3sXhtVyrtLzE&md5=0c29c97422f64799bb223d20056ccfc9CAS |

Bulleri, F., and Airoldi, L. (2005). Artificial marine structures facilitate the spread of a non-indigenous green alga, Codium fragile ssp. tomentosoides, in the north Adriatic Sea. Journal of Applied Ecology 42, 1063–1072.
Artificial marine structures facilitate the spread of a non-indigenous green alga, Codium fragile ssp. tomentosoides, in the north Adriatic Sea.Crossref | GoogleScholarGoogle Scholar |

Burton, G. A., De Zwart, D., Diamond, J., Dyer, S., Kapo, K. E., Liess, M., and Posthuma, L. (2012). Making ecosystem reality checks the status quo. Environmental Toxicology and Chemistry 31, 459–468.
Making ecosystem reality checks the status quo.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC38XjsVOjtrw%3D&md5=cedb0911e2300de2e034a574a1f6a4fdCAS | 22368116PubMed |

Chapman, P. M., McDonald, B. G., and Lawrence, G. S. (2002). Weight-of-evidence issues and frameworks for sediment quality (and other) assessments. Human and Ecological Risk Assessment 8, 1489–1515.
Weight-of-evidence issues and frameworks for sediment quality (and other) assessments.Crossref | GoogleScholarGoogle Scholar |

Chariton, A., Sun, M., Gibson, J., Webb, A., Leung, K., Hickey, C., and Hose, G. C. (2016). Emergent technologies and analytical approaches for increasing our understanding of multiple stressors in aquatic environments. Marine and Freshwater Research 67, 414–428.
Emergent technologies and analytical approaches for increasing our understanding of multiple stressors in aquatic environments.Crossref | GoogleScholarGoogle Scholar |

Clements, W. H., Hickey, C. W., and Kidd, K. A. (2012). How do aquatic communities respond to contaminants? It depends on the ecological context. Environmental Toxicology and Chemistry 31, 1932–1940.
How do aquatic communities respond to contaminants? It depends on the ecological context.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC38Xhs1KjtL3N&md5=36e3b99afa0d5d6232b2fd2229a737dfCAS | 22903782PubMed |

Colnar, A. M., and Landis, W. G. (2007). Conceptual model development for invasive species and regional risk assessment case study: the European green crab, Carcinus maenas, at Cherry Point, Washington, USA. Human and Ecological Risk Assessment 13, 120–155.
Conceptual model development for invasive species and regional risk assessment case study: the European green crab, Carcinus maenas, at Cherry Point, Washington, USA.Crossref | GoogleScholarGoogle Scholar |

Condie, S. A., Hayes, D., Fulton, E. A., and Savina, M. (2012). Modelling ecological change over half a century in a subtropical estuary: impacts of climate change, land-use, urbanization and freshwater extraction. Marine Ecology Progress Series 457, 43–66.
Modelling ecological change over half a century in a subtropical estuary: impacts of climate change, land-use, urbanization and freshwater extraction.Crossref | GoogleScholarGoogle Scholar |

Crain, C. M., Kroeker, K., and Halpern, B. S. (2008). Interactive and cumulative effects of multiple human stressors in marine systems. Ecology Letters 11, 1304–1315.
Interactive and cumulative effects of multiple human stressors in marine systems.Crossref | GoogleScholarGoogle Scholar | 19046359PubMed |

Culp, J. M., Hose, G. C., Armanini, D. G., Dunbar, M. J., Orlofske, J. M., Poff, N. L., Pollard, A. I., and Yates, A. G. (2011). Incorporating traits in aquatic biomonitoring to enhance causal diagnosis and prediction. Integrated Environmental Assessment and Management 7, 187–197.
Incorporating traits in aquatic biomonitoring to enhance causal diagnosis and prediction.Crossref | GoogleScholarGoogle Scholar | 21442732PubMed |

Daam, M. A., and Van den Brink, P. J. (2010). Implications of differences between temperate and tropical freshwater ecosystems for the ecological risk assessment of pesticides. Ecotoxicology (London, England) 19, 24–37.
Implications of differences between temperate and tropical freshwater ecosystems for the ecological risk assessment of pesticides.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3cXitlKjtg%3D%3D&md5=2f8e60fb386784eb5c6bd2581c05a864CAS |

Dafforn, K. A., Johnston, E. L., Ferguson, A., Humphrey, C., Monk, W., Nichols, S. J., Simpson, S. L., Tulbure, M. G., and Baird, D. J. (2016). Data opportunities and challenges for assessing multiple stressors across scales in aquatic ecosystems. Marine and Freshwater Research 67, 393–413.
Data opportunities and challenges for assessing multiple stressors across scales in aquatic ecosystems.Crossref | GoogleScholarGoogle Scholar |

Dam, R. A., Camilleri, C., Bayliss, P., and Markich, S. J. (2004). Ecological risk assessment of tebuthiuron following application on tropical Australian wetlands. Human and Ecological Risk Assessment 10, 1069–1097.
Ecological risk assessment of tebuthiuron following application on tropical Australian wetlands.Crossref | GoogleScholarGoogle Scholar |

De Laender, F., and Janssen, C. (2013). The ecosystem perspective in ecotoxicology as a way forward for the ecological risk assessment of chemicals. Integrated Environmental Assessment and Management 9, e34–e38.
The ecosystem perspective in ecotoxicology as a way forward for the ecological risk assessment of chemicals.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3sXhtVyrtL%2FL&md5=a0b78b6a4a5f0ada4468c7b72ffec236CAS | 23610029PubMed |

De Laender, F., Morselli, M., Baveco, H., Van den Brink, P. J., and Di Guardo, A. (2015). Theoretically exploring direct and indirect chemical effects across ecological and exposure scenarios using mechanistic fate and effects modelling. Environment International 74, 181–190.
Theoretically exploring direct and indirect chemical effects across ecological and exposure scenarios using mechanistic fate and effects modelling.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC2cXhvVygsb7I&md5=7016105ec2fb93e0c577bb424cf4e46cCAS | 25454235PubMed |

Dunbar, M. B., Paagos, P., and Montanarella, L. (2013). European perspective of ecosystem services and related policies. Integrated Environmental Assessment and Management 9, 231–236.
European perspective of ecosystem services and related policies.Crossref | GoogleScholarGoogle Scholar | 23359571PubMed |

EFSA PPR Panel (2013). Guidance on tiered risk assessment for plant protection products for aquatic organisms in edge-of-field surface waters. EFSA Journal 11, 3290.
Guidance on tiered risk assessment for plant protection products for aquatic organisms in edge-of-field surface waters.Crossref | GoogleScholarGoogle Scholar |

EFSA PPR Panel (2014). Scientific opinion on good modelling practice in the context of mechanistic effect models for risk assessment of plant protection products. EFSA Journal 12, 3589.
Scientific opinion on good modelling practice in the context of mechanistic effect models for risk assessment of plant protection products.Crossref | GoogleScholarGoogle Scholar |

EFSA PPR Panel (2015). DRAFT Guidance Document. Guidance to define protection goals for environmental risk assessment in relation to biodiversity and ecosystem services. (European Food Safety Authority: Parma, Italy.) Available at http://www.efsa.europa.eu/sites/default/files/assets/150622a.pdf [Verified 1 December 2015].

Eränen, J. K., Nilsen, J., Zverev, V. E., and Kozlov, M. V. (2009). Mountain birch under multiple stressors: heavy metal-resistant populations co-resistant to biotic stress but maladapted to abiotic stress. Journal of Evolutionary Biology 22, 840–851.
Mountain birch under multiple stressors: heavy metal-resistant populations co-resistant to biotic stress but maladapted to abiotic stress.Crossref | GoogleScholarGoogle Scholar | 19226419PubMed |

European Commission (2013). Addressing the new challenges for risk assessment. (Scientific Committee on Health and Environmental Risks (SCHER), Scientific Committee on Emerging and Newly Identified Health Risks (SCENIHR), Scientific Committee on Consumer Safety (SCCS)). Available at http://ec.europa.eu/health/scientific_committees/consumer_safety/docs/sccs_o_131.pdf [Verified 1 December 2015].

Fairweather, P. G. (1998). Experimental research in environmental management and biodiversity protection: ecological principles and methods. Australasian Journal of Environmental Management 5, 15–17.
Experimental research in environmental management and biodiversity protection: ecological principles and methods.Crossref | GoogleScholarGoogle Scholar |

Fan, L., Liu, M., Simister, R., Webster, N. S., and Thomas, T. (2013). Marine microbial symbiosis heats up: the phylogenetic and functional response of a sponge holobiont to thermal stress. The ISME Journal 7, 991–1002.
Marine microbial symbiosis heats up: the phylogenetic and functional response of a sponge holobiont to thermal stress.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3sXms1Wit7w%3D&md5=6008485d569108bf44f2976dc074702dCAS | 23283017PubMed |

Fleeger, J. W., Carman, K. R., and Nisbet, R. M. (2003). Indirect effects of contaminants in aquatic ecosystems. The Science of the Total Environment 317, 207–233.
Indirect effects of contaminants in aquatic ecosystems.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD3sXovF2qtb0%3D&md5=c8e3f886c57959f4ba3990d8764fd56dCAS | 14630423PubMed |

Forbes, V. E., and Calow, P. (2013). Developing predictive systems models to address complexity and relevance for ecological risk assessment. Integrated Environmental Assessment and Management 9, e75–e80.
Developing predictive systems models to address complexity and relevance for ecological risk assessment.Crossref | GoogleScholarGoogle Scholar | 23613313PubMed |

Fulton, E. A. (2011). Interesting times: winners, losers, and system shifts under climate change around Australia. ICES Journal of Marine Science 68, 1329–1342.
Interesting times: winners, losers, and system shifts under climate change around Australia.Crossref | GoogleScholarGoogle Scholar |

Fulton, E. A., Link, J. S., Kaplan, I. C., Savina-Rolland, M., Johnson, P., Ainsworth, C., Horne, P., Gorton, R., Gamble, R. J., Smith, A. D. M., and Smith, D. C. (2011). Lessons in modelling and management of marine ecosystems: the Atlantis experience. Fish and Fisheries 12, 171–188.
Lessons in modelling and management of marine ecosystems: the Atlantis experience.Crossref | GoogleScholarGoogle Scholar |

Fulton, E. A., Smith, A. D. M., Smith, D. C., and Johnson, P. (2014). An integrated approach is needed for ecosystem based fisheries management: insights from ecosystem-level management strategy evaluation. PLoS One 9, e84242.
An integrated approach is needed for ecosystem based fisheries management: insights from ecosystem-level management strategy evaluation.Crossref | GoogleScholarGoogle Scholar | 24454722PubMed |

Galic, N., Hommen, U., Baveco, J. M., and Van den Brink, P. J. (2010). Potential application of population models in the European ecological risk assessment of chemicals: II. Review of models and whether they can address the protection aims. Integrated Environmental Assessment and Management 6, 338–360.
Potential application of population models in the European ecological risk assessment of chemicals: II. Review of models and whether they can address the protection aims.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3cXhtVWmtbrE&md5=63c75135944bf7afe8b02a79c7386560CAS | 20821698PubMed |

Galic, N., Ashauer, R., Baveco, H., Nyman, A.-M., Barsi, A., Thorbek, P., Bruns, E., and Van den Brink, P. J. (2014). Modelling the contribution of toxicokinetic and toxicodynamic processes to the recovery of Gammarus pulex populations after exposure to pesticides. Environmental Toxicology and Chemistry 33, 1476–1488.
Modelling the contribution of toxicokinetic and toxicodynamic processes to the recovery of Gammarus pulex populations after exposure to pesticides.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC2cXpvVWksLY%3D&md5=3eaa919042a7dfc0148abb98184d537aCAS | 24307654PubMed |

Gentile, J. H., Harwell, M. A., Cropper, W., Harwell, C. C., DeAngelis, D., Davis, S., Ogden, J. C., and Lirman, D. (2001). Ecological conceptual models: a framework and case study on ecosystem management for South Florida sustainability. The Science of the Total Environment 274, 231–253.
Ecological conceptual models: a framework and case study on ecosystem management for South Florida sustainability.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD3MXks1ejsLs%3D&md5=c296cb07d0541d6c4a40d42eab228a79CAS | 11453300PubMed |

Gilliom, R. J., Barbash, J. E., Crawford, C. G., Hamilton, P. A., Martin, J. D., Nakagaki, N., Nowell, L. H., Scott, J. C., Stackelberg, P. E., Thelin, G. P., and Wolock, D. M. (2006). ‘The Quality of Our Nation’s Waters. Pesticides in the Nation’s Streams and Ground Water, 1992–2001.’ (US Geological Survey: Reston, VA.)

Hampton, S. E., Strasser, C. A., Tewksbury, J. J., Gram, W. K., Budden, A. E., Batcheller, A. L., Duke, C. S., and Porter, J. H. (2013). Big data and the future of ecology. Frontiers in Ecology and the Environment 11, 156–162.
Big data and the future of ecology.Crossref | GoogleScholarGoogle Scholar |

Hart, B. T., and Pollino, C. A. (2008). Increased use of Bayesian network models will improve ecological risk assessments. Human and Ecological Risk Assessment 14, 851–853.
Increased use of Bayesian network models will improve ecological risk assessments.Crossref | GoogleScholarGoogle Scholar |

Hines, E. E., and Landis, W. G. (2014). Regional risk assessment of the Puyallup river watershed and the evaluation of low impact development in meeting management goals. Integrated Environmental Assessment and Management 10, 269–278.
Regional risk assessment of the Puyallup river watershed and the evaluation of low impact development in meeting management goals.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC2cXks12jt70%3D&md5=3051d8cc7af82f485148ecb829c26d72CAS | 24288344PubMed |

Hommen, U., Baveco, J. M., Galic, N., and Van den Brink, P. J. (2010). Potential application of ecological models in the European environmental risk assessment of chemicals I: review of protection goals in EU directives and regulations. Integrated Environmental Assessment and Management 6, 325–337.
Potential application of ecological models in the European environmental risk assessment of chemicals I: review of protection goals in EU directives and regulations.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3cXhtVWmtbrL&md5=a1925813f21b9169ffd63cf7a24bbd1dCAS | 20821697PubMed |

Horrigan, N., and Baird, D. J. (2008). Trait patterns of aquatic insects across gradients of flow‐related factors: a multivariate analysis of Canadian national data. Canadian Journal of Fisheries and Aquatic Sciences 65, 670–680.
Trait patterns of aquatic insects across gradients of flow‐related factors: a multivariate analysis of Canadian national data.Crossref | GoogleScholarGoogle Scholar |

Hunka, A. D., Meli, M., Thit, A., Palmquist, A., Thorbeck, P., and Forbes, V. E. (2013). Stakeholder’s perspective on ecological modeling in environmental risk assessment of pesticides: challenges and opportunities. Risk Analysis 33, 68–79.
Stakeholder’s perspective on ecological modeling in environmental risk assessment of pesticides: challenges and opportunities.Crossref | GoogleScholarGoogle Scholar | 22587756PubMed |

Jackson, M. C., Loewen, C. J. G., Vinebrooke, R. D., and Chimimba, C. T. (2016). Net effects of multiple stressors in freshwater ecosystems: a meta-analysis. Global Change Biology 22, 180–189.
Net effects of multiple stressors in freshwater ecosystems: a meta-analysis.Crossref | GoogleScholarGoogle Scholar |

Johnston, E. L., Mayer-Pinto, M., and Crowe, T. P. (2015). Chemical contaminant effects on marine ecosystem functioning. Journal of Applied Ecology 52, 140–149.
Chemical contaminant effects on marine ecosystem functioning.Crossref | GoogleScholarGoogle Scholar |

Kapustka, L. (2008). Limitations of the current practices used to perform ecological risk assessment. Integrated Environmental Assessment and Management 4, 290–298.
Limitations of the current practices used to perform ecological risk assessment.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD1cXpt1yjuro%3D&md5=bda11a6addc8c0f26d2d2eb00ee4ca4aCAS | 18324872PubMed |

Kapustka, L. A., Bowers, K., Isanhart, J., Martinez-Garza, C., Finger, S., Stahl, R., and Stauber, J. (2015). Coordinating ecological restoration options and risk assessment to improve environmental outcomes. Integrated Environmental Assessment and Management , .
Coordinating ecological restoration options and risk assessment to improve environmental outcomes.Crossref | GoogleScholarGoogle Scholar | 26077395PubMed |

Kellar, C. R., Hassell, K. L., Long, S. M., Myers, J. H., Golding, L., Rose, G., Kumar, A., Hoffmann, A. A., and Pettigrove, V. (2014). Ecological evidence links adverse biological effects to pesticide and metal contamination in an urban Australian watershed. Journal of Applied Ecology 51, 426–439.
Ecological evidence links adverse biological effects to pesticide and metal contamination in an urban Australian watershed.Crossref | GoogleScholarGoogle Scholar |

Kimberly, D. A., and Salice, C. J. (2014). Complex interactions between climate change and toxicants: evidence that temperature variability increases sensitivity to cadmium. Ecotoxicology 23, 809–817.
Complex interactions between climate change and toxicants: evidence that temperature variability increases sensitivity to cadmium.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC2cXkt1ahurk%3D&md5=1dc35dcc2c6be3fdc993e23c5e563984CAS | 24623389PubMed |

Kwok, K. W. H., Leung, K. M. Y., Chu, V. K. H., Lam, P. K. S., Morritt, D., Maltby, L., Brock, T. C. M., Van den Brink, P. J., Warne, M. St. J., and Crane, M. (2007). Comparison of tropical and temperate freshwater species sensitivities to chemicals: implications for deriving safe extrapolation factors. Integrated Environmental Assessment and Management 3, 49–67.
Comparison of tropical and temperate freshwater species sensitivities to chemicals: implications for deriving safe extrapolation factors.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD2sXhvFyqs7c%3D&md5=14ccbde22bf3e3a6c1ee9b82a8c0ac9bCAS |

Landis, W. G., and Wiegers, J. K. (2005). Introduction to the regional risk assessment model using the relative risk model. In ‘Regional Scale Ecological Risk Assessment Using the Relative Risk Model’. (Ed. W. G. Landis.) pp. 11–36. (CRC Press: Boca Raton, FL.)

Landis, W. G., and Wiegers, J. K. (2007). Ten years of the relative risk model and regional scale ecological risk assessment. Human and Ecological Risk Assessment 13, 25–38.
Ten years of the relative risk model and regional scale ecological risk assessment.Crossref | GoogleScholarGoogle Scholar |

Lange, K., Townsend, C. R., and Matthaei, C. D. (2014). Can biological traits of stream invertebrates help disentangle the effects of multiple stressors in an agricultural catchment? Freshwater Biology 59, 2431–2446.
Can biological traits of stream invertebrates help disentangle the effects of multiple stressors in an agricultural catchment?Crossref | GoogleScholarGoogle Scholar |

Leeuwangh, P., Brock, T. C. M., and Kersting, K. (1994). An evaluation of four types of freshwater model ecosystem for assessing the hazard of pesticides. Human and Experimental Toxicology 13, 888–899.
An evaluation of four types of freshwater model ecosystem for assessing the hazard of pesticides.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DyaK2MXjs1ygu7k%3D&md5=78315fd8e94142fa0b86d8079fba15e3CAS | 7536432PubMed |

Leung, K. M. Y., Bjørgesæter, A., Gray, J. S., Li, W. K., Lui, G. C. S., Wang, Y., and Lam, P. K. S. (2005). Deriving sediment quality guidelines from field-based species sensitivity distributions. Environmental Science & Technology 39, 5148–5156.
Deriving sediment quality guidelines from field-based species sensitivity distributions.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD2MXltVymtrs%3D&md5=8ca3c854534482e27551763d07f0220dCAS |

Marcot, B. G., Steventon, J. D., Sutherland, G. D., and McCann, R. K. (2006). Guidelines for developing and updating Bayesian belief networks applied to ecological modeling and conservation. Canadian Journal of Research 36, 3075–3086.

McMahon, T. A., Halstead, N. T., Johnson, S., Raffel, T. R., Romansic, J. M., Crumrine, P. W., and Rohr, J. R. (2012). Fungicide-induced declines of freshwater biodiversity modify ecosystem functions and services. Ecology Letters 15, 714–722.
Fungicide-induced declines of freshwater biodiversity modify ecosystem functions and services.Crossref | GoogleScholarGoogle Scholar | 22587750PubMed |

Nienstedt, K. M., Brock, T. C. M., van Wensem, J., Montforts, M., Hart, A., Aagaard, A., Alix, A., Boesten, J., Bopp, S. K., Brown, C., Capri, E., Forbes, V., Koepp, H., Liess, M., Luttik, R., Maltby, L., Sousa, J. P., Streissl, F., and Hardy, A. R. (2012). Development of a framework based on an ecosystem services approach for deriving specific protection goals for environmental risk assessment of pesticides. The Science of the Total Environment 415, 31–38.
Development of a framework based on an ecosystem services approach for deriving specific protection goals for environmental risk assessment of pesticides.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC38XotVChtA%3D%3D&md5=fd3d67affcd7273d26c94f0575acd543CAS | 21733564PubMed |

Noyes, P. D., McElwee, M. K., Miller, H. D., Clark, B. W., Van Tiem, L. A., Walcott, K. C., Erwin, K. N., and Levin, E. D. (2009). The toxicology of climate change: environmental contaminants in a warming world. Environment International 35, 971–986.
The toxicology of climate change: environmental contaminants in a warming world.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD1MXms1yisrk%3D&md5=76c9b5bd90714aab881cf40164b0422cCAS | 19375165PubMed |

Nyberg, J. B., Marcot, B. G., and Sulyma, R. (2006). Using Bayesian belief networks in adaptive management. Canadian Journal of Research 36, 3104–3116.
Using Bayesian belief networks in adaptive management.Crossref | GoogleScholarGoogle Scholar |

Piggott, J. J., Niyogi, D. K., Townsend, K. R., and Matthaei, C. D. (2015). Multiple stressors and stream ecosystem functioning: climate warming and agricultural stressors interact to affect processing of organic matter. Journal of Applied Ecology 52, 1126–1134.
Multiple stressors and stream ecosystem functioning: climate warming and agricultural stressors interact to affect processing of organic matter.Crossref | GoogleScholarGoogle Scholar |

Rico, A., Van den Brink, P. J., Gylstra, R., Focks, A., and Brock, T. C. M. (2015). Developing ecological scenarios for the prospective aquatic risk assessment of pesticides. Integrated Environmental Assessment and Management , .
Developing ecological scenarios for the prospective aquatic risk assessment of pesticides.Crossref | GoogleScholarGoogle Scholar | 26442690PubMed |

Rivero, N. K., Dafforn, K. A., Coleman, M. A., and Johnston, E. L. (2013). Environmental and ecological changes associated with a marina. Biofouling 29, 803–815.
Environmental and ecological changes associated with a marina.Crossref | GoogleScholarGoogle Scholar | 23822594PubMed |

Rubach, M. N., Baird, D. J., and Van den Brink, P. J. (2010). A new method for ranking mode-specific sensitivity of freshwater arthropods to insecticides and its relationship to biological traits. Environmental Toxicology and Chemistry 29, 476–487.
A new method for ranking mode-specific sensitivity of freshwater arthropods to insecticides and its relationship to biological traits.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3cXjt1Cgtbc%3D&md5=1203f6f84e90fbc1f6f1579a00af9d20CAS | 20821467PubMed |

Rubach, M. N., Baird, D. J., Boerwinkel, M.-C., Maund, S. J., Roessink, I., and Van den Brink, P. J. (2012). Species traits as predictors for intrinsic sensitivity of aquatic invertebrates to the insecticide chlorpyrifos. Ecotoxicology 21, 2088–2101.
Species traits as predictors for intrinsic sensitivity of aquatic invertebrates to the insecticide chlorpyrifos.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC38Xht1OmtLbL&md5=b019760e4a3f29a57007679df7431c75CAS | 22711550PubMed |

Scanes, P., Coade, G., Doherty, M., and Hill, R. (2007). Evaluation of the utility of water quality based indicators of estuarine lagoon condition in NSW, Australia. Estuarine, Coastal and Shelf Science 74, 306–319.
Evaluation of the utility of water quality based indicators of estuarine lagoon condition in NSW, Australia.Crossref | GoogleScholarGoogle Scholar |

Schreiber, E. S. G., Bearlin, A. R., Nicol, S. J., and Todd, C. R. (2004). Adaptive management: a synthesis of current understanding and effective application. Ecological Management & Restoration 5, 177–182.
Adaptive management: a synthesis of current understanding and effective application.Crossref | GoogleScholarGoogle Scholar |

Schuler, L. J., Hoang, T. C., and Rand, G. M. (2008). Aquatic risk assessment of copper in freshwater and saltwater ecosystems of South Florida. Ecotoxicology 17, 642–659.
Aquatic risk assessment of copper in freshwater and saltwater ecosystems of South Florida.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD1cXhtFKju77F&md5=25dd93dbad4f07e6ca6bc2bccdab6201CAS | 18622698PubMed |

Tarazona, J. V. (2013). Use of new scientific developments in regulatory risk assessments: challenges and opportunities. Integrated Environmental Assessment and Management 9, e85–e91.
Use of new scientific developments in regulatory risk assessments: challenges and opportunities.Crossref | GoogleScholarGoogle Scholar | 23625625PubMed |

Townsend, C. R., Uhlmann, S. S., and Matthaei, C. D. (2008). Individual and combined responses of stream ecosystems to multiple stressors. Journal of Applied Ecology 45, 1810–1819.
Individual and combined responses of stream ecosystems to multiple stressors.Crossref | GoogleScholarGoogle Scholar |

Trolle, D., Hamilton, D. P., Hipsey, M. R., Bolding, K., Bruggeman, J., Mooij, W. M., Janse, J. H., Nielsen, A., Jeppesen, E., Elliott, J. A., Makler-Pick, V., Petzoldt, T., Rinke, K., Flindt, M. R., Arhonditsis, G. B., Gal, G., Bjerring, R., Tominaga, K., ’t Hoen, J., Downing, A. S., Marques, D. M., Fragoso, C. R., Søndergaard, M., and Hanson, P. C. (2012). A community-based framework for aquatic ecosystem models. Hydrobiologia 683, 25–34.
A community-based framework for aquatic ecosystem models.Crossref | GoogleScholarGoogle Scholar |

US EPA (1998). Guidelines for Ecological Risk Assessment, EPA/630/R-95/002F. US Environmental Protection Agency, Washington, DC.

Van den Brink, P. J. (2008). Ecological risk assessment: from book-keeping to chemical stress ecology. Environmental Science & Technology 42, 8999–9004.
Ecological risk assessment: from book-keeping to chemical stress ecology.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD1cXhsVKksr%2FE&md5=7e3ecf91b557ccaeea2234da822f0313CAS |

Van den Brink, P. J., Alexander, A., Desrosiers, M., Goedkoop, W., Goethals, P., Liess, M., and Dyer, S. (2011). Traits-based approaches in bioassessment and ecological risk assessment: strengths, weaknesses, opportunities and threats. Integrated Environmental Assessment and Management 7, 198–208.
Traits-based approaches in bioassessment and ecological risk assessment: strengths, weaknesses, opportunities and threats.Crossref | GoogleScholarGoogle Scholar | 20981837PubMed |

Van den Brink, P. J., Baird, D. J., Baveco, J. M., and Focks, A. (2013). The use of traits-based approaches and eco(toxico)logical models to advance the ecological risk assessment framework for chemicals. Integrated Environmental Assessment and Management 9, e47–e57.
The use of traits-based approaches and eco(toxico)logical models to advance the ecological risk assessment framework for chemicals.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3sXhtVyrtLzK&md5=dd1d9807069518668f7fa1722b0b46f2CAS | 23625553PubMed |

Vinebrooke, R. D., Cottingham, K. L., Norberg, J., Scheffer, M., Dodson, S. I., Maberly, S. C., and Sommer, U. (2004). Impacts of multiple stressors on biodiversity and ecosystem functioning: the role of species co-tolerance. Oikos 104, 451–457.
Impacts of multiple stressors on biodiversity and ecosystem functioning: the role of species co-tolerance.Crossref | GoogleScholarGoogle Scholar |

Vörösmarty, C. J., McIntyre, P. B., Gessner, M. O., Dudgeon, D., Prusevich, A., Green, P., Glidden, S., Bunn, S. E., Sullivan, C. A., Reidy Liermann, C., and Davies, P. M. (2010). Global threats to human water security and river biodiversity. Nature 467, 555–561.
Global threats to human water security and river biodiversity.Crossref | GoogleScholarGoogle Scholar | 20882010PubMed |

Walters, C. J. (1986). ‘Adaptive Management of Renewable Resources.’ (Macmillan: New York.)

Walters, C. (1997). Challenges in adaptive management of riparian and coastal ecosystems. Conservation Ecology 1, 1.

Walters, C., and Holling, C. S. (1990). Large-scale management experiments and learning by doing. Ecology 71, 2060–2068.
Large-scale management experiments and learning by doing.Crossref | GoogleScholarGoogle Scholar |

Wyant, J. G., Meganck, R. A., and Ham, S. M. (1995). A planning and decision-making framework for ecological restoration. Environmental Management 19, 789–796.
A planning and decision-making framework for ecological restoration.Crossref | GoogleScholarGoogle Scholar |