Monitoring and Evaluation Strategy 2013–2018

Reef Water Quality
Protection Plan
Monitoring and Evaluation Strategy
2013 – 2018
Contents
Context3
Purpose4
Scope4
Principles5
Management questions
6
Goal and targets
7
Monitoring and evaluation components
8
Reporting framework
10
Key deliverables 12
Indicative funding
12
Partners13
Appendix 1—Key actions and deliverables
for Reef Plan monitoring and evaluation
14
© The State of Queensland (Department of the Premier and Cabinet) 2014. Published by the Reef Water Quality Protection Plan Secretariat, December 2014, 100 George Street,
Brisbane Qld 4000. The Queensland Government supports and encourages the dissemination and exchange of information. However, copyright protects this document. The State of
Queensland has no objection to this material being reproduced, made available online or electronically but only if it is recognised as the owner of the copyright and this material remains
unaltered. Copyright enquiries about this publication should be directed to the Department of the Premier and Cabinet, by email to [email protected] or in writing to PO Box
15185, City East Qld 4002. Copies of this publication can be obtained by contacting (07) 3003 9381 or at www.reefplan.qld.gov.au.
Image credits: Great Barrier Reef Marine Park Authority.
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
2
Context
This Monitoring and Evaluation Strategy sets
the monitoring and evaluation framework for
the Reef Water Quality Protection Plan (Reef
Plan) 2013. It builds upon the previous Reef Plan
Monitoring and Evaluation Strategy 2009 and
links to the Reef Plan Research, Development
and Innovation Strategy 2013–2018 and Reef
Plan Investment Strategy 2013–2018.
Reef Plan sets ambitious but achievable targets
for improved water quality and land management
practices, and identifies actions to improve the
quality of water entering the Reef. Measuring
progress towards this goal and targets is vital
in determining the success of Reef Plan.
Reef Plan is a joint commitment of the Australian
and Queensland Governments. Its long term
goal is to ensure that by 2020 the quality of water
entering the Reef from adjacent catchments
has no detrimental impact on the health and
resilience of the Great Barrier Reef. This strategy
describes the monitoring and evaluation
arrangements for Reef Plan.
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
3
Purpose
Scope
The Monitoring and Evaluation Strategy
2013–2018 sets the scope and considerations
required to develop a coordinated monitoring
and evaluation program for Reef Plan. It will
enable partners to evaluate, prioritise and
continuously improve the efficiency and
effectiveness of Reef Plan implementation
(‘adaptive management’) and report on progress
towards Reef Plan’s goal and targets.
This strategy includes two
inter‑related components:
• measuring Reef Plan outcomes (through
the Paddock to Reef Integrated Monitoring,
Modelling and Reporting Program) and
• measuring Reef Plan implementation
(i.e. reporting on progress against Reef
Plan actions).
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
4
Principles
Reef Plan monitoring and evaluation
arrangements will:
• Build on existing knowledge generated since
the commencement of Reef Plan in 2003
and use new research, development and
innovation monitoring and reporting programs
to ensure efficiencies are maximised.
• Inform adaptive management through
effective evaluation of on-ground delivery
to enable partners to improve the efficiency
and effectiveness of their actions.
• Ensure accountability and transparency
through the development of clearly defined
implementation plans and regular evaluation
and reporting of progress towards Reef Plan
actions and deliverables.
• Integrate with other relevant monitoring and
reporting programs in the Great Barrier Reef
region including regional report cards.
• Provide a ‘smart’ design which focuses
monitoring in key areas and on key pollutants,
and uses assessment and modelling tools to
measure water quality and ecosystem health
improvement across the Great Barrier Reef.
• Coordinate the security, maintenance, use and
sharing of data and information from a range
of partners and have consistent quality control
and interpretation processes.
• Measure and report on progress towards
Reef Plan’s goal and targets.
• Coordinate and integrate monitoring,
evaluation and reporting at a range of
scales from the paddock to the Reef using
management uptake, land condition, water
quality and Reef ecosystem health information.
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
5
Management questions
The following key management questions
support the monitoring and evaluation of
Reef Plan.
Measuring Reef Plan implementation:
Measuring Reef Plan outcomes:
• Have implementation plans been developed
• What is the area of land under improved
management systems and practices
(compared to the baseline)?
• What water quality improvement (for key
pollutants) is being achieved due to better land
management practices?
• Are catchment condition and function
indicators stabilising or showing consistent
improvement?
• Has any change in marine water quality
or ecosystem health been detected which
correlates to a reduction in pollutants
entering the Reef?
• What progress has been made in delivering
the Reef Plan actions and deliverables?
and agreed?
• Have the deliverables been met within agreed
timeframes?
• Were the actions the most appropriate and
did they achieve the intended outcomes?
• What could be done differently to improve
overall efficiency of Reef Plan management
and implementation?
• Were the priorities for investment appropriate
and targeted in the most efficient way?
• What impact is a change in water quality
having on the health of the Reef ecosystem
and related coastal and aquatic ecosystems?
• Have we improved our understanding of the
key risks and management solutions?
• How and where could actions be better
targeted to accelerate the water quality
improvement and reduce the impact on the
Reef ecosystem?
–– Which practices are most important?
• Are we making progress toward the Reef
Plan goal and targets?
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
6
Goal and targets
The Reef Plan goal and targets are a key
element of the Monitoring and Evaluation
Strategy. Progress towards the Reef Plan goal
and targets is measured through the Paddock
to Reef program and reported through Reef
Plan report cards.
Reef Plan’s long term goal is to ensure that
by 2020 the quality of water entering the
Reef from broadscale land use has no
detrimental impact on the health and
resilience of the Great Barrier Reef.
Targets for land management and water quality
improvement have been set to help identify a
pathway towards that goal. Both the goal and
targets are considered ambitious and give all
partners something to aspire to.
Some will be more challenging to meet than
others, but overall, they seek to move land
management to best practice in as wide an area
as possible which will have positive water quality
benefits for the Reef.
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
7
Monitoring and evaluation components
Measuring Reef Plan outcomes
The Paddock to Reef Integrated Monitoring,
Modelling and Reporting Program (Paddock
to Reef program) was established in 2009,
funded jointly by the Australian and Queensland
Governments. It is an innovative approach
to integrating monitoring and modelling
information, linking land management practices
in catchments to the health of the Reef (see
Figure 1, page 9).
The program applies a modelling framework
supported by monitoring data to report progress
in the short term. The program design involves
monitoring and modelling various attributes
at a range of scales including management
practices, catchment indicators and water
quality at the paddock and catchment levels as
well as water quality and ecological responses
in the adjacent Reef.
This approach provides the ability to link the
monitoring and modelling outputs at each scale
and across scales. The program is founded
on the key principles of adaptive management
and continuous improvement. It integrates the
best available information, recognising that
data confidence varies across the indicators
and regions.
There are 10 inter-related components of
the program which are integrated through a
common assessment and reporting framework:
• Management practice adoption
• Paddock monitoring
• Paddock modelling
• Groundcover
• Riparian vegetation
• Wetland extent
• Wetland functions and values assessment
• Catchment loads monitoring
• Catchment modelling
• Marine monitoring.
The Paddock to Reef program was reviewed in
2012–2013. The findings of this review informed
the funding arrangements and the program
redesign for 2013–2018. The Program Design
2013–2018 sets out the objectives, design
elements and implementation processes for
the program from 2013 to 2018. The Program
Design will be reviewed annually to ensure it is
effectively meeting the objectives.
The core objective of the Paddock to Reef
program is to measure and report progress
towards the Reef Plan goal and targets through
an annual Reef Plan Report Card. In addition,
the program provides information that enables
partners to evaluate, prioritise and continuously
improve the efficiency and effectiveness of Reef
Plan implementation at Great Barrier Reef-wide
and regional scales.
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
8
easuring Reef Plan
M
implementation
Reef Plan outlines a suite of clearly defined
actions and deliverables. Lead accountable
entities are responsible for developing
implementation plans and regularly reporting
on progress.
In most cases, supporting organisations will
also be required to deliver elements of the
implementation plan. Identification of resources
for the delivery of implementation plans are
the responsibility of accountable entities and
supporting organisations and are beyond the
scope of this strategy.
Regular evaluation and reporting in the form
of progress reports and an independent audit
in 2016 will help to ensure accountability
for the delivery of actions. These progress
reports will also be used to ensure Reef Plan
actions and implementation arrangements are
responsive and continuously improved, based
upon the latest information and knowledge as
part of an adaptive management approach.
The actions and deliverables relevant
to monitoring and evaluating Reef Plan’s
performance are listed in Appendix 1.
The Integrated Paddock to Reef Monitoring,
Modelling and Reporting Program
Paddock
Catchment
Marine
water quality and economic
modelling
water quality modelling
water quality modelling
Plot scale rainfall
simulation trials
Adoption of improved
management practices
Water quality monitoring of
key pollutants under
improved management
practices
Water quality monitoring of key pollutants
at sub-catchment and end-of-catchment
sites
Wetland mapping
Water quality (flow) monitoring
Remote sensing of groundcover and
riparian areas
Remote sensing of
pollutant flood plumes
Seagrass abundance and
health monitoring
Grab sampling of water
quality during flood events
Water quality loggers and
passive samplers
Coral reef health
monitoring
Figure 1: Key components of the Paddock to Reef program
*It is anticipated the eReefs project will deliver a receiving water model
that will close the gap in modelling from the end of catchments to the
marine environment.
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
9
Reporting framework
The Paddock to Reef program collects a wealth
of data and information to inform management
and investment at Great Barrier Reef-wide and
regional scales. Reporting is driven by evaluating
progress towards the Reef Plan goal and
targets (including the Australian Government
Reef Programme and the Reef 2050 Long-Term
Sustainability Plan, which is being developed).
This section outlines the reporting approach
and requirements for Reef Plan report cards, the
primary output of the Paddock to Reef program.
Reporting will be at the Great Barrier Reef-wide
and regional scales (and catchment scales
where possible and appropriate).
Reporting principles
The following principles have been developed
to guide reporting:
• Annual report cards will be delivered by
September the year after data collection
unless extenuating circumstances occur.
• Objectivity and a level of independence
is recognised as critical to the rigour and
acceptance of report card findings.
• Inclusiveness of key stakeholders will ensure
there is trust and ownership of findings and
management responses.
• Information generated by the Paddock to Reef
program on the effectiveness of management
interventions will be disseminated to
stakeholders in a timely fashion to help with
prioritising investment and actions.
• Variability in pollutant loads from year‑to‑year,
due to events such as floods, will be
accounted for by modelling the annual
changes due to management interventions
over a standard long-term climate record.
• The marine and catchment environments are
also strongly influenced by factors such as
variable and extreme weather and this should
be incorporated in the reporting.
• Reporting should focus on documenting
progress towards targets and the health and
condition of the Reef and its associated high
value wetlands.
Scheduling and frequency
As outlined in Reef Plan 2013, a report
card based upon the financial year, is to be
published annually (see Table 1).
best available information is used and
Table 1: Report card schedule and frequency (past and future)
Report Card
Reporting period
Release Date
First Report Card
2008–2009 Baseline
August 2011
2010 (Second) Report Card
Progress from the baseline up to June 2010
April 2013
2011 Report Card
Progress from the baseline up to June 2011
July 2013
2012–2013 Report Card
Progress from the baseline up to June 2013
June 2014
2014 and future report cards
Progress from 2014 onwards
September 2015
and September
each following year
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
10
Report card products
Review processes
A simple and consistent presentation format will
be used across report card products, including
“traffic light metrics” to indicate progress
towards targets. The categories for report card
scores will need to be updated to accommodate
the changed targets for management practices,
pollutant loads and groundcover. The reporting
products (see Figure 2) to support the Reef
Plan report cards recognise there are a range
of products tailored to different audiences; all
of which are publicly available:
The Reef Secretariat, Department of the Premier
and Cabinet, coordinates the production of the
Reef Plan report cards. The formal technical
review process for report cards is:
• Tier 1—Summary Report Card (hard copy
3. Reef Secretariat develops the
summary report.
and website delivery).
–– Provides summary report card results for
the Great Barrier Reef catchment and
six regions.
• Tier 2—Supporting technical information
(website delivery only).
–– Provides all report card results and
summary methods.
• Tier 3—Detailed supporting technical reports
(a range of technical reports and papers
delivered by website or hard copy depending
on the publication).
–– Provides detailed results and methods for
each component (and sub component) of
the Paddock to Reef program.
▶
Summary
Supporting
results and
summary
methods
Detailed
supporting
technical
reports
▶
▶
Tier 1
1. Peer review of the draft report card results,
methods and supporting technical reports
for each component.
2. Submission of the draft report card results,
methods and supporting data to the
Reef Secretariat.
4. Coordination and Advisory Group review.
5. Independent Science Panel review.
In addition to the above report card review
steps, components (or sub components)
of the program are also reviewed externally
as necessary.
Approvals
The Intergovernmental Operational Committee
reviews and approves the report card package.
As part of this review, the Intergovernmental
Operational Committee will seek comments
from the Partnership Committee on draft
results. The release of the report card package
is subject to Australian and Queensland
Government Ministerial approvals.
Report
card
website
Tier 2
Tier 3
Figure 2: Reef Plan reporting products
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
11
Key deliverables
Indicative funding
The actions and deliverables relevant
to Reef Plan monitoring and evaluation
arrangements are outlined in Reef Plan 2013
and in Appendix 1. How the actions and
deliverables will be met is described in detail in
the implementation plans for actions 7, 8 and 9.
Further detail can also be found in the Paddock
to Reef Program Design 2013–2018.
The Paddock to Reef program is jointly
funded by the Australian and Queensland
Governments. Table 2 shows the current
funding arrangements for phase two of the
program from 2013–2018. Total funding for
the program is approximately $8 million per
annum. The majority of this funding is dedicated
to the capture and interpretation of data and
information through monitoring and modelling.
Program management and the production of
the annual report card costs approximately
$150,000 per annum (less than two per cent
of the overall budget).
Australian Government funding focuses
predominantly at the paddock and marine
scales. This is complemented by Queensland
Government funding directed to catchment
scale monitoring, modelling and mapping
activities. Australian Government funding is
provided through the Australian Government
Reef Programme. Queensland Government
funding is predominantly provided through
the Queensland Regional Natural Resource
Management Investment Program 2013–2018
with additional departmental contributions.
Table 2: Paddock to Reef Program
funding arrangements
Component
AG funding
QG funding
Management Practice
adoption
Paddock monitoring
Paddock modelling
Wetlands, riparian
and groundcover
Catchment monitoring
Catchment modelling
Marine monitoring
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
12
Partners
The Department of the Premier and Cabinet
(through the Reef Plan Secretariat) is
accountable for the delivery of the Reef Plan
Monitoring and Evaluation Strategy including
oversight of the Paddock to Reef program
and report cards.
Implementation of the monitoring and
evaluation arrangements will involve significant
contributions by the following partners:
• Great Barrier Reef Marine Park
Authority (GBRMPA)
• Queensland Department of Environment
and Heritage Protection (EHP)
• Queensland Department of Natural
Resources and Mines (DNRM)
• Queensland Department of Science,
Information Technology, Innovation and the
Arts (DSITIA)
• Queensland Department of Agriculture,
Fisheries and Forestry (QDAFF)
• Australian Government Department of the
Environment
• Australian Government Department of
Agriculture
• Regional Natural Resource Management
bodies (Regional NRM bodies)
• Industry groups
• Research organisations
• Great Barrier Reef Foundation (GBR
Foundation).
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
13
Appendix 1—Key actions and deliverables
for Reef Plan monitoring and evaluation
Action 7—Develop and implement an updated
Reef Plan Monitoring and Evaluation Strategy
to measure the efficiency and effectiveness of
Reef Plan.
• Update the Reef Plan Monitoring and
Evaluation Strategy (DPC).
• Prepare Reef Plan report cards to report on
the progress towards Reef Plan goals and
targets (DPC).
• Report on effectiveness of Reef Plan
implementation (DPC).
• Undertake independent audit and evaluation
of Reef Plan (DPC/Department of the
Environment).
• Report on integration of the Paddock to Reef
program with other relevant monitoring and
reporting programs in the Great Barrier Reef
region as part of an Integrated Monitoring
Framework (GBRMPA/DPC).
Action 8—Implement an updated Paddock
to Reef Integrated Monitoring, Modelling and
Reporting (Paddock to Reef) Program.
• Update the Paddock to Reef program
design (IOC).
• Review Paddock to Reef program
design (IOC).
• Implement the updated Paddock to Reef
program including monitoring and annual
reporting (DPC).
• Annual fertiliser and pesticide use data
collection arrangements are agreed
(Regional NRM bodies).
• Fertiliser and pesticide use data collected
and reported (Regional NRM bodies).
• Paddock scale water quality monitoring
and modelling to measure effectiveness of
management practices, including a focus on
critical practices that reduce pollutant losses
significantly (Department of the Environment/
DNRM with support from DSITIA).
• Catchment pollutant loads monitored
(DSITIA with support from DNRM).
• Catchment pollutant loads modelled
(DNRM with support from DSITIA).
• Groundcover and wetlands and riparian
vegetation monitored (DSITIA).
• Inshore marine water quality and ecosystem
health monitored (GBRMPA).
Action 9—Improve data and information
management to support Reef Plan data
sharing, assessment and reporting.
• Test automation of the Reef Plan report card
(DPC/GBR Foundation).
• Store and maintain paddock and catchment
data within the Spatial and Scientific
Information Management for Reef (SSIMR)
environment (DNRM).
• Industry uptake of management practices
Monitoring and Evaluation Strategy | Reef Water Quality Protection Plan | www.reefplan.qld.gov.au
DPC4071_FEB2015
and systems, under an agreed framework,
that can input directly into Paddock to Reef
modelling and reporting against targets
(QDAFF/Agricultural industry).
14
DPC4071_FEB2015