This page has been archived on the Web

Information identified as archived is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please contact us to request a format other than those available.

Appendix 5: FSDS Performance Measurement Framework

Stream 1: Developing and reporting on the FSDS
Immediate outcomeInformation on FSDS activities and results is used by stakeholdersIncreased ability to identify improvements to future FSDSs
Performance indicatorAnnual number of print and internet-based publications of the Canadian Environmental Sustainability IndicatorsAnnual number of print and internet-based publications using information from the Federal Sustainable Development Strategy (or results from the Progress Report)# of issues revealed through CESD report and SDAC comments on the FSDS Consultation Report that are addressed in the final FSDS.
Data sourceCESI web analytics
CESI website hits
Interviews with selected stakeholders
FSDS web analytics
Internet search
FSDS website hits
Interviews with selected stakeholders
CESD reports, SDAC comments
on the FSDS Consultation Synthesis Report
Definitions and methodologyQualitative interviews with a selection of CESI/FSDS stakeholders (GoC, NGOs, other levels of government) to determine how data is usedQuantitative analysis of number of hits and downloads of CESI/FSDS material by stakeholder and other CESI web analyticsThe CESD and SDAC are required to review and comment on the draft FSDS Consultation Report. The SDO will compile these recommendations and compare to what was included in the final FSDS and the Progress Report.
ResponsibleSDOSDOSDO
Frequency of reportingAt least once every 3 years for each indicatorAt least once every 3 years for each indicatorEvery 3 years (with adoption of new FSDS)
Target valueTarget will be set once a baseline value is measured (2011)Target will be set once a baseline value is measured (2011)50% adoption
Date to achieve target2013 and ongoing2013 and ongoing2013 and ongoing
Baseline or actual valueBaseline to be established in 2011Baseline to be established in 2011Baseline to be established in 2011
Date of baseline measurement201120112011


Stream 2 : Measuring performance
Logic model elementIncreased soundness and coverage of FSDS indicators
Performance indicator# of indicators provided by departments for the goals and targets in the FSDS that meet indicator criteria for Themes I to III.% of targets with indicators in the GGO Supplementary Table that can be aggregated, to provide an assessment of the environmental footprint of federal operations.
Data source

FSDS indicators for Themes I to III

Bellagio principles

GGO Supplementary Table
Definitions and methodology

Determine the % of indicators that meet the indicator criteria based on the Bellagio principles of policy relevance, utility, indicator soundness, data availability and cost-effectiveness.  As new data becomes available and/or new indicators are developed, assess changes to existing indicators and complete assessment of new indicators.

Bellagio principles are defined as: indicators should be consistent and comparable over time and space, backed by credible science and methods.

Analysis of indicators GGO Supplementary Information Table.

Aggregation criteria to be developed.

ResponsibleSDO will conduct the initial evaluation 1–3. An independent evaluation by EC’s evaluation branch or by a consultant will be undertaken when feasiblePWGSC
Frequency of reportingAt least once every 3 years for each indicator. New indicators should be assessed once established.Annual
Target valueTarget will be set once a baseline value is measured (2011)TBD
Date to achieve target2013 and ongoing2014 and ongoing
Baseline or actual valueBaseline to be established in 2011Baseline to be established in 2011
Date of baseline measurement20112010


Stream 3: DSDS (RPP/DPR)
Immediate outcomeIncreased internal capability for integrated sustainable development planning and reporting
Capability is defined as knowledge and tools
Increased provision of information on resources related to sustainable development activities and results
Performance indicator% of participating departments reporting they have adequate capacity for integrated planning and reporting (i.e. training and knowledge)Extent to which  departments/agencies use the guidance requirements for producing RPPs, DPRs and departmental websites
Data sourceA survey with Departmental / agency representatives identified by the SD leads
(Survey to be developed in 2011)
FSDS Departments / agencies RPPs/DPRs (DSDS)
The criteria for meeting each of these levels will be developed in 2011
Definitions and methodology

Short survey of departmental planners to be developed in 2011.  Questions such as: On a scale of 1 to 5, where 1 is not at all aware and 5 is fully aware,

  • How aware are you of TBS, PWGSC and EC FSDS guidance documents regarding the development of RPPs, DPRs and departmental websites? How clear are the guidance documents?
  • How useful was the guidance?
  • To what extent did you apply the guidance outlined in the guidance when developing your RPP, DPR and website?
  • Was EC/TBS/PWGSC helpful in providing additional support during the development of your RPP, DPR or website?

Analysis of departmental and or agencies to document the degree to which each department/agency is using the guidance for the RPP, DPR and departmental website. i.e. on a scale of 1 to 5:

  1. did not use
  2. partially used
  3. mostly used
  4. used completely
  5. exceeds expectations
ResponsibleSDOSDO
Frequency of reportingEvery 5 years (every second FSDS)Every 3 years to flow into the Progress Report
Target valueTBD once the baseline is establishedTBD once the baseline is established
Date to achieve target2013 and ongoing2013 and ongoing
Baseline or actual valueBaseline to be established in 2012Baseline to be established in 2011 with publication of the first RPP and 2012 with the first DPR
Date of baseline measurementFall 20122011 (RPP)
2012 (DPR)


Stream 4: Sustainable development practices
Immediate outcomeIncreased capability to use the FSDS in policy developmentIncreased capability to consider the impact policy decisions have on the environment
Capability is defined as knowledge and tools
Performance indicator% of participating departments reporting they have increased capability to use the FSDS in policy development% of participating departments reporting they have increased capability  to consider the impact policy decisions have on the environment
Data sourceSurvey of departments and agencies SD officesSDO will prepare a survey for departments
Definitions and methodology

Short survey to departments to be developed in 2011. Responses will be on a scale of 1 to 5:   

  1. very low
  2. low
  3. moderate
  4. high
  5. very high

Short survey to departments to be developed in 2011. Responses will be on a scale of 1 to 5:   

  1. very low
  2. low
  3. moderate
  4. high
  5. very high
ResponsibleSDOSDO
Frequency of reportingEvery 5 years (every second  FSDS)Every 5 years (every second FSDS)
Target valueTBD once the baseline is establishedTBD once the baseline is established
Date to achieve target2013 and ongoing2013 and ongoing
Baseline or actual valueBaseline to be established in 2011Baseline to be established in 2011
Date of baseline measurement20112011


Intermediate outcomes
Intermediate outcomeIncreased integration of SD into decisions made regarding the development of Government of Canada initiativesIncreased integration of environmental considerations into social and economic decision-making
Performance indicator

Examples of possible indicators:

  • Gaps are filled
  • Quality of goals, targets and implementation strategies
  • Increased transparency and accountability
  • FSDS meets international best practices
Compliance with SEA guidance as reported by departments/agencies in their DPRs on their websites
Data sourceTBDAssessment of compliance as reported in DPRs
Definitions and methodologyTBDDepartmental DPR Guidance suggests that departments report on the compliance rate with CEAA guidance specifically as it relates to the FSDS
ResponsibleSDOSDO
Frequency of reportingTBDEvery 3 years
Target valueTBDTBD once the baseline is established
Date to achieve targetTBD2013 and ongoing
Baseline or actual valueTBDBaseline to be established in 2012
Date of baseline measurementTBDFall 2012


Ultimate outcome
Ultimate outcomeImproved performance of federal sustainable development goals and targets
Performance indicator% CESI sustainable development indicators showing improvement on themes I to III in the FSDS% of FSDS GGO targets that are on track to meet / have met target expectations or are on track to exceed / have exceeded target expectations (as per self-selected traffic light indicators)
Data sourceResults achieved by CESI indicatorsGGO Supplementary Table in DPRs
Definitions and methodologyReview data on CESI indicators compared to previous yearReview of traffic light indicators in the GGO Supplementary Table
ResponsibleSDOPWGSC
Frequency of reportingEvery 3 years (with adoption of new FSDS)Each DPR
Target valuePerformance on CESI indicators should show improvement over time100% in each fiscal year
Date to achieve target2013 and ongoing2011–2012 and ongoing
Baseline or actual value2011 (or when indicator data is available)Not applicable
Date of baseline measurement2011Not applicable


 

Date modified: