This page has been archived on the Web

Information identified as archived is provided for reference, research or recordkeeping purposes. It is not subject to the Government of Canada Web Standards and has not been altered or updated since it was archived. Please contact us to request a format other than those available.

Skip booklet index and go to page content

Evaluation of the Services to Marine Transportation Sub-activity

Annex 1: Issues, Indicators and Methods

Evaluation Issues, Indicators and Methods (text description)
IssueIndicatorsMethods
1. Is there a continued need for Services to Marine Transportation?
  • Evidence of / views on societal/ environmental need for program
  • Document review
  • Literature review
  • Open-ended interviews
2. Are Services to Marine Transportation aligned with federal government priorities?
  • Program objectives correspond to recent/current federal government priorities
  • Program objectives are aligned with current departmental strategic outcomes
  • Document review
3. Is the program consistent with federal and departmental roles and responsibilities?
  • Program mandate aligned with federal government jurisdiction
  • Document review
  • Key informant interviews
3. Is the program consistent with federal and departmental roles and responsibilities?
  • Evidence of / views on legitimacy, appropriateness and necessity of departmental roles, responsibilities and accountabilities with respect to marine transportation
  • Document review
  • Open-ended interviews
  • Stakeholder/partner surveys
4. Are appropriate performance data being collected, captured and safeguarded? If so, is this information being used to inform senior management / decision makers?
  • Existence of effective performance measurement strategy:
    • Performance indicators cover all outcomes
    • Performance indicators are linked to the outcomes being measured
    • Evidence of rigorous performance data collection and reporting activities
    • Satisfaction of decision makers with timeliness of data collection/reporting
  • Evidence of fully populated database(s)
  • Document review
  • Open-ended interviews
  • Performance data analysis
5. To what extent have intended outcomes been achieved as a result of the program?
  • Evidence of / views on achievement of intended outputs and outcomes
  • Output: Percentage of ice charts and forecasts transmitted within 30 minutes of prescribed deadlines
  • Output: Percentage of gale warnings issued at least 24 hours in advance of the event
  • Output: Percentage of ice warnings issued and verified prior to the event
  • Output: Frequency (percentage of times) that trained ice service specialists are provided as per partnership agreements
  • Outcome: Evidence of use of meteorological, oceanographic and ice information products and services by target users
  • Outcome: Views of program stakeholders on the accuracy, timeliness, accessibility / user-friendliness and use (by target users) of marine weather and ice information products and services
  • Outcome: Satisfaction of target end-users with the accuracy, timeliness, accessibility / user-friendliness and usefulness of marine weather and ice information products and services
  • Outcome: Evidence of reduced number of emergency interventions (by emergency response teams and/or the CCG) due to marine weather or ice
  • Outcome: Evidence of reduced unexpected delays encountered by commercial marine transports due to marine weather or ice
  • Evidence of / views on factors outside the direct purview of the program that may influence / have influenced the achievement of intended outcomes
  • Document review
  • Open-ended interviews
  • Performance data analysis
  • End-user questionnaire
6. Are Services to Marine Transportation achieving their intended outcomes in the most economical manner?
  • Views on whether good value is being obtained with respect to the use of public funds
  • Open-ended interviews
  • End-user questionnaire

7. Is the Services to Marine Transportation program undertaking activities and delivering products in the most efficient manner?

  • How could the efficiency of the program’s activities be improved?
  • Are there alternative, more efficient, ways of delivering the program?
  • Evidence of / views on whether the cost of producing program outputs is as low as possible
  • Document review
  • Financial analysis
  • International comparison
  • Open-ended interviews
  • End-user questionnaire

7. Is the Services to Marine Transportation program undertaking activities and delivering products in the most efficient manner?

  • How could the efficiency of the program’s activities be improved?
  • Are there alternative, more efficient, ways of delivering the program?
  • Views on how the efficiency of program activities could be improved
  • Views on whether there are alternative, more efficient ways of delivering program activities and outputs
  • Open-ended interviews
  • End-user questionnaire
Date modified: