Evaluation of the Services to Marine Transportation Sub-activity

1. Is there a continued need for Services to Marine Transportation?

• Evidence of / views on societal/ environmental need for program

• Document review
• Literature review
• Open-ended interviews

2. Are Services to Marine Transportation aligned with federal government priorities?

• Program objectives correspond to recent/current federal government priorities

• Document review

• Program objectives are aligned with current departmental strategic outcomes

• Document review

3. Is the program consistent with federal and departmental roles and responsibilities?

• Program mandate aligned with federal government jurisdiction

• Document review
• Key informant interviews

• Evidence of / views on legitimacy, appropriateness and necessity of departmental roles, responsibilities and accountabilities with respect to marine transportation

• Document review
• Open-ended interviews
• Stakeholder/partner surveys

4. Are appropriate performance data being collected, captured and safeguarded? If so, is this information being used to inform senior management / decision makers?

• Existence of effective performance measurement strategy:
  • Performance indicators cover all outcomes
  • Performance indicators are linked to the outcomes being measured
  • Evidence of rigorous performance data collection and reporting activities
  • Satisfaction of decision makers with timeliness of data collection/reporting
• Evidence of fully populated database(s)

• Document review
• Open-ended interviews
• Performance data analysis

5. To what extent have intended outcomes been achieved as a result of the program?

• Evidence of / views on achievement of intended outputs and outcomes
• Output: Percentage of ice charts and forecasts transmitted within 30 minutes of prescribed deadlines
• Output: Percentage of gale warnings issued at least 24 hours in advance of the event
• Output: Percentage of ice warnings issued and verified prior to the event
• Output: Frequency (percentage of times) that trained ice service specialists are provided as per partnership agreements
• Outcome: Evidence of use of meteorological, oceanographic and ice information products and services by target users
• Outcome: Views of program stakeholders on the accuracy, timeliness, accessibility / user-friendliness and use (by target users) of marine weather and ice information products and services
• Outcome: Satisfaction of target end-users with the accuracy, timeliness, accessibility / user-friendliness and usefulness of marine weather and ice information products and services
• Outcome: Evidence of reduced number of emergency interventions (by emergency response teams and/or the CCG) due to marine weather or ice
• Outcome: Evidence of reduced unexpected delays encountered by commercial marine transports due to marine weather or ice

• Document review
• Open-ended interviews
• Performance data analysis
• End-user questionnaire

• Evidence of / views on factors outside the direct purview of the program that may influence / have influenced the achievement of intended outcomes

• Document review
• Open-ended interviews
• Performance data analysis
• End-user questionnaire

6. Are Services to Marine Transportation achieving their intended outcomes in the most economical manner?

• Views on whether good value is being obtained with respect to the use of public funds

• Open-ended interviews
• End-user questionnaire

7. Is the Services to Marine Transportation program undertaking activities and delivering products in the most efficient manner?

• How could the efficiency of the program’s activities be improved?
• Are there alternative, more efficient, ways of delivering the program?

• Evidence of / views on whether the cost of producing program outputs is as low as possible

• Document review
• Financial analysis
• International comparison
• Open-ended interviews
• End-user questionnaire

• Views on how the efficiency of program activities could be improved

• Open-ended interviews
• End-user questionnaire

• Views on whether there are alternative, more efficient ways of delivering program activities and outputs

• Open-ended interviews
• End-user questionnaire