Can the TTC Report Meaningfully on Service Quality?

In many articles over several years, I have written about the quality of transit service in Toronto and the degree to which it varies from the sometimes sunny presentations by TTC management. Since the onset of the Covid-19 pandemic and heading into an extremely difficult budget year for 2021, understanding service from a rider’s perspective has become more important than ever to retain and rebuild demand on the transit system.

On the budget side, there are already harbingers of cuts to come. The TTC proposes to remove poor performing routes from the network and to trim hours of service on some routes. This includes the 14x Downtown Express services with their notoriously high cost/passenger and a few routes’ late evening operations. This is really small-scale stuff especially considering that the saving from cancelled express routes is already in place since Spring 2020.

The larger problem Toronto will face will be to decide what deeper trimming might look like, how candidates for cuts might be chosen, and how to evaluate the operation of what remains. There are already problems with erratic service that accentuates crowding problems coupled with an underutilized fleet of transit vehicles. Conversely, advocates for service retention and impovement, including, one hopes, TTC management, need solid ground to support calls for specific improvements and to measure them when they occur.

Management reports monthly on service quality and vehicle performance, but the metrics used fall far short of telling the whole story. Recently, CEO Rick Leary mentioned to the TTC Board that these metrics will be updated. This is worthwhile to the extent that new information is actually revealed, not simply a rehash of what we have already.

This article reviews the metrics now in the CEO Report and proposes updates both to the metrics and to the standards against which they report.

Broadly the areas covered here are:

  • Ridership and Trip Counts
  • Budget, Scheduled and Actual Service
  • On Time Performance and Service Reliability
  • Service Capacity
  • Vehicle Reliability and Utilization
  • Infrastructure Reliability

This is a long article because it covers many topics and I wanted to put the arguments together so that the way factors interact is clear. If you want to skip all the details, at least for your first read, there are consolidated recommendations at the end of the article.

Technical note: Many of the illustrations were taken from the October 2020 CEO’s Report. Although I have enlarged them for readability, their resolution is limited by the quality of the source document.

The Tyranny of Averages

Almost all TTC performance metrics consolidate data into monthly average values and, sometimes, into annual moving averages. While this approach simplifies presentation and shows long term trends, it hides a great deal of variation that is at least as important to quality measurement as the long term view.

As I have written many times:

Passengers do not ride average buses.

Telling riders that on average buses are not full and that their arrival is within standards is meaningless to someone who waits twice or more the scheduled headway (the time between vehicles) and finds a crowded bus when one shows up. This problem existed long before the pandemic, but crowding and the effect of service cuts combine to make it a greater concern than before.

Averaging in the performance of off-peak services such as evenings and weekends with overall route behaviour masks poor quality service. Conditions during busy periods are diluted by data from trips when demand on a route is lower.

Averaging performance across the network dilutes the behaviour on busy routes even further by including vehicles running with less crowding and better reliability.

Continue reading