Back in the early days of John Tory’s mayoralty, the 2015 budget discussions were overshadowed both by the legacy of the Ford administration and by major issues with project control at the TTC. From the Ford years, Tory inherited a mean-spirited attitude to transit spending and service cuts that the new mayor would come to reverse, for a time at least. A bigger issue, however, was the matter of runaway spending by the TTC on two major projects: the Spadina subway extension (aka TYSSE) and the resignalling contracts for the Yonge-University-Spadina subway (aka Line 1).

Even while the TTC’s CEO was coming to grips with these projects, Council passed a motion asking for a review of how the TTC was managing its business.

145. City Council direct the City Manager to issue a Request For Proposal to expedite a review of Toronto Transit Commission Capital program service delivery including:

a. a review of project management of Toronto Transit Commission Major Capital Projects in the past five years to determine actual project costs and completion dates relative to original schedules and estimated costs;

b. a review of staff reporting mechanisms to the Toronto Transit Commission and City Council related to capital project budget and completion date status; and

c. future organizational options for Transit project management and delivery of Major Capital projects related to Transit expansion and major State of Good Repair projects.

146. City Council direct the City Manager to co-ordinate the review in Part 145 above with the Chief Executive Officer, Toronto Transit Commission and to report to the Toronto Transit Commission no later than the November 23, 2015 Board meeting. [Item EX 3.4 Council meeting of March 10, 2015]

In the fullness of time, considerably later than the November 2015 date in the motion, a report from KPMG landed on the TTC Board’s agenda, the TTC Capital Program Review. This was supplemented at the meeting by a presentation from KPMG and a response from CEO Andy Byford.

The terms of reference for KPMG’s work were somewhat different from the Council motion.

KPMG’s scope was as follows:

• review project management practices at the TTC with respect to the delivery of the Capital Program, and provide recommendations to staff that will assist the organization to improve capabilities for managing capital projects and programs. The TTC Capital Program Review seeks to achieve the following goals:
• Improve the organization’s project and program management performance by learning from past experience;
• Support continuous improvement efforts underway at the TTC, including the continued implementation of the TTC Portfolio Management Office (“PfMO”) established in 2014;
• Assess project governance structure and protocols for reporting of project status, to ensure the appropriate level of transparency and accountability to project sponsors and stakeholders; and
• Provide guidance on project delivery options and project management requirements for projects of varying size, scope, and complexity. [Presentation, p. 4]

Item “a” of the Council motion asked for a comparison of actual costs and completion dates with original plans. KPMG does not provide this information, and even worse, included a table of selected projects that does not clearly explain their history (see below). There is no “deep dive” into any of the projects and, therefore, no specifics that could be tied to “lessons learned”, to practices that created the problem in the first place.

The table below is the closest the report comes to commenting on Council’s request, but read in isolation it can be misleading. It is ironic that in their presentation to the TTC Board, KPMG did not include this table and made no comment  on it. CEO Andy Byford was not so kind, and emphasized that most of the scope changes were perfectly legitimate.

Other projects included in KPMG’s review but not in the table above were:

• Fuel Storage Tank Replacements
• Subway Station Easier Access Phase III
• Surface Track
• On Grade Paving

Of these, only the Easier Access program was flagged as “Challenged” with the others as “Successful”, but the reason for the EAP’s status likely has more to do with the complexity of later stages of the work and a lack of funding than with project management and controls. [See Table 1 at pp. 20-21 of KPMG’s report]

Two of these (track and paving) are the only “Ongoing” programs reviewed by KPMG. These are fundamentally different from “Finite” projects such as the construction of a line or the retrofit of elevators to stations. I will return to this distinction later.

This is a dangerous table in that it shows an apparent growth from $5 billion to almost $8 billion in project costs, a 60% increase.  That was the easy headline in media coverage of this report, and the sort of simplistic comparison that some members of Council would seize on as symptomatic of “waste” at the TTC. Scope change appears as a “primary cause” in five of these projects, but not all such changes arise from the same circumstances.

• TYSSE’s cost grew due to inflation between the original estimate and the eventual approval of the project, and of course because the line was extended from York University to Vaughan Centre.
• There was a considerable delay between the approval and actual start of work thanks to foot-dragging by senior governments in finalizing their contribution agreements. No adjustment to the completion date nor allowance for inflation was added to the estimate.
• Politicians along the line wanted showcase stations, not the standard TTC boxes, and much of the contingency in the project’s budget was consumed by unexpectedly high bids for these structures.
• The TYSSE project suffered from poor organization with many contractors on competing deadlines. This arose in part because the prevailing wisdom at the time was that work should be parceled out in small enough pieces that multiple mid-size contractors could bid. This arrangement was more a political decision than a technical one.
• The original project did not foresee a conversion to Automatic Train Control (ATC) because that was not part of the TTC’s plans at the time. This item was added after the fact under a separate project budget, but this work added yet another layer of complexity to overlaps between many subsystem installation contracts.
• The original fleet plan for TYSSE included the continued use of a portion of the older T1 fleet on the YUS with most, but not all, of the trains coming from the new TR order. After the decision to implement ATC, the T1s were no longer suitable because of the high cost of retrofitting ATC to them, and the TR contract grew accordingly. The TTC has a surplus of T1s, but no place to use them, including the proposed Scarborough subway which will also have ATC. The planned opening date for the SSE occurs well before the planned completion of the replacement of the T1s, a project that will have to be accelerated shifting spending into earlier years than planned.
• The TTC now has a much larger subway car fleet than foreseen a decade ago thanks to the T1 surplus and cars for improved service under ATC that will not actually be used until 2019 and beyond when the ATC project completes. Additional space will be needed for the T1 replacements that will require concurrent storage space and a significantly different carhouse design from Greenwood Shops. These projects are not yet funded, and are not fully included in the cost estimates for the SSE.
• The TR purchase, like all TTC vehicle contracts, includes a base order plus an option for additional vehicles. This is a standard arrangement for procurement because the TTC never receives full funding for its plans in one go, and circumstances change causing quantities to go up, or occasionally down. The complete order now includes enough trains for the complete replacement of non-ATC capable trains on YUS, conversion of the Sheppard subway from T1 to TR operation, the Spadina extension to Vaughan and additional trains to run more frequent service once ATC is in use on YUS.
• The ATC contract evolved out of a dog’s breakfast of plans for new signalling on the YUS. Originally, the plan was simply to replace the aging block signal system on the original part of the line. However, funding for this could only be obtained by misrepresenting necessary maintenance work as something that would enable additional capacity. Eventually, the project grew to have at least two overlapping technologies being installed at the same time so that non-ATC operations could co-exist on an ATC line. This proved unworkable, and the contracts were consolidated into a single ATC project. The extra costs are a direct result of, first, underscoping the project for political reasons, and later from a failure to appreciate the technical complexity of what was being attempted.

The above are only the high points of a much more complex history (available in the linked articles), but what should be evident is that major projects interact with each other even though they are almost always discussed as if they are completely separate entities. This is a major problem in TTC budgeting and in the political context where such projects are debated. KPMG hints at this problem in its review, but does not drag any details out into the open.

The following discussion can only touch on the full report of 273 pages, and is intended to place the report more in the political context of the TTC Board and Council (and through them to the ongoing debates about TTC funding) than KPMG which tended to focus on internal issues of process.

Continue reading →