Cross-Examination by Mr. Tolmie

ONTARIO
ENERGY
BOARD
FILE NO.:
EB-2016-0152
Ontario Power Generation Inc.
VOLUME:
6
DATE:
March 7, 2017
BEFORE:
Christine Long
Presiding Member and Vice Chair
Ellen Fry
Member
Cathy Spoel
Member
EB-2016-0152
THE ONTARIO ENERGY BOARD
Ontario Power Generation Inc.
Application for payment amounts for the period from
January 1, 2017 to December 31, 2021
Hearing held at 2300 Yonge Street,
25th Floor, Toronto, Ontario,
on Tuesday, March 7, 2017,
commencing at 9:32 a.m.
---------------------------------------VOLUME 6
---------------------------------------BEFORE:
CHRISTINE LONG
Presiding Member and Vice Chair
ELLEN FRY
Member
CATHY SPOEL
Member
A P P E A R A N C E S
MICHAEL MILLAR
IAN RICHLER
Board Counsel
VIOLET BINETTE
LAWRIE GLUCK
JANE SCOTT
RUDRA MUKHERJI
Board Staff
CHARLES KEIZER
CRAWFORD SMITH
BARBARA REUBER
JOHN BEAUCHAMP
CHRIS FRALICK
Ontario Power Generation Inc.
(OPG)
IAN MONDROW
SHELLY GRICE
Association of Major Power
Consumers of Ontario (AMPCO)
MICHAEL BUONAGURO
JULIE GIRVAN
Consumers Council of Canada (CCC)
BRADY YAUCH
LARRY SCHWARTZ
Energy Probe Research Foundation
KENT ELSON
Environmental Defence (ED)
DAVID POCH
Green Energy Coalition (GEC)
SCOTT WALKER
Ontario Association of Physical
Plant Administrators (OAPPA)
RICHARD STEPHENSON
Power Workers' Union (PWU)
MIKE McLEOD
Quinte Manufacturers' Association
MARK RUBENSTEIN
JAY SHEPHERD
School Energy Coalition (SEC)
BOHDAN DUMKA
Society of Energy Professionals
(SEP)
MICHAEL JANIGAN
MARK GARNER
Vulnerable Energy Consumers
Coalition
I N D E X
O F
P R O C E E D I N G S
Description
Page No.
--- On commencing at 9:32 a.m.
1
Appearances
2
ONTARIO POWER GENERATION - PANEL 1C
P. Galloway, Previously Affirmed
2
Cross-Examination by Mr. Rubenstein
22
--- Recess taken at 10:48 a.m.
--- On resuming at 11:06 a.m.
45
45
Cross-Examination by Mr. Buonaguro
Cross-Examination by Mr. Poch
Cross-Examination by Mr. Yauch
45
62
70
--- Luncheon recess taken at 11:59 p.m.
--- On resuming at 1:11 p.m.
77
77
Preliminary Matters
78
Cross-Examination by Mr. Yauch
Cross-Examination by Mr. Tolmie
Cross-Examination by Mr. Richler
Questions by the Board
Re-Examination by Mr. Keizer
78
82
88
95
101
--- Recess taken at 1:54 p.m.
--- On resuming at 2:00 p.m.
103
103
ONTARIO POWER GENERATION - PANEL 2A(I)
J. Mauti, C. Fralick, R. Puch, Affirmed
103
Examination-In-Chief by Mr. Smith
Cross-Examination by Mr. Stephenson
Cross-Examination by Mr. Millar
103
105
116
--- Recess taken at 3:02 p.m.
--- On resuming at 3:20 p.m.
143
143
Cross-Examination by Mr. Tolmie
Cross-Examination by Mr. Rubenstein
165
170
--- Whereupon the hearing adjourned at 4:33 p.m.
189
E X H I B I T S
Description
EXHIBIT NO. K6.1:
Page No.
VECC COMPENDIUM.
EXHIBIT NO. K6.2: CROSS-EXAMINATION COMPENDIUM
OF MR. TOLMIE FOR OPG PANEL 1C.
3
82
EXHIBIT NO. K6.3: BOARD STAFF CROSS-EXAMINATION
COMPENDIUM FOR OPG PANEL 2A(I)
116
EXHIBIT NO. K6.4: CROSS-EXAMINATION COMPENDIUM
OF SEC FOR OPG PANEL 2A(I)
170
U N D E R T A K I N G S
Description
UNDERTAKING NO. J6.1: TO PROVIDE THE LOCATION
IN THE EVIDENCE OF THE RISK REGISTER DR.
GALLOWAY REVIEWED.
Page No.
62
1
1
Tuesday, March 7, 2017
2
--- On commencing at 9:32 a.m.
3
MS. LONG:
4
Good morning, everyone.
5
6
Please be seated.
Good morning, Dr. Galloway.
The panel continues to sit today in EB-2016-0152.
Mr. Keizer, are there any preliminary matters we need
7
to deal with this morning?
8
Preliminary Matters:
9
MR. KEIZER:
Yes, there are two.
The first is a
10
routine matter that we have filed Undertaking J2.8 and
11
Undertaking J3.4.
12
The second matter relates -- and I've advised my
13
friend from VECC with respect to this -- relates to some
14
items that are in VECC's compendium, and this isn't really
15
-- what I put my friend on notice is that after Dr.
16
Galloway looked at the compendium she identified that there
17
were pieces in the compendium that related to Kemper and
18
she alerted me, the fact that she currently is involved in
19
testimony and evidence with respect to the Kemper facility,
20
I believe, as well Vogtle.
21
that there may be issues with respect to confidentiality
22
that Dr. Galloway may encounter, and obviously this isn't
23
intended to curtail my friend's cross, but we will
24
obviously have to deal with it as the question arises.
25
as I've said, I've alerted my friend to that fact.
26
MS. LONG:
Okay.
And so I've alerted my friend
And
Ms. Khoo, what I intend to do, I
27
mean, we'll let Ms. Khoo go ahead with her cross-
28
examination.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
2
1
MR. KEIZER:
2
MS. LONG:
Yes.
And if Dr. Galloway has an issue with the
3
questions that are being asked we'll deal with them at that
4
time, and I will ask Dr. Galloway put on the record why
5
she's not able to answer the questions, and then, Mr.
6
Keizer, you can raise any concerns that you have and we'll
7
deal with each issue as it comes up in the cross.
8
9
MR. KEIZER:
No, that's fine.
intend.
10
MS. LONG:
11
MR. KEIZER:
12
MS. LONG:
13
MR. RICHLER:
14
APPEARANCES:
15
MS. LONG:
16
17
That's as we would
Okay.
Thank you very much.
Good.
Any other issues?
None from us, Madam Chair.
Okay.
Then, Ms. Khoo, can you begin your
cross-examination, please.
MS. KHOO:
Sure.
So first I wanted to apologize to
18
the panel for not introducing myself yesterday.
19
been quite a sudden transition, and so I thank everyone in
20
the room for bearing with me.
Oh, no problem.
This has
21
MS. LONG:
I should have asked you.
22
I wasn't sure.
23
in for Ms. Khoo representing the Vulnerable Energy
24
Coalition?
That's my fault.
So we have an appearance
25
MS. KHOO:
Yes, that's right.
26
MS. LONG:
Thank you.
27
ONTARIO POWER GENERATION - PANEL 1C
28
Patricia Galloway, Previously Affirmed.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
3
1
2
Cross-Examination by Ms. Khoo:
MS. KHOO:
Good morning, Dr. Galloway.
And thank you
3
for appearing today to answer our questions again.
4
established yesterday, I'm not going to challenge your
5
qualifications, and there are just a few things I wanted to
6
clarify.
7
what -- the confidential aspects of Kemper, but again, you
8
can mention if that happens to be the case.
9
As we
I don't think, hopefully, it will be cross on
So first you testified yesterday, and in your report
10
as well, that you found that OPG has reasonably and
11
prudently prepared for its execution of DRP; is that
12
correct?
13
DR. GALLOWAY:
14
MS. KHOO:
Okay.
15
MS. LONG:
Can I just stop you for one minute.
16
That's correct.
And throughout your report -We're
just checking that we have your compendium.
17
MS. KHOO:
Oh.
18
MS. LONG:
I do.
Do you have a copy?
19
need some extra copies.
20
Richler, if we can just mark it, please.
We might just
That's on our end here.
21
MR. RICHLER:
22
EXHIBIT NO. K6.1:
23
MS. LONG:
Okay.
24
MS. KHOO:
Thank you.
And Mr.
Yes, VECC's compendium will be K6.1.
VECC COMPENDIUM.
Thank you.
Please continue.
And throughout your report,
25
Exhibit D2, tab 2, schedule 11, attachment 3 you frequently
26
refer to industry standards and best practices.
27
be correct to say that you rely on such standards and best
28
practices as a basis for determining what is reasonable or
Would it
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
4
1
prudent in managing projects?
2
DR. GALLOWAY:
3
MS. KHOO:
It would be one of the bases, yes.
Thank you.
Now, I would like to turn to
4
the table you provided in response to Undertaking JT1.24.
5
This is on page 10 of the compendium.
6
a number of projects in response to the request to identify
7
those within the last ten years of comparable scope to your
8
work for OPG; is that correct?
9
10
11
DR. GALLOWAY:
question, please?
MS. KHOO:
This table provides
I'm sorry, could you repeat the
I'm sorry.
This table, it's a response to the request
12
to identify the projects that you've worked on with work of
13
comparable scope to your work for OPG?
14
15
16
DR. GALLOWAY:
Yes, it is a response to the last ten
years that are comparable to scope.
MS. KHOO:
Okay.
That's correct, yes.
So I would like to go over some of
17
these, and again, as mentioned, if they run into the
18
limitations you have with respect to your other testimony
19
you can just raise that at the time.
20
So on page 12 of the compendium -- this one is about
21
Kemper County power plant -- you stated in the testimony
22
that MPC's management decisions and actions as to the
23
Kemper IGCC project fell within a zone of reasonableness
24
and were prudent.
25
26
27
28
Was this assessment based on industry standards and
best practices?
DR. GALLOWAY:
It was based on a number of things.
was based on industry best practices.
It
It was based on
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
5
1
utility practice.
2
reasonably known by Mississippi Power Company as of March
3
31st, 2013, and it was also based on what was provided to
4
the commission in its CPCN and based on what the level of
5
effort at the time the utility undertook based on the
6
progress of Kemper up to its CPCN.
7
things that were based on that conclusion.
8
9
10
MS. KHOO:
It was based on what was known and
Those were all the
And these are all typical factors that go
into drawing a conclusion like that on these sorts of
projects?
11
DR. GALLOWAY:
12
MS. KHOO:
Yes.
Okay.
Thank you.
On page 17 of the
13
compendium, a New York Times article from July 2016 stated
14
that the Kemper County plant at that time was over two
15
years behind schedule, over 4 billion dollars above budget,
16
and still not operational.
17
article from Mississippi Today states that as of October
18
2016 the plant cost over double the original estimate and
19
was still not operational.
20
On page 32 of the compendium an
In light of that, do you stand by your original
21
assessment that management decisions for Kemper County were
22
within a zone of reasonableness and were prudent?
23
DR. GALLOWAY:
I would like to qualify the response.
24
As I'd indicated, the first response was the conclusions
25
were effective as of March 31st, 2013.
26
are in the two articles put forth are beyond March 31st,
27
2013 and are part of an ongoing review and will be part of
28
a prudence hearing that will be held later this year, and
The matters that
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
6
1
therefore my analysis and conclusions relative to the
2
aspects so stated in these two articles is still under
3
review, and therefore I do not believe that I can comment.
4
MS. KHOO:
That's fair.
Thank you for that.
5
I will now turn to page 36 of the compendium, which
6
references your work for Duke Energy on the Edwardsport
7
plant.
8
states that your firm concluded that Duke acted prudently
9
in managing the project, and this assessment was based on
In the third paragraph from the bottom the article
10
the similar factors to those that you mentioned above with
11
respect to Kemper?
12
DR. GALLOWAY:
Yes, but again I think that the
13
conclusions must be put into perspective.
14
for Duke Energy on reasonableness and prudence was on
15
various aspects.
16
entire amount.
17
imprudence and disallowance on one aspect of Duke Energy's
18
management itself.
19
Duke Energy's EPC contractor.
20
found that Duke Energy was reasonable and prudent in its
21
management of the EPC contractor, we found that the EPC
22
contractor had taken actions that were deemed by us to be
23
unreasonable and imprudent to the tune of a range, I
24
believe it was 500 to 800 million dollars.
25
The conclusions
It wasn't on the entire project or the
Qualifying that, we did find some
We also found disallowance relative to
Those amounts, while we
We -- under testimony I so indicated to the commission
26
at that time.
It would be obviously up to the commission
27
as how to handle that under the statute, and there was also
28
allegations, I believe, that so cited in your compendium of
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
7
1
2
fraud concealment and gross mismanagement.
So the commission found that there was no fraud
3
concealment or gross mismanagement and, relative to the
4
other matters, there was a settlement between the
5
commission and Duke, and relative to the 500 to 800 million
6
dollars the commission deemed that that was not a
7
responsibility of the ratepayers but that Duke could go
8
ahead and attempt to recover those in a separate action
9
against the EPC contractors.
10
11
12
So that is the basis of the reasonableness and
prudency.
It was within those bounds.
MS. KHOO:
Thank you.
So to clarify, reasonableness
13
and prudency was found on Duke's part, and then it was
14
because of the contractor that the project ended up going
15
the way it did in terms of the adverse consequences?
16
MS. GALLOWAY:
Except for I indicated there was one
17
other aspect.
I can't remember exactly the dollars.
It
18
was in the millions relative to a specific area on how they
19
handled grey water, and that particular aspect was deemed
20
by us to be imprudent on the actions of Duke Energy.
21
MS. KHOO:
Thank you.
22
MS. LONG:
Dr. Galloway, can you clarify for me the
23
distinction you're drawing between what your mandate was on
24
the Duke Energy project and Kemper project?
25
they were different scopes of work, one was more defined
26
than the other?
27
28
MS. GALLOWAY:
No.
Are you saying
So Kemper and Duke were both full
prudence audits for the entire aspect of the plant.
Duke
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
8
1
Energy was ahead of Kemper in its building.
Kemper is
2
going through its final start-up and commissioning.
3
Energy's Edwardsport IGCC's plant was in its start-up and
4
commissioning aspects when the prudence hearing was held.
5
And so the review for both plants was looking at the
Duke
6
decision to build, the preplanning and execution, the
7
entire execution of the project, and also that involved the
8
actions of the EPC contractor as well.
9
The Kemper project was somewhat different, not in our
10
scope, but somewhat different in the fact that they did not
11
have an EPC contractor.
12
and they themselves took on the role of EPC contractor
13
through their parent company.
14
They had multi-prime contracting
They are one of the few utilities that actually have
15
their own construction management arm, and so they did
16
their own EPC contracting.
17
at their role in that EPC contracting management.
18
But yes, we would have looked
So their roles were very similar.
It's just that the
19
Duke proceeding is over and was finished, and the Kemper
20
proceeding is not over and has not yet had a prudence
21
hearing.
22
been prefiled testimony.
23
not been held yet at all, and that is going to be done
24
later this year.
The testimony that I have filed in Kemper has
25
MS. LONG:
26
MS. FRY:
The prudence hearing has actually
Thank you.
Just to be clear, for both of those
27
projects, the construction was essentially finished at the
28
point at which you did your prudence review, is that
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
9
1
2
correct?
MS. GALLOWAY:
Correct.
The Kemper project was due to
3
the mandate from the commission is that when they pre-
4
approved the estimate, Mississippi Power Company had to
5
make annual filings of prudence.
6
an interim filing of testimony from everyone relative to
7
prudence.
8
was still ongoing because it was annual prudence reviews.
9
Before the hearings was held on that, the commission
So that is why there was
Up to the point of March 31, 2013, the project
10
changed its decision and made the decision, revised its
11
order that they would not hear prudence on an annual basis,
12
that they would wait until the completion of the project to
13
hold one hearing instead of annual hearings.
14
why no further testimony has been filed, an while the
15
prudence evaluation we are doing is still underway.
16
MS. LONG:
Continue, Ms. Khoo.
17
MS. KHOO:
Thank you.
18
19
And that's
I realize it's getting
repetitive, so this is the last one on the table.
On page 44 of the compendium, you testified before the
20
Florida Public Service Commission that the company behind
21
Levy County Nuclear Power Plant reasonably and prudently
22
implemented its management decisions.
23
On the page before that, similarly you testified that
24
PF's management decision was reasonable and prudent based
25
on information known, and that reasonably should have been
26
known by management at the time the decision was made.
27
28
Was that finding that PF's management decisions were
reasonable and prudent also in accordance with industry
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
10
1
standards, best practices, and the standard factors that
2
you mentioned earlier in making this sort of assessment?
3
MS. GALLOWAY:
As I think I testified yesterday, Levy
4
was very, very different in the mandate from that of Kemper
5
and Duke.
6
that was the decision to continue with the Levy project on
7
a limited basis, with work only proceeding for its combined
8
operating license and the amendments to the contract that
9
were made in light of that decision.
10
It was an evaluation of only one decision, and
So the prudence review was only for that decision to
11
continue, defer work, and whether the amendments within the
12
contract were reasonable and prudent.
13
yesterday, that was the testimony that all of the parties
14
had stipulated to and agreed to, and the commission
15
adopted.
16
procedures and processes and the things you compare against
17
best practices.
18
was known or reasonably should have been known at the time
19
that the utility made its decision to undertake that, which
20
was more in light of the Nuclear Regulatory Commission and
21
what the Nuclear Regulatory Commission was doing relative
22
to review of the combined operating licenses in the United
23
States, the timing of those combined operating licences,
24
and other factors such as the demand for power, the need
25
for power, why Levy was still a good option based on the
26
economic circumstances at the time, and those would have
27
been the factors surrounding that particular decision.
28
And as I indicated
It was -- it wasn't a review of policies and
MS. KHOO:
It was the decision-making process on what
Thank you.
However, after that, so on page
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
11
1
45 of the compendium, the Tampa Bay Times from August 2013
2
reported that Levy was shut down, and customers were on the
3
hook for $1.5 billion.
4
In light of that, I suppose, would you stand by your
5
original decision because it was limited in the scope as
6
you described?
7
MS. GALLOWAY:
Yes.
Plus it was, as I indicated,
8
based on the circumstances known at the time to the
9
utility.
Circumstances changed in many ways from the
10
nuclear industry all the way through economic conditions
11
and the price of fuel, with natural gas prices especially
12
plummeting, and all of those things resulted in different
13
circumstances that resulted in this decision that Duke
14
Energy made at that time.
15
MS. KHOO:
In relation to that project, is it true
16
that Jeffrey Lyash was the CEO of Progress Energy or Duke
17
at that time?
18
MS. GALLOWAY:
19
MS. KHOO:
20
current CEO of OPG?
That's correct.
This is the same Jeffrey Lyash who is the
21
MS. GALLOWAY:
22
MS. KHOO:
That is correct.
To confirm, of the projects we just
23
discussed, which seem to involve significant cost overruns
24
and were considerably delayed or shut down, in all those
25
cases at the time of the assessment, the assessment was
26
their management was reasonable and prudent?
27
28
MS. GALLOWAY:
No.
I think I've testified on Duke
that there was a significant disallowance that we found,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
12
1
one on both the utility and one on the EPC contractor of
2
the utility to -- I think our total disallowance was in the
3
range of 500 to 900 million dollars.
4
On Kemper, the testimony, yes, is still true up
5
through March 31st of 2013.
The conditions or any actions
6
taken by Mississippi Power after that time are still under
7
review, and no testimony has yet been filed.
8
And relative to the Levy project, again that was just
9
a contract basic decision that was accepted by all parties
10
11
12
13
14
15
16
to be reasonable and prudent.
MS. KHOO:
Thank you.
So the Duke finding was after
the fact of the actual project?
MS. GALLOWAY:
The project was still in start-up and
commissioning at the time of the prudence hearing.
MS. KHOO:
And the Kemper County assessment is still
under review?
17
MS. GALLOWAY:
18
MS. KHOO:
That is correct.
So would you agree that based on these
19
projects, that there seems to be a certain disparity
20
between the initial assessment at the time of
21
reasonableness and prudence and how these projects actually
22
turned out in practice?
23
MS. GALLOWAY:
24
MS. KHOO:
25
MS. GALLOWAY:
No, I do not.
Would you like to elaborate?
Well, prudence is -- in the U.S.
26
jurisdictional aspect is based on what was known, or
27
reasonably should have been known at the time a decision is
28
made.
That is how the commissions view all of the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
13
1
2
decisions.
The Mississippi commission has not obviously met or
3
heard any of the evidence yet.
4
Mississippi commission as to whether they deem the costs
5
reasonable and prudent.
6
It will be up to the
There is a distinction on the Kemper plant, of course.
7
The Kemper plant, which was a first of a kind in every
8
single aspect, the technology had never been built anywhere
9
before.
The plant had never been built anywhere before,
10
and there had never been a plant that agreed to do 65
11
percent carbon capture.
12
evaluated currently are against a lot of those knowns that
13
were known to everybody at the time the commission approved
14
the CPCN.
15
So the cost that are being
Also, there is a cap on the Kemper plant that both
16
parties agreed to because of the fact that the plant had
17
never actually been built before, so the ratepayers, the
18
customers, are protected.
19
costs of those costs over that, and the ratepayers that --
20
the proceeding that is about ready to go forward will be on
21
the exclusions, because there are exclusions to that cap
22
for which the utility and the commission have agreed will
23
be reviewed for prudence.
24
Kemper.
25
Southern Company has assumed the
So that is a difference on
On Duke there were provisions in the CPCN again, new
26
technology that had never been used, first-of-a-kind
27
elements of which both the commission and the utility
28
recognized.
There were some -- there were cost estimates
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
14
1
that came in based on that that both parties knew would
2
probably occur due to those first-of-a-kind risks.
3
costs were approved by the commission.
Those
4
And so the prudence element that was being reviewed
5
was the cost over the second approved cost estimate, not
6
the first approved cost estimate, and it's those costs that
7
there was the issue of the EPC contractor's costs.
8
So those were two very distinct differences, and
9
again, on Levy everyone agreed that the first decision was
10
a reasonable and prudent decision at the time it was made.
11
MS. KHOO:
The fact of the matter is, however, that
12
even if the outcomes had valid reasons or valid change of
13
circumstances, even if a decision seems prudent and
14
reasonable before implementation, that won't necessarily
15
stop the project itself from running over budget and over
16
schedule in its actual implementation?
17
DR. GALLOWAY:
It all depends on the circumstances and
18
what was known or reasonably should have been known and
19
what was known at the parties at the time that a plant is
20
being built.
21
difference between both Kemper and Darlington and Duke and
22
Darlington is that in the Darlington refurbishment program
23
that there was an extensive pre-planning period and that
24
the design was complete, that they were able to have
25
lessons learned.
26
learned from other refurbishment projects and nuclear
27
projects and other megaprograms.
28
And as I had indicated yesterday, a very huge
They were actually able to take lessons
The difference in the jurisdictional aspect in the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
15
1
United States, as I was explaining yesterday, is that when
2
a utility applies for its certificate of public necessity
3
and need, the CPCN, it does not have the same luxury of
4
going through that.
5
percent design had actually been completed at the time.
6
They did not have fully established organizations.
7
did not run any type of probabilistic modelling.
8
not have their organizational structure in place, and there
9
was no lessons learned to be gained because the Kemper
For instance, on Kemper less than 10
They
They did
10
project had never been built before and the technology had
11
never been used before, so there was no way to gain any
12
prior knowledge.
13
original estimate was made.
14
And so that was the basis upon which that
The same is true for Duke Energy.
There also was no
15
probabilistic modelling done.
16
planning done.
17
lessons learned because again even though a different
18
gasification technology, the technology had only been done
19
on a very small scale, and not an expanded scale, and so
20
those were very different factors than what Darlington has
21
upon which that original estimate was made.
22
There was no extensive pre-
There was not the opportunity to again take
And everyone was quite aware at the time that this was
23
put up for the CPCN that you also had economic conditions.
24
The Department of Energy was encouraging utilities to take
25
advantage of the abundance of coal, which was a natural
26
resource in the United States.
27
energy, which was deemed to be viable with IGCC -- sorry,
28
integrated gasification combined cycle.
There was a push for clean
There was also
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
16
1
investment tax credits that were being offered by the
2
government, and there was at that time, if everyone
3
remembers, natural gas prices were not low.
4
extremely high, and there was a desire for fuel diversity.
5
All of the parties, including the customers, the
They were
6
intervenors, and the utilities all at the time of the CPCNs
7
recognized that those types of risks were quite heavy,
8
could not be modelled, because there was no way to model
9
those risks because there was no subject-matter experts out
10
there that would be able to identify the types of risks
11
that might arise, and therefore everyone recognized that
12
there would be cost increases that potentially would occur
13
that could not be incorporated into that original cost
14
estimate.
15
So I think it's very important to judge what was known
16
and the pre-planning execution at the time of those two
17
plants to put in context what the final cost is today.
18
19
20
21
MS. KHOO:
Thank you.
I'm just going to see if my
colleague Mr. Garner has anything to add.
I believe that's everything for VECC.
Thank you very
much.
22
DR. GALLOWAY:
Thank you.
23
MS. LONG:
24
follow-on to that.
25
guess, on Kemper, for example, that there is not the same
26
pre-planning as has gone on for the DRP and other things
27
that were not done, and yet your opinion was that at the
28
time when your review -- it was reasonable.
Thank you.
Can I just ask a question, a
You've talked about the limitations, I
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
17
1
Are you saying that it was reasonable based on -- that
2
it's situational based on what the current standard is that
3
such pre-planning -- there were no lessons to be learned,
4
that's just typical common practice that they wouldn't have
5
designed?
6
opinion?
7
Is that the context in which you came to your
I'm just trying to understand that.
DR. GALLOWAY:
Yes, the U.S. is much different in its
8
regulatory regime of what a utility does and does not do
9
before it makes its application to actually build a
10
project.
11
that utilities do not take under a lot of what I would call
12
planning per se before they apply for their CPCN, because
13
of the -- all the costs are at risk.
14
And the regulatory regime in the United States is
And so they do sufficient planning in order to come up
15
with a reasonable estimate with what I would call
16
qualifiers on -- based on the circumstances and what was
17
known at the time.
18
So when the commissions review those applications for
19
CPCN they also review those qualifications of what is known
20
at the time.
21
through what I would call the reasonable and prudence
22
review.
23
the commission hearing, the prudence hearing, and they talk
24
about whether that's a reasonable assumption or not a
25
reasonable assumption.
26
And so it's those qualifications that also go
Each of those qualifiers is actually discussed in
Just as an example on the Kemper project itself,
27
because it had never been done before, ever, one of the
28
issues that was raised in the CPCN hearing on Kemper was,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
18
1
was, for instance, the decision to go with the Department
2
of Energy's desire to put into place IGCC a good thing for
3
Mississippi and the state of Mississippi.
4
Part of what went into that look of whether that was a
5
reasonable assumption underlying the need to go forward
6
with the project included that Mississippi, for instance,
7
has a huge amount of coal.
8
was looking relative to the number of jobs that the project
9
would create.
10
It is a very poor state, and it
And so there were economic -- there were other factors
11
that the commission considered in that decision that did
12
not actually go to cost that the commission in its order --
13
and if you read the order you will see this -- that those
14
opportunities for the state of Mississippi and the fact
15
that the utility would pay -- be making big tax payments,
16
all of those were considered to be reasons that the project
17
should go forward.
18
And then there was also a recognition that, being a
19
complete first of a kind, that there may be increases that
20
would come forward and that, you know, there was a
21
discussion and actually an agreement between the commission
22
and a settlement and the utility of how those first-of-a-
23
kind types of risks would be handled.
24
And so the commission in the States for each of these
25
jurisdictions on a CPCN looks at -- they recognize that the
26
extent of pre-planning is not there.
27
those estimates will probably come back for a cost
28
increase, and if they do, it is those new conditions and
They recognize that
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
19
1
circumstances that then will be reviewed, and whether the
2
utility took actions that were reasonable and prudent based
3
on the new circumstances that go beyond the original cost
4
estimate.
5
MS. FRY:
Let me turn it around a bit.
Obviously,
6
every project is individual, and you look at each project
7
at the particular stage when you are asked to come in and
8
opine.
9
So let me turn it around.
Of the projects that you're
10
referring to that you've dealt with in the past, which is
11
the one you would say is most similar to Darlington, in
12
terms of the circumstances of the project and the point at
13
which you were brought in?
14
MS. GALLOWAY:
As I indicated, most of the projects in
15
the States do not have this extensive preplanning.
16
fact, none of them have the extensive replanning and in
17
fact, probabilistic modelling comes in typically after the
18
project has been approved, when they go forth to look at
19
their cost estimate when they refine that cost estimate and
20
at that time, they will decide whether or not they need to
21
come forth to the commission for any types of increase.
22
In
But I will say that the Vogtle project probably has
23
some similarities in the fact that because the nuclear
24
regulatory commission in the United States was reviewing
25
these new designs that were going to be standardized
26
designs that presumably would make the cost of nuclear more
27
efficient and effective going forward instead of being one-
28
off designs, which is what was going on in the '70s and
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
20
1
'80s.
2
different.
3
for these different types of reactor designs.
4
Each nuclear power plant was built completely
And so the NRC was looking at these licenses
So the AP 1000, for instance, is a particular design
5
that had to have NRC approval first before they could
6
actually build that.
7
Vogtle case, everything depended on the EPC contractor in
8
that case because, it's the EPC contractor that brings
9
forth that AP 1000 design, it is going to be managing it,
The EPC contractor -- and in the
10
it has to come up with the policies and procedures, and so
11
the risk profiling and the risk review was somewhat
12
different than here, but similar in some respects.
13
So the risks were modeled within the contract, because
14
the contractor held everything that was going to be done
15
versus the utility putting in the policies and procedures
16
and looking at the -- and having done the design first and
17
having the contractor basically come in and execute that
18
work.
19
In Vogtle, the EPC contractor was doing everything.
20
So the risk review looked at the risks within the contract,
21
and the contractor was responsible for looking at how those
22
risks were going to be modeled, or how the risk would be
23
assumed by them versus the utility.
24
went through the actual risk profiling that was done on the
25
contract and that is -- for instance, in our scope of work,
26
we looked at the risk on how the risk was modeled and how
27
it was included within the EPC contract, and that is what
28
the commission actually took on was they have their own --
So the prudence review
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
21
1
it's called an independent monitor, but they had their
2
staff -- their consultant review the risks that were
3
incorporated within the contract.
4
We reviewed the risk as they were incorporated within
5
the contract.
6
indicate is that the contract was reasonable and prudent,
7
and that the risks within that contract were understood by
8
both parties including risks that might arise that would
9
result in a change order.
10
And then the -- what the order came out to
What the commission had to approve and did was that
11
should the risks that were unknown but covered within the
12
contractual provisions of the contract arise, then if those
13
conditions did arise, those conditions would come back to
14
the commission for review for those change order amounts.
15
And if they fell within the approved commission agreement
16
for those risks, those costs
17
and prudent.
18
would be deemed reasonable
So that is what has happened, is certain risks arose
19
under that contract.
20
contract.
21
settlement.
That settlement was put forth to the
22
commission.
They held a hearing on that, and the
23
commission so determined in its order that those costs were
24
part of the costs that would be applicable under the
25
contract in the change order provision, and approved those
26
cost increases.
27
28
They were provided for in the
The contractor and the utility came into a
MS. FRY:
Okay.
So if you were to summarize the key
similarities between the Vogtle project and how you came
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
22
1
in, the point you came in, and the Darlington project, can
2
you just sort of name the key similarities you would see?
3
MS. GALLOWAY:
The risk review, but being different in
4
the way I just described it.
The planning organization
5
relative to the structure and the organizational structure
6
that was going to be set up on both sides to execute the
7
program.
8
manage the project, including the various metrics and the
9
reporting.
The policies and procedures that were in place to
The project control tools and who would be
10
responsible for undertaking those project control tools,
11
but whether the project control tools met best practices
12
and would allow for a successful execution of the Vogtle
13
project.
14
So I believe that even though the CPCN was limited and
15
they didn't do as extensive a planning here, the same
16
elements that we reviewed here we, reviewed there for that
17
for their CPCN filing.
18
in that respect.
So they would be very, very similar
19
MS. FRY:
Thank you very much.
20
MS. LONG:
21
CROSS-EXAMINATION BY MR. RUBENSTEIN:
22
MR. RUBENSTEIN:
Mr. Rubenstein, are you next?
Yes, I am, thank you very much.
I
23
would like to follow-up on your discussion at the end about
24
the Vogtle.
25
Just to clarify, if I'm looking at JT 1.24 -- and this
26
is page 10 of the VECC compendium -- it says that you
27
participated in the engagement, but did not file testimony.
28
What exactly was your role?
Who were you representing
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
23
1
2
and what was the engagement that you had?
MS. GALLOWAY:
So Pegasus Global did file testimony.
3
The late Dr. Kris Nielsen actually filed the testimony in
4
the CPCN hearing that was the risk evaluation of the
5
contract, the history of the nuclear industry -- because I
6
think as I mentioned yesterday, Vogtle was the first
7
nuclear plant in twenty years to be built in the United
8
States, and served as the AP 1000 reference plant -- and
9
also to opine on the organization structure, the policies
10
and procedures, and project controls that were set in
11
place.
12
So Dr. Nielsen filed that testimony and testified in
13
front of the PUC hearing, and then the CPCN order was
14
developed.
15
did that evaluation.
16
that reviewed all of those aspects.
17
personally did not file and give testimony.
18
by Dr. Nielsen of the Pegasus Global Group.
I was part of the team, the Pegasus team that
19
MR. RUBENSTEIN:
20
MS. GALLOWAY:
21
22
There was a team of about five of us
It's just that I
That was done
What year would that have been?
Two thousand and -- I want to say 2008,
I believe.
MR. RUBENSTEIN:
My understanding, from documents and
23
testimony we've heard about Vogtle in this proceeding, is
24
that the project has gone significantly behind schedule.
25
believe OPG, in one of their documents, has stated it's at
26
least 39 months behind schedule.
27
understanding?
28
MS. GALLOWAY:
I
Is that your
Well, I believe again it goes to the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
24
1
points that I was just raising with the Board.
2
contract that was approved at the CPCN, it was recognized
3
that there may be certain risks that would arise that would
4
result in change orders.
5
of the contract.
6
Within the
Those risks did arise, were part
Those change orders included both the time extension
7
and the costs under the clauses.
That went through a
8
hearing last year and those additional costs, through the
9
settlement and additional extensions to the plant, were
10
deemed reasonable and prudent and approved by the
11
commission.
12
And relative to the cost, I think it's important to
13
understand from a transparency standpoint -- and I believe
14
that this information is very public; it's probably on the
15
Georgia Power website.
16
transparent in what they show.
17
there was an anticipation that there would be at the
18
completion of this -- they do have CWIP, as we talked about
19
yesterday, but there would be an anticipation that there
20
would be about a 12 percent increase in rates for the
21
Vogtle project.
22
number of -- from financing costs to looking at fuel prices
23
that that is now looked at to be -- going to be much lower
24
impact to the ratepayers, and so actually, even though the
25
costs are higher, the actual costs that will be borne by
26
the ratepayers will be much less than anticipated at the
27
CPCN.
28
Not for sure, but they're pretty
At the time of the CPCN
That now has been re-evaluated through a
MR. RUBENSTEIN:
So as I understand what you're saying
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
25
1
is there was an expectation that there were going to be
2
scope changes in that project and Vogtle -- the sponsor of
3
Vogtle would have to return to the commission.
4
there was an expectation from the beginning.
5
DR. GALLOWAY:
That was --
Yes, because at the time of the CPCN in
6
2008 they didn't even have a combined operating licence
7
approved by the NRC yet, which everyone was fully aware of,
8
and no one can anticipate what the NRC may or may not do.
9
It's a completely unknown risk in the United States, and I
10
don't believe the combined operating licence was actually
11
given to Vogtle until 2012, so some four years later.
12
13
14
So those are the types of things that were built into
the contract and some of the risks that might arise.
MR. RUBENSTEIN:
When you say NRC you mean the Nuclear
15
Regulatory Commission?
16
DR. GALLOWAY:
17
MR. RUBENSTEIN:
Yes, I'm sorry.
So from your discussion with Vogtle
18
and the comments you were making with respect to the
19
comparisons that VECC took you to, am I to -- I want to
20
understand this.
21
legislative systems in each of the -- in the States, and
22
they each have their own unique circumstances.
23
I recognize in the U.S. different
Have you then ever done an engagement that is very
24
similar to this that is a -- you're asked to provide on a
25
forecast basis, essentially, that the budgeting, the
26
management control, the contingencies are all reasonable,
27
with the expectation that there will be no change orders,
28
that they shouldn't be -- the utility shouldn't come back
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
26
1
to the regulator?
2
specifically?
3
Have you ever done anything like that
DR. GALLOWAY:
I'm a little bit confused by your
4
question.
5
clarification of exactly what you're asking me whether I've
6
done or not done?
7
Can you just give a little bit more
MR. RUBENSTEIN:
Sure.
I'll try to, at least.
I want
8
to understand if you've done something that is, at least in
9
my view, a little bit more precisely exactly what you're
10
asked to do in this proceeding.
11
mandate in this proceeding is you're being asked for this
12
project to comment on the reasonableness of the process to
13
develop the budget, the schedule, the contingency, the
14
program controls.
15
As I understand your
Have you ever done that for a project that has not
16
gone in -- is not planned to go in-service for a number of
17
years and there is an expectation from, I would believe,
18
the utility itself that it should not need to go back to
19
the commission, that there will -- it should not need to
20
make scope changes or material scope changes?
21
DR. GALLOWAY:
Well, yes.
I mean, again, there are
22
instances that are, I will say non-nuclear, because there
23
are not a lot of nuclear examples, okay?
24
the -- and so Bellefonte was a different situation.
25
government-run utility, and so it goes through completely
26
different proceedings.
27
28
I mean, Vogtle is
It's a
We did look at that decision-making, whether or not
they had the pre-planning and the policies and procedures
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
27
1
set up to make that decision to go with 1 and 2 versus 3
2
and 4 at the time.
3
If I go to non-nuclear, though, there are several
4
examples.
5
transmission and distribution project for ATC company,
6
looking at the same thing of whether their initial policies
7
and procedures and government -- I mean, their structure
8
and governance was all according to plan.
9
executed and came in, I think, pretty much on time and on
10
11
For instance, we did a prudence evaluation on a
That project was
budget.
The Energy Strong program that we are an independent
12
monitor on, which is public-service gas and electric in New
13
Jersey, again, we were brought in at the very beginning of
14
the project, a joint mandate by both the commission and the
15
utility and rate council.
16
mandate was to precisely look at the structure, the
17
policies, the -- it's a megaprogram, by the way, as well.
18
It's about 1.2, 1.3 billion dollars, and it's made up of
19
four major different projects underneath.
20
look at the management structure, we were asked to look at
21
the organization, the qualifications of the personnel, the
22
planning, the schedule, the cost estimate, look at the
23
project control systems, the reporting.
24
we're being asked to look at here, we were asked, and we
25
were asked to report out on that, and we do report out on
26
that to both the commission and the utility and rate
27
council on a quarterly basis with an annual report as well.
28
And in fact, the next annual report review is tomorrow for
It's a three-party group.
Our
We were asked to
Everything that
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
28
1
2
last year's review.
And to date, we have been monitoring that project for
3
three years now.
4
forecasted to come in ahead of schedule by as much as maybe
5
even a year, and it is forecasted to come in under budget.
6
The project is going to -- it's
And so we were asked to do the exact same thing that
7
we were asked to do here, except we were retained by all
8
three parties, and we are reporting out on that
9
continuously over the time.
10
And there will be a prudence hearing that will be done
11
at the conclusion of the project, which presumably we will
12
also be asked to testify.
13
So that was -- it's very similar to here, it's just
14
not a nuclear program.
15
a hardening of the system in order to protect it against
16
hurricanes and floods and those types of events that have
17
caused major outages in the state of New Jersey, because of
18
the types of storms that they have had over the years.
19
It's a -- it's -- Energy Strong is
The other example, of course, would be Crossrail that
20
I talked about yesterday, where Her Majesty's Treasury
21
asked us to come in and do a complete review of the risks,
22
and again the structure, the policies and procedures, the
23
project controls, and the whole setup for the Crossrail
24
system that was then prepared in a report that was given to
25
the treasury and then submitted to parliament.
26
MR. RUBENSTEIN:
27
DR. GALLOWAY:
28
MR. RUBENSTEIN:
But none for nuclear.
Excuse me?
But none for nuclear.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
29
1
DR. GALLOWAY:
Well, as I've indicated, the only
2
nuclear project in 20 years is the Vogtle nuclear project,
3
other than -- we're not working on SCANA, so I can't
4
comment on SCANA.
5
MR. RUBENSTEIN:
I want to ask you about -- if we can
6
turn to your report.
And I'm looking at page 13, and when
7
I use page numbers I'm using the page numbers in the top
8
right-hand corner.
9
asked to do, just to clarify what you were asked to do and
10
what you did not -- you were asked not to do and you have
11
not opined on.
12
I just want to understand what you were
And as I read the purpose of your testimony, and as I
13
read it, it says you were asked to provide an assessment,
14
an independent and objective assessment:
15
"...of the degree to which Ontario Power
16
Generation's plan and approach to execution of
17
the DRP, including the processes in place for
18
management of cost, schedule, program controls,
19
and the application of any contingency are
20
consistent with other ways megaprojects and
21
megaprograms of similar magnitude and scale,
22
complexity, have been carried out."
23
Am I reading that correctly?
24
DR. GALLOWAY:
25
MR. RUBENSTEIN:
That's correct.
And if we take that to sort of a
26
higher level, really, as I read your report, what you
27
opined on in your understanding, you looked at the
28
processes to develop the cost, the schedule, the program
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
30
1
controls, the contingency, and you found them reasonable.
2
DR. GALLOWAY:
3
the structure as well.
4
5
MR. RUBENSTEIN:
And also looked at the organization and
And you found that they were
reasonable.
6
DR. GALLOWAY:
7
I indicated yesterday.
8
MR. RUBENSTEIN:
Yes, in light of all of the things that
So just to be clear what you weren't
9
asked to do and which you have not opined on, you have --
10
while you have determined that the processes and plans are
11
reasonable, the numbers that underlie them, have you -- you
12
have not determined that they're prudent.
13
DR. GALLOWAY:
14
MR. RUBENSTEIN:
Am I correct?
I'm a little bit -So I'll give you an example.
So you
15
talk about in your report that the process to determine the
16
cost estimate is reasonable.
17
the $12.8 billion is specifically a reasonable number or
18
the cost items that underlie the budget -- you haven't done
19
a line-by-line to review to make sure they're correct.
20
I correct?
21
DR. GALLOWAY:
You have not determined that
Am
Well, there is not a line-by-line
22
review done.
What we did review within the estimate is we
23
looked at the basis of estimate that was prepared by OPG
24
that is quite a detailed document that discusses how the
25
actual costs were developed, the source documents for those
26
costs, the actual estimates for the cost.
27
reviews of samples of some of those source documents to
28
ensure that the dollars that are composed of some of those
We did do
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
31
1
elements follow through that cast basis of estimate, and
2
then would translate into the model for the P90 confidence
3
level.
4
We did look at the risk registers, for instance, which
5
have input into how the total cost is developed, relative
6
to whether or not the types of risks that were being looked
7
at were reasonable types of risks to be modeled and
8
incorporated within that.
9
Then we also looked at other independent reports that
10
were done based on the estimate and the risk, to look at
11
other subject matter experts that have done a much more in
12
depth review of those.
And that's the whole process.
13
So the process is what we did look at, but that
14
process does incorporate the review of actual samples of
15
how they went about the process to get those numbers and to
16
get the risks that go into the $12.8 billion.
17
So with that sampling and the way it's modeled, it
18
should be a reasonable number based on the reasonable
19
process, and the fact that it followed industry practices
20
and it followed all of the lessons learned and the
21
development of the actual cost estimates itself.
22
So based on those reviews, the inputs, and the
23
independent reviews of those inputs on those specific
24
dollar items, then the 12.8 was derived based on a
25
reasonable and prudent process.
26
MR. RUBENSTEIN:
Let me ask you about -- you talked
27
about you reviewed the risk register.
In doing so, as I
28
understood it, you opined that the process to determine how
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
32
1
to -- which risks to include and how to value those risks
2
you think are reasonable.
3
Am I reading that correctly, that when you talk about
4
your review of the risk register, that's what you've done?
5
MS. GALLOWAY:
Well, we went through the risk
6
register.
7
with individuals as well to understand how those risks were
8
derived, how they were vetted, how they ensured all the
9
risks were captured.
10
Part of the reason we had reviews and interviews
I don't remember, sitting here today, exactly which
11
risks we probably talked about specifically from those risk
12
registers.
13
sampling, you know, how did you get that risk, how was that
14
looked at, how was it then incorporated.
15
merely going through the exercise.
16
doing the risk register proper, but getting down a little
17
bit more into the granulation how specific risks were
18
identified, how they were vetted, how they were then
19
incorporated into the risk register, and then how they were
20
modeled in the probabilistic risk model itself.
21
But did look at specific risks to inquire as a
MR. RUBENSTEIN:
So it wasn't
It was the exercise of
So did you verify -- as I understand
22
it, there are a thousand-plus risks in the risk register.
23
Did you look at each individual risk and determine that the
24
risk has been described appropriately, the probability is
25
being determined appropriately, the financial value or the
26
cost if it materializes has been appropriately determined
27
and is appropriate, and the scheduling cost -- essentially
28
the delay it may cause, the impact is correct.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
33
1
You didn't do that for each individual item?
2
MS. GALLOWAY:
As I indicated, we took a sampling.
We
3
did not look at each individual item.
We looked at
4
individual samples from the risk register, and then probed
5
those specific items to determine whether or not they did
6
in fact follow through the process of what we would expect
7
a reasonable and prudent individual and organization,
8
whether it be utility or another owner, or even a
9
contractor, what would be expected of how they would look
10
at those risks, cost those risks, and put those risks into
11
the ultimate model.
12
MR. RUBENSTEIN:
Am I correct that you -- I don't
13
think you were asked to, and I don't think you did.
You
14
were not asked to opine on the reasonableness of certain
15
cost overruns with respect to safety and improvement
16
projects, and facilities and infrastructure projects, any
17
prerequisite projects?
18
MS. GALLOWAY:
Not the actual cost itself, but how
19
those cost impacts were being used relative to lessons
20
learned, and how the lessons learned from those were being
21
incorporated into the DRP estimate, and also the policies,
22
procedures and management and how the DRP would be executed
23
going forward to minimize against the type of cost
24
increases that happened on the F&IP and SIO projects.
25
26
MR. RUBENSTEIN:
Thank you.
If we can turn to page
25, I'm reading from line 5, and you say:
27
"By utilizing the higher confidence number, e.g.
28
P90,the owner and stakeholders reduce a
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
34
1
2
significant amount of risk due to cost overrun."
Do you see that?
3
MS. GALLOWAY:
4
MR. RUBENSTEIN:
Yes, I do.
You'd agree with me that by utilizing
5
a higher confidence level, the owner and stakeholders
6
increase the likelihood that the project will come in under
7
budget?
8
MS. GALLOWAY:
9
MR. RUBENSTEIN:
Yes.
And you say, and this is on line 19:
10
"Selection of a confidence level primarily is
11
reflective of the risk appetite of the owner."
12
Do you see that?
13
MS. GALLOWAY:
14
MR. RUBENSTEIN:
15
16
Yes.
Can you explain to me what you mean
by that?
MS. GALLOWAY:
So if you go back up to line 5 and 6,
17
it's specifically -- and this is what I was referring to
18
yesterday in my testimony -- by utilizing higher confidence
19
number, e.g. P90, the owner and stakeholder reduces a
20
significant amount of risk due to cost overruns.
21
The owner, and this is what we looked at here, has to
22
look at what the confidence level must be from both a
23
regulator and themselves, and whether or not those costs
24
that are going to be put forth are going to be reliable so
25
that the utility has some confidence that it will be able
26
to manage the project and the program here within that
27
envelope of risk to a certain degree of certainty that it
28
can meet its budget.
And at the same time, the regulator
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
35
1
has confidence that the program will also be able to be
2
completed within a certain cost regime, because regulators
3
have to look into the future as to, over a compendium of
4
time, of where costs might be at some point in the future.
5
So it's important, from our review, that we look at
6
both stakeholder expectations and we look at the
7
circumstances of the risk, the complexities, the magnitude
8
and that we build in some of those risks within a
9
confidence level that allows management to manage a program
10
potentially at a lower confidence level, but having an
11
envelope to ensure the number that it's putting forth for
12
approval at a point of time which is years earlier than
13
completion, there is a much higher reliability in a.k.a.
14
confidence that the program will not go beyond that cost or
15
schedule, similar to what I was talking about with, for
16
instance, Crossrail yesterday.
17
MR. RUBENSTEIN:
I understand why OPG would want to
18
limit its risk.
19
ultimately have to pay for the cost overrun themselves.
20
They may be able to get approval and pass it on to
21
ratepayers, but they have to pay for it.
22
That makes sense to me as the owner.
I don't understand why ratepayers should have to pay
23
to deal with OPG's risk appetite.
24
understand that?
25
They
MS. GALLOWAY:
Can you help me
Again, when I indicated the -- the risk
26
appetite is looking at what both stakeholders are going to
27
have to put forward as a reasonable and reliable cost,
28
ultimate cost of a program.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
36
1
If you look at past megaprograms -- and this is what I
2
was alluding to yesterday -- in which other megaprogram
3
experts out there today have also now opined upon, is that
4
the cost estimates were too low and they were not reliable
5
because they did not adequately consider the types of risks
6
that is could arise that one cannot see today.
7
therefore, the probabilistic risk modelling is important
8
and the confidence level, depending on the magnitude, the
9
size, and the complexity of the project is important.
And
And
10
what is being found today relative to megaprograms is that
11
the stakeholders that are recognizing that, especially, I
12
will say, public stakeholders that do have to report out to
13
a customer, a ratepayer, the public at large, taxpayers,
14
whatever the megaprogram is going to be, that you want to
15
be able to have some assurance that when you tell your
16
customer, your taxpayer, the public of what something is
17
going to cost, there is now an expectation, and to prepare
18
for that expectation, and to be able then to manage so you
19
would come in at or even below that cost or schedule.
20
at the end of the day all stakeholders' expectations have
21
been met.
So
22
On lower confidence levels, it's, for instance, a P50
23
level, the AKA of that is there's a 50 percent chance it's
24
going to come in on time and on budget, but there is a 50
25
percent chance it's not.
26
risk if it's going to go over budget and over schedule and
27
a cost that neither the governments want to try to
28
reconcile of why that happened or even the utility or the
And that 50 percent is a huge
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
37
1
owner building a project to say it's not a number that
2
we're comfortable because of the risks that we do not know
3
today that could happen.
4
risk modelling with all the risks that potentially could
5
occur and why you choose a higher confidence level on a
6
program of this size and magnitude and complexity.
7
MR. RUBENSTEIN:
That's why you do a probabilistic
So I understand from what you're
8
saying then that there is some benefit to coming in under
9
budget, right?
OPG doesn't need to explain to other
10
entities why it came in over budget.
11
inherent benefit for large projects to come in under
12
budget.
13
There is just an
Did I -- am I understanding that correctly?
DR. GALLOWAY:
I think when you plan a project of any
14
sort the goal from all stakeholders is to come in within
15
budget and within schedule.
16
or schedule that's all a bigger benefit.
17
to make sure that you meet the schedule and budget so set
18
at the beginning.
19
should be an expectation on any project.
20
If you can exceed that budget
But the goal is
That's an expectation on any project and
MR. RUBENSTEIN:
Well, I would have thought the goal
21
here is to determine the right budget and the right
22
schedule, it's not about setting expectations, necessarily.
23
DR. GALLOWAY:
Well, the expectations goes to how
24
you've planned the project.
This program was planned on a
25
P90 confidence level, meaning when they model the risks and
26
come out and look at those risks, they are looking at the
27
combination of all risks over four units that can accrue
28
and possibly arise over the entire tenure of the planning
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
38
1
2
for this program.
That P90 confidence level means that if a good portion
3
of those risks arise, and they could, no one knows whether
4
they will or will not arise sitting at this point today,
5
then there is confidence that it is a reliable and a good
6
budget based on that risk modelling.
7
is showing.
8
9
That is what the P90
So there becomes an expectation that you will meet
whatever estimate that arise from that P90 modelling.
10
that's the expectation.
11
it's going to come in at 12.8.
12
that, that will be a benefit to everyone.
13
MR. RUBENSTEIN:
So
If it's 12.8, the expectation is
And if it comes in below
As I understood from your
14
examination-in-chief, you went back into your files and you
15
looked and you said, well, what other projects that I've
16
been involved in have a P90, and you were able to find two.
17
Did I understand that?
18
I believe the other one was the Bellefonte project?
19
DR. GALLOWAY:
There's the Crossrail project, and
Yes, I think I indicated yesterday I
20
did not remember -- first of all, we don't keep our records
21
based on what confidence levels or where things modelled or
22
don't model.
23
risk modelling at the time of the CPCN on either the Kemper
24
or the Duke project.
25
'70s and '80s risk probabilistic modelling did not even
26
exist, and so obviously those projects would have never had
27
one, because the modelling, the software, just wasn't in
28
place to do that.
I even talked about today that there was no
It just wasn't done.
Back in the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
39
1
When I have obviously been reading the testimony every
2
day, when I saw questions on the P90 I tried to think
3
whether or not there potentially was recent projects where
4
I did see that and records that I have, you know, available
5
to me.
6
it went through a very detailed risk modelling exercise.
7
do know that it had a confidence level.
8
remember the confidence level of the Crossrail project, so
9
I did check that.
I remember something on Crossrail, because I knew
I could not
Similarly, I remembered there was risk
10
modelling done for Bellefonte, and so I went back to
11
determine whether or not that also had a P90 modelling,
12
which I found that it did.
13
MR. RUBENSTEIN:
Do I take it -- you may not know
14
this, but do I take it that those were the only two that
15
you were able to remember or look up, that the majority of
16
projects don't use a P90?
17
I
DR. GALLOWAY:
I would agree that there are not very
18
many projects that use a P90.
It depends on the complexity
19
and the magnitude.
20
the same complexity and magnitude because one was a nuclear
21
project and the one was an 18 billion dollar project.
22
is part of the reason I went back to those files, because I
23
thought they were of the same magnitude and complexity.
24
I don't know whether some of the others did or did
The two that I mentioned I knew were of
That
25
not, because I didn't consider other projects to be of the
26
same size and complexity, so I did not go back to the files
27
to check.
28
MR. RUBENSTEIN:
And I am correct that your opinion as
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
40
1
you've talked about earlier with respect to the DRP is
2
that, you know, this project has done more work leading up
3
to execution phase really than most projects?
4
DR. GALLOWAY:
5
MR. RUBENSTEIN:
Yes.
I want to ask you about -- briefly
6
about megaprojects and nuclear megaprojects.
7
heard from a number of OPG witnesses and from the
8
documentary evidence, and I think you've commented on it
9
indirectly, they have a habit of going over budget and over
10
11
As we've
schedule, or beyond schedule, correct?
DR. GALLOWAY:
I believe you have to look at the
12
circumstances at the time.
I do believe that, yes, the --
13
from the original cost estimate to where they are now, the
14
ones in the '70s and '80s obviously were under different
15
circumstances.
16
being actively built in the United States anyway to do
17
comparisons on.
18
what those original estimates were and what the conditions
19
and qualifications were.
20
MR. RUBENSTEIN:
There is only three today that are out --
And I think I've already testified as to
I'm not saying that the reasons for
21
the over budget or why they went behind schedule were
22
imprudent, but just generally megaprojects, and made a
23
career helping utilities work towards solving this problem,
24
I think, you know, that they've gone over budget and
25
they've gone over schedule, they have a chequered past in
26
that regard, at a high level.
27
28
DR. GALLOWAY:
But I don't think it's fair, because
there is not a fair comparison of how the original
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
41
1
estimates were developed.
2
developed on P90 modelling.
3
same pre-execution planning.
4
The original estimates were not
They weren't developed on the
Had they done the same type of pre-execution planning
5
and they done risk probabilistic modelling, the initial
6
estimate would have been much higher, and if the initial
7
estimate had been much higher their results may be much
8
different than they are.
9
So I don't think it's a fair-to-fair comparison to
10
look at what the initial estimate was and where they've
11
ended up, because they're not apples-to-apples as to how
12
the original estimate was initially developed.
13
MR. RUBENSTEIN:
So let me go back to page 13 of your
14
report, where you were asked what your -- essentially your
15
task was.
16
processes in place for cost, schedule, program controls,
17
and the application of the contingency to ensure that they
18
are consistent with the way other megaprojects and
19
megaprograms of similar magnitude, scale, and complexity
20
have been carried out.
And you were to make an assessment of the
21
So would I be -- so do I understand what you're
22
essentially doing is you're -- you looked at what OPG did
23
and you compared it against, well, what is everybody else
24
doing, and that's how you come to the assessment that OPG
25
is doing a much better job than most other projects.
26
DR. GALLOWAY:
Yes, I mean, it was -- we looked at the
27
industry standards.
We looked at other megaprograms, ones
28
that are underway, ones that have been completed in the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
42
1
past, and we looked at utility industry best practice.
2
Those are the three items that we used to valuate the
3
reasonableness and prudence of what's going on in the
4
Darlington refurbishment program.
5
MR. RUBENSTEIN:
So if other utilities and other
6
projects and other megaprojects, as you were saying, maybe
7
didn't have the best comparison, they didn't do as much
8
budgeting, and so they end up going -- at least maybe on an
9
apples to oranges comparison -- over budget.
10
Is it maybe true that the way those megaprojects and
11
megaprograms in the past are actually not the best way to
12
compare.
13
be a better way to do it?
14
We shouldn't look at these projects; there should
MS. GALLOWAY:
I think that as I so indicated
15
yesterday, that's one of the areas where Mr. Roberts and I
16
agree that each megaprogram -- there are so many different
17
variables that go on between projects that make them
18
unique, that it's not possible do an apples to apples
19
comparison between a megaproject and a megaprogram.
20
However, as I also indicated yesterday and again this
21
morning, is that what the global construction industry as a
22
whole and both governments and owners and financers are
23
learning is that there's a lot of elements of why
24
megaprojects have gone over their initial schedule and
25
budget, that we as an industry are learning from.
26
For instance, doing a probabilistic modelling, going
27
to P90 confidence level for these very large projects is
28
something that we are learning, when you do megaprojects,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
43
1
that you should do more of.
More pre-execution planning
2
would assist greatly in having the megaprograms be
3
successful, from both a cost and a schedule perspective.
4
This is something that Mr. Flyvbjerg, for instance,
5
has come out I think even last year in an article that he
6
prepared, that we are learning from megaprograms and how
7
they were executed, and the very things I just talked about
8
are things that different entities are now using, and that
9
there is going to be a higher probability of success for
10
these megaprograms as they apply these types of lessons
11
learned from megaprojects in the past.
12
MR. RUBENSTEIN:
If we turn to page 22, here you're
13
discussing -- this is with respect to is the setting up
14
your discussion of cost management, and you were asked
15
about the industry standards you use.
16
talk about the government accountability office, at GAO,
17
you talk about the AACE basis.
18
19
20
And as I see, you
Am I correct that those are the industry standards
that you are looking at?
MS. GALLOWAY:
We looked at Project Management
21
Institute, we looked at AACEI, we looked at the U.S.
22
government accounting, and then with the experience that I
23
have in the utility industry, obviously utility industry
24
best practices as well.
25
MR. RUBENSTEIN:
When we turn to page 30 where you're
26
talking about schedule management, again you're looking at
27
the Project Management Institute, you're talking about the
28
AACE, and you're talking about the government
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
44
1
2
3
accountability office.
Those are the industry standards you're making the
comparison to?
4
MS. GALLOWAY:
And utility best practices.
5
MR. RUBENSTEIN:
Are there industry standards for
6
schedule development applicable to megaprojects?
7
and AACE, along with other entities such as GAO."
8
That's what I am reading of what you've --
9
MS. GALLOWAY:
"Yes, PMI
Right, and at the very beginning of
10
what you've read me on the initial pages comparing to other
11
megaprograms and megaprojects, it goes into the utility
12
best practice of other megaprograms and megaprojects of
13
what the utility industry has done in its planning.
14
one of the aspects that's also within this.
15
That's
That's not, quote, a written standard, which is why
16
it's not included in this answer.
17
evaluation process as outlined earlier in what we were
18
comparing to.
19
MR. RUBENSTEIN:
But it's part of the
Then if I go to page 34, where you
20
are talking about reporting -- sorry, you're talking about
21
reporting management.
22
Management Institute best practices.
23
that.
24
MS. GALLOWAY:
Here you're utilizing the Project
I see a reference to
It would be one of the references.
But
25
again, it would be the same industry standards from Project
26
Management Institute, what is also from AACEI utility best
27
practices, those would be all the same standards we would
28
be evaluating against.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
45
1
MR. RUBENSTEIN:
When I go to page 25 and you talk
2
about the contingency, am I correct -- is there an industry
3
best standard of the confidence level you should choose, or
4
is that strictly your industry experience that you're
5
drawing your views from?
6
MS. GALLOWAY:
I think I include in my testimony that
7
there is not an industry standard relative to the choosing
8
of a confidence level, that it is unique to each project
9
and it depends on its magnitude, complexity, size, and the
10
11
risk that it's looking at.
I think I've made that statement in my testimony that
12
there is not, quote, a standard for choosing a confidence
13
level.
14
15
16
MR. RUBENSTEIN:
Thanks very much.
Those are my
questions.
MS. LONG:
Thank you, Mr. Rubenstein.
I think we'll
17
take our morning break for fifteen minutes, and then, Mr.
18
Buonaguro, you can proceed.
19
--- Recess taken at 10:48 a.m.
20
--- On resuming at 11:06 a.m.
21
MS. LONG:
22
CROSS-EXAMINATION BY MR. BUONAGURO:
23
MR. BUONAGURO:
Mr. Buonaguro.
Thank you.
Good morning.
Good
24
morning, Dr. Galloway.
25
counsel for Consumers Council of Canada, and I have some
26
questions for you.
27
28
My name is Michael Buonaguro.
I'm
First I would like to follow up on some of the
information you gave about the Kemper project.
That's what
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
46
1
I'm going to call it, the Kemper project.
2
mentioned that March 31st, 2013 was the last time you were
3
directly involved in reviewing that project pending the new
4
review of the project, the new prudence review, I think you
5
referred to.
6
DR. GALLOWAY:
You had
No, I am currently still reviewing.
7
It's just the pre-filed testimony that was filed was only
8
as of March 31st, 2013.
9
MR. BUONAGURO:
Right.
So your -- when you were
10
referred to your opinion on the Kemper project it was the
11
point-in-time opinion of March 31st, 2013?
12
DR. GALLOWAY:
13
MR. BUONAGURO:
Yes.
And so just for comparison purposes,
14
your point-in-time review of the DRP, I think you've
15
mentioned yesterday, I think it was to Mr. Stephenson,
16
would be July 31st, 2016?
17
DR. GALLOWAY:
18
MR. BUONAGURO:
Correct.
Right.
So it's the same sort of
19
thing, things that happened after that date you obviously
20
haven't reviewed, so for example, whatever OPG has done
21
since July 31st of 2016 you don't have an opinion on.
22
DR. GALLOWAY:
23
MR. BUONAGURO:
Correct.
Okay.
And you said something
24
interesting about Kemper.
25
- that March 31st, 2013 date related to an annual review of
26
the Kemper project that you used to do?
27
28
DR. GALLOWAY:
And you said, I think the last -
So in the CPCN order on Kemper the
commission had indicated that it was going to set up an
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
47
1
annual prudence review to review matters annually and make
2
a determination on prudence annually.
3
in, and then the commission changed its decision, came out
4
with a new order, and indicated that it was not going to
5
review prudence on an annual basis and it would wait until
6
the project was completed to hear prudence.
7
MR. BUONAGURO:
Okay.
The pre-filings went
So maybe I can follow up.
How
8
many years of annual review actually happened, or are you
9
telling me none happened?
10
11
12
DR. GALLOWAY:
None happened.
There have been zero
prudence hearings on Kemper to date.
MR. BUONAGURO:
Okay.
That explains a lot then,
13
because the way it came up earlier it sounded like it had
14
been going on and it stopped, but you're saying it actually
15
never really got started.
16
DR. GALLOWAY:
17
MR. BUONAGURO:
18
DR. GALLOWAY:
19
The prudence review, that's correct -On an annual --- never been a hearing to date
since --
20
MR. BUONAGURO:
21
DR. GALLOWAY:
22
MR. BUONAGURO:
Okay.
-- the CPCN hearing.
Thank you.
And I want to lead into my
23
questions in general with something I heard yesterday if I
24
could.
25
154, from -- I don't know what volume number it is, sorry
26
-- volume 5.
27
Starting at line 26 of page 153.
28
This is from the transcript, page 154 -- or 153 to
It's going to come up on the screen.
So I pick up part of your answer there, and you say:
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
48
1
"And that is why the megaprograms that are taking
2
what I would call a more realistic view of having
3
as much information as they reasonably can based
4
on what is known at the time and modelling that
5
from a probabilistic standpoint that the financer
6
of the megaprogram, whether that's a private
7
entity, an investment bank, an owner, a
8
commission, gives them a higher confidence of
9
what they know and ultimate cost may be, and they
10
can then make better informed decisions knowing
11
what that ultimate cost may be."
12
So I took that to mean in the context of this case --
13
and we're talking about the OPG's use of a P90 for the DRP
14
-- and I'm going to talk in terms of Unit 2 cost, as
15
opposed to the entire program costs if I may.
16
we're talking about the DRP Unit 2 costs projected of 4.8
17
billion dollars to go into service in 2022 -- sorry, 2020,
18
I believe, the P90 basically tells everybody, don't be
19
surprised if it comes into 4.8 billion, because there's a
20
lot of things that are going to happen between now and then
21
that we've modelled using the Monte Carlo simulation, so on
22
and so forth, but hopefully it will come in under, and if
23
it goes over there's going to have to be pretty good
24
reasons for it.
25
here; is that fair?
26
So when
That's sort of how I took what's going on
DR. GALLOWAY:
Well, the P90 confidence modelling was
27
done on four units, not on just one unit.
And so all of
28
the units, of course, with how they are interconnected and
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
49
1
the risks are all modelled on a four-unit basis.
2
would be difficult for me to opine specifically on, quote,
3
how those risks may be separated out, because I don't think
4
you can easily separate out the models since it was on four
5
units.
Okay.
And so it
6
MR. BUONAGURO:
So thank you for that.
7
I had understood, and perhaps I misunderstood, that
8
you had said something about what you were asked to do, and
9
you talked about allocation, and I had assumed that that
10
meant the allocation of the contingency.
11
Are you telling me that you don't have an opinion
12
about how OPG has allocated the contingency amount of $1.7
13
billion between the units?
14
DR. GALLOWAY:
We looked at it from an entire program.
15
So the contingency as it applied in the P90 model for the
16
entire program, and not specific to, quote, Unit 2.
17
MR. BUONAGURO:
Okay.
Fair enough.
You're aware,
18
though, that they've allocated for the purposes of rate-
19
setting 700 million or so of contingency to Unit 2?
20
DR. GALLOWAY:
21
MR. BUONAGURO:
22
23
Yes.
And again, I've rounded it up.
It's
changed slightly, but -- thank you.
And I think, though, from what you're saying and what
24
I had understood about contingency in the first instance,
25
when the company comes with a completed Unit 2, hopefully,
26
in 2020, if the total amount for Unit 2 isn't 4.8, it could
27
be more than 4.8, because more than the allocated, quote
28
unquote, amount of contingency occurred as Unit 2 is being
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
50
1
built, but it also could be less, because less of the
2
allocated contingency could have occurred in relation to
3
Unit 2.
4
5
6
Those are both reasonable scenarios?
DR. GALLOWAY:
Yes, projects could come in before and
under.
MR. BUONAGURO:
Yeah.
And then if we talk more
7
holistically on the 12.8 billion and the $1.7 billion of
8
contingency for the entire project, contingency may not
9
come to fruition in that amount.
10
It might come in lower.
And hopefully it comes in lower, right?
11
DR. GALLOWAY:
12
MR. BUONAGURO:
Yes.
Okay.
Now, I want to talk briefly
13
about imprudence, because a lot of your evidence that --
14
or, sorry, I should say a lot of the examples of evidence
15
that you've given in the past related to what I would call
16
ex post facto prudence reviews; is that correct?
17
DR. GALLOWAY:
18
MR. BUONAGURO:
Yes.
Where you've looked at how a company
19
has managed a project to completion and then asked for
20
approval of costs, and part of the review of those costs is
21
to see if any of the costs incurred were actually
22
imprudently incurred?
23
DR. GALLOWAY:
Yes, but with the caveat of it's not --
24
in hindsight it's not an after-the-fact review per se,
25
because under the prudence statute in the U.S., the
26
jurisdictions, is that every decision that is made has to
27
be looked at and evaluated and it has to be looked at in
28
the time that it was made based on what it was -- what was
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
51
1
known or what reason it should have been known at the time.
2
So it's not like you have the ability on five years to
3
say, well, that decision, actually, after five years
4
doesn't look like it was a good decision.
5
in the context of when the decision was made and what was
6
known.
7
MR. BUONAGURO:
Fair enough.
It has to be put
The difference being,
8
though, that because you're not able to sit with the
9
company and watch them make decisions in real-time, you
10
have do it after the fact, but I understand what you're
11
saying.
12
not is in the context of the time they're making the
13
decision and what they had available to them at the time of
14
the decision.
15
The measure of whether they're being reasonable or
DR. GALLOWAY:
Yes, but just to correct one -- I think
16
your prior question was, our prudence reviews are always de
17
facto after the fact.
18
Vogtle this morning, those reviews was on the CPCN, so that
19
was in the exact scenario as here, as I relayed to the
20
Board.
21
I want to -- as I talked about with
So the project had not gone forth to an execution yet
22
at all.
23
prudence review was done on the pre-execution planning for
24
Vogtle.
25
It was seeking approval to go forward, and so that
MR. BUONAGURO:
Thank you.
But I'm assuming that any
26
-- whenever you do that type of review, you're always
27
limited at the point in time, right?
28
you haven't -- and not presuming to evaluate all the
As we talked about,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
52
1
decisions that OPG makes from July 31st forward and bless
2
them as prudent in advance.
3
31st, 2016, based on what they're planning to do, it looks
4
good, it looks prudent.
5
DR. GALLOWAY:
You're saying that as of July
And how they are planning to actually
6
implement and go forward with the execution.
7
just the establishment of what they have in place, but
8
actually their plans for execution and their understanding
9
of those plans on how they will implement the policies,
10
procedures, and processes.
11
is true here.
So it's not
That was true in Vogtle, and it
12
So you're looking at, and I think I so opined, that
13
based on that approach, based on the interviews with the
14
project personnel who will be responsible for executing the
15
program, that plan would favourably position OPG for a
16
successful execution.
17
18
MR. BUONAGURO:
That's assuming that they execute in
accordance with their plans.
19
DR. GALLOWAY:
20
MR. BUONAGURO:
Yes.
I think that's what Schiff Hardin's
21
evidence raises the issue of, which is that planning is
22
great, and I think they generally agree that the planning
23
is done well, but it's the actual execution of those plans
24
over the next four years which may or may not result in
25
imprudent costs, right?
26
DR. GALLOWAY:
True.
But I think Mr. Roberts and I
27
both agree that the process and the tools that are in place
28
are reasonable and prudent, and if executed in accordance,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
53
1
2
should allow for a successful execution of the DRP.
MR. BUONAGURO:
If we come to 2020 and the project
3
comes into service, and the dollar value for the DRP is as
4
budgeted, the $4.8 billion, are you saying that we know for
5
sure that that does not include any interim costs?
6
DR. GALLOWAY:
I don't think I can answer that sitting
7
here today.
8
one has the ability to evaluate.
9
10
11
Those are actions in the future for which no
MR. BUONAGURO:
I fully expected that to be your
answer; I'm just making sure.
Now, in order to determine whether or not there's
12
imprudent costs built into that final cost, I assume this
13
Board, if it were so inclined, would have to look at the
14
evolution of the project and decision-making and
15
essentially do a prudence review of the project to
16
distinguish between costs that are what I might call true
17
contingency costs -- i.e., costs that were identified and
18
responded to and mitigated, but still incurred -- versus
19
costs that resulted as a result of imprudent decision-
20
making or execution by OPG.
21
That sort of analysis would have to be done in order
22
to separate out prudent costs versus imprudent costs,
23
right?
24
DR. GALLOWAY:
Again, in the pre-approval of a cost
25
estimate -- I mean, no one goes into pre-planning assuming
26
that you're going to be imprudent.
27
fraud or issues of concealment, both items of which even
28
the commissions and jurisdictions in the United States
But barring things of
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
54
1
would say if those happened, then those particular costs
2
would not be allowed even if they were under a particular
3
cost.
4
But the pre-approval of the cost estimate is deemed to
5
be reasonable and prudent and encompasses a contingency to
6
cover risks that could happen, and if a utility comes in at
7
that cost, those costs would go into rate base as pre-
8
approved but for actions of fraud or concealment.
9
MR. BUONAGURO:
I see.
So if this Board approves
10
$4.8 billion for Unit 2 and the project comes in at
11
$4.8 billion or less, you're suggesting that the only
12
disallowance of any of that amount would have to relate to
13
-- I think you said fraud or concealment?
14
DR. GALLOWAY:
That would be up to the Board on
15
however they decide to look at those costs.
16
be for me to tell the Board what to do.
17
MR. BUONAGURO:
That wouldn't
I'm following up on what you said.
18
You said pre-approval of a cost usually means that when
19
they come in for -- when the final costs are incurred and
20
the costs are at or below budget, then it's fraud or
21
concealment?
22
23
24
DR. GALLOWAY:
That's the way the jurisdictions in the
States handle it, yes.
MR. BUONAGURO:
If that were the way it worked here
25
and the Board remained concerned it wants to distinguish
26
between what I call contingency amounts -- so contingency
27
amounts meaning amounts that don't necessarily relate
28
specifically to a contract, but relate to the risks they
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
55
1
identified and came to fruition and caused that -- some
2
part of that 700 million budgeted amount versus costs that
3
actually were imprudently incurred, in terms of failing to
4
identify risks that they should have identified, or not
5
reacting appropriately to a risk, the solution would be to
6
lower the amount that's pre-approved?
7
DR. GALLOWAY:
I think you would have to look at the
8
circumstances.
I think based on the premise you put
9
forward is not enough facts to ascertain.
There's
10
considered in prudence a zone of reasonableness.
11
not necessarily a -- there is not an optimal response.
12
There is not a preferred response.
13
There is
There are different responses that management can take
14
depending on the circumstances at the time, which is why
15
you have to look at the circumstances at the time.
16
the examples that you gave, if they -- what would appear to
17
be an inappropriate use to a risk would have to look at all
18
the facts at the time on the circumstances of why that may
19
appear to be an inappropriate risk, but based on other
20
factors, would still fall within a zone of reasonableness
21
which would have been covered within that contingency
22
aspect for the estimate.
23
MR. BUONAGURO:
Fair enough.
So even
But my point is that
24
that examination would take place after the fact.
25
a difference between what you told me, I think, about the
26
impact of a pre-approval of a budget versus part of a
27
budget that isn't pre-approved.
28
Maybe I can attack it this way.
There's
If the pre-approved
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
56
1
budget is 4.8 billion and the costs come in at 5.5 billion,
2
presumably there's going to be -- we know there's going to
3
be a request from OPG to recover the impact of that
4
additional .6 billion dollars in spending, and the
5
examination by the Board is going to have to look at
6
whether or not that extra cost was prudently incurred,
7
correct?
8
9
10
DR. GALLOWAY:
I assume.
I'm not sure how this Board
works in this jurisdiction, but I would presume so.
MR. BUONAGURO:
Right.
And in that instance, would
11
the same limitations on the prudence review be in place
12
that you were talking about?
13
fraudulent or concealment?
14
DR. GALLOWAY:
It would only be if they were
I don't know.
I'm not familiar with
15
what this Board -- one, what OPG will ask, what this Board
16
will opine upon, and how that relates to the overall 12.8-
17
billion-dollar estimate.
18
As I indicated, the risks and the costs are all done
19
on a probabilistic modelling of all four units, and so a
20
cost overrun on Unit 2 may potentially, based on the
21
lessons learned from Unit 2 that resulted in those cost
22
overruns, may be applied to the later units that
23
potentially costs could be reduced in later units, so
24
within the overall contingency of the $12.8 billion, the
25
entire program still comes in on budget.
26
So it is with those considerations that would need to
27
be looked at relative to any overage on Unit 2, because it
28
can't be looked at in isolation on the total cost of the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
57
1
program because that -- the way the cost overruns and
2
under-runs are modeled are on the four unit process, not an
3
individual unit basis.
4
MR. BUONAGURO:
Thank you.
My point being, though,
5
that the exercise would have to be done.
6
look at what actually happened in order to make the
7
determination of whether or not there was imprudence, or
8
whether it was simply an appropriate contingency event or
9
contingency cost?
10
DR. GALLOWAY:
You would have to
There's a lot of factors.
I'm not sure
11
I can totally answer your question, because I don't know
12
the facts and the circumstances that may arise 4 to 5 years
13
from now.
14
MR. BUONAGURO:
Thank you.
I want to take you to page
15
34 of your evidence briefly, Exhibit D2, tab 2, schedule
16
11, attachment 3, page 34.
17
I am looking at the bullet points under what types of
18
information is typically provided -- I guess that should
19
have been what types of information are typically provided
20
in performance or progress reporting.
21
I'm looking at the bullet points and most of them, I
22
think I can fit under reporting that OPG is proposing to do
23
on an annual basis with respect to the DRP.
24
that sticks out to me is the current status or risks and
25
issues.
26
the reporting proposal by OPG with respect to the DRP, did
27
you?
28
But the one
Did you review -- I think you said you reviewed
DR. GALLOWAY:
Yes.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
58
1
2
3
MR. BUONAGURO:
And did you see them proposing to
report on current status or risks in issues?
DR. GALLOWAY:
I believe that I saw a dashboard type
4
of proposal where you have -- and it's very commonly used
5
nowadays on megaprograms, where you have, like, colours,
6
you have green, yellow, red, red being risks that are
7
critical risks that could impact cost or schedule, yellow
8
that means they might, and green meaning they probably
9
don't have any impact.
10
I believe I saw some type of dashboard reporting that
11
would on a macro level present overviews on risks and risks
12
that were occurring to the project.
13
14
MR. BUONAGURO:
You note in the evidence in the
preface to the bullet points, you say:
15
"PMI notes that more elaborate reports may
16
include..."
17
Bullet, bullet:
18
"...current status or risks and issues."
19
Can you give an example of where that's occurred in
20
21
another context?
DR. GALLOWAY:
It's occurring on Vogtle.
It's
22
occurring on Kemper.
23
program that we're doing the independent monitoring on.
24
MR. BUONAGURO:
It's occurring on the Energy Strong
And what's the depth of detail in
25
those reports on the current status of risks and issues?
26
Is it --
27
DR. GALLOWAY:
28
MR. BUONAGURO:
It's the dashboard that I talked about.
That's it?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
59
1
DR. GALLOWAY:
Yes.
There's not more detail that is
2
provided in those particular annual reports.
I mean, us as
3
the independent monitor, of course, look at more detail
4
that the utility is actually using to look at those risks
5
by looking at the risk registers and whether or not they
6
are actually determining whether risks are retired or
7
whether new risks have arisen and how they've been looked
8
at and how they've been viewed, and then ensuring that that
9
information rolls up to that dashboard type of a review,
10
which is what we consider appropriate for a senior
11
management and Board review of how the project stands
12
currently to risks and issues.
13
MR. BUONAGURO:
So if the Board were interested in an
14
annual report versus -- of that level of detail, that's the
15
sort of reporting that would have to be done to the Board,
16
the OEB, as opposed to the -- I can't remember what you
17
called it -- the dashboard amount, which is what is given
18
to the public?
19
DR. GALLOWAY:
No, no, no, no, no.
What I meant by
20
the dashboard, that is the level of reporting that is given
21
both to senior management of a utility, given to its Board,
22
and given to the commission.
23
typically provided, is that dashboard overview.
24
25
26
27
28
MR. BUONAGURO:
That is the level that is
So who is the target audience for what
you just described to me in terms of the level of detail?
DR. GALLOWAY:
The risk -- which level of detail are
you talking about, the dashboard or the risk registers -MR. BUONAGURO:
The more detailed one.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
60
1
DR. GALLOWAY:
That's the project management level, so
2
these are the people that are actually in this instance
3
managing the bundles, the project bundles.
4
looking at the detail of the risks, and they would be the
5
ones looking at whether risks have retired, risks have
6
arisen, they would be working with the risk management
7
organization that has been established for the DRP.
8
would be doing that detail-level process and they would be
9
handling that detail level and then rolling up the level as
10
11
They would be
They
it goes higher up through the organization.
MR. BUONAGURO:
My understanding then from what you
12
just said, that's the level of detail that you require in
13
order to ensure that the company is managing the risks
14
appropriately?
15
DR. GALLOWAY:
16
little bit more --
17
MR. BUONAGURO:
18
DR. GALLOWAY:
19
MR. BUONAGURO:
20
21
Which level?
Again, can you just be a
The more detailed level, before -The more --- it gets transformed into a
dashboard.
DR. GALLOWAY:
So the more detailed level, the risk
22
register and the risk monitoring is laid out quite in some
23
detail in OPG's policies and procedures, along with the
24
different levels within the organization that will be doing
25
different tasks along that line.
26
this case for the program is quite detailed and has the
27
mechanism of retiring risks and putting new risks on and
28
evaluating the cost and schedule impacts of those risks
So the risk register in
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
61
1
2
through its risk assessment.
And that is what was in place when I -- we did our
3
review and was being implemented when we did our review,
4
and I would assume would continue to be implemented and in
5
use as it was at the time of our review.
6
MR. BUONAGURO:
Thank you.
One last question, and I'm
7
only asking it because there was some cross on this in
8
panel 1B.
9
In terms of the risk register, is the risk register
10
that you actually identified as part of your analysis on
11
the record already?
12
are risk registers on the record, but as we understood it
13
through the cross-examination, they are a point-in-time
14
document; i.e., if you print it today versus you print it
15
four months ago, they will look very different.
16
wondering if the one that you reviewed is actually on the
17
record.
18
DR. GALLOWAY:
19
MR. BUONAGURO:
I ask that because I understand there
So I'm
I have no idea.
Okay.
So the one undertaking I would
20
ask is that the risk register that you actually reviewed
21
would be added to the record.
22
MR. KEIZER:
I believe it already is on the record.
23
MR. BUONAGURO:
24
MR. KEIZER:
25
MR. BUONAGURO:
26
MS. LONG:
27
MR. KEIZER:
28
MR. BUONAGURO:
Thought it might be.
I don't know the exact exhibit number -If it's not -- if it's not --
You'll direct to us that?
Yes.
Perfect.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
62
1
2
MS. LONG:
All right.
Can we just mark that just so I
don't lose track, please.
3
MR. RICHLER:
4
UNDERTAKING NO. J6.1:
5
EVIDENCE OF THE RISK REGISTER DR. GALLOWAY REVIEWED.
6
MR. BUONAGURO:
7
MS. LONG:
8
Mr. Poch, we have a hard stop today at noon.
9
MR. POCH:
10
That will be Undertaking J6.1.
TO PROVIDE THE LOCATION IN THE
Thank you, those are my questions.
Thank you, Mr. Buonaguro.
That should be fine, Madam Chair.
If I
don't notice the clock, please interrupt me.
11
MS. LONG:
I will do that, thank you.
12
CROSS-EXAMINATION BY MR. POCH:
13
MR. POCH:
First of all, just a few questions that
14
have arisen from your discussion so far.
15
AP1000 a few times.
16
design?
17
DR. GALLOWAY:
18
MR. POCH:
You've mentioned
I take it that's the Westinghouse
Yes.
And Westinghouse was -- that part of
19
Westinghouse was bought by Toshiba a number of years ago;
20
is that correct?
21
DR. GALLOWAY:
22
MR. POCH:
That is correct.
And I read recently that -- correct me if
23
I'm wrong -- that Toshiba has decided to get out of the
24
nuclear business.
25
DR. GALLOWAY:
26
MR. POCH:
I've read the same thing.
Right.
Secondly, just in terms of your
27
discussion with Mr. Buonaguro a few minutes ago, I just
28
want to make sure I understand -- make sure we're on the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
63
1
same page.
2
reasonable at this time, it's going to go into rate base in
3
2020, and that only any variance from that will be
4
examined, would you agree that one possibility is OPG could
5
proceed, come in at 4.8, but have imprudently allowed, say,
6
300 million dollars' worth of costs, yet that was
7
fortuitously offset by 300 million dollars' worth of
8
contingency at the P90 level that didn't materialize and we
9
would never know that?
10
11
If this Board were to agree that 4.8 is
That's a risk with that approach.
Would you agree?
DR. GALLOWAY:
I don't know the circumstances upon
12
which the Board has laid out its review, and further,
13
again, I think as I was given the answer to the example
14
earlier on when something was deemed -- appeared imprudent,
15
that that actually would have to be looked at at the
16
circumstances at the time.
17
MR. POCH:
Of course we can -- I understand your
18
point.
I'm just saying your client in this case, OPG, has
19
proposed the mechanism I've just described to you that it's
20
4.8 absent, you know, fraud or, you know, extreme
21
situations like where there's an allegation of fraud, for
22
example.
23
subsequently get to evaluate prudence of the 4.8.
That's the end of it.
The Board won't
24
Would you agree that if that scenario was adopted by
25
this Board -- and I agree with you we don't know what the
26
Board will decide -- but if it were to be the approach,
27
that there is this risk?
28
DR. GALLOWAY:
You know, that is why the -- in the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
64
1
U.S. the jurisdictions have taken the cost of pre-approval
2
of an estimate absent fraud and concealment, and, yes, if a
3
utility comes in within that estimate, that is the pre-
4
approved cost, and that is what the commission will allow.
5
6
7
I don't know what this Board will allow, but that is
the practice in the United States.
MR. POCH:
So in the States a Board in that situation
8
where they've pre-approved something years before, as long
9
as it meets that price they're not going to -- they don't
10
ask whether the eventual sum was a product of imprudence
11
being offset by good fortune or not?
12
content to let it lie; is that --
13
DR. GALLOWAY:
They're just, they're
I think they look at it from the
14
contingency level and building in that things may happen
15
that cannot be predicted at the time of the pre-approval,
16
and as long as again the project comes in within the pre-
17
approval it has been accepted.
18
over -- provided there is not a program where it has to be
19
looked at the overall cost of the program, then those
20
overages are what is being looked at.
21
It is the costs that go
I think, for instance, on Vogtle, if you were to look
22
at the commission's order, that's exactly what the
23
commission order said in Vogtle, that if the cost of the
24
unit came in -- 3 and 4 within the initial certified cost,
25
that any costs up to that would be approved and anything
26
over that would have to come back, which is the exact
27
mechanism they went through when it was increased, and that
28
hearing has just finished a few months ago.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
65
1
MR. POCH:
Right.
So that -- I think we're in
2
agreement that that's what goes on, and that one of the --
3
the price we pay for that approach possibly is that there
4
could be imprudence which never sees the light of day,
5
because it's offset by contingencies not materializing.
6
It's entirely possible?
7
DR. GALLOWAY:
With the caveat of that's the cost and
8
the risks that were looked at, that were built into the
9
price and but for fraud and concealment, there is a built
10
11
in risk for that entire cost that's pre-approved.
MR. POCH:
I understand what you're saying.
But I'm
12
concerned about the contingency -- something that wasn't
13
built into the price, that wasn't built into the
14
contingency allowance, wasn't identified as a risk, and was
15
imprudently incurred.
16
DR. GALLOWAY:
I don't know if I can actually answer
17
the question, because the risk mechanism that is looked at
18
covers everything up to a point cost which is asked for the
19
pre-approval.
20
indicated, the fraud and concealment, that total cost would
21
be approved.
22
23
24
MR. POCH:
And again, within the exceptions as I've
Okay.
I think I can leave it there.
I
think the situation is clear.
If you turn up L 4.3, schedule GC 5, we asked you
25
about the history of your involvement in nuclear projects,
26
and your corporation involvement is referred to there.
27
I take there has been some -- I think you refer to some 55
28
nuclear projects that Pegasus-Global has been in some
And
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
66
1
fashion involved in.
2
DR. GALLOWAY:
3
MR. POCH:
Yes.
If we turn to 4.3, schedule 15, SEC 40,
4
there's a chart attached as attachment 1, and I think you
5
referred to this earlier.
6
7
There's 29 projects there where you personally have
testified or issued a report.
8
DR. GALLOWAY:
9
MR. POCH:
Or been participatory in the analysis.
Right, that involved nuclear.
Of all these
10
projects you're aware of, and the ones you're aware of but
11
weren't personally involved in or corporately involved in,
12
including the ones in Canada, if we were to look at the
13
cost and schedule estimates that is were provided 5 years
14
in advance of the expected in-service date, would you agree
15
that virtually in the nuclear world, the vast majority end
16
up coming in either above cost, delayed in schedule, or
17
both?
18
DR. GALLOWAY:
They have, based on what I had
19
indicated previously, that they did not have the benefit of
20
doing the P90 confidence level and the type of pre-
21
execution planning.
22
estimating basis, there is a high likelihood that several
23
of these would have come in within the budget and schedule.
24
MR. POCH:
Had they been done on a P90 cost
But in fact, there haven't been any nuclear
25
projects done in the way you just described?
This is the
26
brave new world where you're trying to learn from other
27
activity, other areas of activity that probabilistic
28
estimation is helpful, for example?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
67
1
DR. GALLOWAY:
Right.
As I had mentioned -- well,
2
Bellafonte is different; it's on here.
3
on a P90 basis.
4
on TBA relative to the decision not to proceed.
5
Bellafonte was done
Other circumstances relative -- economics
But most of these, except for Vogtle 3 and 4 and Levy
6
and of course Darlington, all the other were done before
7
probabilistic modelling was even in effect.
8
no opportunity to do such probabilistic modelling.
9
So there was
So you're only looking at the Levy unit, which we've
10
already talked about and was decided to not to go forward.
11
Bellafonte in the same situation, and Vogtle 3 and 4 is the
12
only other one on this chart, and I believe we've discussed
13
that in the contract risk reviews.
14
units are tracking under the current re-approved estimate.
15
16
17
MR. POCH:
And currently, the
But not near the original estimate when the
project was first approved to go ahead by the regulators?
DR. GALLOWAY:
Again, that was under the understanding
18
by both the commission, the intervenors, and the utility
19
that there would be costs and risks that would arise that,
20
if they did, would go into a re-approved certified
21
estimate.
22
approved.
23
And that's what occurred, and was what has been
MR. POCH:
Now, in terms of your review of OPG's
24
project, we've heard there's thousands of items in the risk
25
registry, for example.
26
I take it -- am I correct in my understanding that it
27
wasn't part of your mandate to go and look at the zirconium
28
tube replacement and decide if they caught all the possible
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
68
1
technical risks?
2
exercise, you've done your best to identify those risks,
3
you're tracking them, you dealt with them in the contracts,
4
and so on.
5
Your mandate was to say you've done an
Is that fair?
DR. GALLOWAY:
No, I think I indicated before we did
6
some sampling of the risks in the risk register, to follow
7
back the roots of those risks, how they were identified,
8
how they were vetted, how they were put in, how the costs
9
in the schedule risks were determined and how they fit into
10
the model.
11
And then we reviewed detailed other reports by subject
12
matter experts that did do the in-depth deep dive review to
13
see what they reviewed and how they made their findings and
14
opinions, based on the deeper dives of those other risks.
15
MR. POCH:
I understand you've looked at the risks
16
that have been identified, and seen they've been tracked
17
through and included either in the base forecast or
18
contingency, what have you.
19
risks that weren't identified.
20
21
22
I guess I'm talking about
You didn't attempt to, did you, look and see if there
were risks that simply weren't identified at the outset?
DR. GALLOWAY:
That was part of the interviews of the
23
process of how they went about identifying the risks, how
24
many groups or sessions, risk sessions, risk workshops
25
which are typically the way you look at risks.
26
You have different workshops with subject matter
27
experts that identify risks.
You then have vetting of
28
those risks by other subject matter experts, which was
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
69
1
2
performed here.
So we looked at the process of the risks and how they
3
were identified, and by whom, and by how many types of
4
individual groups.
5
different levels of input in the multitude of subject
6
matter experts, and internally and externally, we thought
7
they had captured reasonably all of the input of all
8
possible risks that could be reasonably identified.
9
10
MR. POCH:
What is your understanding of OPG's mandate
from the government with respect to this project?
11
DR. GALLOWAY:
12
MR. POCH:
13
understand it?
14
15
16
And through that process of the various
What do you mean by their mandate?
What's their marching orders, as you
DR. GALLOWAY:
To refurbish the Darlington four units
so they have another 30 to 35 years of life extension.
MR. POCH:
And OPG has gone about this with the
17
contracts and the allocation of work in-house versus
18
contractors and so on, and you've looked at all that.
19
I can inform you one of the -- part of the mandate was
20
to minimize commercial risk.
21
see if they got other bids with other contractual
22
arrangements where they outsourced more of the risk?
23
DR. GALLOWAY:
Did you go back and look to
We looked at the contracting
24
methodology.
But as I indicated, we were not asked to look
25
at the terms and conditions of how those contracts were
26
actually selected and negotiated.
27
company, I believe.
28
MR. POCH:
That was done by another
So the government wanted -- gave OPG some
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
70
1
instruction in terms of how it wanted to see risk and cost
2
traded off.
3
responded to that?
4
DR. GALLOWAY:
5
That would be embedded in the terms and
conditions of the contracts, and we did not evaluate that.
6
7
You're not opining on the manner in which OPG
MR. POCH:
Thank you.
Those are all my questions.
Thank you, Madam Chair.
8
MS. LONG:
Thank you, Mr. Poch.
9
Mr. Yauch, do you want to get started?
10
CROSS-EXAMINATION BY MR. YAUCH:
11
MR. YAUCH:
12
DR. GALLOWAY:
13
Sure.
Good afternoon.
Good afternoon.
It's not afternoon
yet.
14
MR. YAUCH:
It feels like it.
15
[Laughter]
16
Start on page 2 of your report.
So I'm going to take
17
you through a couple documents and then I'll ask you a
18
question.
19
DR. GALLOWAY:
20
testimony or --
21
MR. YAUCH:
22
DR. GALLOWAY:
23
MR. YAUCH:
24
DR. GALLOWAY:
Yes, of your testimony.
Or page 2 of my report?
Of your testimony.
25
exhibit number?
26
MR. YAUCH:
27
DR. GALLOWAY:
28
Page 2, meaning page 2 of the filed
I gave the --
But is it the page number or the
Page 7 of 122 or page 2 of -Thank you.
Thank you.
I just want to
make sure I'm on the right page.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
71
1
MR. YAUCH:
Okay.
That's fine.
So in it, I'm line
2
12, and you go through this in other parts of your
3
documents, you say OPG was active in issue resolution.
4
I take that in your review of the company you found that
5
OPG found -- encountered problems when it was doing work
6
and took all the necessary steps to solve those problems.
7
Is that a correct way to characterize what you found?
8
DR. GALLOWAY:
9
MR. YAUCH:
10
11
12
13
14
15
16
So
I'm sorry, what --
On line 12.
DR. GALLOWAY:
-- I'm trying to look on page -- on
line 12, and I don't see that statement.
MR. YAUCH:
"And active in issue resolution."
Am I
not seeing it?
DR. GALLOWAY:
Oh, I see.
"And active and issue
resolution"?
MR. YAUCH:
Yeah.
And you expand on it later in page
17
52, but essentially I'm going to characterize what you
18
said.
19
problems as it encountered them when it came to Darlington
20
work?
21
You found that OPG did a good job at solving
DR. GALLOWAY:
I think I've talked in the context of
22
the lessons learned that they took from the refurbishment
23
projects and the other nuclear projects and the other
24
megaprograms and they reasonably applied those lessons
25
learned into the execution -- pre-execution planning for
26
the Darlington program.
27
28
MR. YAUCH:
Okay.
compendium for 1A.
So if you can go to page 39 of my
So this was an audit report.
If you
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
72
1
scroll down a little bit, it's highlighted.
And the
2
auditor -- this report was done at the same time you did
3
your report, and it said there was a cultural tolerance for
4
acceptance of work --
5
MS. SPOEL:
Exhibit number of that 1A compendium?
6
MR. YAUCH:
I forget the exhibit number.
7
MS. SPOEL:
Oh.
8
MR. YAUCH:
Thank you.
9
10
Oh, I have it.
It's 1.4 -- K1.4.
So this auditor at the same
time found that there was a cultural tolerance for
acceptance of work delays, and it said:
11
"This tolerance for work delays is being enabled
12
by a leadership team."
13
So I was curious what they found compared to what you
14
found, and if you can comment on why you didn't see these
15
sorts of issues that this other auditor found?
16
DR. GALLOWAY:
Well, first, the Refurbishment
17
Construction Review Board and I have been active in review
18
boards as well.
19
be critical, to try to find ways that you can catch
20
potential issues early so that they don't manifest
21
themselves into cost and schedule impacts.
22
this report in that context, having been in their shoes
23
similarly for other programs.
24
The mandate for those review boards is to
And so I take
And when they're talking about work delays from the
25
enabled leadership team, I mean, that's a finding that they
26
have at the time.
27
same context or response to what we were previously talking
28
about in the incorporation of lessons learned from the
I don't think that's the same -- in the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
73
1
other programs that were incorporated into the pre-
2
execution planning here.
3
they're looking at and their schedule adherence.
4
This is a point in time that
At this point in time in July the schedule was -- the
5
final schedule was still under development.
6
our review the final integrated schedule was planned to be
7
complete in August and September, and so I believe that
8
they were probably trying to assist them, and from what I
9
can just gather from looking at their report very briefly
10
as to looking at ways as they're doing that work planning
11
to ensure that again the processes and the procedures that
12
they have in place will be emphasized and persons trained
13
on those and that these types of reflections will be picked
14
up before that schedule completion is finished.
15
MR. YAUCH:
At the time of
So you said that the construction review
16
board was a bit more critical than what you were tasked to
17
do.
18
leadership team of OPG to see if they were able to meet the
19
deadlines that they were tasked to meet.
20
difference between the two audit reports?
21
So you weren't tasked to critically look at the
DR. GALLOWAY:
Is that the
Well, again, I'll try to be a little
22
bit more clear.
A construction review board on any program
23
is tasked to come in at a point in time and to look at
24
items at points in time that may be occurring to pick
25
similarly as we are doing as the independent monitor on the
26
Energy Strong program for PSE&G to find, even if they're
27
isolated incidences, to find things that they want to bring
28
to the senior leadership and the program management's
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
74
1
attention so that the types of things that they are
2
potentially seeing at a point in time can be either
3
corrected or whether the policies and procedures need to be
4
revised so that there is better clarity with who will be
5
following those to minimize these point-in-time
6
observations.
7
The part that -- the analysis and the scope that we
8
were undertaking was that we were looking at the policies
9
and the procedures and the processes and the organization
10
and the structure to ensure that those met industry best
11
practices and were put in such a way that if implemented
12
would allow for successful execution of the program.
13
So there are differences in what the construction
14
review board is being asked to do versus what we on the
15
reasonableness and prudence of the actions taken by OPG.
16
There's different mandates between both of these exercises.
17
MR. YAUCH:
Okay.
Thank you.
If you can go to page
18
41 of that compendium.
Just to follow up on this, just go
19
down, that bullet point under point 3, it says:
20
"Management behaviour when schedule expectations
21
are missed is weak."
22
So as a follow-up of what you said earlier, your group
23
just looked at whether OPG had the process in place and the
24
construction review board looked at whether they were able
25
to meet those processes, correct?
26
between the two?
27
28
DR. GALLOWAY:
in place.
That's the difference
No, we went beyond just whether they're
As I indicated, we then took on interviews of
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
75
1
project personnel as to their understanding of what those
2
policies and procedures and processes were, their
3
understanding of how they were to be implemented, their
4
current implementation of those policies and procedures,
5
and the reasonableness of their understanding and their
6
implementation of those.
7
These are point-in-time observations of -- which is
8
typical of, again, a construction review board.
To
9
identify I would have to, for instance, look at the
10
specifics that they are talking about.
11
reports would be very similar to our independent monitoring
12
reports, that it doesn't dive down into the detail in the
13
report, but in their discussions with management, they may
14
be talking about a few activities, they may be talking
15
about a particular area, and you would have to look at the
16
specifics behind this bullet to see whether or not that's a
17
programmatic concern or whether it is a particular specific
18
area concern with particular people on particular
19
activities.
20
for me to ascertain what this bullet is referring to.
21
I mean, their
Without that knowledge it would be difficult
MR. YAUCH:
No, but in your report you actually never
22
questioned management's behaviour to meet schedules.
23
didn't find that as a problem.
24
DR. GALLOWAY:
You
No, I believe that we did, especially
25
in respect to the pre-execution projects that were trending
26
over schedule and over budget.
27
the reviews with OPG personnel to understand why, to
28
understand why those potentially had different processes
We specifically went into
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
76
1
for which they were being managed, the lessons learned from
2
those and how they were being incorporated into the new
3
policies and procedures.
4
So yes, we were looking at where things stood against
5
certain schedules for different projects that were
6
underway, and how OPG was reacting to those particular
7
delays, to some of those pre-execution projects.
8
9
MR. YAUCH:
In regards those pre-execution projects,
in your evidence -- and OPG has sort of maintained this
10
point as well -- that those weren't done how refurbishment
11
is going to be done, so we shouldn't compare the two.
12
the same time, the way in which we did the refurbishment
13
planning was with this statistical model, the Monte Carlo
14
model.
15
At
But in your evidence, you also say that those early
16
projects were essentially guinea pigs for what comes Next,
17
that a lot of groups do these early projects to see how
18
things go.
19
But from the Board's point of view, we can't actually
20
look at whether those are going to be any indication of how
21
the rest are going to go, because they were done
22
differently.
23
they're just a different project, correct?
24
25
26
So in a way, they weren't really guinea pigs;
DR. GALLOWAY:
question.
There's a lot of presumptions in your
But let me try to break that down a little bit.
It is correct that those early projects were not done
27
to the same policies and procedures that were developed for
28
the Darlington refurbishment program.
They were done to
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
77
1
the projects and modifications, policies, and procedures
2
that had been existing at the time.
3
The same was true for some of the contracting
4
practices.
Those projects -- decisions were made to
5
execute those to have them completed, but there was also
6
lessons learned from that.
7
working in the policies and procedures that needed to be
8
incorporated in the policies and procedures for Darlington
9
to minimize, to be able to ascertain what potential delays
For instance, what was not
10
might be earlier to minimize against this, to look at the
11
lessons learned from the contracting strategies to be able
12
to incorporate that into different contracting strategies
13
for Darlington.
14
So yes, while they were done under different policies
15
and procedures and contracts, how those panned out were
16
lessons that were in fact incorporated in the policies,
17
procedures and contracting models on the Darlington
18
refurbishment program in order to minimize and/or eliminate
19
the issues that arose on the pre-execution projects.
20
21
MR. YAUCH:
break now?
22
MS. LONG:
23
MR. YAUCH:
24
MS. LONG:
25
Do you want me to keep on going, or take a
Is this a convenient time?
Yes, I can stop now.
Thank you very much.
We are going to break
and be back at 1:05, please.
26
--- Luncheon recess taken at 11:59 p.m.
27
--- On resuming at 1:11 p.m.
28
MS. LONG:
Mr. Keizer.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
78
1
PRELIMINARY MATTERS:
2
MR. KEIZER:
Madam Chair, just one preliminary matter,
3
and that is related to the undertaking given this morning,
4
6.1, and the location of the risk register that was
5
reviewed by Pegasus is at issue 4.3, Staff 73, attachment
6
7, pages 21 to 235.
7
MS. LONG:
8
MR. KEIZER:
9
MS. LONG:
Thank you very much for that.
Thank you.
Mr. Yauch, are you ready to proceed?
10
CROSS-EXAMINATION BY MR. YAUCH:
11
MR. YAUCH:
12
MS. LONG:
13
MR. YAUCH:
Good afternoon.
I think it's afternoon --
Good afternoon.
-- now.
I just have two areas left to
14
explore.
15
Monte Carlo model.
16
to you about this, and it's been the centre of a lot of
17
discussion.
18
So the first one is the -- it's the idea of the
And I know a lot of people have talked
As far as I can tell, this is the only nuclear project
19
that's ever been built that has used this type of model to
20
estimate the cost and the contingency involved with it,
21
correct?
22
DR. GALLOWAY:
To my knowledge that would be correct.
23
I haven't analyzed the nuclear plants in Europe to know
24
whether or not that is the case.
25
MR. YAUCH:
So during this application, these five
26
years, Unit 2 will be completed, so at the end of this,
27
this will be the first time, or maybe midway through, that
28
this Board and the public in Ontario and the public
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
79
1
worldwide will see whether a Monte Carlo model can actually
2
tackle the nuclear industry and control costs, whereas in
3
the past we weren't able to control the costs in the
4
industry, correct?
5
will actually play out when it comes to a nuclear project.
6
DR. GALLOWAY:
This is our first live look at how this
Relative, if you want to take nuclear,
7
correct, but there are other megaprograms with the same
8
magnitude and complexity that are underway under this
9
probabilistic model.
10
MR. YAUCH:
So you don't think the nuclear industry is
11
a statistical outlier when it comes to infrastructure
12
projects and it falls in the complexity of other groups.
13
14
DR. GALLOWAY:
I think the Crossrails project is even
more complex than the Darlington refurbishment program.
15
MR. YAUCH:
Okay.
So I just have one last area.
If
16
you can go to page 5 of your testimony, or page 10 of 122,
17
depending on how you see it.
18
metrics, and from what I gather you looked at all the
19
metrics that OPG had laid out in this application and you
20
said, yes, these meet industry standard?
21
DR. GALLOWAY:
22
MR. YAUCH:
So at the top you talk about
Yes.
And OPG didn't go above and beyond, or is
23
it -- it just stayed within line of what you'd expect for
24
the number of metrics on a project of this complexity?
25
DR. GALLOWAY:
I think that I've laid out how they
26
will be addressing those metrics is certainly commendable
27
and in some aspects was maybe more than you would expect to
28
see.
I think given the complexity of the program that was
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
80
1
appropriate.
2
conform with what is identified in the industry best
3
practices and they are following along the lines of
4
industry best practices.
5
But the metrics that they have in place do
MR. YAUCH:
Okay.
So if you can go to Energy Probe
6
compendium 1A and page 38.
This is again from the
7
construction review board.
I'll wait for them to bring it
8
up.
9
And right under recommendation number 3 they say:
10
"While the project ask have a large number of
11
metrics, they do not consistently provide an
12
accurate, integrated picture of project health."
13
So the review board seemed to find, yeah, the metrics
14
were there, but OPG didn't actually -- the metrics weren't
15
providing OPG or the public at this point an accurate
16
picture of what was actually happening.
17
as well?
18
DR. GALLOWAY:
Did you find that
Again, being a point in time that this
19
was taken, I believe, for instance, when I talked about
20
schedule, that the schedule, which is a metric, the
21
schedule was underway, being completed, and the integrated
22
schedule was not planned to be done until August or
23
September, so relative to those scheduled metrics they
24
would not be the integrated picture in July of 2016, which
25
is something that they were working on.
26
So whether or not the construction review board saw
27
that at the point in time and made a recommendation, I
28
again don't know the underlying reason of this, but we did
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
81
1
find that the schedule, by not being yet complete, but
2
being completed, you wouldn't have the ability to do an
3
integrated view of July of 2016 on those metrics because
4
the integrated schedule had not yet fully been completed
5
and was planned to be so in August and September.
6
MR. YAUCH:
Now, did your group take a metric -- a
7
sample of metrics and then dive deep in them and see if the
8
actual health or schedule or cost of the project actually
9
aligned with the metric?
Did you take a deep look at each
10
one and see if what they were telling the company was
11
actually true?
12
DR. GALLOWAY:
Yes, as I had indicated, we did some
13
sampling, and so relative to, for instance, you know,
14
progress, we would ask to see how they were measuring that
15
at the time that they were reporting in light of the
16
schedules at the time.
17
see the process and the numbers and how they were producing
18
those metrics to understand that that was not only
19
following the processes in the procedures, but that
20
actually it was reflecting a metric that was reflective of
21
the information that it had at the time.
22
MR. YAUCH:
The same for cost.
We wanted to
Did you find overall the metrics were
23
correct, that what they were saying was actually happening,
24
or unlike the review board, which found that wasn't
25
actually happening?
26
DR. GALLOWAY:
Well, again, the review board is a
27
point in time, and when it says "integrated", as I
28
indicated, since the schedule was not yet complete, you
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
82
1
2
wouldn't have an integrated picture of those metrics.
So without knowing what they were particularly talking
3
about, I would not be able to comment whether our findings
4
are different or they are of the same finding.
5
MR. YAUCH:
Those are my questions.
6
you very much.
7
MS. LONG:
8
CROSS-EXAMINATION BY MR. TOLMIE:
9
MR. TOLMIE:
Thank you.
Thank you.
Mr. Tolmie.
Thank you, Madam Chair.
10
Tolmie, Sustainability Journal.
11
very brief point that I would like to make.
12
13
MS. LONG:
a compendium here, 1C.
And I have -- this is a
Is this something that --
MR. TOLMIE:
15
MS. LONG:
16
MR. TOLMIE:
17
MS. LONG:
18
MR. RICHLER:
19
EXHIBIT NO. K6.2:
20
TOLMIE FOR OPG PANEL 1C.
21
MS. LONG:
23
My name is Ron
Mr. Tolmie, just before you proceed, I have
14
22
Thank
That's correct.
-- are you planning to file that?
Yes.
Yes?
Okay.
Can we mark that, please?
Madam Chair, that will be Exhibit K6.2.
CROSS-EXAMINATION COMPENDIUM OF MR.
And Dr. Galloway, do you have a copy of
that?
DR. GALLOWAY:
You know, I thought I did, and for some
24
reason it must be the only piece of paper I did not bring
25
with me, and I do apologize.
26
MS. LONG:
All right.
27
DR. GALLOWAY:
28
MS. LONG:
Let's just make sure --
Thank you.
-- everyone has a copy.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
83
1
MR. TOLMIE:
This morning in your testimony you made
2
the comment that more planning can give rise to better
3
outcomes in megaprojects.
4
said?
5
DR. GALLOWAY:
6
reliable results, yes.
7
MR. TOLMIE:
Is that more or less what you
Well, more planning does give more
Okay.
So do you think that adequate
8
planning has been applied in this particular case to
9
anticipate the results?
10
DR. GALLOWAY:
We have certainly opined that the
11
approaches and the extensiveness of the pre-execution
12
planning positions OPG favourable for a successful
13
execution of the program.
14
MR. TOLMIE:
Okay.
I don't know if you noticed, but
15
in Ontario the base load generation capacity actually
16
exceeds the average consumption of electricity.
17
aware of that, or can you provide any...
18
19
20
DR. GALLOWAY:
Are you
Not within my scope, sir, so I wouldn't
know the answer to that.
MR. TOLMIE:
Okay.
The numbers are not hard to find.
21
You can look at the daily reports from IESO or many other
22
reports and they will show you the base load generation
23
capacity, which is the nuclear capacity plus hydro,
24
basically, and they show that our demand is in fact quite
25
stable year after year.
26
demand in terawatt-hours by the number of hours, you'll
27
come up with an average value for the power demand, and the
28
generation capacity actually exceeds the power demand.
If you divide the total annual
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
84
1
Does that imply that we could relieve all or some of
2
the problems by simply adding storage -- electricity
3
storage to the system?
4
DR. GALLOWAY:
Since it wasn't in my scope of review I
5
don't think that it would be appropriate for me to comment,
6
because I haven't reviewed any of the facts surrounding
7
that.
8
9
10
MR. TOLMIE:
Why was this an issue that wasn't covered
in the application itself, do you think?
DR. GALLOWAY:
11
comment on that.
12
MR. TOLMIE:
I don't know.
I wouldn't be able to
The -- if there's storage available in
13
Canada if one intended to apply storage as a means of
14
matching supply and demand.
15
16
17
DR. GALLOWAY:
Again, it wasn't in my scope, so I
would be unable to comment.
MR. TOLMIE:
So it's a planning problem that wasn't
18
included in OPG's application itself.
19
that is potentially significant that was not mentioned in
20
the application, is that correct?
21
MR. KEIZER:
That is an issue
Madam Chair, the witness is here to
22
respond to her report, the Pegasus report which relates to
23
the policies, procedures, and risk aspects and other things
24
related to the Darlington refurbishment plan.
25
She has not been here to tender a report related to
26
storage, or to what is or is not in the application that
27
OPG has filed.
28
MS. LONG:
That's true, Mr. Tolmie.
Do you have any
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
85
1
questions of Dr. Galloway with respect to the report that
2
she filed?
3
MR. TOLMIE:
My question is about the report.
It
4
should cover all the issues that are significant.
5
report should cover whatever OPG is doing, and OPG should
6
report all the major --
7
MS. LONG:
Her
If you have an issue with what OPG -- the
8
scope that OPG gave to Dr. Galloway, that's an issue for
9
OPG.
10
That's not an issue for Dr. Galloway.
She can only speak to the scope of work that she was
11
asked to complete, and her report that she's filed in
12
evidence.
13
to do so, about the report she filed.
14
So you need to ask her questions, if you choose
I see some in your compendium that look like they're
15
related to the report, and those questions you can ask Dr.
16
Galloway.
17
outside of what she was asked to opine on.
But beyond that, she can't speak to things
18
MR. TOLMIE:
19
comments on the plan.
20
MS. LONG:
She was asked, in my view, to provide
And the plan should cover --
She was asked to give her opinion on the
21
plan that was provided to her, not to coach OPG on what
22
should be in the plan, or opine on what should be in the
23
plan.
24
beginning of her evidence.
25
Her scope of work is clearly outlined in the
So if you have an issue of OPG's scoping of her work,
26
that's something you can deal with with OPG through
27
argument, not through Dr. Galloway.
28
MR. TOLMIE:
We're dealing with a missing element,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
86
1
whether it's missing in the OPG plan or in Dr. Galloway's
2
review of that plan, I guess, is something that can be
3
debated.
4
But it's a major missing element.
5
MS. LONG:
What she's here to give expert evidence to
6
this panel on is what she was asked to review.
7
this panel can benefit from hearing from her on.
8
to rephrase your questions.
9
10
11
12
13
14
15
MR. TOLMIE:
That's what
The objective of the Board hearing is to
determine if the rates are appropriate; is that correct?
MS. LONG:
I'm very clear on what our objective is, so
you don't need to coach me on that, Mr. Tolmie.
MR. TOLMIE:
Is it in fact a Board concern that one
should look at things that relate directly to rates?
MS. LONG:
Mr. Tolmie, I'm not going to engage in this
16
argument.
17
there are panels you can ask these questions of.
18
Galloway is here to strictly speak to her report.
19
20
21
22
We've talked about your views on storage, and
going to move to another intervenor that does.
MR. TOLMIE:
question then.
I'll ask this one straightforward
Do you know who wrote the report?
DR. GALLOWAY:
24
MR. TOLMIE:
26
27
28
But Dr.
So if you don't have questions about her report, we're
23
25
You need
My report?
No, the OPG report that you were
considering.
DR. GALLOWAY:
I'm not for sure I understand the
question of the report that you're referring to.
MR. TOLMIE:
The application.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
87
1
DR. GALLOWAY:
2
MR. KEIZER:
Well -The application is actually thousands of
3
pages of documents, covering a wide variety of panels and
4
issues.
5
application from any number of contributors from OPG, of
6
which some of those and most of those are probably
7
witnesses in this proceeding.
8
9
So there would be any number -- it's an OPG
MR. TOLMIE:
Just to explain why I'm asking, there are
several different agencies involved in Canada in making
10
decisions and plans and acting those programs, and it's not
11
clear to us as to who is pulling the strings.
12
does the IESO, or OPG, or the Minister of Energy make these
13
plans.
14
You know,
So it would be extremely useful to know how the plan
15
itself is generated -- not in a negative sense.
16
want to know, so that we can contribute appropriately.
17
18
MS. LONG:
I just so
Do you mean the application that OPG has
filed?
19
MR. TOLMIE:
Yes.
20
MR. KEIZER:
The application extends beyond the
21
Darlington refurbishment program, which is what the past
22
few days have been about, and that Dr. Galloway is here to
23
address.
24
application, it's probably better placed with panel 2,
25
which deals with the regulatory constructs of the
26
application, not Dr. Galloway.
So I think if you have questions about the
27
MR. TOLMIE:
28
MS. LONG:
I'll go on to panel 2 then.
Thank you.
Thank you, Mr. Tolmie.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
88
1
MR. KEIZER:
Sorry, Madam Chair.
Can I note
2
something?
3
compendium, Exhibit 6.2.
4
series of questions and answers and also cites where -- and
5
I want to be clear that although we've marked it as an
6
exhibit, that those questions and those answers may or may
7
not be, depending upon where he has taken the information
8
from, that they are not OPG's questions and answers.
9
10
We marked as an exhibit Mr. Tolmie's
MS. LONG:
And on his exhibit, he has a
That is well understood.
you for clarifying that.
Thank you.
Mr. Richler?
11
CROSS-EXAMINATION BY MR. RICHLER:
12
MR. RICHLER:
13
Good afternoon, Dr. Galloway.
Thank you, Madam Chair.
My name is Ian Richler
14
and I'm with OEB Staff.
15
already been asked and answered, so I will be brief.
16
Thank
Some of the questions I had have
Yesterday, you provided a helpful summary of the
17
similarities and differences between your report and the
18
report prepared by Staff's expert, Ken Roberts of Schiff
19
Hardin.
20
Just to clarify, would you agree with Schiff Hardin's
21
central thesis that good planning does not ensure similar
22
execution?
23
DR. GALLOWAY:
You certainly have to implement and
24
execute according to the plans, so it may or may not,
25
depending on how that is executed.
26
MR. RICHLER:
Have you seen megaprojects that were
27
exemplary in the project definition phase, but faltered in
28
the execution phase?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
89
1
DR. GALLOWAY:
I think generally, again in the reviews
2
that we have done, we may have found elements within the
3
execution plan that were not executed.
4
areas, for instance, that I was talking about on Duke of
5
areas of disallowance.
6
These would be the
But I think as a general statement, it would be unfair
7
to make that general statement.
8
potentially may be areas that would have to be looked at
9
under the circumstances and at the time.
10
MR. RICHLER:
How about the Kemper and Vogtle projects
11
you discussed this morning?
12
planning?
13
I think that there
DR. GALLOWAY:
Did they have world class
The Vogtle project, yes, the same types
14
of findings for their CPCN filing was very similar to the
15
findings here.
16
just a few months ago the commission's order found the
17
program is continuing to execute reasonably and prudently
18
according to those plans.
19
along based on those exemplary pre-execution planning and
20
policies and procedures.
21
And the program, as I also indicated, as of
And so, that one is following
The Kemper, up until the period March 31st, 2013, yes,
22
based on the conditions and the extent of the knowledge at
23
the time of the CPCN, which was much less than even that of
24
Vogtle, significantly less.
25
findings, are deemed reasonable and prudent.
26
think I testified earlier, that prudence review is still
27
ongoing and the testimony will be filed later this year,
28
and the hearing will be later this year.
Those, in the preliminary
But as I
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
90
1
MR. RICHLER:
I understood you to say yesterday that
2
sometimes you are engaged to assist with project audits.
3
When you were assessing a project that has experienced
4
problems -- in other words, when you are doing what Mr.
5
Buonaguro characterized this morning as an ex post facto
6
prudence review -- what role if any does the risk register
7
play in your assessment?
8
DR. GALLOWAY:
So if you are looking at the project
9
after it has been completed, then you would be looking at
10
how management reviewed the risks and how they dealt with
11
risks.
12
you would look at the risk register, how the risks were
13
identified, how they were put on the risk register, and how
14
they were modelled from cost and time, and you would look
15
at that process and determine whether it was reasonable.
16
For instance, you would look at, similarly here,
As the project moved forward, as it is often common,
17
there will be risks that were not identified originally
18
that may arise, and now you're looking at, you know, when
19
they get on to the risk register, because that's the way
20
risks happen, and that's why you have risk register.
21
Sometimes risks go off when they retire and you have new
22
risks that come on that weren't identified in the
23
beginning, and so you then look at how long the process of
24
looking at management at the time, how they dealt with the
25
new risks that came on, how did it model out, as far as
26
cost and time impact, was it a risk -- I think I gave them
27
those green, yellow, and red indicators of the type of
28
impact that's done on a probabilistic basis based on
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
91
1
consequence and probability of happening.
2
turn red are the ones that you would then develop a
3
mitigation plan for, and then you would determine whether
4
or not if that risk then occurred on the project then
5
whether they executed according to that mitigation plan.
6
The ones that
So that is the way the risk management process works,
7
and that's what, if you looked at the end of the project,
8
you would take every point in time where the risks were
9
reviewed and how they were retired or how new risks when
10
they came on came on, and then how they were modelled,
11
reviewed, and whether plans were necessary to be prepared,
12
and whether or not if the risk manifested itself whether
13
they executed according to those mitigation plans.
14
MR. RICHLER:
Thank you, that's helpful.
15
Could you perhaps give us one example of a review
16
where -- a risk -- looking backwards that a risk register
17
helped you in your assessment of a project that had
18
experienced difficulties?
19
DR. GALLOWAY:
Yes, I think Duke is a good example,
20
because Duke had some first-of-a-kind risks relative to its
21
technology.
22
in place for that particular IGCC plant, while it had been
23
on a pilot basis, they knew some of the risks, but of
24
course when you scale it up to a larger scale you may not
25
know all of the risks.
26
And obviously, since the technology that was
And so in our review we found a technology risk that
27
had not been identified earlier that arose during the
28
detailed design that was underway at the project.
We
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
92
1
looked at how it was then added to the risk register when
2
it was identified, because that was important for us to
3
determine when a risk arises how does it quickly get looked
4
at as far as its potential consequence.
5
So in the design the risk was identified.
Then the
6
risk during the process actually did not manifest to the
7
extent they thought it would, but because there was a high
8
consequence a mitigation plan was written for that
9
particular technical risk.
10
So during the beginning of startup -- and remember
11
that I think I mentioned the prudence review was happening
12
during the startup and testing phase -- the risk was not as
13
consequential as it had been modelled for, but because they
14
did have the mitigation plan, startup was able to look at
15
that technical risk and execute according to the mitigation
16
plan so outlined and mitigated the impact that it was
17
deemed to potentially have.
18
impact to be less than it was modelled out to be.
19
MR. RICHLER:
The mitigation allowed that
Could you turn to page 76 of 122 of your
20
report, please.
Again, for the record, this is Exhibit D2-
21
2-11, attachment 3.
22
question:
At the top of page 76 you address the
23
"In your opinion, does the fact that the
24
facilities and infrastructure projects and safety
25
improvement opportunities were not executed per
26
the cost and schedule plan foreshadow similar
27
issues in the execution of the DRP?"
28
And your answer is no.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
93
1
Following up on the discussion you had with Mr. Yauch
2
just before lunch, I'm wondering, when you were conducting
3
your review and interviewing OPG folks, did you look into
4
what went wrong with those pre-execution projects?
5
DR. GALLOWAY:
We explored the reasons why schedule
6
and/or costs were over on the projects, and that is what I
7
believe I was explaining earlier relative to some of the
8
contractual issues at the time, that maybe the risk
9
allocation was not as robust as it could have been, and the
10
strategies, and they took those lessons learned to apply
11
them to the contracts in the DRP project.
12
Relative to schedule I think I had mentioned that the
13
policies and procedures and processes and project control
14
tools that were in place in the projects and modifications
15
group from which these projects were executed may not have
16
allowed earlier detection of some of the issues that arose,
17
and so corrections and revisions were made in the policies
18
and procedures and processes for the Darlington
19
refurbishment program that would allow earlier detection of
20
issues and more intense monitoring from the OPG staff to
21
minimize and/or eliminate some of those issues that
22
happened in the pre-execution projects.
23
24
25
So those are the types of reviews that we did on those
overruns on cost and schedule.
MR. RICHLER:
So I just want to make sure I
26
understand.
27
problems that materialized on those pre-execution projects?
28
What in your view was the root cause of the
DR. GALLOWAY:
I think it's what I've just indicated,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
94
1
is that the policies, procedures, and project control tools
2
may not have been as robust as they are now to have early
3
detection to be able to mitigate and/or recover the
4
schedule delays and/or to mitigate issues with cost to
5
allow the correction to minimize those costs or find
6
opportunities for those risks on cost to be shared
7
differently than they were on these early projects.
8
MR. RICHLER:
Was it a problem of planning or
9
execution or both?
10
DR. GALLOWAY:
Well, if your policies and procedures
11
and processes are not robust enough to pick up some things,
12
if you execute according to those, you may not pick up on
13
the early detection.
14
is to ensure that the policies and procedures and processes
15
and project controls would be robust enough for early
16
detection and allowing for mitigation and correction.
17
mean, that was the lesson learned.
18
MR. RICHLER:
I think that was the lessons learned,
I
And I think you just mentioned that you
19
considered OPG's contracting approach in respect of these
20
pre-execution projects.
21
specifically with OPG's decision to undertake those pre-
22
execution projects under its existing extended services
23
master service agreements, as opposed to developing a
24
tailor-made contract for those projects?
25
in your view, was it reasonable to rely on those standard
26
pre-existing contracts or, in light of the magnitude of
27
some of those projects, would it have made more sense to
28
develop tailor-made contracts?
Did you have any concerns
In other words,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
95
1
DR. GALLOWAY:
Well, our scope did not cover the
2
contracts that were developed for those early execution
3
projects.
4
from the issues that occurred relative to cost and
5
schedule, and how those were mitigated with the processes,
6
the policies, procedures, and the contracting methodology
7
for DRP.
8
9
10
Rather, our scope was, what lessons were learned
MR. RICHLER:
So just to be clear, you have no opinion
on the way the contracts for those pre-execution projects
were structured?
11
DR. GALLOWAY:
12
MR. RICHLER:
13
That was not within our scope.
All right.
Those are all my
questions.
14
MS. LONG:
15
questions for you.
Thank you, Mr. Richler.
16
QUESTIONS BY THE BOARD:
17
MS. FRY:
18
Thank you.
The Panel has some
I have just a couple of questions to follow-
up on your earlier testimony.
19
So at one point you were discussing the Darlington
20
project metrics, and you said in that some aspects, the
21
metrics were more than you would expect to see.
22
23
24
Can you explain which metrics you were talking about
that exceeded expectations?
DR. GALLOWAY:
I think in, for instance, the way that
25
they're looking at earned value, they're more granular than
26
I have seen other utilities look at relative to the detail
27
of the level of progress, the level of the actual budgets
28
and costs that they are looking at in capturing.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
96
1
Some utilities roll those numbers up and do it at a
2
more macro level.
3
much more lower level within the system and the program of
4
those metrics which, in our view allows for earlier
5
detection of issues that go to cost and schedule.
6
7
MS. FRY:
Was that the main example, or were there
other metrics that exceeded expectations?
8
9
Darlington seems to be doing it at a
DR. GALLOWAY:
That was one example I remember.
The
others pretty much follow the industry best practices in
10
standards.
11
can't tell you if some of the others were exemplary above
12
what I would expect.
13
think, is much more granular and robust here than I have
14
seen on other programs.
15
Without going back to my specific review, I
MS. FRY:
Okay.
But the earned value clearly, I
You've said a few types that you've
16
noted that lessons learned were incorporated into the
17
Darlington planning, and one example you just gave was
18
early detection.
19
the lesson learned was, and how it was incorporated into
20
the Darlington planning?
21
Are there other specific examples of what
DR. GALLOWAY:
I think the entire depth of, for
22
instance, design completion.
23
lessons learned from megaprograms in general that you
24
typically, whether it's the ability of having the luxury or
25
just the decision not to go that far, that you seldom see
26
completion of design to what we have at Darlington, what we
27
saw.
28
I think that was a big
So that was a huge lessons learned.
I think there were some lessons learned from some of
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
97
1
the refurbishment projects.
I don't have the detail off of
2
my head, but we went through the various tables of lessons
3
learned that they captured from the prior refurbishment
4
projects and went through them specifically with them at
5
the time to see how they incorporated those specifics,
6
whether they were technical lessons learned, or whether
7
they were contractual, or later we looked through that to
8
see how they then incorporated that either into their
9
probabilistic modelling, their risk reviews to give it a
10
higher or lower list -- I mean a higher or lower
11
probability of that risk manifesting and its calculation.
12
I think we, also in those lessons learned, did look at
13
what they were learning on the other nuclear projects, for
14
instance Vogtle, SCANA, Bellafonte; Watts Bar is also
15
mentioned relative to lessons learned on both allocation of
16
risk -- I think I mentioned before the contract and how
17
much risk you actually turn over to your EPC contractor
18
versus the decision to take some of those risks and manage
19
them yourself because you think you're in a better position
20
to do that.
21
I think again the pre-execution planning for the other
22
nuclear plants was much less than here, and I think that
23
was a lessons learned that they took.
24
So there was, I think, numerous examples of those
25
risks, and what we did is we wanted to go through each of
26
those lessons learn and see how they applied it.
27
went into various categories; it wasn't just a cost.
28
lessons learned went into how they looked at those risks,
And it
Those
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
98
1
how they might change the project control tools to have
2
earlier detections, as I just indicated, relative to the
3
earned value system.
4
They may have looked at how they want to handle some
5
of those technical issues so they wouldn't have the same
6
problem in Darlington they may have had in other
7
refurbishment projects.
8
9
So that's the level we went through on those lessons
learned.
10
MS. FRY:
11
MS. LONG:
Thank you.
Dr. Galloway, I just have two questions for
12
you.
If you can turn to page 52 of your report, around
13
line 16, your answer here:
14
"Based on my review and the interviews conducted,
15
it is my understanding that OPG benchmarked
16
against the available cost data from other
17
refurbishment projects at Point Lepreau,
18
Pickering, and Bruce units 1 and 2, incorporating
19
lessons learned from these projects into the DRP
20
estimate."
21
And then you go on to say because it was the first of
22
a kind nature of the program that you understand that much
23
of the benchmarking was based on their own operating
24
experience.
25
And I guess I wasn't clear on the first part of your
26
answer where you say "based on my review".
27
exactly that you reviewed with respect to benchmarking?
28
DR. GALLOWAY:
What is it
Again, how it's mostly in the lessons
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
99
1
2
3
learned that I just discussed.
MS. LONG:
So you didn't actually look at any
benchmarking cost data from any of these other projects?
4
DR. GALLOWAY:
5
MS. LONG:
No.
Thank you.
My final question: you spoke a
6
bit this morning -- I was very interested when you spoke
7
about the energy strong program, and how your role is
8
basically as an independent monitor.
9
10
DR. GALLOWAY:
MS. LONG:
Yes.
I wonder if you can expand upon how it is
11
you came to be in that role.
12
commission asked you to take on, or was that something that
13
the utility proposed, that you become involved?
14
that you became involved in that mandate?
15
DR. GALLOWAY:
Was that something that the
How was it
So the original energy strong program
16
that was proposed by the utility was probably 2 to 3 types
17
the size that it is now.
18
at the time of trying to do too much at once, and so the
19
commission, through a settlement of what actually the scope
20
of work that would be for the energy strong program, the
21
commission determined that it wanted an independent monitor
22
that the utility would pay for, of course, hopefully
23
potentially recovering that through its rates at some point
24
in the future.
25
The commission expressed concern
But the commission is the one that determined that
26
they wanted the independent monitor, and that independent
27
monitor would report to both the commission rate counsel
28
and also to the utility.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
100
1
MS. LONG:
Okay.
And then as I understand it, you do
2
quarterly reports and an annual report.
3
extent that you've noticed anything in those reports that
4
needs improvement, how is it that -- well, I guess those
5
reports are made public.
6
to make the corrections based on what your recommendations
7
are, and has that been the common practice that those
8
things have been undertaken?
9
DR. GALLOWAY:
Yes.
And I guess to the
And is it up to the utility then
The procedure that was
10
established, the protocol that was established is that we
11
will -- it's continuous monitoring.
12
attending the weekly meetings, we are reviewing all
13
reports.
14
So for instance, we're
Any decision that is going to be made by the utility
15
is discussed with the monitor before the decision is
16
finally implemented.
17
of the commission in order to allow the utility to look at
18
its options and potentially make different tweaks of that
19
method at the decision, you might say, or the outcome.
20
We have found that the utility has been very
This is something that -- a request
21
cooperative.
22
Recommendations, but where the recommendations have not
23
been taken, the utility provides its response to the
24
commission on why it has not taken that recommendation.
25
The utility, on the other hand, has taken a lot of the
26
recommendations.
27
28
The utility has not taken all of the
And as I believe I stated either today or yesterday -I can't remember now which one -- I think that all the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
101
1
parties believe that the process has been beneficial in
2
that the program, which is probably about 80 percent done
3
at this time, is tracking below budget and under schedule.
4
So everyone seems to be very pleased with the process.
5
MS. LONG:
Thank you.
Mr. Keizer, any redirect?
6
MR. KEIZER:
7
MS. LONG:
8
RE-EXAMINATION BY MR. KEIZER:
9
MR. KEIZER:
If I can just have one moment?
Sure.
I have a couple questions in redirect and
10
one relates to, I believe, your discussion this morning
11
with Mr. Poch where there were some discussions about
12
unanticipated risk, and I guess it's a clarification with
13
respect to it, is that if a risk occurs that -- on a
14
project that's not anticipated, does that necessarily
15
equate to imprudence?
16
DR. GALLOWAY:
No, that's exactly what I was referring
17
to, I believe, under the other question, that all projects
18
will have risks that get retired and will have risks that
19
arise during a project, and that is just the way projects
20
happen, so, no, there would be no indication of imprudence
21
just because a risk arose.
22
MR. KEIZER:
The other question, actually, follow on
23
from Madam Chair's questions, and that is, on the Energy
24
Strong work that you do, the report that you prepare -- and
25
I just wanted to clarify -- is that a public report or a
26
private report?
27
the Board or is it something that's published and put on
28
the website?
Is it private as between the utility and
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
102
1
DR. GALLOWAY:
My understanding is that it is between
2
the commission and the utility and rate council.
3
believe that it is a document that is made public on the
4
website of either of those -- any of those parties.
5
6
7
MR. KEIZER:
I do not
And would it eventually be used in a
public endeavour, or not at all?
DR. GALLOWAY:
I believe the understanding is that if
8
a prudence hearing is held at the end of the project that
9
potentially the reports may be made available.
I don't
10
think the commission and the rate council and the utility
11
have come to an agreement on that yet.
12
there is a disagreement.
13
decided as to -- yet as to how those reports potentially
14
might be used at some point in the future.
And I don't mean
I just don't -- the three haven't
15
MR. KEIZER:
16
Those are my questions, Madam Chair.
17
MS. LONG:
18
Thank you very much for your testimony, Dr. Galloway.
19
If I can just have one moment.
Thank you, Mr. Keizer.
You are excused.
20
DR. GALLOWAY:
21
MS. LONG:
22
23
24
Mr. Keizer, I understand your next panel is
ready to go?
MR. KEIZER:
Yes, and I -- Mr. Smith, Crawford Smith,
is going to take that panel through its paces.
25
MS. LONG:
26
MR. KEIZER:
27
MS. LONG:
28
Thank you.
Okay.
You'll be back on Thursday then?
I'll be back on Thursday.
I think we'll take five minutes here just
to change the deck chairs and get the next panel up.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
103
1
MR. KEIZER:
Thank you.
2
--- Recess taken at 1:54 p.m.
3
--- On resuming at 2:00 p.m.
4
MS. LONG:
5
MR. SMITH:
Mr. Smith?
Madam Chair, good afternoon.
We have
6
OPG's panel 2A(i), which is the application overview,
7
nuclear rate setting framework, and business planning
8
panel.
9
10
I'll introduce them briefly.
We have Mr. John Mauti furthest from me, Mr. Chris
Fralick, and Randy Pugh, and I'd ask they be affirmed.
11
ONTARIO POWER GENERATION - PANEL 2A(I)
12
John Mauti,
13
Chris Fralick,
14
Randy Pugh, Affirmed
15
EXAMINATION-IN-CHIEF BY MR. SMITH:
16
MR. SMITH:
Very briefly, members of the Board, let me
17
start with you, Mr. Fralick.
18
vice-president of regulatory affairs of OPG.
19
MR. FRALICK:
20
MR. SMITH:
21
last year?
MR. FRALICK:
23
MR. SMITH:
increasing responsibility since approximately 2000?
MR. FRALICK:
26
MR. SMITH:
28
I did.
And you have been with OPG in positions of
25
27
I am.
And that is a position you assumed early
22
24
I understand you are the
That's correct.
Including responsibility as regional plant
manager for northwest operations?
MR. FRALICK:
Yes.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
104
1
MR. SMITH:
I understand that you have an MBA in
2
business from Wilfred Laurier University, and an
3
engineering degree from the University of Waterloo.
4
MR. FRALICK:
5
MR. SMITH:
6
Yes.
Mr. Mauti, I understand you are the vice-
president, chief controller, and accounting officer of OPG.
7
MR. MAUTI:
I am.
8
MR. SMITH:
In that position, you provide overall
9
corporate controllership services.
10
MR. MAUTI:
Yes, I do.
11
MR. SMITH:
You have been with OPG or its predecessor
12
since approximately 1991?
13
MR. MAUTI:
That's true.
14
MR. SMITH:
And you have had business planning or
15
controllership responsibilities since roughly 2012?
16
MR. MAUTI:
That's true, yes.
17
MR. SMITH:
And you have a business degree from
18
Wilfred Laurier university?
19
MR. MAUTI:
Yes.
20
MR. SMITH:
And you are a CPA?
21
MR. MAUTI:
Yes.
22
MR. SMITH:
Finally, Mr. Pugh.
I understand you're
23
the Director of regulatory affairs, regulatory accounting
24
and finance?
25
MR. PUGH:
26
MR. SMITH:
27
MR. PUGH:
28
MR. SMITH:
I am.
You have been with OPG since 2004?
Correct.
Prior to that, you were employed by this
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
105
1
Board and before that, by Union Gas Limited?
2
MR. PUGH:
I was.
3
MR. SMITH:
4
MR. PUGH:
5
MR. SMITH:
I understand, sir, you are also a CPA.
I am.
Mr. Fralick, maybe I can turn to you.
On
6
behalf of the panel, do you adopt the evidence assigned to
7
panel 2A(i) as detailed in Exhibit A1, tab 9, schedule 1?
8
MR. FRALICK:
9
MR. SMITH:
10
11
12
I do.
Thank you.
I have no further examination-
in-chief, and tender them for cross-examination.
MS. LONG:
Mr. Stephenson, are you ready to commence
your cross-examination?
13
CROSS-EXAMINATION BY MR. STEPHENSON:
14
MR. STEPHENSON:
I am.
Good afternoon, panel, and
15
good afternoon, witnesses.
16
the past.
17
for the Power Workers' Union.
I think I've met all of you in
My name is Richard Stephenson, and I am counsel
Good afternoon.
18
I want to talk about the nuclear stretch factor.
As I
19
understand it, the purpose of this mechanism is to attempt
20
to improve OPG's performance relative to one of its key
21
performance metrics, which is the total cost per megawatt-
22
hour metric.
Am I right about that?
23
MR. FRALICK:
Yes.
24
MR. STEPHENSON:
And OPG is increasingly looking for
25
that metric as being an important performance indicator, I
26
gather, and it's embedded in fact in your business plan,
27
correct?
28
MR. FRALICK:
It is, yes.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
106
1
MR. STEPHENSON:
I think this is self-evident, but
2
you'll agree with me that obviously that metric turns on
3
two numbers.
4
other hand, it is your actual output, your production,
5
correct?
On the one hand, it's your costs, and on the
6
MR. FRALICK:
It is, yes.
7
MR. STEPHENSON:
Can I just ask you if the object of
8
the exercise is to improve your performance relative to
9
that metric, why do you have a proposal that deals with
10
11
only one of the two elements of that metric?
Your proposal deals entirely with costs, correct, and
12
not about production?
13
MR. FRALICK:
The stretch factor is applied to 75
14
percent of the total OM&A cost in our proposal.
15
production is based on our forecast, the way we've done it
16
as per our historical methodology.
17
18
19
The
As you're aware our rate, is 100 percent variable so
we are incented to increase our output as much as possible.
MR. STEPHENSON:
Sure.
But this is a cost-cutting
20
metric, correct?
21
cost-cutting; that is you've got to find savings on your
22
costs, correct?
23
MR. FRALICK:
Sorry, your stretch factor is all about
That's the way it works?
It's an efficiency measure as we
24
understand it, so it is applied to the cost.
25
way in which to make up for that stretch factor would be to
26
increase our production relative to plan.
27
28
MR. STEPHENSON:
However, one
That would be true, but it's
certainly not going to be measured by your stretch factor,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
107
1
it's not going to be captured in that mechanism, correct?
2
MR. FRALICK:
Correct.
3
MR. STEPHENSON:
I mean, aren't I right that one of
4
the ways that you can improve your performance against the
5
total cost per megawatt hour metric is by increasing your
6
costs by increasing your costs in a cost effective manner
7
such that you're increasing your production that such an
8
revenue -- the incremental revenues exceed the incremental
9
costs?
10
MR. FRALICK:
Yes, we do have a category of projects
11
in fact that we would pursue on the basis of value
12
enhancing, and we do those types of analyses and pursue
13
projects that fall into that category.
14
MR. STEPHENSON:
That's true not only in terms of
15
capital projects, but also -- I mean, outage management has
16
been an ongoing priority for the company, correct?
17
MR. FRALICK:
Yes.
18
MR. STEPHENSON:
And the simple reality is the best
19
way for the company to increase production is to manage
20
your outages efficiently, make them as short as possible,
21
correct?
22
MR. FRALICK:
Well, that would certainly be one
23
predominant way, but also managing our reliability so we
24
minimize forced loss rate would also achieve the same.
25
MR. STEPHENSON:
Sure, I got it.
But just in terms of
26
minimizing your outage length, one of the ways of doing
27
that is by deploying more resources during the outage.
28
You're actually putting incremental costs in, correct?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
108
1
MR. FRALICK:
Yes.
In terms of making decisions about
2
the length of an outage or how to manage and resource an
3
outage, the duration and the impact on our revenues
4
associated with the cost and what we expect to be able to
5
get as a result of that investment, is always part of the
6
decision-making.
7
So on a real-time basis, if we think that we can
8
return a unit quicker and the incremental revenue that
9
would result is more than the cost that we would incur to
10
11
achieve, then we would pursue that.
MR. STEPHENSON:
And that would be a means whereby you
12
are in fact increasing your costs, but doing better on the
13
metric, right?
14
MR. FRALICK:
15
MR. STEPHENSON:
16
That's right.
But your stretch factor just doesn't
deal with that the all, right?
17
MR. FRALICK:
That's right.
18
MR. STEPHENSON:
Let me just talk now about your
19
challenge in in fact taking costs out of the company during
20
the rate period.
21
Your evidence indicates that you are constrained in a
22
variety of ways, in terms of your ability to take costs out
23
and that's in part why you're only applying it to a portion
24
of your costs, correct?
25
MR. FRALICK:
Yes.
26
MR. STEPHENSON:
And you've excluded certain areas
27
that have to do with safety, as I understand it, so that
28
you've got -- it's 75 percent of your OM&A is the basket
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
109
1
that you're capturing in this for the stretch factor
2
purposes, correct?
3
MR. FRALICK:
Yeah, our stretch factor in our proposal
4
applies to our base OM&A plus the corporate allocations.
5
Now, within base OM&A there are certain cost drivers where
6
we do not expect to be able to achieve efficiencies, so as
7
you alluded to, safety, regulatory requirements, things
8
that are very prescriptive in nature that you won't be able
9
to improve from an efficiency perspective.
So that
10
necessarily drives us to look at our total cost bucket in
11
order to come up with the cost savings that we will need to
12
identify in order to offset that stretch factor.
13
MR. STEPHENSON:
So you've got a savings number for
14
your stretch factor, but as I understand it, I mean, have
15
you got a calculation anywhere in your evidence where you
16
can have attempted to isolate as a practical matter the
17
amount of cost from which you are able to make some
18
savings, you know, you say even within this there's, you
19
know, safety issues that we can't meaningfully extract any
20
costs anyway.
21
So once you extract the things that you don't have a
22
meaningful ability to extract costs, what's left?
23
the -- what's the bucket from which you're taking costs out
24
of?
25
MR. FRALICK:
What is
I don't have that number off the top of
26
my head.
It would be something less than the 75 percent of
27
our OM&A that we have applied it to.
28
bit of a proxy for where we think we can obtain
We treat that as a
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
110
1
efficiencies, but we know that it's not -- I do not have
2
that figure directly.
3
MR. STEPHENSON:
So if we think about it, that it's
4
not 75 percent, it's a number lower than 75 percent, then
5
the actual amount in practical terms of your stretch factor
6
is a number higher than the notional stretch factor that
7
you've got -- or, sorry, the nominal stretch factor that
8
you have got in your application, correct?
9
MR. FRALICK:
Yes, if I'm following you, then the --
10
if the 75 percent includes things that we will not be able
11
to achieve efficiencies upon, then the degree to which that
12
amount decreases, then what's left of a fixed amount of
13
stretch factor that we have calculated now divided by a
14
smaller number becomes a bigger percentage, yes.
15
16
MR. STEPHENSON:
We just don't know exactly what that
number is?
17
MR. FRALICK:
No.
18
MR. STEPHENSON:
Okay.
Another way of thinking about
19
constraints on your ability to take costs out is -- are the
20
legal and committed limitations that you've got on at least
21
certain buckets of your costs, and one of those limitations
22
is with respect to your compensation envelope, correct?
23
There are some constraints on your ability to extract costs
24
out of that envelope, correct?
25
MR. FRALICK:
Yes, the compensation costs are --
26
they're the outcome of collective agreement negotiating
27
process, to a large extent.
28
measures by way of overtime and things like that, but as
We do have some control of
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
111
1
I'm sure panel 4 will go into much greater detail, once
2
that collective agreement is negotiated and set, then the
3
rates for that term of the collective agreement are indeed
4
set, and therefore our ability to extract labour costs from
5
-- certainly on a rate basis are -- we don't have that as a
6
lever.
7
MR. STEPHENSON:
Okay.
Can I just get you to turn up
8
-- it's Exhibit A1, tab 3, schedule 2.
9
for this part.
10
11
12
It's the evidence
And in particular page 38.
I just want to
correct one thing.
In the middle of the page there is a reference to the
PWU collective agreement.
Line 17:
13
"These agreements run from April 1, 2015 to March
14
31, 2017."
15
Do you see that?
16
MR. FRALICK:
17
MR. STEPHENSON:
18
MR. FRALICK:
19
MR. STEPHENSON:
20
2018?
On line 17?
Yes.
Yes.
That's wrong, right?
It's actually
That's just a typo?
21
MR. FRALICK:
That's correct.
22
MR. STEPHENSON:
Okay.
And I think this is true for
23
both of your labour agreements, at least the two big ones
24
with the Society and the PWU, and I may have to deal with
25
this with another panel, but let's see how far I can get
26
with you.
27
28
Both of those agreements prohibit the company from
doing any involuntary layoffs or terminations during their
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
112
1
period, correct?
2
MR. FRALICK:
As I understand it, yes.
3
MR. STEPHENSON:
So as I understand it, in terms of
4
the company's ability to decrease the costs associated with
5
those collective agreements, it's really limited to three
6
things.
Item number 1 is attrition, correct?
7
MR. FRALICK:
8
MR. STEPHENSON:
9
That would be a means.
People leave the company, you have
some ability to not replace them, correct?
10
MR. FRALICK:
Yes.
11
MR. STEPHENSON:
But however, if we look in your
12
material -- and I can check this with somebody else if you
13
don't know it -- you're not actually forecasting decrease
14
in complement until after 2020.
15
MR. FRALICK:
Not in any material way.
I have to turn up the evidence, but I
16
believe it's relatively flat through most of the five-year
17
term, yes.
18
MR. STEPHENSON:
The second way that you can take
19
costs out is by controlling the amount of overtime, and
20
you've indicated that, correct?
21
MR. FRALICK:
Yes.
22
MR. STEPHENSON:
But this dovetails back to the issue
23
of outage management to a large degree, doesn't it?
24
where the lion's share of your overtime in fact is
25
dedicated, correct?
26
27
28
MR. FRALICK:
That's
We incur a lot of overtime, particularly
in the maintenance ranks, during outages, yes.
MR. STEPHENSON:
And from the company's perspective,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
113
1
you actually in a -- colloquially, you make money on that
2
overtime.
3
even at higher rates, if you can shorten that outage
4
duration, you're back online and making revenue?
5
If you can deploy those additional resources
MR. FRALICK:
Yeah, I guess if you're saying that it
6
would be a myopic view to look strictly at overtime, say,
7
and minimize that at all costs, to use the phrase, would be
8
a narrow way to look at how to run the business.
9
not do that.
10
11
MR. STEPHENSON:
Right.
You would
I mean, you may save a
dollar, but it may cost you a dollar and a half, right?
12
MR. FRALICK:
Yes.
13
MR. STEPHENSON:
Okay.
And the third way you can take
14
some costs out of these collective agreements is that you
15
have got some temporary employees governed by these
16
collective agreements and you can, you know, increase or
17
decrease the number of those, correct?
18
MR. FRALICK:
Well, linked to your first metric, being
19
attrition, as people leave, particularly in light of what
20
we were looking at at Pickering and end of commercial
21
operations in the next decade, we have got the term
22
employee provision now, so we would look to shift more
23
employees to that from a full regular FTE, yes.
24
MR. STEPHENSON:
Right.
But that's more of a
25
theoretical than a real issue in terms of your ability to
26
say, because you're not actually forecasting any material
27
change in complement, right?
28
MR. FRALICK:
Correct.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
114
1
MR. STEPHENSON:
And that's governed by your perceived
2
need, right, that you would take -- you would be -- if you
3
could get more complement down you would, but you perceive
4
you need these bodies to do your operations, right?
5
MR. FRALICK:
We have a challenging mandate to meet at
6
our stations over the next decade, and we have a work
7
program that has to be executed to ensure that we maintain
8
the reliability and execute the tough mandate that we have,
9
and that's the complement that -- and the full plan that we
10
11
require in order to be successful in that endeavour, yes.
MR. STEPHENSON:
So -- and obviously on management
12
comp you have less legal constraints around your ability to
13
reduce that, but again, as I understand your staffing plan
14
from elsewhere in your materials, you're more or less
15
looking at a fairly flat complement in that area as well,
16
at least until 2020, again because you perceive that that's
17
what you need to run the operation.
18
MR. FRALICK:
That's right.
19
MR. STEPHENSON:
So if you -- if you're -- and the
20
compensation bucket is a very substantial proportion of
21
your OM&A spend, correct?
22
23
24
MR. FRALICK:
Yes, it's -- I'd be guessing, but
somewhere two-thirds or more.
MR. STEPHENSON:
And if that bucket is -- you'd agree
25
with me it's pretty highly constrained in terms of your
26
ability to extract dollars, fair?
27
MR. FRALICK:
Yes.
28
MR. STEPHENSON:
And bearing in mind those
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
115
1
constraints, if we're looking only at the remaining aspect
2
of your OM&A budget, again if you're going to extract all
3
the vast majority of the savings for your stretch factor
4
out of that remaining portion, again the actual amount of
5
the stretch is that much bigger, correct?
6
MR. FRALICK:
To achieve the stretch factor that we've
7
proposed will be a challenge.
8
side some $50 million cumulative over the full five years,
9
and that's not going to be easy for us to find.
10
MR. STEPHENSON:
It totals, on the nuclear
I didn't see in the evidence actually
11
any plan, proposal, any identification actually where the
12
money is coming from.
13
MR. FRALICK:
Is there something I missed?
No, you didn't miss it.
The stretch
14
factor by design is an up-front give that is incremental to
15
our challenging business plans.
16
a number of initiatives that we will need to execute in
17
order to achieve, and the stretch factor is above and
18
beyond that, and we have not identified what those
19
initiatives will be in detail at this point in time.
20
need to do that.
21
MR. STEPHENSON:
Our business plan includes
We
The number that you've indicated is
22
this .3 percent, which is essentially compounded, as I
23
understand it, over the term.
24
MR. FRALICK:
Yes.
25
MR. STEPHENSON:
But just as we've gone through and
26
talked about the constraints on areas where you can't
27
meaningfully get money out -- I mean, if we talked about
28
the stretch factor as a practical matter in terms of
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
116
1
controllable costs being at, say, one percent or higher,
2
does that sound like a reasonable number?
3
4
5
6
MR. FRALICK:
greater than .3.
MR. STEPHENSON:
Those are my questions.
MS. LONG:
8
MR. MILLAR:
Thank you, Mr. Stephenson.
Good afternoon, Panel.
Mr. Millar?
When would you be
looking at taking an afternoon break?
10
MS. LONG:
11
MR. MILLAR:
12
CROSS-EXAMINATION BY MR. MILLAR:
13
Good afternoon, panel.
14
am counsel for Board Staff.
15
pleasure of meeting before.
16
Thank you
very much.
7
9
I'd be guessing, but certainly it's
Around 3 o'clock.
Thank you.
My name is Michael Millar; I
I believe we've all had the
First, I have some questions about your custom
17
incentive regulation proposal for your nuclear operations,
18
and -–
19
20
21
22
MR. SMITH:
Sorry, Mr. Millar.
compendium; was it your intention to mark that?
MR. MILLAR:
Yes, why don't we do that?
K6.3, Staff compendium.
MR. FRALICK:
24
EXHIBIT NO. K6.3:
25
COMPENDIUM FOR OPG PANEL 2A(I)
26
MR. MILLAR:
28
That will be
Panel, you have copies of this?
23
27
You provided a
Yes.
BOARD STAFF CROSS-EXAMINATION
You proposed a five-year custom incentive
for your nuclear facilities?
MR. FRALICK:
Yes, we have.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
117
1
MR. MILLAR:
And one of the features is the stretch
2
factor which you were just discussing with Mr. Stephenson,
3
and I'm going to start with a few questions about that.
4
Maybe we could begin by turning to page 2 of the
5
compendium.
6
Stephenson as talking about, but I thought I would take you
7
to the Board's words on this.
8
stretch factor is.
9
10
And this gets a little bit to with a Mr.
It sort of describes what a
If you look at the third full paragraph about the
middle the page, it states:
11
"The stretch factor component of the X factor is
12
intended to reflect the incremental productivity
13
gains that firms are expected to achieve under
14
incentive regulation, and is a common feature of
15
IR plans.
16
vary by company, and depend on the efficiency of
17
a given company at the outset of the IR plan.
18
Stretch factors are generally lower for firms
19
that are relatively more efficient."
20
Now first of all, it's talking about an X factor
21
there.
22
custom IR.
23
These expected productivity gains can
So obviously, this is discussing IRM as opposed to
But for our purposes here today, is that an accurate
24
description of a stretch factor, from your perspective?
25
that what you were thinking when you proposed a stretch
26
factor, that that's the purpose of a stretch factor?
27
28
MR. FRALICK:
Yes.
Is
We essentially took the definition
of the stretch factor to be akin to the one that we applied
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
118
1
to our hydroelectric assets, which is more of a pure fourth
2
generation IRM, and we treated it the exact same.
3
construct perspective, a stretch factor is the same, yes.
4
MR. MILLAR:
From a
This is not unique to OPG; it's a
5
standard tool the Board has been using under incentive
6
regulation for many years?
7
MR. FRALICK:
8
MR. MILLAR:
9
10
As I understand it, yes.
The document I took you to is for
distributors, for example, and I know you modeled your plan
on that.
But this is not new to OPG, is my point.
11
MR. FRALICK:
12
absolutely new for OPG.
13
previous proceeding.
14
applied a stretch factor.
15
MR. MILLAR:
The use of a stretch factor is
We have not applied that in any
This is the first time we have
Certainly it's new to OPG, but the
16
concept of a stretch factor has been around at the Board
17
for a while under incentive regulation plans for
18
distributors?
19
MR. FRALICK:
20
MR. MILLAR:
Understood, yes.
Just to take you to a couple things Mr.
21
Stephenson mentioned, it's been used by distributors for
22
many years.
23
agreements with those employees; is that fair?
LDCs have employees and they have collective
24
MR. FRALICK:
25
MR. MILLAR:
26
I would assume so, yes.
You can take that subject to check, that
Hydro One has collective agreements.
27
MR. FRALICK:
28
MR. MILLAR:
I know Hydro One does, yes.
And many, at least of the larger ones,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
119
1
would have collective agreements with their employees?
2
MR. FRALICK:
3
MR. MILLAR:
Yes.
And there are probably doubtless other
4
areas.
5
be areas where a distributor simply can't find
6
efficiencies; is that probably true?
7
They wouldn't be regulated by CNSC, but there would
MR. FRALICK:
Probably true.
However, OPG is unique
8
in the fact that we have a 100 percent variable rate design
9
and no part of our costs are fixed, and that is a
10
11
significant difference to other regulated entities.
MR. MILLAR:
But a stretch factor applies against the
12
entire -- okay, I take your point.
13
savings that you might be able to find from your
14
compensation costs.
15
Let's move on to
There was a suggestion that you have very little
16
wiggle room when it comes to making savings on compensation
17
costs, although you did concede there are some things like
18
over time, and I'd also suggest the number of FTEs that are
19
outside the collective agreement that you do have some
20
control over?
21
MR. FRALICK:
Yes, we have control over the numbers
22
and overtime to a certain extent.
23
running the operation, you're not strictly looking at how
24
many people you have or how much your overtime is.
25
looking at are you able to get the work done within the
26
overall envelope.
27
28
However, when you're
You're
So you're switching in between your resource types and
resource work execution methods, as appropriate in the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
120
1
2
3
given circumstance.
MR. MILLAR:
Mr. Fralick, you'd be familiar with OPG's
business transformation initiative from several years ago.
4
MR. FRALICK:
5
MR. MILLAR:
I am, yes.
I am doing this from memory, but it ran
6
something like from 2011 to 2015?
7
in that range?
8
9
10
Does that sound right,
Mr. Mauti, you may know better?
MR. MAUTI:
Yes, it did.
That was the approximate
range, yes.
MR. MILLAR:
And through that initiative, you were
11
able to shed over 2000 positions, 2000 FTEs.
12
correct?
13
MR. MAUTI:
14
MR. MILLAR:
15
I believe the number we quoted was 2700.
MR. FRALICK:
17
MR. MILLAR:
19
Okay, so closer to 3000.
And by doing
that, you were able to realize significant OM&A savings?
16
18
Is that
Yes.
And you also realized significant
efficiency through business transformation, is that fair?
MR. MAUTI:
Part of the approach for coming up with
20
the centre led sort of structure was to try to gain those
21
efficiencies, and operate the business as effectively as
22
possible, yes.
23
MR. MILLAR:
And your collective agreements did not
24
prevent you from realizing those savings, or realizing
25
those efficiencies?
26
MR. MAUTI:
Not directly.
We were able to leverage
27
the demographics of the company that would allow for those
28
departures to happen, without there being a formal process
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
121
1
2
to downsize in the company.
MR. MILLAR:
Can I ask you to turn to page 3 of the
3
compendium, please?
4
you proposed a stretch factor of 0.3 percent, and this
5
would apply to a portion of your OM&A expenses as we've
6
already discussed.
7
8
9
10
As you discussed with Mr. Stephenson,
You also mentioned that's approximately 75 percent of
your total OM&A?
MR. FRALICK:
MR. MILLAR:
That's correct.
The savings that would result from your
11
proposal over the five years of the custom IR term is
12
$50 million; is that correct?
13
14
15
MR. FRALICK:
The cumulative total over the five years
is 50 million, yes.
MR. MILLAR:
Let's start with the derivation of how
16
you came up with the 0.3 percent.
17
framework for electricity distributors, there's five
18
different buckets you can fall in, is that right?
19
MR. FRALICK:
20
MR. MILLAR:
Under the current
Yes.
And you can see that in the footnote at
21
the bottom of page 3 of the compendium.
22
percent, .15, .3, .45 and .6.
23
buckets?
24
MR. FRALICK:
25
MR. MILLAR:
There's zero
So those are the five
Yes.
And maybe we can turn to page 7 of the
26
compendium.
Electricity distributors are slotted into one
27
of these groups based on the relative efficiency of their
28
operations, is that correct?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
122
1
MR. FRALICK:
2
MR. MILLAR:
As we understand it, yes.
Okay.
And I guess the way they do that
3
is a report is prepared, and this -- the most recent one is
4
by Pacific Economics Group, and they do some research on
5
their relative efficiency, and then all of the LDCs are
6
slotted in one of those five buckets; is that right?
7
you understand it?
8
MR. FRALICK:
9
MR. MILLAR:
As
As we understand it, yes.
Okay.
In fact, if you turn to page 7 of
10
the compendium you can see the most recent stretch factor
11
assignments for the LDCs.
12
MR. PUGH:
13
MR. MILLAR:
That's correct.
Now, OPG, of course, is not part of this,
14
because you're not an LDC, and you weren't part of this
15
study, but your proposal is to place yourself in the middle
16
group, the 0.3 percent?
17
MR. FRALICK:
Yes, OPG utilized the existing
18
ScottMadden methodology for benchmarking that's been in
19
place for many years, and we assessed where we ranked on
20
our TGC basis relative to, you know, the benchmark, and
21
through our calculation determined that we would be at .3,
22
yes.
23
MR. MILLAR:
Yes, in fact you'll see that if you turn
24
to page 8 of the compendium.
I've taken an excerpt from
25
your application.
26
the measure you used for efficiency was TGC, and I think
27
Staff tends to agree with that measure, but maybe you could
28
let us know why that is the measure you selected.
And first, just to backtrack a little,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
123
1
MR. FRALICK:
I think ultimately it is a fair
2
reflection of OPG's cost performance.
3
readily benchmarkable, and its denominator is megawatt
4
hours, which is our product, and so we feel that that is
5
appropriate for use in the determination of a stretch
6
factor.
7
MR. MILLAR:
Okay.
It's one that's
And then if we look at chart 9, we
8
see what you did.
You split Darlington and Pickering, and
9
you assigned each of them their own value based on their
10
relative efficiency, and for Darlington the TGC was top
11
quartile, so you gave that a zero.
12
bottom quartile.
13
through the production forecast, weighed it, and you ended
14
up at more or less 0.3.
15
You gave that .6.
MR. FRALICK:
For Pickering it was
You sort of ran that
That's how you arrived at 0.3?
Correct.
We production-weighted the
16
individual stations' stretch factor determination based on
17
their TGC performance.
18
MR. MILLAR:
And what you did was you chose to
19
consider Pickering TGC and Darlington TGC separately, as
20
opposed to considering an overall number for OPG.
21
ask you to turn to page 9 of the compendium.
22
business plan.
23
approach you take in the business plan.
24
think it's the second sentence overall:
If I can
This is your
We can see here near the -- this is not the
If you look -- I
25
"In 2016 OPG adopted TGC as an enterprise-wide
26
measure of operational cost-effectiveness in
27
addition to TGC metrics for each of the nuclear
28
and hydro operations."
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
124
1
So why is it appropriate to use an all-in number for
2
your business planning purposes but for setting a stretch
3
factor you wanted to divide it between Pickering and
4
Darlington?
5
MR. MAUTI:
In the business plan that you referenced
6
on page 9 we summarized an enterprise and by technology
7
level the two total generating cost measures.
8
further in the back of the business plan, and A221,
9
attachment 1, page 30, provides the operational targets,
They are
10
including TGC at a Pickering and Darlington individual
11
level.
12
So the way we described it in the front part of the
13
business plan was just to get an overall flavour from a
14
technology point of view.
15
plan package tends to have a consolidated kind of use of
16
things.
17
So the front of the business
We have a lot more detail in the back as well.
So they are calculated -- they're benchmarked at a
18
station level.
19
this on the technology basis.
20
We just reported them at the front part of
MR. MILLAR:
Okay.
The numbers that you used to set
21
the 0.3 that we just looked at on page 8, I guess it was,
22
those were based on the 2015 nuclear benchmarking report;
23
is that correct?
24
MR. FRALICK:
25
MR. MILLAR:
That's correct.
And although it's called the 2015
26
benchmarking report it's actually for 2014 numbers; is that
27
right?
28
MR. FRALICK:
That's correct.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
125
1
2
MR. MILLAR:
And at the time you prepared the
application that was the most recent data that you had?
3
MR. FRALICK:
4
MR. MILLAR:
That's correct.
And just to take a step back, this
5
nuclear benchmarking report, I do have some benchmarking
6
questions here.
7
getting into more detail on benchmarking, but I think since
8
it relates to stretch factor we will have to go over this
9
just a little bit here.
Obviously it's panel 3 with which we'll be
10
What this benchmarking report does is it compares your
11
performance against other North American nuclear operators?
12
MR. FRALICK:
13
MR. MILLAR:
It does.
And the comparators in this report and
14
the entire methodology was established with the assistance
15
of the consulting firm ScottMadden?
16
MR. FRALICK:
17
MR. MILLAR:
18
It was, yes.
And you've been reporting on this basis
for quite a number of years now.
19
MR. FRALICK:
20
MR. MILLAR:
Yes, that's right.
Okay.
And back with the 2015
21
benchmarking report, as we've discussed, Darlington was top
22
quartile and Pickering was bottom quartile.
23
then we have the 2016 benchmarking report, and if I could
24
ask you to flip all the way ahead to page 29 of the
25
compendium.
26
However, since
We see the results of that here.
If you look under the "value for money" metric just
27
over halfway down the page, you'll see the three-year total
28
generating cost, and it's colour-coded, so if you loacross
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
126
1
to Pickering we see red, which means fourth-quartile, which
2
is where it was in the previous report, but Darlington now
3
is second quartile; is that right?
4
MR. FRALICK:
That's right.
So this, as you'll see,
5
is a rolling three-year average for the Darlington metrics.
6
So 2015 would have come in and 2012 would have dropped off.
7
And 2015 was a very unique year for Darlington, in that it
8
executed a one-in-ten-year vacuum building outage, so
9
you've taken the entire plant down, so the corresponding
10
production is down considerably, the costs are up.
11
was a significant driver for the cost performance coming in
12
for Darlington in 2015.
13
So that
In addition to that you'll see further on down in this
14
report on page 80 the capital performance and -- while
15
still well within the first quartile, the capital program
16
for Darlington has increased in recent time as it's gearing
17
up for the Darlington refurbishment.
18
And the third contributing factor which again
19
reinforced the need for refurbishment is, the FLR rate at
20
Darlington has exceeded our target, and that has also
21
contributed to the variance.
22
23
24
25
26
MR. MILLAR:
And those may all be the reasons for
that, but you've dropped to second quartile under TCG.
MR. FRALICK:
Yes, the point being that the 2015 is
not a representative year for those matters.
MR. MILLAR:
Okay.
But we don't -- when we look at
27
these figures it's based against your comparators.
In any
28
given year one of your comparators may have higher FLR than
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
127
1
they anticipated or there may be a major project coming.
2
3
When we look at TGC the result is what the result is;
is that fair?
4
5
MR. FRALICK:
Yes, but the entire benchmark doesn't
take a VBO at the same time in the same year.
6
MR. MILLAR:
It doesn't, but other years you might
7
have benefited when somebody else had an outage like that.
8
Is that possible?
9
MR. FRALICK:
10
MR. MILLAR:
Marginally.
Let's flip back to page 10 of the
11
compendium.
This shows your most current results for OPG
12
as a whole.
And am I right that of the 13 nuclear
13
operators that are measured you are 12th out of 13th when
14
it comes to TGC?
15
16
17
MR. FRALICK:
You're the second-worst?
That appears to be what this table says,
yes.
MR. MILLAR:
And that's a drop-off of what you had
18
when you originally filed.
19
ahead to page 12, this was the original pre-filed material.
20
You were a bit better than -- you were 10th out of 13th
21
overall, but as I say, you're now 12th out of 13th.
22
23
24
MR. FRALICK:
Right.
You can see that -- if you flip
And the reasons for that I
outlined.
MR. MILLAR:
Okay.
And then indeed if we look at your
25
business plan that's back on page 9, I note first on page
26
10 that your TGC for 2015 was $54.58.
27
after, you'll see on page 9 of the compendium right at the
28
top $63.20, so you're predicting a very significant
For 2016, a year
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
128
1
2
increase from 2015 to 2016 as well; is that fair?
MR. FRALICK:
Yes, and while panel 3 can go into this
3
in greater detail, certainly a significant driver would be
4
the commencement of the Darlington refurbishment program,
5
as well as other outage activities.
6
MR. MILLAR:
So is that a normal -- we'll get into
7
normalized with panel 3, I think, but is that a normalized
8
number, is that a non-normalized number?
9
10
MR. MAUTI:
As you see it on page 9, this would be a
non-normalized number.
This is the raw number itself.
11
MR. MILLAR:
12
For 2016, Darlington shut-off -- Unit 2 went out at
13
14
15
16
Okay.
That's the raw number.
Thank you.
the end of November?
MR. FRALICK:
No, it went out in the middle of
October.
MR. MILLAR:
Middle of October, okay.
You'll see that
17
over the test period, the costs are up in the 75 to -- 74
18
to 77 range.
19
normalized, so I take it the DRP is one causes of the high
20
costs at that time.
21
MR. MAUTI:
22
predominant by far.
23
Again, those are the raw numbers not
MR. MILLAR:
Correct.
That's probably the most
Given the numbers up to 2015, if you wish
24
to exclude 2016, is it still your view that this is mid
25
range performance on TGC?
26
MR. FRALICK:
Well, we would look at the period before
27
2015, given the unique outage in 2015.
If you want to look
28
at a period that's reflective of what OPG's underlying
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
129
1
performance is, and in that period OPG was indeed top
2
quartile for Darlington.
3
noted, has been unchanged.
4
MR. MILLAR:
And Pickering has, as you've
But most recent actual data we have from
5
2015, at least on a company-wide basis, shows you as 12th
6
out of 13th in TGC performance.
7
suggest a stretch factor of 0.6.
To some, that would
8
Do you have anything to add to what you just said?
9
MR. FRALICK:
I wouldn't say that that is a direct
10
conclusion.
11
methodology that we have utilized, that would not come out
12
at 0.6.
13
14
I think if you run through the calculation
MR. MILLAR:
You didn't rerun on the numbers, though,
did you based on the most updated results -- or did you?
15
MR. PUGH:
We did do is we ran the results using these
16
2015 benchmark numbers that appear on page 29 of your
17
compendium.
18
at the median at .3, and it shows Pickering is in the
19
fourth quartile at .6.
20
21
22
So it shows that Darlington is in fact right
And when we ran the numbers for those, we came up with
.43.
MR. MILLAR:
Okay.
So that would be closer to .45
23
than .3, obviously.
And is OPG actually amending its
24
application to reflect that, or are you still seeking 0.3?
25
MR. FRALICK:
26
MR. MILLAR:
27
I have some questions about the memorandum of
28
We're seeking 0.3.
Let me move to my next area.
agreement, and I actually thought these would be questions
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
130
1
for panel 3 because they're really about benchmarking.
2
I saw on your consolidation sheet that they're questions
3
for you.
4
So I'll try them with you.
But if there posed to
5
panel 3, by all means punt me to them.
6
lose my chance.
7
MR. FRALICK:
8
MR. MILLAR:
9
But
I don't want to
Are these questions for you, Mr. Fralick?
Likely John, Mr. Mauti.
Mr. Mauti, you're familiar with the
memorandum of agreement that OPG has with its shareholder?
10
MR. MAUTI:
11
MR. MILLAR:
Yes, I am.
And there have been changes to that
12
memorandum of agreement since last we enjoyed a discussion
13
here in this room, since the last case?
14
MR. MAUTI:
15
in August 2015.
16
MR. MILLAR:
Sorry, the memorandum of agreement changed
So after the last main OPG proceeding.
17
I'm sorry, I did see you at the technical conference, so I
18
apologize for that.
19
One of the changes relates to benchmarking, and if you
20
look at page 16 of the compendium, we have the old
21
memorandum of agreement.
22
it discusses continuous improvements, and that you're to
23
benchmark and target the top quartile against other North
24
American operated utilities.
25
You'll see that in paragraph 3,
And if we look at the revised version of the
26
memorandum of understanding, you'll see that on page 15 of
27
the compendium -- I didn't reproduce the whole thing, but I
28
think I have the replacements here -- that language no
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
131
1
longer appears, is that fair?
2
3
MR. MAUTI:
The language on benchmarking has changed
and it is now in a subsection 6.1.3.
4
MR. MILLAR:
That's right.
Should questions I have
5
about this, are they for you now or should these be for
6
panel 3, questions about your approach to benchmarking?
7
8
MR. MAUTI:
depending on the technical --
9
10
You can try the questions for me,
MR. MILLAR:
I'll try them, and you can tell me if
we've gone too far.
11
The MOA no longer specifies you should target top
12
quartile in your benchmarking efforts.
13
why that change was enacted?
14
MR. MAUTI:
First, do you know
I guess as part of updating the memorandum
15
of agreement that had, I believe, been in existence in
16
since 2005.
17
There were several changes and Board Staff IR number 1
18
described what those main changes were.
19
benchmarking, I believe it was a recognition it was a
20
recognition to do appropriate benchmarking, as it should
21
always be, you should try to find an appropriateness of how
22
you're doing the benchmarking and what you were comparing
23
to.
24
When it came to
So I think in our case, recognizing that in 2015 our
25
nuclear fleet was getting to a point where the plants were
26
going through very different changes, whether that's
27
refurbishment for a second life for Darlington or
28
approaching commercial end of commercial operations or
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
132
1
potential extension for Pickering, it was more appropriate
2
to have a memorandum of agreement that required
3
benchmarking that was appropriate for the operations as we
4
have them at the time.
5
They have changed substantially since 2005, and I
6
would assume that's what led to the change in the wording
7
to make it an appropriate benchmark as opposed to something
8
more specific.
9
MR. MILLAR:
And the new language, which we see at
10
page 15, it doesn't say anything about targets at all; is
11
that right?
12
MR. MAUTI:
13
what's appropriate.
14
cycle of that plant and how you're comparing what some of
15
those factors would be, that you do benchmarking to be able
16
to come up with actionable things you can take from that,
17
not just necessarily to compare to what's at the top or the
18
bottom of that comparator group.
19
20
21
No, it just says you should benchmark to
MR. MILLAR:
And again, understanding the life
It doesn't mention continuous improvement
Either, at least not specifically; is that fair?
MR. MAUTI:
Perhaps not specifically within that, but
22
in the expectations for operations in terms of improvement,
23
I believe that language is in the MOA, just not specific to
24
the benchmarking.
25
26
MR. MILLAR:
OPG still proposes to set targets for TGC
and in fact, we see that in the application, right?
27
MR. MAUTI:
28
MR. MILLAR:
That is correct, yes.
And you are targeting -- it's not just an
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
133
1
absolute number.
2
quartiles as well?
3
MR. MAUTI:
You have targets with respect to
We try to understand obviously where we
4
believe the industry is going from a quartile basis and set
5
our targets, again in taking into account the evolution of
6
the plant, and specifically with Darlington as it's going
7
through refurbishment for the next decade, where you'll
8
have one and sometimes two units out for refurbishment,
9
that has a dramatic impact on the TGC value.
10
11
So we need to
take that into account.
It would be inappropriate to suggest we are targeting
12
top quartile to Darlington while it's going through that
13
phase of refurbishment.
14
MR. MILLAR:
With respect to continuous improvement, I
15
assume you'd agree with me that despite the fact that those
16
words don't appear in the MOA anymore, OPG still does
17
strive for continuous improvement?
18
MR. MAUTI:
Yes.
I believe you had a compendium
19
excerpt from the previous hearing as well, and Ms. Swami
20
also did reference the fact that we're always trying to
21
improve and make changes to our operations targeting,
22
whether it's a how we do our outages or the reliability of
23
our plants, safety and what-not.
24
Those are things we continuously look at and continue
25
to compare ourselves.
26
MR. MILLAR:
Let's turn to that.
That's page 20 of
27
the compendium, I believe.
At the bottom of the page, this
28
is a response from Ms. Swami to a question I asked.
She
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
134
1
states:
2
"And would I like to see us move up the relative
3
ranking?
4
trying to make our performance better, and that's
5
why we targeted improvement programs," et cetera.
Of course.
OPG is always interested in
6
I assume that still holds true today?
7
MR. MAUTI:
8
MR. MILLAR:
9
Yes, it does.
Thank you.
I have a couple of more
questions about the stretch factor, but not about the
10
number, the 0.3 or what have you, but the portions of your
11
spend you propose to apply it to.
12
Could we turn to page 22 of the compendium?
We went
13
over this a little bit already, but to refresh everybody's
14
memory, you don't propose to apply the stretch factor to
15
your entire O&M budget.
16
O&M and allocated service O&M, is that right?
17
MR. FRALICK:
18
MR. MILLAR:
It will be applied to nuclear base
And allocated corporate support costs.
Sorry, yes, I misstated that yes.
When
19
we turn to page 23, we see those numbers and without
20
straining anyone's vision too much, you can see that
21
project OM&A is line 2 and allocation of corporate cost is
22
line 7, is that right?
23
MR. FRALICK:
24
MR. MAUTI:
25
MR. MILLAR:
Yes.
That's correct.
And 11 is the total OM&A.
So I just want
26
to make sure I understand how you did the calculation.
27
added lines 2 and -- I'm sorry, it's base OM&A.
28
misspoke.
You
I
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
135
1
MR. FRALICK:
2
MR. MILLAR:
Yes.
It's base OM&A.
My mistake.
So line 1 and line 7, you
3
added those together, and then you took that as a
4
proportion of the total OM&A, which is line 11.
5
you came up with the 75 percent?
6
MR. FRALICK:
7
MR. MILLAR:
That's how
Yes.
Okay.
When we did the calculations it
8
actually -- it varied between 70 and 75 percent depending
9
on the year.
Would you take that subject to check?
10
MR. FRALICK:
11
MR. MILLAR:
Subject to check.
Okay.
All right.
And you propose to
12
exclude all other O&M from the application of the stretch
13
factor because in -- I'm reading from page 24 here.
14
don't know that you need to pull it up, but you state:
15
"OPG does not expect to find material
16
efficiencies in the remaining 25 percent."
17
MR. FRALICK:
Yes, so the projects, for example, and
18
outages, they are discrete activities, so they're not
19
activities that we do on a repetitive basis.
20
unique endeavour, and we develop a scope, and that is
21
tailored to that specific need at that time.
22
I
Each one is a
So from the perspective of efficiency of getting
23
better at doing the same thing, these cost categories do
24
not lend themselves to that type of gains.
25
MR. MILLAR:
Well, let's look at that a little bit
26
more carefully.
If we go back to page 23, which is up on
27
the screen, first, the two largest things you look to
28
exclude -- or two of the larger things that are excluded
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
136
1
are project OM&A and outage OM&A, which you were just
2
discussing?
That's lines 2 and 3?
3
MR. FRALICK:
4
MR. MILLAR:
5
Yes.
And together those are about 500 million
dollars a year?
It varies a little bit?
6
MR. FRALICK:
7
MR. MILLAR:
Sure, yes.
Give or take?
In fact, the bulk of that
8
is outage OM&A.
In 2017, for example, it's 394, and it's
9
mostly around that range until you get to 2021, give or
10
take 400 million?
11
MR. FRALICK:
12
MR. MILLAR:
13
That's right.
And the Darlington units
are on a -- on outage cycle that's every three years?
14
MR. FRALICK:
15
MR. MILLAR:
16
Yes, between 394 and 415, yes.
That's right, yes.
And Pickering is faster than that.
two years.
17
MR. FRALICK:
18
MR. MILLAR:
Correct.
So these are -- the work may vary, but
19
outages are not unique, are they?
20
a set schedule?
21
It's
MR. FRALICK:
They're things you do on
To a certain extent they are, but
22
they're also -- the scope of any given outage is defined by
23
the corrective backlog that you want to undertake at that
24
point in time, so if something is broken, you need an
25
outage to fix it.
26
outage to a large extent, so while there would be some
27
component inspection type work that would be common, there
28
would certainly be a large portion that would be unique to
That would inform the scope of your
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
137
1
a given outage.
2
3
The extent to which that breakdown is detailed, that
would be a question best asked to panel 3, though.
4
MR. MILLAR:
Okay.
Understood.
And -- but it's your
5
view no lessons learned on outage OM&A?
6
efficient over time?
7
MR. FRALICK:
You don't get more
No, that's not my point at all.
My
8
point is that each of these outages is unique endeavour,
9
and we set a budget that is challenging to execute the
10
scope of work that we need to for a given outage.
We would
11
execute lessons learned on outages like we do on projects,
12
and we continue -- we seek to improve our performance.
13
Indeed, outage performance is one of the initiatives listed
14
in our business plan.
15
MR. MILLAR:
So I guess I'm not quite following why
16
you don't think there are significant efficiencies to be
17
found there when there could be under base OM&A.
18
assume you have an aggressive forecast for base OM&A as
19
well, but you think a stretch factor is reasonable to apply
20
there.
21
is.
22
But I
I guess I'm not quite seeing what the difference
MR. FRALICK:
Yeah, it's the repetition of the work.
23
It's the likeness of the work.
24
much more work that is like for like, where you're
25
repeating a similar task over and over again, where it
26
would be more reasonable to seek efficiency gains.
27
28
Within base OM&A there is
In an outage it's not like that.
Each outage is
constructed uniquely, given the circumstances and scope at
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
138
1
2
that time.
MR. MILLAR:
In your review of the Board's -- the
3
renewed regulatory framework and all its related documents,
4
did you find any references there that suggested that a
5
stretch factor would only apply to a portion of O&M?
6
MR. FRALICK:
No, we did not find a reference to that
7
extent.
We did note that the note of steady state is
8
something that is referenced in the RRFE, so when we looked
9
at our cost categories we looked for costs that we would
10
feel would be -- well, that are more objectively in a
11
steady state, and that is base OM&A and the corporate
12
support costs.
13
14
MR. MILLAR:
Your stretch factor also excludes your
capital spend; is that right?
15
MR. FRALICK:
16
MR. MILLAR:
It does.
And the same question I just asked with
17
respect to the RRFE or its related documents, did you find
18
a source there that suggested that capital should be
19
excluded from productivity measures such as a stretch
20
factor?
21
MR. FRALICK:
We did not find such a reference.
22
However, similar to the project OM&A bucket the capital
23
project bucket is similarly constructed of very discrete
24
projects, so unlike distributors, where you would see a lot
25
more repetition, each of this -- each project is unique, by
26
and large.
27
28
OPG employs what we call a project portfolio -portfolio management approach, sorry.
So we determine an
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
139
1
annual budget for our capital program that is informed by
2
benchmarks.
3
capital program as efficiently as possible in order to
4
enable us to execute additional projects.
5
However, we are incented to execute our
We always have more projects than we have budget.
So
6
we are inherently incented to become as efficient as
7
possible on capital in order to make more investment in the
8
station which will improve reliability and performance, and
9
given the fact that our rate design is 100 percent
10
variable, we are always incented to try to maximize
11
production.
12
is that.
13
So our incentive within the capital portfolio
MR. MILLAR:
Now, you -- I know this isn't the hydro
14
panel, but under hydroelectric you're doing IRM, which also
15
has a stretch factor; is that right?
16
MR. FRALICK:
17
MR. MILLAR:
18
19
correct?
Yes, it does.
And that applies to everything.
Am I
It applies to O&M and capital?
MR. FRALICK:
Yes, we -- as we'll talk to in panel
20
2A(i), we have endeavoured to mirror the hydro IRM
21
structure as closely to the fourth-generation IRM construct
22
as possible.
23
24
25
MR. MILLAR:
So why should the stretch factor apply to
capital under IRM but not under custom IR?
MR. FRALICK:
Well, under IRM we understand it's an
26
all-in.
And while everything I said about the capital
27
program is also appropriate for hydroelectric, when it
28
comes to custom incentive regulation, we looked at that
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
140
1
from the perspective of, you know, what was in a steady
2
state on the nuclear side of the house, and the capital
3
program, as I said, is much more discrete, and we feel that
4
it is -- an incentive on the capital program would not --
5
an efficiency -- stretch factor on the capital program
6
would not result materially in a change in our behaviour
7
towards how we executed that capital program.
8
9
MR. MILLAR:
Do I take that to mean that -- well,
you're -- I think you're proposing there be less incentives
10
for productivity under custom IR than under IRM, in that
11
you're not applying the stretch factor to everything?
12
Would that be a fair way to characterize it?
13
taken your answer as to why you think that's appropriate,
14
but that's the ultimate outcome of your proposal; is that
15
fair?
16
MR. FRALICK:
And I have
No, I think there are unique risk
17
challenges on the nuclear side that are also relevant here
18
compared to hydroelectric, so for example, where
19
hydroelectric has variance accounts to address certain
20
unknown risks, and rightfully so, nuclear, on the other
21
hand, is strictly 100 percent variable.
22
So it's risk exposure, risk profile, is materially
23
different than what it is on the hydroelectric side,
24
notwithstanding the technology differences and the risk
25
associated with nuclear risks as opposed to hydroelectric,
26
and that's gone into in great detail in our Concentric
27
cost-of-capital report, attachment 12C2
28
MR. MILLAR:
Okay.
C1-1-1.
But you're not without protection
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
141
1
on the nuclear side.
2
the nuclear side.
3
MR. FRALICK:
4
MR. MILLAR:
6
we will discuss.
Well, there is the midterm review, which
7
MR. FRALICK:
8
MR. MILLAR:
9
MR. FRALICK:
11
We do, but none with regards to
production.
5
10
You have many deferral accounts on
Your proposal -There's none currently in effect.
Okay.
We are seeking that the midterm review,
yes.
MR. MILLAR:
Madam Chair, I just have one or two quick
12
more questions on this area and then it would be
13
appropriate for a break if that's --
14
MS. LONG:
15
MR. MILLAR:
16
Yes.
Okay.
Are you familiar with the Toronto
Hydro custom incentive regulation decision?
17
MR. FRALICK:
18
MR. MILLAR:
At a high level.
Okay.
I reproduced a page of it from --
19
page 25 of the compendium, and I don't have much of a
20
question here other than to point out at least in that case
21
the Board was resistant to the idea of excluding capital
22
from the stretch factor in a custom IR.
23
You've already given many reasons why you think OPG
24
shouldn't have a stretch factor applied to capital.
25
there anything you want add in light of the Toronto Hydro
26
decision?
27
28
Is
I just thought I'd put it to you, in fairness.
MR. FRALICK:
I think exploring the portfolio
management approach, as I discussed with panel 3, would be
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
142
1
helpful to further understand how that portfolio is managed
2
to the view of stretch factor not being meaningful
3
incentive, if it were to be applied on that.
4
the point that distributors, their capital program is
5
discretely different from nuclear.
6
faces very significant safety and regulatory requirements,
7
training requirements that is are indeed incremental to
8
what the distributors would face.
9
I reiterate
The nuclear industry
And thirdly, our rate design, again going back to the
10
fact that it's a 100 percent variable rate design.
11
a distinct difference for OPG relative to the distributors.
12
MR. MILLAR:
That is
Finally on this point, let's imagine the
13
Board was inclined to consider a stretch factor on capital.
14
Its a not always obvious how that would work.
15
there's two ways that leap to mind for me.
16
I guess
One would be you could use the stretch as an offset to
17
the revenue requirement impact of new capital spend over
18
the test period.
19
straight offset to the capex number itself.
20
Or alternatively, you could use it as a
Do you have any thought -- I know this isn't in your
21
proposal, but if the Board wanted to go that way, do you
22
have any thoughts on what the best way to implement that
23
would be?
24
MR. FRALICK:
25
MR. MILLAR:
26
27
28
We have not turned our mind to that.
Madam Chair, would this be an appropriate
time for a break?
MS. LONG:
It would be, yes.
We'll break for 15
minutes.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
143
1
--- Recess taken at 3:02 p.m.
2
--- On resuming at 3:20 p.m.
3
MS. LONG:
4
MR. MILLAR:
5
I have some questions now about your proposed nuclear
Mr. Millar, are you ready to continue?
Yes, I am.
Thank you, Madam Chair.
6
annual reporting.
7
established a number of reports and measures that OPG would
8
be required to file on an annual basis in the 2010-0008
9
proceeding?
10
MR. PUGH:
11
MR. MILLAR:
12
And you will recall that the Board
That's correct.
And essentially you propose to continue
filing this material throughout the test period.
13
MR. FRALICK:
14
MR. MILLAR:
Yes.
Can I ask you to turn to page 27 of the
15
compendium.
16
propose to report on?
17
MR. FRALICK:
18
And I think you've listed here the things you
That's correct, yes.
That's out of
A132, yes.
19
MR. MILLAR:
Yes, that's right.
20
Could I ask you to flip the page to page 28.
Is this
21
the format you would be filing in, in other words, showing
22
quartiles, or would it just be the raw numbers?
23
MR. FRALICK:
24
MR. MILLAR:
25
I'm not sure.
If I told you Staff's preference would be
for quartiles would you have an opinion on that?
26
[Laughter]
27
MR. PUGH:
28
MR. MILLAR:
We would be happy to help.
Okay.
Thank you.
And in terms of -- we
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
144
1
see here things are broken out by Pickering and Darlington.
2
Is it your proposal to continue reporting on that basis?
3
MR. FRALICK:
4
MR. MILLAR:
Yes.
Would you be willing to file -- we'll get
5
into this in benchmarking, but the three key metrics are
6
generally thought to be total generating cost, the WANO
7
nuclear performance index, and the UCF, the unit capability
8
factor.
9
10
11
12
Would you be willing to report those on a company-wide
basis, an OPG-wide basis?
MR. FRALICK:
Well, on a company-wide basis -- you
mean you're referring to nuclear only --
13
MR. MILLAR:
14
MR. FRALICK:
15
MR. MILLAR:
16
MR. FRALICK:
Yes --- I'm assuming.
That's right, nuclear.
I'm not sure how we break that down.
17
would have to talk to panel 3 about the specifics of how
18
they calculate their metrics.
19
20
21
22
23
MR. MILLAR:
Okay.
We
If that's practical is there an
objection to filing that?
MR. FRALICK:
We don't -- if it's practical we don't
have an objection.
MR. MILLAR:
Okay.
Thank you.
If we can turn to
24
pages -- or page 31 of the compendium.
You'll see at the
25
top of the page you propose to file what are called
26
normalized numbers.
27
normalized, but I think for reporting purposes you propose
28
to file normalized numbers, or do I have that right?
You calculate normalized and non-
Maybe
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
145
1
you haven't said how you plan to report?
2
question is, are you filing normalized or non-normalized
3
for Darlington?
4
MR. FRALICK:
I guess my
Yeah, just looking down at line 8 there.
5
We are proposing to compare Darlington's TGC on a
6
normalized basis.
7
MR. MILLAR:
Okay.
And I apologize to the Board
8
Panel.
We haven't gotten into exactly what normalized
9
means, but just for the purposes of our discussion here
10
today it's a mechanism you've developed to sort of correct
11
for the fact that Darlington will be under refurbishment
12
for essentially the entire test period, and you've adjusted
13
the denominator to reflect that.
14
MR. FRALICK:
Yeah, that's right.
So the extent to
15
which Unit 2 is out of service now, it would be
16
contributing -- expected to contribute a certain amount of
17
megawatt hours in a given year.
18
It's not, so we would add that back into the denominator.
It's on refurbishment.
19
Now, it's not a perfect correction to adjust on a
20
benchmarking basis, but it's something that we're proposing
21
that's easy to do.
22
MR. MILLAR:
Understood.
And we'll get into the
23
details of that more with panel 3, I believe, but for
24
reporting you propose to file normalized numbers?
25
MR. FRALICK:
26
MR. MILLAR:
27
28
Yes.
Do you have an objection to filing
normalized and non-normalized?
MR. FRALICK:
No.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
146
1
MR. MILLAR:
Okay.
Thank you.
If we look at page 33
2
of the compendium, you propose to file your targets for the
3
coming year?
Do you see that at the very top?
4
MR. FRALICK:
5
MR. MILLAR:
Yes.
Is there any opposition to providing as
6
well the variance between your last target and actuals?
7
other words, in 2018 -- when 2019 comes you'll have actual
8
figures for 2018, but you'll also have what your target had
9
been for 2018.
I'm wondering if there is any opposition to
10
filing the delta between what you predicted and what your
11
actuals were?
12
MR. FRALICK:
I don't believe so.
Subject to any
13
issues that panel 3 would have.
14
But again, without any principal reason to object we
15
wouldn't have one.
16
MR. MILLAR:
They have got the numbers.
And is the reporting going to be done on
17
a year-by-year or an annual basis or on a rolling average
18
basis?
19
MR. FRALICK:
The reporting would be done on an annual
20
basis.
21
based on rolling average data.
22
benchmark works within the ScottMadden methodology.
23
However, the metrics, where indicated, would be
MR. MILLAR:
And that's how the
With respect to the timing of this, maybe
24
you can help me with this.
25
the test period.
26
your 2017 numbers?
27
MR. PUGH:
28
In
Let's look at the first year of
For 2017, when would you expect to file
Your annual report for 2017?
If the purpose is going to be to include
benchmark quartile data, that may take some time.
We'll
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
147
1
probably have the actuals early in the year.
2
on the benchmark that's coming from ECG or from WANO, that
3
might take several months into the next year to have that
4
comparator.
5
6
7
MR. MILLAR:
But depending
Yeah, that's what I understood.
the raw data earlier than the quartile data?
MR. MAUTI:
That's definitely true.
And I'm not
8
exactly sure when the WANO data for some of your
9
operational measures would be available.
10
We get
MR. MILLAR:
And I guess we'll see how this shakes
11
out, but assuming that there is a significant delay between
12
those two numbers being available, is there any opposition
13
to filing the raw data first and then updating it with the
14
quartiles when that comes in?
15
16
17
MR. MAUTI:
Again, principally, no, it's just, it's a
matter of when those data points are available.
MR. FRALICK:
For example, we filed the 2016
18
ScottMadden benchmarking report as an attachment to an IR,
19
so that was in the October time frame, so it's quite some
20
time through the year before that ScottMadden methodology
21
would be complete.
22
MR. MILLAR:
Yeah, that's why I was asking, because I
23
understand the raw data is available much earlier than
24
that, and I think Staff wants the quartiles, but we don't
25
necessarily want to wait eight months or whatever the time
26
period may be.
27
Thank you.
28
But I think we understand each other.
So I'll move on to my next area, which is the midterm
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
148
1
review.
2
of the compendium.
3
And in that light perhaps we could turn to page 36
Yes, thank you.
And just to frame this issue to remind us what we're
4
talking about, your proposal is that a review be conducted
5
at the midterm of your test period, and the purpose of that
6
review will be limited to updating your nuclear production
7
forecast plus the clearance of your year-end 2018 balances
8
for certain DVAs; is that right?
9
MR. FRALICK:
Yes, just to be clear, the midterm
10
review in terms of updating the production forecast is
11
separate and distinct from the clearance of the deferral
12
and variance accounts.
13
MR. MILLAR:
14
MR. FRALICK:
Okay.
So in other words, if the midterm review
15
is not ultimately accepted, we would still intend to file,
16
to clear our deferral and variance accounts --
17
MR. MILLAR:
18
MR. FRALICK:
19
MR. MILLAR:
20
MR. FRALICK:
22
MR. MILLAR:
But if your proposal is accepted as
Yes.
And the review would take place sometime
in the first half of 2019?
24
MR. FRALICK:
25
MR. MILLAR:
26
-- at this time.
filed, this would all be one proceeding?
21
23
That's helpful.
That's what we're proposing, yes.
So it would apply to the first two-and-a-
half years of the test period.
27
MR. FRALICK:
28
MR. MILLAR:
That's right, yes.
Okay.
So it's DVAs in the production
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
149
1
forecast.
2
historically you've had some difficulty in meeting your
3
production forecast?
4
If we turn to page 40, it's fair to say that
MR. FRALICK:
As outlined in chart 2 and further
5
explained below, yes, we have had challenges meeting our
6
production targets.
7
MR. MILLAR:
And in fact since -- from 2008, 2015, I
8
don't think you ever hit your -- first of all, neither the
9
Board-approved production forecast or indeed your own
10
applied-for production forecast, although it's been pretty
11
close in some years.
12
MR. FRALICK:
13
MR. MILLAR:
That is correct.
And if we flip back to page 37 of the
14
compendium, you list a number of factors here starting at
15
the bottom of page 37, that make forecasting your
16
production over a five-year term difficult; you present
17
some challenges.
18
So I would like to go through those with you.
19
first is the risk of public policy changes; do you see
20
that?
21
MR. FRALICK:
22
MR. MILLAR:
23
24
The
I see that.
Is there anything new there?
I read
through it.
MR. FRALICK:
No.
It's just inherent risk something
25
in the realm of public policy could occur that we have not
26
currently anticipated, and that would have an impact on
27
production.
28
MR. MILLAR:
The reason you're seeking an ability to
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
150
1
update the production forecast in this case -- not to put
2
words in your mouth, but I assume the five years is the
3
problem here.
4
that would be less of a risk?
5
If this was one or two year test period,
MR. FRALICK:
Yes, thanks for that.
We have
6
historically set our nuclear production forecast in rates
7
on, at most, two-year basis and this would see us setting
8
rates on 30 months at the outset, and then re-setting that
9
again for the second 30 months.
10
11
12
So it would still be an extension of what we have
historically set our production forecast on, but yes.
MR. MILLAR:
Okay.
Similarly, if we flip to page 38,
13
items IV and V, regulatory requirements and approvals and
14
ageing facilities, this is all steady state, right?
15
is nothing particularly new in this application that we
16
wouldn't have seen in previous applications.
17
have always been around?
18
MR. FRALICK:
There
Those risks
We have faced regulatory uncertainty.
19
Given the state of Pickering's endeavours and Pickering
20
standard operations, and then leading into Pickering end of
21
commercial operations, we know there is a particular
22
regulatory requirement that we're going to have to meet, so
23
there could be some risks associated with that that we
24
today don't foresee.
25
MR. MILLAR:
Sure.
But that would have been true of
26
your last application as well.
27
difference here is the length of the forecast.
28
MR. FRALICK:
I guess the chief
The length of the forecast, yes.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
151
1
MR. PUGH:
And I think for the ageing facilities as
2
you get closer to the end of your life.
3
consultation here with respect to incentive regulation,
4
they talked about the ageing curve being an S-curve, and as
5
you get towards the end of your life, you have a lot more
6
variability in your production.
7
MR. MILLAR:
When we had a
Sure, but you've identified different
8
risk categories for both Pickering and Darlington, so I
9
assume those would be captured under those headings.
10
MR. PUGH:
Certainly the ageing facilities would be
11
more particular to Pickering, as it nears the end of its
12
life.
13
MR. MILLAR:
Let's talk about Pickering.
You see that
14
at the bottom of page 37 and the top of page 38, one of the
15
risks you highlight is Pickering extended operations and
16
you state -- this is again at the very bottom of page 37:
17
"Canadian Nuclear Safety Commission approval is
18
still required and as discussed elsewhere in the
19
application, OPG has not yet completed work
20
necessary to confirm that the Pickering units
21
would be fit to operate beyond 2020."
22
23
So that's a risk you identify with your production
forecast?
24
MR. FRALICK:
25
MR. MILLAR:
It is, yes.
Let's flip to page 41 of the compendium.
26
This is a press release issued by OPG on January 11th of
27
2016.
28
it states a quote from Mr. Lyash:
And if you look down to the second last paragraph,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
152
1
"Our technical work shows that Pickering can be
2
safely operated to 2024, and that doing so would
3
save Ontario electricity customers up to
4
600 million dollars, avoid 8 million tons of
5
greenhouse gas emissions, and protect 4500 jobs
6
across Durham Region."
7
Mr. Lyash appears to be fairly confident here that the
8
plant will operate 2024.
9
and/or contrast that with what I've just read you about
10
Pickering.
11
12
I'm wondering if you can compare
MR. FRALICK:
If you read the very last sentence
at the bottom:
13
"Any plan to extend Pickering's life would
14
require approval of the CNSC."
15
So that's the only thing we are referring to.
16
MR. MILLAR:
17
18
well.
It was caveated in that press release as
That's fair enough.
If we go back to your list of risk factors, this time
19
page 38 of the compendium, the last one is the execution of
20
the Darlington refurbishment program.
21
highlighted risks around whatever delays there may be would
22
have a significant impact on your production forecast.
23
that fair?
24
MR. FRALICK:
25
MR. MILLAR:
It could, yes.
Right.
And again you've
Is
It could go either way.
If we go to page 42 of the
26
compendium, I don't know if this is the same press release,
27
but it was issued the same day.
28
OPG, and in the very first paragraph:
It's a press release from
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
153
1
"OPG is well positioned to deliver the DRP on
2
time and on budget.
3
world's top performing nuclear stations.
4
put in years of detailed planning,
5
of the art training facility, assembled an
6
excellent team and partnered with top companies
7
from across Ontario."
8
9
Darlington is one of the
We've
built a state
This press release -- I know it's a not regulatory
document, but it doesn't highlight any -- you seem fairly
10
confident here that everything is going to go well with the
11
DRP.
12
MR. FRALICK:
We've just heard five and a half days of
13
testimony with regard to the Darlington refurbishment
14
program and the complexities associated with that, the
15
risks associated with it the P90 considerations.
16
I won't rehash all of that, but there is a significant
17
amount of risk associated with the execution of this
18
project.
19
nothing short of misleading.
20
And to portray that this is a done deal would be
MR. MILLAR:
Okay.
I agree with you; we've heard
21
plenty about the risks of Darlington over the past couple
22
of days, so I won't ask any more on that.
23
However, if there is a delay in restarting Unit 2,
24
this would have a very significant impact on your
25
production forecast in 2020 and 2021?
26
MR. FRALICK:
Potentially.
You'd have to run
27
different scenarios because as Unit 2 delays, then the Unit
28
3 start would delay, and Unit 1 at the back end may push
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
154
1
off into the next term.
And there's these warranty outages
2
on Unit 2 that play into the mix here.
3
So the actual production impact varies and is very
4
dependent upon just how much and what direction the DRP
5
changes by.
6
MR. MILLAR:
That's a fair comment.
Certainly there
7
are scenarios where it could have a very significant on
8
your production forecast?
9
10
11
MR. FRALICK:
MR. MILLAR:
MR. FRALICK:
13
MR. MILLAR:
15
How would it work in the other direction
that would increase production forecast?
12
14
In either direction.
If it was done early.
Wouldn't you be shutting down Unit 3
early?
MR. FRALICK:
You would, but then you'd be -- there
16
would other outages that play into the mix.
As I said, I
17
don't want to get into the scenarios here in a
18
hypothetical, but we could look at a given scenario, and
19
have looked at some of these where if it's early by this
20
much or late by that much.
21
There's many moving parts is the bottom line.
22
MR. MILLAR:
That's fair enough.
The midterm review;
23
you are proposing to -- outside of a DVA analysis, you're
24
proposing to adjust your production forecast only, and you
25
are not proposing to have any look at revenue requirement;
26
is that right?
27
MR. FRALICK:
28
MR. MILLAR:
That is correct.
Yes.
And if I look at page 38 of the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
155
1
compendium, the page we were already on, do I understand if
2
you look starting around line 23, that its a your view that
3
-- well, I'll just read it:
4
"Subject to the OEB concluding that rates are no
5
longer just and reasonable pursuant to the Act,
6
the regulation does not entitle the OEB to
7
revisit those approved revenue requirement
8
amounts during the five years."
9
10
11
And then you go on to say there is no such limitation
for production.
So do I understand you to be suggesting that the
12
regulation prevents the Board from reviewing the revenue
13
requirement after it's been set in this proceeding?
14
MR. FRALICK:
Yes, that's our interpretation of the
15
regulation.
16
requirements for five years.
17
It requires that the Board establish revenue
MR. MILLAR:
Now, in your adjustment of the production
18
forecast, imagine we do as you've proposed.
As a midterm
19
review, you adjust the production forecast.
You're also
20
proposing to make consequential adjustments to your fuel
21
costs?
22
MR. FRALICK:
We are indeed, and we're doing that
23
fundamentally because the fuel is an absolutely direct
24
marginal cost, and any fluctuation in production forecast
25
would have a direct impact on fuel cost and, quite frankly,
26
it would be wrong for us to not update for fuel cost.
27
28
MR. MILLAR:
I understand the rationale behind it.
But is fuel cost an O&M expense?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
156
1
2
MR. FRALICK:
I believe that's where it's captured,
yes.
3
MR. MILLAR:
It's part of revenue requirement?
4
MR. FRALICK:
5
MR. MILLAR:
It is part of revenue requirement, yes.
In your view, is there a carve-out in the
6
reg that allows for adjustments to revenue requirement if
7
they're related to fuel costs?
8
9
MR. FRALICK:
It was a principal position we've taken
with regards to the fact that fuel is a direct marginal
10
cost, and we felt it would be wrong for us to exclude that
11
from an update on production.
12
MR. MILLAR:
Okay.
It would be disingenuous.
Let's imagine that there is some
13
type of problem with Unit 2, it's delayed for some reason
14
-- and I take your point that that doesn't necessarily
15
result in a lower production forecast.
16
scenario where that does happen.
17
But let's imagine a
So you find two years in that your production forecast
18
is too high.
19
have the production forecast lowered.
20
obviously the ultimate impact of that would be to raise
21
payment amounts, is that fair?
22
So you come to the Board and you apply to
MR. PUGH:
If that happened,
The actual impact of that would be recorded
23
in a variance account that we proposed -- I think you have
24
it in the compendium.
25
midterm review variance account.
26
MR. MILLAR:
But it would be recorded in the
That's right.
So it goes into a variance
27
account, but ultimately that would serve to increase
28
payment amounts.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
157
1
MR. PUGH:
2
MR. MILLAR:
Once it's cleared.
Yeah.
You're right that it wouldn't
3
happen at the review, but at some point that -- those
4
monies would be recovered from ratepayers.
5
MR. PUGH:
If the Board approved a lower forecast to
6
reflect that, then that would be the implication of it,
7
yes.
8
9
MR. MILLAR:
Okay.
But in your view the Board is not
able at the same time to update the revenue requirement to
10
reflect the fact that Unit 2 is not in rate base, that
11
there may be different O&M costs associated with that.
12
That would be outside of the scope of the review in OPG's
13
proposal.
14
MR. PUGH:
15
MR. MILLAR:
That's correct.
Similarly, let's imagine a scenario where
16
you don't get CNSC approval for Pickering beyond 2020.
17
would -- in that scenario you would come in to seek to
18
adjust your production forecast downwards?
19
MR. FRALICK:
You
I think in the event of something as
20
dramatic as that to OPG's plans we would be coming into the
21
Board in any event.
22
MR. MILLAR:
Is that because it would trigger the 300
23
basis points off-ramp, or is there some other reason you'd
24
be --
25
MR. FRALICK:
Well, similar to what we've said in GEC,
26
I think 464, whereas in the event that an off-ramp is
27
triggered we would come back to the Board, that's not part
28
of an application cycle or part of the midterm review
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
158
1
2
proposal.
But that is -- it would be a very significant event
3
that would fundamentally change the outlook on the company,
4
and we would come back to the Board and seek direction in
5
that event.
6
MR. MILLAR:
Okay.
I was going to save my off-ramp
7
questions, but you've brought it up.
So I had understood
8
you to say that the reg prevents the Board from adjusting
9
revenue requirement, and I'm trying to square how that
10
would mesh with the idea of off-ramp.
An off-ramp would
11
require a review of the revenue requirement.
12
And I understood you to say the rate prevented that,
13
so I just, I want to understand why it's okay if there is
14
an off-ramp.
15
MR. FRALICK:
Are you referring -- like, in my
16
previous description of off-ramp, it was as the -- in the
17
context of DRP, in that language.
18
are you referring to off-ramps within the context of the
19
RRFE?
20
MR. MILLAR:
When you say off-ramp
Well, OPG's proposal in this case for
21
nuclear is, there is an off-ramp if your earnings are plus
22
or minus 300 basis points --
23
MR. FRALICK:
24
MR. MILLAR:
Okay.
-- off the forecast.
That's the off-ramp
25
I'm talking about.
And I guess I wanted to see how this
26
squared with your assertion that the regulation does not
27
allow the Board to revisit the five years of revenue
28
requirement once it has set that for this proceeding?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
159
1
MR. FRALICK:
In terms of the applicability of the
2
off-ramp, OPG is not seeking unique treatment with regards
3
to how an off-ramp would work as a mechanism under any
4
incentive regulation.
5
MR. MILLAR:
I understand that.
And if this is a
6
matter for argument, that's fine.
7
position to be that you can't change revenue requirement
8
after it's been set in this proceeding because of the
9
regulation.
10
11
But I understood OPG's
There is no similar regulation for anybody
else.
So I just wanted to understand how there could be off-
12
ramps if the regulation permitted adjustments to revenue
13
requirement.
14
MR. SMITH:
I think this may be a matter of argument.
15
I mean, it will obviously depend on the overall caveat as
16
to whether or not the Board determines under section 78.1
17
the resulting rates are just and reasonable, Mr. Millar.
18
MR. MILLAR:
19
answer might be.
20
OPG's room (sic) that there is an absolute prohibition on
21
any adjustments to revenue requirement after it sets rates
22
through this proceeding.
23
actually say that.
24
Well, and that's what I expected the
So I take it that it's OP -- it's not
Certainly I don't read the reg to
But as you fairly pointed out in your application --
25
you do say subject to the OEB concluding that rates are no
26
longer just and reasonable, so maybe we're talking
27
ourselves into a circle here, but I don't read that to say
28
that once the OEB sets just and reasonable revenue
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
160
1
requirements for five years it is forbidden from ever
2
looking at that again.
3
MR. SMITH:
Does OPG agree with that?
I think the fairest articulation of the
4
position is the one that's at page 38 of your compendium,
5
set out at line 23.
6
7
MR. MILLAR:
All right.
to argument.
8
All right.
9
production forecast.
10
Well, we can leave the rest
compendium.
Just let me get back to forecasting, your
Could we go to page 39 of the
So at about line 9 you state:
11
"In general it is more difficult to forecast
12
events further into the future.
13
increases further when the subject matter of the
14
forecast is inherently certain."
15
16
This difficulty
And I think that's what you were speaking to earlier,
Mr. Fralick; is that right?
17
MR. FRALICK:
18
MR. MILLAR:
Yes.
So no doubt there are risks in predicting
19
the production forecast out five years.
20
you, though, is, you seem to be very comfortable in
21
forecasting your revenue requirement out for five years.
22
Why is that easier to predict than your production
23
forecast?
24
MR. FRALICK:
My question to
Not to be facetious, but I don't think
25
we've said anywhere that we're comfortable with forecasting
26
our revenue requirement out five years.
27
is put an application before the Board which is -- has
28
endeavoured to match the Board's intentions and directions
What we have done
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
161
1
with regards to OPG's regulatory construct and framework
2
for the next five years, so it's a custom incentive
3
regulation for nuclear and an IRM for hydroelectric, and
4
we've only sought to apply changes where it's appropriate,
5
and in the case of the midterm review, that is a very
6
significant area of risk for the business.
7
highlighted on chart 2 and F -- E211 that it has been a
8
historical challenge for us.
9
production forecast window from 24 to 30 months in this
You've rightly
We are increasing our
10
proposal.
11
unparalleled state of the nuclear life cycle that we're in
12
within OPG, both at Darlington and at Pickering, we feel
13
that it's not an unreasonable request to come in and seek
14
to update the nuclear production forecast, given the fact
15
again that we have a 100 percent variable rate design.
16
We are accepting some risk.
MR. MILLAR:
Given the
And I apologize if I put words in your
17
mouth.
I didn't mean to do that.
18
suggest that OPG had said it was easy to forecast revenue
19
requirement out five years, but when we went through the
20
list of risk factors that you'd identified for production
21
forecast, the five factors, is it fair that those apply
22
equally to the forecasting of revenue requirement?
23
MR. FRALICK:
24
MR. MILLAR:
And I didn't mean to
Sorry, what page was that again?
That is on page 37 and 38 of the
25
compendium.
26
these would all apply to revenue requirement as well?
27
28
I mean, generally speaking, it seems to me
MR. FRALICK:
I mean, they would have different
impacts, but I think they would all be considerations that
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
162
1
would have to be taken into account in terms of the
2
revenue-requirement impact.
3
MR. MILLAR:
They could.
You've proposed -- we discussed -- you're
4
proposing a deferral account, the nuclear production
5
variance account.
6
tracked, assuming the Board found there were any
7
differences?
8
MR. PUGH:
9
MR. MILLAR:
That's where these differences would be
Midterm account, yes.
Yes, sorry, the -- yeah, the midterm
10
nuclear production -- I might have described it wrong, but
11
it's going into a variance account?
12
MR. PUGH:
13
MR. MILLAR:
It is.
Does that variance account actually have
14
to be made now -- there wouldn't be any entries until after
15
the midterm review; is that fair?
16
MR. PUGH:
That's fair.
17
MR. MILLAR:
18
MR. FRALICK:
19
MR. MILLAR:
Okay.
That's correct, yes.
And finally, I don't know if you'll be
20
able to answer this question or not, but I'll put it to you
21
so I don't lose it.
22
regulation on rate smoothing, and it now appears to
23
incorporate DVA balances and the Board's consideration of
24
how to smooth.
25
MR. PUGH:
26
MR. MILLAR:
There have been some updates to the
Are you familiar with that?
Yes.
And you'll be proposing, if your proposal
27
is accepted, you'll be looking to clear DVA balances as
28
part of the midterm review.
And I just want to know if
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
163
1
you've given any thought to whether the regulation will
2
impact that any way, would it include a proposal for
3
smoothing of those amounts, or if the regulation -- if
4
you've had any thought about that?
5
MR. FRALICK:
Yeah, in our interpretation of the
6
regulation we understand that the consideration of deferral
7
and variance accounts for hydroelectric and nuclear would
8
be utilized in the determination of the smoothing of the
9
nuclear payment amount in a major application, so -- and
10
where we are now for the next five years.
11
When we come in the midterm to seek clearance of the
12
deferral and variance accounts, as I understand the Board
13
has mechanisms to consider with regards to the overall
14
impact that any of those riders could have on customers, be
15
that spreading the disposition over a longer period of time
16
or whatnot.
17
18
19
So I don't believe that the regulation is at all in
conflict with that.
MR. MILLAR:
And I wasn't suggesting it was in
20
conflict.
21
regulation result in changes in the way that you present
22
the DVA balances for clearance, and if this is a better
23
question for the rate smoothing panel, or if you don't know
24
yet, that's fine.
25
thought to that.
26
27
28
I guess my question was more, will the new
MR. PUGH:
I just wondered if you had given any
First of all, I do think it's a better
question for the rate smoothing panel.
MR. MILLAR:
Okay.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
164
1
2
MS. LONG:
Mr. Fralick, are you on the rate smoothing
panel?
3
MR. FRALICK:
4
MS. LONG:
5
MR. FRALICK:
6
With additions?
Yes, Lindsay Arsenault is also on that
panel with us.
7
MR. SMITH:
8
MS. LONG:
9
We all are.
There is an addition, yes.
And the mechanics of how this is all going
to work are going to be --
10
MR. SMITH:
11
MS. LONG:
Filed tomorrow.
-- explained to us.
I'm waiting with bated
12
breath.
13
and you'll take us through this?
14
lot of questions about the actual mechanics of this are
15
going to work in the context of what we've talking about
16
now.
17
18
19
But I understand it's going to be filed tomorrow,
MR. SMITH:
You understand we have a
I understand there will be many questions
about this.
MR. FRALICK:
In an effort to be responsive in our
20
impact statement, we have -- we will be including a number
21
of interrogatories that we will be updating because a
22
number of scenarios were requested.
23
24
25
So we hope that that will be illustrative of the
impact of what the new rate smoothing proposal will do.
MR. SMITH:
To be clear on that, there were IRs asked
26
on the last methodology.
We've updated all of those.
They
27
are attachments -- they will be attachments to the evidence
28
that's being filed tomorrow.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
165
1
MS. LONG:
I don't want to derail Mr. Millar's cross-
2
examination here, but have you, Mr. Smith, had any contact
3
from any other intervenors who are looking to delve deeper
4
into what's filed as of Wednesday?
5
I guess we can deal with it on Thursday, based on
6
what's filed, whether or not you anticipate that there will
7
be more interrogatories asked, or these updated
8
interrogatories may be sufficient.
9
10
I guess we'll hear from people on Thursday or Friday,
once they've had a chance to review the material.
11
MR. SMITH:
12
MR. MILLAR:
We have not had any contact, no.
Thank you, Madam Chair.
I'm actually
13
finished with my cross-examination, so thank you very much,
14
panel.
15
16
17
MS. LONG:
Mr. Tolmie?
Do you have some questions for
this panel?
MR. TOLMIE:
I had submitted a compendium.
But in the
18
interests of getting on with the job and shortening the
19
time, I would like to simply respond to your invitation to
20
bring up the storage issue for this particular panel, if
21
that's okay.
22
MS. LONG:
You can pose a question.
I don't know what
23
the question is, and I don't know if this is the proper
24
panel to answer it.
25
we'll see what it is.
But you can ask your question and
26
CROSS-EXAMINATION BY MR. TOLMIE:
27
MR. TOLMIE:
28
What we discussed earlier today is the
concept that the base load generation currently exceeds the
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
166
1
actual demand for power on average in Ontario, and that's
2
giving rise to problems right now.
3
If you look at the price record over the past several
4
years, there have been many occasions in which the price
5
has gone negative.
6
exceeding the demand, right?
7
MR. FRALICK:
8
MR. TOLMIE:
That indicates that the supply is
Yes.
Okay.
But every day of the year for many
9
years now, the night time price for electricity has gone to
10
a very low value, typically close to zero, is that correct?
11
MR. FRALICK:
I wouldn't be able to speak with
12
authority with regards to the trend in the HOEP.
13
that it varies quite a bit.
14
What it is on a given day, or its trend, I don't know if I
15
could speak with any specificity.
16
panel could.
17
not experts in.
18
19
I know it's not a high number.
I don't know if any OPG
That's an IESO type of an area that we are
MR. TOLMIE:
You're aware, though, that it goes
through a big trough every night?
20
MR. FRALICK:
21
MR. TOLMIE:
22
I know
Certainly.
Okay.
And OPG gets paid per megawatt
hour of energy actually delivered, is that correct?
23
MR. FRALICK:
24
MR. TOLMIE:
That's correct.
Okay.
Now, if you look at the numbers
25
that come from IESO, the surplus generation over average
26
demand is something like 43 hundred megawatts.
27
quite a bit.
28
That's
But if you look at what's happening with the policies
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
167
1
in Ontario, they're trying to reduce the consumption of
2
fossil fuels in particular, and those fossil fuels are
3
being used to heat homes.
4
-- most of the cooling of that comes from the electricity.
5
So if the government and industry succeed in reducing
And part of the heat and cooling
6
the demand for electricity for heating purposes, the
7
potential is to the order of 5700 megawatts, which brings
8
up the possibility that you may be facing a deficit of
9
demand over supply of around 10,000 megawatts in the not
10
too distant future.
11
demand for a lot of the power that you're committing to
12
produce; is that possible?
13
MR. FRALICK:
14
MR. TOLMIE:
15
MR. FRALICK:
16
17
18
MR. TOLMIE:
20
MR. TOLMIE:
23
24
Is it significant if it's possible?
Is it significant if it's possible?
Would that have an impact on your revenue
then?
MR. FRALICK:
22
I don't know.
10,000 megawatts is significant.
19
21
In other words, there would be no
I don't know.
Would it have an impact on the
appropriate rate setting for this Board to determine?
MR. FRALICK:
That level of change in provincial
demand has not been reflected in our application.
MR. SMITH:
Madam Chair, I simply ask for guidance.
25
don't know what to do with Mr. Tolmie's question, other
26
than these seem like broad system planning questions.
27
don't have a witness panel to address them.
28
-- nor do I think, frankly, OPG is the right party to
I
We
If there are
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
168
1
2
address them.
To the extent we want Mr. Tolmie to ask the questions,
3
there is an IESO witness.
I don't want that person to be
4
put on the spot.
5
we can say when we have certain evidence responsibilities
6
that are outlined in the schedule that we talked about at
7
the outset of this.
But on the other hand, I don't know what
8
If Mr. Tolmie wants to ask any question about any of
9
the evidence that OPG has prepared, we're certainly happy
10
11
12
13
to take those questions.
MR. TOLMIE:
If it has an impact on the rate, should
it not be something that would be considered by the Board?
MS. LONG:
Mr. Tolmie, I think to the extent you have
14
a question about what this panel is giving evidence on, so
15
if you related your question to production forecast, that
16
is something they can ask answer a question on.
17
18
19
You can ask questions about what they considered in
putting their application before the Board.
That is fair.
But to talk about system wide planning, that's not
20
something that this panel is charged with answering
21
questions on.
22
MR. TOLMIE:
The IESO person that's going to talk
23
about the Pickering system, as I understand, which is
24
really a different --
25
MS. LONG:
The IESO witness, we were very clear in
26
our procedural order that they are going to speak to the
27
analysis they've done, and I'm going to constrain parties
28
to speak about -- to ask questions about what was filed and
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
169
1
not have other scenarios that the witness is going to do
2
system planning on the spot.
That is not the intention of
3
the IESO witness being here.
He is going to speak to that
4
report.
5
MR. TOLMIE:
That was my assumption, so it really
6
doesn't provide an opportunity to raise an issue that I
7
think is fundamental to setting the rate.
8
9
MS. LONG:
Well, this rate hearing may not be the
forum for you to raise the issues you want to discuss.
I
10
want to get back to this witness panel, and whether or not
11
you have any questions to ask them of the evidence they've
12
given and they're responsible for.
13
MR. TOLMIE:
Well, as you suggested, one of the
14
questions is with regard to future projections for demand
15
for your services.
16
MS. LONG:
17
18
So do you have a question related to that,
a specific question that this panel can answer?
MR. TOLMIE:
Does the plan to reduce that demand, by
19
eliminating the requirement for both fossil fuels and
20
electricity for thermal applications, have an impact on
21
your estimates?
22
MR. FRALICK:
Our application has not factored in any
23
significant system demand reductions, or the impact
24
thereof, in the next five years.
25
26
MR. TOLMIE:
That's what I was driving at, that the
production may not be precise.
27
MS. LONG:
Thank you, Mr. Tolmie.
28
MR. RUBENSTEIN:
Mr. Rubenstein?
Thank you very much.
Panel, I have a
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
170
1
compendium of documents, if we can mark that.
2
if the hearing panel has a copy.
3
MR. MILLAR:
4
EXHIBIT NO. K6.4:
5
FOR OPG PANEL 2A(I)
6
MR. RUBENSTEIN:
7
8
9
I don't know
K6.3.
CROSS-EXAMINATION COMPENDIUM OF SEC
Mr. Millar has asked a lot of my
questions, so -MR. SMITH:
Sorry, Mr. Rubenstein's compendium -- are
we at 6.3 or 6.4?
10
MR. MILLAR:
My mistake.
6.4.
11
CROSS-EXAMINATION BY MR. RUBENSTEIN:
12
MR. RUBENSTEIN:
Staff has asked a number of my
13
questions, so I just have some odds and ends I would like
14
to ask you about.
15
here and how you set the structure of this application,
16
specifically the structure of the nuclear side of the
17
business and the payment amounts, and as I understand from
18
the Board's direction you were required to set the
19
hydroelectric assets on an IR framework and the OPG assets
20
on a custom IR framework.
21
well?
22
23
MR. FRALICK:
I just want to go back to the beginning
Is that your understanding as
I'm not sure, when you say OPG assets --
we were required to set --
24
MR. RUBENSTEIN:
25
MR. FRALICK:
Regulate --
-- hydroelectric assets on an IRM
26
mechanism and the nuclear assets, as is stated in the
27
February 17th, 2015 letter:
28
"A longer-term approach to payment amount setting
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
171
1
for the nuclear assets that focuses on the
2
parameters of -- for a multi-year cost-of-service
3
application while incorporating elements of IR."
4
5
MR. RUBENSTEIN:
I'm on page 3.
letter that we're talking about here.
I think I have this
We see this:
6
"The Board expects OPG to develop IR framework
7
for its hydroelectric assets, any custom IR
8
framework for its nuclear assets, based on the
9
principles outlined in the RRFE."
10
MR. FRALICK:
I see that, yes.
11
MR. RUBENSTEIN:
All right.
So you're set -- and your
12
proposal is for the nuclear assets to set them on a custom
13
IR basis?
14
MR. FRALICK:
Yes.
15
MR. RUBENSTEIN:
All right.
And then I just want to
16
understand what that means in your -- from your
17
perspective.
18
and how you've set them on a custom IR basis, is to set
19
them on a five -- to determine your budget for the five
20
years on a five-year cost-of-service basis, and then to put
21
in place the stretch factor on 75 percent of your OM&A.
22
I correct?
23
And my understanding, your proposal to do so
MR. FRALICK:
As it pertains to strictly the cost
24
items and the framework requirements of a custom IR, yes,
25
the cost was on a five-year basis with a stretch factor
26
that will apply to 75 percent of the OM&A.
27
28
Am
MR. RUBENSTEIN:
And Mr. Millar talked to you about
how you determine the stretch factor and why it's only
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
172
1
applied to OM&A, and I just wanted to understand that a
2
little bit better.
3
As I understand for the OM&A perspective you've
4
determined that you should -- it's only appropriate to
5
apply to, I believe it was base OM&A, and -- I forget the
6
term you used.
7
MR. FRALICK:
8
MR. RUBENSTEIN:
9
Corporate support cost.
Corporate support cost, and not for
project OM&A and outage OM&A, correct?
10
MR. FRALICK:
Correct.
11
MR. RUBENSTEIN:
And as I understood your discussion,
12
it was because project and outage OM&A, there is no
13
productivities, further productivities, to be had.
14
MR. FRALICK:
I wouldn't characterize it that way.
I
15
would say that, while we strive to get better at projects
16
and outages over time, because of the fact that they're
17
discrete undertakings, we reflect the best estimate for the
18
cost for that given scope of work within our business plan.
19
MR. RUBENSTEIN:
And so it's your expectation, though,
20
you forecasted in amount, like, for 2017 and 2018 and 2010
21
and so on, so if we look at 2018, you're not going to be,
22
from today until you start doing that work, find any more
23
productivity.
24
MR. FRALICK:
Well, we will continue to look for areas
25
to improve.
With regards to where we are going to be able
26
to find incremental efficiency gains above and beyond what
27
we've outlined in our business plan, we have not yet
28
identified what those are going to be, but out of
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
173
1
necessity, given the fact that the -- where we have applied
2
the stretch factor we will have limitations with regards to
3
identifying costs to that magnitude, we're going to have to
4
look wherever we can in order to come up with the extra
5
savings in order to account for the full quantum of that
6
stretch factor.
7
MR. RUBENSTEIN:
But I just want to talk, because your
8
proposal, as I understood it, is for project and outage
9
OM&A as compared to other OM&A that is covered.
It's not
10
appropriate, and I just want to focus on that.
11
took it, as I understood it, it's because there is
12
something inherently different with that type of work that
13
you won't be able to find more efficiency benefits than may
14
be embedded in that budget.
15
MR. FRALICK:
And as I
Is that correct?
I mean, without restating my testimony
16
with Mr. Millar, yes, we look to apply the stretch factor
17
to the areas of the nuclear cost that were in a steady
18
state that would be subject to efficiency gains.
19
MR. RUBENSTEIN:
So when I look at the chart that Mr.
20
Millar took you to on page 23 of his compendium, I see that
21
for 2018, so this was the first year stretch factor is
22
applied to any amount, if you take a look at the project
23
and outage OM&A, I did about $503 million.
24
that?
Do you see
Line 2 and 3?
25
MR. PUGH:
Yes.
26
MR. RUBENSTEIN:
And so if we applied a stretch factor
27
of your proposed stretch factor of 0.3, I get about one-
28
and-a-half million dollars.
Does that sound reasonable to
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
174
1
you?
2
MR. FRALICK:
It's in the ballpark, yeah.
3
MR. RUBENSTEIN:
So your evidence -- and as I
4
understand is for the $503 million that you plan to spend,
5
you don't think you could find $1.5 million of savings?
6
MR. FRALICK:
What we're suggesting is for the reasons
7
we outlined earlier with our -- some of the compensation
8
restraints, regulatory and safety requirements, and other
9
things that are inherent within the base OM&A where we are
10
applying the stretch factor, we will necessarily be
11
required to look elsewhere in order to come up with that
12
savings.
13
So I'm not saying that we cannot find or won't be
14
looking to get better within those cost categories, but as
15
a category, they are much more discrete, and they do not
16
lend themselves to efficiency gains the way the base OM&A
17
cost category does.
18
MR. RUBENSTEIN:
Okay.
So I think I understand.
The
19
rationale then is more, you don't even think you can get
20
the 0.3 on everything else, the 75 percent?
21
MR. FRALICK:
22
MR. RUBENSTEIN:
23
24
this amount?
Yes.
So then it would be unfair to add in
Is that my understanding?
MR. FRALICK:
The 0.3 stretch factor applied as we
25
have accumulates over the five years and eventually totals
26
$50 million will be a significant challenge for us, yes.
27
28
MR. RUBENSTEIN:
And as I understood the evidence,
capital is also inappropriate to do the stretch factor,
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
175
1
2
correct?
MR. FRALICK:
Yes, for the reasons that I outlined
3
earlier with Mr. Millar.
4
MR. RUBENSTEIN:
And I want to understand, the way
5
that you determined the stretch factor was using the total
6
-- was the total generating cost per megawatt hour.
7
how you determined which cohort you would be in, to
8
determine the 0.3?
9
MR. FRALICK:
That's
Yes, so it's in A132, the methodology,
10
but we took a look at Pickering and Darlington
11
independently, look at their TGC rating, what stretch
12
factor would you apply to Darlington based on its TGC
13
performance, what stretch factor would you apply to
14
Pickering based on its TGC performance, and then we
15
production-weighted those two numbers to come up with an
16
ultimate stretch factor that was reflective of all of
17
nuclear, and in the case of our pre-filed that equals
18
0.3 percent.
19
MR. RUBENSTEIN:
And my understanding about the total
20
generating cost per megawatt hour is that's an all-in.
21
That includes capital cost and OM&A cost, correct?
22
MR. FRALICK:
It is, yes.
23
MR. RUBENSTEIN:
So if we're only applying it to OM&A,
24
why is it not more appropriate to use some form of OM&A
25
costs per megawatt hour, an apples-to-apples comparison?
26
MR. PUGH:
I think it's because the metrics that we
27
have that are benchmarked for the ScottMadden methodology
28
provides a reasonable basis for comparison, and those are
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
176
1
the numbers that are available, are the total generation
2
costs, and because we felt that was a reasonable
3
representation of the company, as we said earlier, that
4
we've actually adopted as a metric for our company, we
5
thought that was a reasonable basis for which to do a
6
comparison.
7
MR. RUBENSTEIN:
Can I ask you to turn to page 21.
8
This is from the benchmarking report -- the updated
9
benchmarking report, the 2016.
Sorry, 21 of the -- and my
10
understanding is you do benchmark on non-fuel operating
11
costs per megawatt hour.
12
Why isn't this the more appropriate benchmark to use?
13
MR. FRALICK:
Fundamentally it is not an appropriate
14
metric to benchmark CANDU plants on, so the fundamental
15
design benefit of CANDU is the fact that you can get away
16
with using cheaper fuel.
17
So the cost trade-off for that is that you have some
18
higher OM&A costs.
19
done and laid out over many years, is on a TGC basis.
20
So the appropriate metric, as we have
MR. RUBENSTEIN:
Sorry, I don't understand.
My
21
understanding is your fuel costs are not included in the --
22
while they're part of the revenue requirement and I guess
23
in some sense they're OM&A costs, you don't -- in the
24
categories in Mr. Millar's table on page 23 you -- it's
25
sort of outside what you consider total OM&A, correct?
26
27
28
MR. FRALICK:
In the benchmarking, it is not included
in the non-fuel operating cost category.
MR. RUBENSTEIN:
I still don't understand why, if
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
177
1
we're now comparing your OM&A costs, why we shouldn't use
2
the more appropriate me metric, which is non-fuel operating
3
cost per megawatt hour.
4
MR. FRALICK:
I'll try to explain myself better.
The
5
benchmarks that we compare ourselves to, which are at the
6
front of this report, are many utilities from across North
7
America, many of which -- most of which are not CANDU.
8
9
10
11
So one of the fundamental design differences of CANDU
compared to a pressurized water reactor or boiling water
reactor is that we can utilize unenriched uranium fuel.
The trade-off in the design is you have higher OM&A
12
costs to enable that technology.
13
trade-off that costs you more on the technology side, but
14
gets you that benefit on the fuel side.
15
So you have a design
So to only extract the one piece of it and then
16
compare is not an apples to apples comparison.
17
why a TGC is an appropriate comparator for CANDU in amongst
18
a peer group that includes others in addition to CANDU.
19
MR. RUBENSTEIN:
So that is
Can I ask you to turn to page 25?
20
You also have a metric fuel cost per megawatt hour.
21
don't we just add up, I would have thought based on your
22
response, the non-fuel operating cost per megawatt hour and
23
The fuel cost per megawatt hour.
24
benefits you’re talking about, about the CANDU reactor and
25
how it has cheaper fuel costs, and you have the issues you
26
believe you have with using non-fuel operating costs, and
27
have all-in OM&A cost per megawatt hour.
28
MR. MAUTI:
So why
And then you have the
I guess one reason the company overall has
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
178
1
adopted a total generating cost in terms of a comparator is
2
within the nuclear industry, the total generating cost
3
takes into account all basically cash expenditures that are
4
required to operate the plant for any given year.
5
In previous proceedings, we looked at our
6
capitalization policies and thresholds about what's
7
considered capital versus O&M.
8
actually sees through all that and actually takes a look at
9
the total cost to operate.
Total generating cost
We believe it's the most
10
appropriate way of an apples-to-apples comparative basis to
11
look amongst all within the industry.
12
So I think for that reason that's why, in terms of
13
standings us up against others, that's probably the most
14
appropriate one too use.
15
MR. RUBENSTEIN:
16
17
18
19
But it includes capital cost which
you are not then applying the stretch factor to.
MR. FRALICK:
Correct.
From a comparison perspective,
the total cost metric is the most appropriate to benchmark.
MR. RUBENSTEIN:
My understanding of the Board's IRM
20
framework and what your -- essentially your proposal with
21
respect to the hydroelectricity is sort of an I minus X
22
mechanism, correct?
23
24
25
MR. FRALICK:
Under hydroelectric, yes, we've applied
an I minus X, yes.
MR. RUBENSTEIN:
And my understanding is the X
26
mechanism that the Board uses and what you're forecast to
27
use for hydroelectric is made up of two parts, a stretch
28
factor as well as industry productivity factor, correct?
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
179
1
MR. FRALICK:
Correct.
2
MR. RUBENSTEIN:
So you were asked at Energy Probe 34
3
-- sorry Energy Probe 2, on page 34, about why you have not
4
proposed a productivity factor for nuclear.
5
your response, essentially the high level -- there’s a lot
6
of work being done on Pickering and Darlington, and thus
7
the historical periods will not be reflective of the
8
future.
9
And as I read
Is that fair?
MR. FRALICK:
That's one of the reasons why.
I think
10
the subject of a total factor productivity for nuclear has
11
been one of significant discussion over the years, as OPG
12
has evolved its regulatory framework.
13
to the Board's EB 2012-0340 report, there is quite a bit of
14
discussion in there about the suitability and applicability
15
of the total productivity study for nuclear.
16
submitted some comments with regards to that report that go
17
to that extent.
18
So if you look back
In fact, SEC
So that report also itself, on page 7, I believe,
19
outlines the fact that a total factor productivity is not
20
appropriate for nuclear.
21
MR. RUBENSTEIN:
If I can ask you to turn to page 36?
22
I want to understand this question from a business planning
23
perspective of how OPG plans its operations.
24
We asked you in SEC number 1 a number of questions,
25
and we were asking you how -- in essence, about any
26
forecast or estimates you've done with respect to a number
27
of different things, but they include price levels when
28
generating becomes unproductive, or your own price levels
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
180
1
2
which potentially customers to exit the system.
And your response was essentially, well, we don't have
3
any of those; we don't have any of those studies.
4
a fair characterization?
5
MR. FRALICK:
Is that
I think OPG prides itself on being a
6
low-cost electricity generator in Ontario.
7
strive to maintain that position through this application.
8
The smoothing mechanism that we will be discussing in
9
And in fact, we
panel 6 is another consideration that will be deployed to
10
minimize the impact of OPG's rates.
11
very challenging time, as you're well aware, with the
12
Darlington refurbishment, so it is a fundamental tenet of
13
OPG’s competitive advantage to retain its position as a low
14
cost provider.
15
MR. RUBENSTEIN:
I understand.
We're going through a
I want to understand
16
from a planning perspective, how do you implement that
17
process where you want to be a low cost provider, you want
18
to ensure you are competitive.
19
20
21
From a planning process, how do you go about making
sure that occurs?
MR. MAUTI:
Can you just give me some insight?
In terms of the cost to operate the
22
facilities we have and the applications we're putting
23
forward to the Board to determine our price position, the
24
IESO has information available and we have groups within
25
Ontario Power Generation that to try to assess where that
26
marketplace is going in comparison to that, and we sort of
27
look at what our weighted average price of our generation
28
is versus the price for other generators in the province.
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
181
1
And historically, we've been some 35 to 40 percent on
2
average overall cheaper than all the other generation
3
within the province.
4
We look at our forecast, and what's happening through
5
our smoothing proposals and through our IRM proposals with
6
hydroelectric, and we still believe that on a forecast
7
basis, we will still continue to be significantly below,
8
somewhere in the 30 to 40 percent, based on our forecast,
9
below other generators.
10
So we do feel that we do have that price mitigation
11
aspect of what we are doing, notwithstanding the fact we're
12
trying to refurbish the nuclear station, which has its own
13
specific pressures on prices as generation comes up and
14
investments are made, and as Pickering approaches its end
15
of life.
16
There are a lot of things obviously happening within
17
the nuclear fleet in the next ten years, and we're trying
18
to navigate through that while being cognizant what our
19
position is in relation to our customers.
20
MR. RUBENSTEIN:
Is that an output of -- sort of the
21
end of the line conclusion based on the planning, so
22
essentially you've forecasted your rates and what you
23
believe you need to operate the plants and so on, and then
24
you've come to the determination that we're still lower
25
than -- we're going to be okay because we're 30 percent
26
lower than other sources, or whatever the number is?
27
that something at the top end in the planning process,
28
where you say we must ensure that we are competitive.
Or is
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
182
1
2
Which one is it?
MR. MAUTI:
Historically, you know where you are
3
within -- it's easy to get the historical information now.
4
IESO publishes enough information and data for you to be
5
able to, at least globally, look at that.
6
forward in terms of our path that we’re taking with our
7
smoothing proposal and IRM, there’s more unknown trying to
8
forecast into the future how the rest of the marketplace
9
and the rest of the generation will play out in the
10
11
And going
province.
We feel comfortable -- not as much as when you are
12
looking backwards historically, but we do feel, based on
13
information available, at the end we would still have the
14
competitive advantage position.
15
MR. RUBENSTEIN:
Let me ask you about the off ramp
16
proposal.
17
the word standard, but it’s generally the usual 300 basis
18
point.
19
20
21
My understanding is it's -- I don’t want to use
MR. FRALICK:
We've not sought any deviation from the
definition of an off ramp in the RRFE.
MR. RUBENSTEIN:
I want to understand what you mean by
22
the -- what's going to happen when you tell the Board.
23
it your view that if you’re plus or minus 300 bases points
24
at the end of the year, you will file something with the
25
Board, or is it simply they will alert you if there is an
26
issue based on your annual triple R filings, or whatever
27
the equivalent is for OPG?
28
MR. PUGH:
Is
We would file on June 30th, which was our
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
183
1
filing requirements in 2010-008, we would file our
2
regulatory ROE and the results would be there, and with
3
that we would advise the Board whether we thought that this
4
was because of a temporary activity, whether it was
5
ongoing, so we would provide them some advice, and then the
6
Board would determine whether they wanted to bring us in
7
for an application, because the RRFE said they may have an
8
application, and therefore we would provide them input in
9
order to do that --
10
MR. RUBENSTEIN:
11
MR. PUGH:
12
MR. RUBENSTEIN:
All right.
-- beyond just the 300 basis point number.
Maybe this is for the smoothing
13
panel, and I -- how is this going to work with the rates
14
being smooth?
What are we comparing 300 basis points to?
15
MR. PUGH:
What are you comparing it to?
16
MR. RUBENSTEIN:
Well, you're deferring -- as the plan
17
goes on you're smoothing, so you're not actually bringing
18
in the revenue that you would need in that year, an amount
19
goes into an account.
20
if there's a -- maybe there is no interaction between the
21
smoothing proposal and the 300 basis points.
22
MR. MAUTI:
Just trying to understand how the --
In the calculation of the regulatory ROE
23
it's based on our net income, and our net income is largely
24
driven on revenue requirement.
25
the amount through rates, think of more of a financing sort
26
of aspect of it.
27
income that would be sort of reporting in each individual
28
year.
The process of smoothing
It doesn't specifically change the net
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
184
1
2
3
4
5
6
MR. PUGH:
That example is drawn out in your
compendium at Board Staff 271.
MR. RUBENSTEIN:
that, and this is on...
MR. PUGH:
The short is -- it's not -- the RSV has
no --
7
MR. RUBENSTEIN:
8
MR. PUGH:
9
10
Yeah, I was going to bring you to
Page --
-- income impact.
It has a cash-flow
impact.
MR. RUBENSTEIN:
So you will have a -- you will get --
11
the Board will approve a revenue requirement for a given
12
year that you're seeking as approved -- say it's exactly as
13
approved.
14
in that given year from the smooth payment amounts will
15
differ.
But the revenue that you will actually collect
16
MR. PUGH:
Correct.
17
MR. RUBENSTEIN:
And I'm just trying to understand if
18
you can help us understand the -- how this -- the
19
calculation.
20
-- how this works with this interrogatory that you had
21
provided.
22
or is it better for the smoothing panel, because this may
23
all change.
24
I know -- and I didn't fully understand the
So I was wondering if you can go through it now,
MR. FRALICK:
Well, hopefully this will sum it up, and
25
if not, Randy can fill in with the details, but if the
26
entries that OPG makes into the rate smoothing deferral
27
account affect our cash flow but they do not affect our net
28
income, so the balances that get recorded into the RSDA are
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
185
1
2
recognized as income in the year that they're recorded.
MR. RUBENSTEIN:
3
to page 40.
4
would be.
5
$221.7 million?
All right.
If I can ask you to turn
You were asked essentially what the threshold
And as I see for, say, 2020, it's about
Am I -- that's my --
6
MR. PUGH:
You've got the right number.
7
MR. RUBENSTEIN:
So just based on sort of a simple
8
calculation, if Darlington Unit 2 is delayed by a year for
9
some -- and doesn't go in-service in 2020 as forecasted,
10
aren't you going to be fully offside the 221.7 million?
11
It's my understanding it's coming in to sort --
12
$4.8 billion are coming -- forecasted and will be built
13
into the revenue requirement to come in in February.
14
MR. PUGH:
Unless we had a very good hydro year, yes.
15
MR. RUBENSTEIN:
So my question is, will accounts that
16
have some sort of variance account protection on it, such
17
as the Darlington refurbishment, because of the nuclear
18
capacity refurbishment variance account, in that case would
19
you seek for the -- would you ask the Board to do anything
20
if you're 300 basis points off?
21
22
23
MR. PUGH:
We didn't understand your question.
You'll
have to try it again.
MR. RUBENSTEIN:
That's totally fine.
Considering
24
that for an example like Darlington you can be
25
significantly offside the 200 basis points but there is a
26
variance account that captures the in-service timing
27
difference, my understanding, that is the refurbishment --
28
nuclear refurbishment capacity variance account.
For other
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
186
1
amounts where there is an in-place variance account
2
treatment, is that an area where you would say to the
3
Board, we don't think you need to -- we may be 300 basis
4
points off, but you don't need to worry about it?
5
MR. FRALICK:
I think I'm trying to think how to
6
answer this.
The -- where we have costs that are subject
7
to a deferral and variance account, those are still
8
recognized as revenue, so the extent to which something
9
were to occur that caused the cost to, instead of being
10
part of a revenue requirement, to flow into a deferral and
11
variance account, that would not impact our ROE.
12
would only be costs that would not flow to a deferral and
13
variance account that could potentially impact ROE to the
14
point of triggering an off-ramp in this example.
15
16
17
MR. RUBENSTEIN:
So it
I'll have to think about that, but
I'll move on.
I just want to ask just about -- quickly about the
18
midterm review.
Mr. Millar has discussed a number of
19
aspects of that.
20
originally filed the production forecast for the second
21
half there would be an update as well as the consequential
22
fuel cost, correct?
So as I understood originally as
23
MR. FRALICK:
Correct.
24
MR. RUBENSTEIN:
The deferral and variance accounts
25
will also be updated?
26
the deferral and variance accounts?
27
MR. FRALICK:
28
MR. RUBENSTEIN:
I mean, there will be a clearance of
Yes.
And as well, from the N2 update, we
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
187
1
will be reviewing the D -- proposed to review the D2O
2
project as well?
3
MR. FRALICK:
That's our proposal, yes.
4
MR. RUBENSTEIN:
And you went with Mr. Millar, and Mr.
5
Millar took you through to a number of risks that you
6
thought was specific to the nuclear production element, and
7
I was wondering, had you considered how much -- what
8
component of those risks could be dealt with through the
9
Board's Z factor policy, which my understanding you still
10
11
want to leave open in your proposal?
MR. FRALICK:
Custom IR proposal?
I don't believe we looked at it through
12
that lens, but we have looked at the Z factor.
13
understand that it -- we would be seeking it for -- within
14
this application, and if we were to encounter an exogenous
15
event that would be appropriately subject to a Z factor,
16
then we would pursue recourse through that mechanism.
17
MR. RUBENSTEIN:
We
But my question was you -- Mr. Millar
18
took you through to a number of risks that were -- for why
19
you believe you needed to update the production forecast.
20
Do you recall that?
21
MR. FRALICK:
Yes.
22
MR. RUBENSTEIN:
My question to you is, did you
23
consider how those risks may be alleviated by the ability
24
to potentially come before the Board for a Z factor,
25
meaning there would be no need for a midterm review for
26
production?
27
28
MR. FRALICK:
We would assess any given event that
were to materialize through that lens at that time.
So I
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
188
1
wouldn't say that we went through and imagined any infinite
2
number of possible scenarios, but, yes, we would view an
3
event through the lens of a Z factor before seeking another
4
treatment.
5
MR. PUGH:
I think, Mr. Rubenstein, one of the things
6
we did consider, as Mr. Fralick has said, we started off
7
with the RRFE, said, what can't we live with.
8
production forecast was an element of that, and then what
9
we said was, can we make it as close to custom IR as
10
The
possible.
11
So by coming up with another forecast we're again
12
subject to forecast risk for the other term, and we thought
13
that was consistent with taking on the risk of RRFE and
14
custom IR.
15
MR. RUBENSTEIN:
Can I get you to turn to page 6.
16
You're aware of the Board's handbook on utility rate
17
applications?
18
19
20
MR. FRALICK:
Yes, it was issued during our
interrogatory period last year.
MR. RUBENSTEIN:
I recognize that.
Sorry, page 7.
If I can ask you
21
to turn to page 26.
26 of the handbook.
22
And under "updates" the Board is talking about custom IR,
23
and the Board says:
24
“Updates:
25
custom IR application, the OEB expects that there
26
be no further rate applications for annual
27
updates within the five-year term unless there
28
are exceptional circumstances, with the exception
After the rates are set as part of a
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720
189
1
of the clearance of established deferral and
2
variance accounts.
3
expect -- address annual rate application for
4
updates of cost of capital, working capital
5
allowance, or sales volume.
6
establishment of new deferral and variance
7
accounts should be minimized as part of the
8
custom IR application."
9
For example, the OEB does not
In addition the
Do you find that the need to adjust your sales volume,
10
essentially your production forecast is an exceptional
11
circumstance?
12
MR. PUGH:
I think in the circumstances which we're
13
forecasting now, I think it's very different than anything
14
we've been through, so yes.
15
16
17
MR. RUBENSTEIN:
Thanks very much.
Those are my
questions.
MS. LONG:
Thank you, Mr. Rubenstein.
That concludes
18
cross-examination for today.
We are back on Thursday with
19
the panel 1D, Schiff Hardin.
And, Mr. Smith, I would ask
20
that you have this panel ready, just in case we do have
21
some time on Thursday.
22
MR. SMITH:
23
MS. LONG:
24
Yes, they are queued up to be available.
Good.
If there is nothing further, we are
adjourned until 9:30 Thursday morning.
25
MR. SMITH:
Thank you.
26
--- Whereupon the hearing adjourned at 4:33 p.m.
27
28
ASAP Reporting Services Inc.
(613) 564-2727
(416) 861-8720