OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
APPENDIX B
SERVICE DESCRIPTION
CONTENTS
1.
INTRODUCTION ....................................................................................................... 2
2.
PURPOSE ................................................................................................................. 2
3.
BACKGROUND TO THE AUTHORITY ..................................................................... 2
4.
BACKGROUND TO REQUIREMENT/OVERVIEW OF REQUIREMENT ................... 2
5.
SCOPE OF REQUIREMENTS .................................................................................. 4
6.
SERVICE LEVELS AND PERFORMANCE ............................................................... 6
7.
ADDITIONAL REQUIREMENTS ............................................................................... 8
8.
PROJECT TIMETABLE ............................................................................................. 9
9.
INTELECTUAL PROPERTY RIGHTS (IPR) ............................................................ 10
OFFICIAL
Page 1 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
1.
INTRODUCTION
1.1
The Transport Appraisal and Strategic Modelling (TASM) team within the Department
for Transport are responsible for maintaining and updating WebTAG1 guidance on
the modelling and appraisal of transport interventions. Values of travel time savings
and reliability are often central to these appraisals, which are an important part of the
Transport Business Case2.
1.2
Therefore, TASM has commissioned a research project (Value of Travel Time Saving
Research) to provide fully up-to-date values for use in transport appraisal (hereafter
referred to as ‘the research project’).
1.3
This requirement covers the quality assurance and peer review process of the
research project. The objective of this quality assurance and peer review element is
to provide an independent audit of the data collected and modelling undertaken, and
an independent peer review of the approach taken and recommendations being
made in the research project. Due to the range of objectives, this requirement is likely
most suited to suppliers or consortia combining expertise in large-scale primary
survey data collection fieldwork and the technical aspects of values of travel time
savings.
2.
PURPOSE
2.1
Given the importance of values of travel time savings and reliability to Transport
Business Cases, and therefore the importance of the research project producing
reliable, robust results, the purpose of this requirement is to verify and audit the
collected data; audit the modelling processes that have been undertaken; and
provide a peer review of the overall approach taken and recommendations being
made for the values of travel time savings and reliability.
3.
BACKGROUND TO THE AUTHORITY
3.1
The Department for Transport is responsible for billions of pounds of investment in
maintaining and improving the country’s transport networks. Investment, and many
other spending, decisions are supported by a 5-part Transport Business Case.
Transport appraisal information, developed by following WebTAG guidance, can
inform each of these 5 cases but is predominantly used in the economic case, which
subsequently inform Value for Money statements.
3.2
The Transport Appraisal and Strategic Modelling (TASM) team within the Department
is responsible for maintaining and developing the guidance given in WebTAG on how
transport interventions should be modelled and appraised. Examples of the research
TASM undertakes as part of this role is available here3.
4.
BACKGROUND TO REQUIREMENT/OVERVIEW OF REQUIREMENT
4.1
In May 2014, the Department awarded a contract to an external contractor to
undertake research on ‘Values of travel time savings and reliability’ (referred to as
the ‘research project team’). The research project will estimate values of travel time
savings and reliability (and other related factors, such as crowding) based on
estimates of willingness-to-pay derived from stated and revealed preference (SP and
1
https://www.gov.uk/transport-analysis-guidance-webtag
2
https://www.gov.uk/government/publications/transport-business-case
3
https://www.gov.uk/government/collections/transport-appraisal-and-strategic-modelling-tasm-research-reports
OFFICIAL
Page 2 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
RP) exercises. These willingness-to-pay methods will be applied to business, as well
as personal and commuting travel, looking at employees, employers and the selfemployed.
4.2
The research project team are to collect RP and SP data using survey based
methods. Respondents will be recruited through a mixture of intercept and telephone
recruitment and questionnaires will be completed either by online self-completion or
computer assisted telephone interviews (CATI). Travellers for car, rail and bus (for
business, commuting and other non-work journey purposes) will be recruited through
a mixture of intercept and phone methods. All travellers on other public transport
modes (light rail, tram and London Underground) will be recruited by intercept. All
recruitment of employers will be by phone.
4.3
Intercept recruitment will be undertaken at petrol and service stations, rail (and other
public transport) stations and stops and on-street. To identify potential respondents,
the research project team have stated they will follow a ‘1 in n’ approach and make
use of a short screening interview to establish whether the response is in scope and
respondents would be willing to take part in the research.
4.4
The intercept recruited sample will be complemented by a telephone sample,
recruited using a Random Digital Dialling (RDD) sample that geographically
represents the population of England by region. Again, potential respondents will first
undertake a short recruitment interview, to establish whether they are in scope and
willing to participate in the research, and willing participants will be offered the choice
to complete the questionnaire on-line or by telephone (CATI).
4.5
All recruitment of and surveys with employers will also be undertaken by telephone.
The sample of business phone numbers will be purchased from an established
provider and numbers randomly assigned to interviewers. The target respondent will
be the person within the company responsible for making decisions about how
employees travel for business purposes.
4.6
As well as covering a range of journey purposes, the research project is covering a
range of transport modes. Bus, car and rail were included as the ‘core’ modes and
additional options have been commissioned to extend this to include other public
transport (light rail, London Underground and tram) and active (walking and cycling)
modes.
4.7
The Department for Transport has split the research project into two phases. Phase 1
covered review, qualitative research, design, development, testing and piloting of
questionnaires. Phase 2, which is underway, comprises the main data collection
stage, modelling and estimation of values, and reporting of conclusions and
recommendations. The table below sets out the scope and target sample sizes for
Phase 2 (by recruitment method):
Modes
Car
Journey Purposes
Employee’s
business
800 SP intercept
200 SP phone
Employer’s
business
133 SP phone
Bus
n/a
n/a
Rail
800 SP intercept
200 SP phone
1250 RP intercept
133 SP phone
OFFICIAL
Page 3 of 11
Commuting
Other non-work
800 SP intercept
800 SP intercept
200 SP phone
200 SP phone
400 SP intercept
400 SP intercept
100 SP phone
100 SP phone
800 SP intercept
800 SP intercept
200 SP phone
200 SP phone
1250 RP intercept
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
Other PT (light
rail, tram and
LUL)
500 SP intercept
133 SP phone
500 SP intercept
500 SP intercept
Walk and cycle
n/a
n/a
500 SP intercept
500 SP intercept
4.8
Analysis of the pilot results in Phase 1 included linear models estimated in attribute
space and multiplicative models estimated in ‘willingness-to-pay space’. The precise
form of modelling that will be undertaken to estimate values of travel time savings is
still to be determined and will, to some extent at least, be data driven. However, it is
likely that the modelling will include more complex, advanced choice modelling
techniques, potentially including mixed-logit and latent class models.
4.9
The Department envisages that the peer review and audit team for this requirement
will be working concurrently with the research project team. The primary point of
contact for this requirement will be the Department’s project manager for the
research project but the Supplier may also have to liaise with members of the
research project team.
5.
SCOPE OF REQUIREMENTS
5.1
The quality of the VTTS research is of great importance to the Department for
Transport. The scope of this requirement is therefore to verify and audit the data
collected; audit the modelling undertaken; and to provide a peer review of the general
approach being taken; to provide assurance around the recommendations being
made in Phase 2 of the ‘Values of travel time savings and reliability’ research project.
5.2
There will be three key tasks, or workstreams, forming this requirement:



5.3
Ex-post audit of the data collected in Phase 2;
Audit of modelling and peer review of recommendations in an interim report on
“emerging values and segmentation”; and
Audit of modelling and peer review of recommendations in the final report.
During the course of the requirement it may be necessary to transfer data between
the Supplier and the research project team and/or the Department. Data handling
procedures should follow the minimum mandatory requirements set out in the Final
Report on Data Handling Procedures in Government (Cabinet Office, 2008). The
appropriate software and procedures should be in place to ensure the secure storage
and transfer of data. Any data passed to the Department should be encrypted and
delivered by secure means, to be discussed and agreed with the Department's
project manager.
Ex-post audit of data collected in Phase 2
5.4
The broad objective of this element of the requirement is to verify, through an ex-post
audit of the collected data and records of the processes followed, that data was
collected in Phase 2 in line the methods the research project team had described.
The research project team will provide documentation on the fieldwork preparation
and an audit trail of the fieldwork activities.
OFFICIAL
Page 4 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
5.5
For intercept recruitment, the requirement is to verify that the ‘1 in n’ approach was
followed; that initial recruitment interviews were undertaken correctly; and that
respondent details and rejections were correctly recorded.
5.6
For telephone recruitment, the requirement is to verify that the sampling approach
was correctly followed and initial recruitment interviews were correctly undertaken.
5.7
For telephone (CATI) interviews, the requirement is to verify that interviewers were
not introducing bias through leading respondents; that respondents were sent
personalised SP experiments (pivoted around a recent, typical trip); and that data
from the CATI interviews were accurately entered.
5.8
For data entry of online self-completed questionnaires, the requirement is to
verify that respondents were sent unique links to access the questionnaires and that
the processes in place accurately recorded and compiled responses from those
questionnaires.
5.9
For storage and transfer of data, the requirement is to verify that data are being
handled in a safe and secure manner, particularly regarding the anonymity of data
and treatment of identifiable factors, in line with the minimum mandatory
requirements set out in the Final Report on Data Handling Procedures in
Government (Cabinet Office, 2008) and stated quality assurance procedures.
5.10
The scope of this requirement is limited to verifying the quality and consistency of the
data collection, input and storage processes used in the research project. There is
not any scope for further data collection to be commissioned. However, it is within the
scope of this requirement to report on any instances where processes have not been
followed, and the implications of this for the reliability and robustness of the final
estimated values. Also, if the processes in place would have significant implications
for the reliability and robustness of the final estimated values, reporting these
implications – and recommendations for how such issues could be addressed in the
modelling and analysis – is within scope.
Emerging values and segmentation
5.11
The research project includes an interim deliverable on “Emerging values and
segmentation”, the purpose of which is to provide results from initial modelling and
analysis and to set out options for how the values could be segmented. This element
of this requirement has two objectives: to verify the accuracy of the key modelling
results at this stage of the research project; and to peer review and provide advice to
the Department on the recommendations being made.
5.12
For the modelling, the requirement is to verify the accuracy of the results being
presented. For example, by testing the reproducibility of the results. At this stage,
there will likely be several options for how the values could be segmented. The
number of modes and journey purposes covered by the research project, and the
sorts of segmentations used in appraisal guidelines internationally, should provide a
guide to the range and number of segmentations likely to be tested. The modelling
will be undertaken with bespoke code using the Ox software package.
5.13
It is likely that there will be some element of ex-post weighting or sample
enumeration applied to the modelling results, to improve their representativeness.
OFFICIAL
Page 5 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
Verification and of the accuracy of any such processes is within scope of this
element.
5.14
For the peer review element, the requirement is to advise the Department on both
the suitability, reliability and robustness of the modelling approaches being used in
the research project; and the specific recommendations made (or options presented)
for how the values could be segmented and applied in transport appraisal. This
should consider the approaches used and recommendations made from a statistical
(e.g. in terms of model diagnostics and fit; and any implications of the data collection
approach for the reliability and generalizability of the results); theoretical (e.g. in
terms of consistency with economic theory underpinning cost-benefit analysis); and
practical (e.g. in terms of implementation in appraisal) perspective.
Final Report
5.15
The requirement at this stage is similar to that for the interim deliverable on
“emerging values and segmentation”. However, audit of the modelling should
include verifying that there is a suitable audit trail and model quality assurance
process in place, as well as ensuring the accuracy of the results being presented. As
with the element relating to the “emerging values and segmentation”, this should
include any ex-post weighting or sample enumeration, and should also cover any
data cleaning performed on the final data set.
5.16
For the peer review, the requirement is the same as for the “emerging values and
segmentation” stage – to peer review and provide advice on the modelling approach
that has been used and recommendations made by the research project team.
5.17
As with the interim deliverable, there may be a range of values and models suitable
for different contexts. So reproduction of modelling results and review of
recommendations is unlikely to be limited to a single model and set of values.
6.
SERVICE LEVELS AND PERFORMANCE
6.1
The required output for this requirement is to measure the quality and consistency of
the data collection method by the research project team and to provide a peer review
and audit of the modelling and analysis undertaken. The Authority will measure the
quality of the Supplier’s delivery by:
6.1.1
Reporting of progress during the requirement – in responding to the
questions in Appendix D, Potential Providers should set out their
proposed approach for reporting to the Department during the project, the
proposed number of written progress updates, the form of the updates
(email/memo/other) and proposed number of progress meetings.
6.1.2
An interim deliverable / technical note (covering the ex-post data
collection audit and review of the “emerging values and segmentation”
report), documenting:
o
o
o
o
the ex-post data collection audit and verification activities undertaken;
the conclusions from those activities about how the data collection and
quality assurance (including data handling) processes have been
followed;
implications for the reliability and robustness of resulting values;
an assessment of any risks arising for the research project as a result
OFFICIAL
Page 6 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
o
o
o

The Department recognises the timescales for auditing and reviewing the
data collection and ‘emerging values and segmentation’ from the research
project are short and would be prepared to discuss with the supplier the form
this interim deliverable / technical note should take.
6.1.3
A final report, documenting:
o
o
o
o
6.2
of the data collection processes, including how they could be mitigated
in the estimation of values and formulation of recommendations for
appraisal practice;
the activities undertaken to verify the modelling undertaken to that
point in the research project;
a review of the suitability, reliability and robustness of the modelling
approach being used by the research team; and
advice to the Authority on the options for segmentation / application of
the resulting values in appraisal guidance.
the activities undertaken for (and reported in) the interim report;
the activities undertaken to audit and verify the modelling undertaken
for the research project’s final report;
a review of the suitability, reliability and robustness of the modelling
approach used by the research team; and
advice to the Authority on the recommendations made for how the
results should be applied in appraisal guidance.
The Plan as at the Effective Date is set out below:
Milestone
Deliverables
Milestone
Date
Customer Responsibilities
Ex-post audit and
verification of the
data collected
Interim report / technical note
(as described above) covering:
Friday 20
February
2015
Provide Supplier with data
collection documentation and
audit trail, and the data set,
on contract commencement.
Peer review and
modelling audit of
“emerging values
and segmentation”
report
 the audit / verification
activities undertaken;
 implications for the
reliability and robustness of
resulting values;
 and advice on modelling /
segmentation for the final
report.
OFFICIAL
Page 7 of 11
Provide Supplier with
“emerging values and
segmentation report” (and
details of / access to the
modelling undertaken) on
Monday 2 February 2015
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
Peer review and
modelling audit of
final report
Final peer review and audit
report, covering material from
interim report and:
Friday 17
April 2015
 the audit / verification
activities undertaken for
the final report; and
Provide Supplier with draft
final report (and details of /
access to the modelling
undertaken) on Tuesday 31
March 2015
 peer review of the
approach taken and
recommendations made in
the final report.
6.2.1
If so required by the Customer, the Supplier shall produce a further
version of the Plan (based on the above plan) in such further detail as the
Customer may reasonably require. The Supplier shall ensure that each
version of the Implementation Plan is subject to approval. The Supplier
shall ensure that the Implementation Plan is maintained and updated on a
regular basis as may be necessary to reflect the then current state of the
implementation of the Services.
6.2.2
The Customer shall have the right to require the Supplier to include any
reasonable changes or provisions in each version of the Implementation
Plan.
6.2.3
The Supplier shall perform its obligations so as to achieve the Milestone
by the Milestone Date.
6.2.4
Changes to the Milestone shall only be made in accordance with the
variation procedure and provided that the Supplier shall not attempt to
postpone the Milestone using the variation procedure or otherwise
(except in the event of a Customer default which affects the Supplier's
ability to achieve the Milestone by the relevant Milestone Date).
6.3
Payments must be linked to the satisfactory delivery of pre-agreed products and
deliverables. Therefore, to facilitate interim payments, Potential Providers must
propose additional interim milestones / deliverables, and a related schedule of
payments, to be agreed with the Customer.
7.
ADDITIONAL REQUIREMENTS
7.1
A Purchase Order Number for this requirement will be provided to the successful
contractor.
7.2
Payment will be made through the DfT Shared Services following receipt of each
invoice.
7.3
Invoices should be sent to:
Accounts Payable
Shared Services arvato
5 Sandringham Park
Swansea Vale
OFFICIAL
Page 8 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
Swansea
SA7 0EA
7.4
The purchase order number (to be advised following award of the contract) must be
shown prominently on each invoice. Invoices should also include a brief description
of the tasks completed. To ensure swift payment, invoices should only be submitted
to the Shared Services Centre once the invoice amount has been agreed with the
Department’s Contract Manager.
7.5
Unauthorised spending above the contracted limit will not be covered by the
Department for Transport under any circumstances. The contractor should contact
the Contract Manager as soon as possible if there is any concern with the timescales
or budget to identify what remedial action can be taken. The Project Manager shall
maintain regular contact with the Contract Manager, on a basis to be agreed at the
inception meeting.
8.
PROJECT TIMETABLE
8.1
The timetable for the requirement is given below:
8.1.1
Supplier provided with detail of Phase 2 data collection and collected data
set: week commencing 26 January 2015
8.1.2
Supplier provided with “emerging values and segmentation” report (and
related modelling information / detail): 2 February 2015
8.1.3
Interim report on ex-post data audit and review of “emerging value” report:
20 February 2015
8.1.4
Supplier provided with draft final report (and related modelling information
/ detail): 31 March 2015
8.1.5
Submission of draft final peer review and audit report: 17 April 2015
8.1.6
Contract end date (to allow revisions and discussion of conclusions): 15
May 2015.
OFFICIAL
Page 9 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
9.
INTELECTUAL PROPERTY RIGHTS (IPR)
9.1
It shall be a condition of the Contract that, except to the extent that the Services
incorporate designs furnished by the Contracting Authority, the Services will not
infringe any patent, trade mark, registered design, copyright or other right in the
nature of Intellectual Property of any third party and the Successful Provider shall
indemnify the Contracting Authority and the Crown against all actions, suits, claims,
demands, losses, charges, costs and expenses which the Contracting Authority or
the Crown may suffer or incur as a result of or in connection with any breach of this
Condition.
9.2
All Intellectual Property Rights (including ownership and copyright, but excluding
trade marks and trade names of the Successful Provider) in:
a) any Specifications, instructions, plans, drawings, patents, patterns, models,
designs or other material furnished to or made available to the Successful
Provider by the Contracting Authority shall remain the property of the Contracting
Authority; and
b) the final version of any tangible product of the Services (the “Final Product”)
delivered to the Contracting Authority and prepared by or for the Successful
Provider for use, or intended use, in relation to the performance of this Contract;
shall (save as set out below) belong to the Contracting Authority on payment of the
Contract Price for the Services, and the Successful Provider shall not and shall
procure that the Providers employees, servants, agents, suppliers and subcontractors shall not (except when necessary for the implementation of the Contract
or as otherwise permitted by the Contract) without prior written consent of the
Contracting Authority, use any Intellectual Property Rights assigned to the
Contracting Authority in accordance with this clause.
8.3
9.3
The Contracting Authority shall not require the Successful Provider and the
Successful Provider shall not be obliged to transfer or assign:
8.3.1
Intellectual Property Rights in any part of the Final Product that may be
owned by a third party and which has been identified as such in the Final
Product and or
8.3.2
any Intellectual Property Rights in the Providers methods of work, working
papers, computer programmes, methodologies, skills, experience,
expertise and any associated or related information maintained by the
Provider in any form, all Intellectual Property Rights therein remaining
vested in the Provider
To the extent that matters excluded in the part (b) are comprised in or incorporated in
or required in connection with a Final Product, the Provider shall grant the
Contracting Authority on payment of the Contract Price for the Services a nonexclusive royalty free licence to use the same solely for the purposes contemplated
by this Contract. The Provider shall retain ownership of its working papers. Subject
to the Providers confidentiality commitments to the Contracting Authority, for the
purposes of delivering services to the Contracting Authority and other clients of the
Provider, the Contracting Authority and other Contractor Persons shall be entitled to
OFFICIAL
Page 10 of 11
OFFICIAL
RM5040 SO-7863 Values of Travel Time Savings Peer Review & Audit
Appendix B – Service Description
use, develop or share with each other knowledge, experience and skills of general
application gained through performing the Services.
OFFICIAL
Page 11 of 11