Fundamentals of HSST
assessment and the Annual
Review of Progression
(ARP)
Dr Suzanne Chamberlain
Head of Education and Assessment
Supporting training, Maintaining standards, Improving outcomes
Session overview
HSST assessment
• Challenges for HSST assessment
• Fundamental principles of assessment
• Assessment requirements for the award of the Certificate
of Completion
• Today’s statement
Annual Review of Progression
• Update on ARP trial
Questions and comments
Supporting training, Maintaining standards, Improving outcomes
Challenges for HSST assessment
• Multiple specialisms
• Within specialisms, different workplace roles and
responsibilities
• Requirement for Life Sciences to complete FRCPath
• Breadth of prior attainment: some STP, some MSc, some
PhD, some FRCPath Part 1
• Breadth of professional backgrounds: some already enacting
the role of consultant
• Collaboration with royal colleges, professional bodies and
specialists in each field
• Unique training context; unlike anything else in healthcare
Supporting training, Maintaining standards, Improving outcomes
Fundamental principles of assessment
•
•
•
•
•
•
Comparable workload (across specialisms and centres)
Realistic workload (supports learning not assessment)
Fairness (clear and consistent standards for all)
Reliability (enough judges and cases?)
Validity (appropriate tasks set at the right level?)
Appropriate sampling of curriculum content (enough breadth
of evidence?)
• Triangulation of evidence (like any research exercise)
• Positive driver for learning (not jumping through hoops)
Comprehensive and convincing evidence-base that shows
you, your supervisor and your future employer what you
know and can do
Supporting training, Maintaining standards, Improving outcomes
Decision-making for HSST
Physiological Sciences, Physical Sciences and Biomedical Engineering,
Clinical Bioinformatics
NSHCS
MAHSE
Comparable
Life Sciences
NSHCS
MAHSE
RCPath
Supporting training, Maintaining standards, Improving outcomes
Criteria for award of Certificate
of Completion for HSST
1. Workplace-based assessment (OLAT)
2. Professional Doctorate (MAHSE) and/or
FRCPath (RCPath)
3. Standardised assessment (NSHCS)
Supporting training, Maintaining standards, Improving outcomes
1. Workplace-based assessment
• Aim for one workplace-based assessment per month (60
in total over 5 years)
• Create comprehensive portfolio of your competence and
progress
• In consultation with your supervisor, map out 12
assessments for each year that mark meaningful
milestones in your development as a consultant clinical
scientist
• Discuss your assessment plan with supervisor (as part
of your annual appraisal?)
• Use reflective log and MSF to capture other aspects of
learning and professional development
Supporting training, Maintaining standards, Improving outcomes
2. Professional Doctorate
(DClinSci) and FRCPath
Mandatory assessments associated with both
FRCPath
Parts 1 and 2 in full
Doctor of Clinical Science
Section A: Leadership and professional development
Section B: Specialist scientific clinical programme
Section C: Research, development and innovation
Supporting training, Maintaining standards, Improving outcomes
3. Standardised assessments
(NSHCS)
Year 4 assessment of clinical/scientific skills
Independent, objective check on clinical and scientific skills that
you are required to have mastered prior to registration as CCS
OSCE/OSFA/OSCSA
Innovation in Clinical Science project
Standardised assessment of ability to contribute to innovation in
HCS
Workplace-focused tasks and assessment
Supporting training, Maintaining standards, Improving outcomes
Innovation in Clinical Science project
• 4,000 word report
• Presentation and discussion with a multi-professional panel:
for example, scientists, patients, hospital execs, academics
• Can you convince specialists and non-specialists that you can
conceive an idea for service improvement, evaluate feasibility,
reflect on cost-benefits, risks, barriers, and, if appropriate,
develop plan for implementation?
• Can you communicate your ideas in accessible way?
• Not assessed on outcome/implementation, but on insight,
process, and how you reflect on and communicate your ideas
Supporting training, Maintaining standards, Improving outcomes
Today’s joint statement for
Life Sciences
Agreements in principle:
• MAHSE partner Universities will accept a pass in the FRCPath
Part 1 examination in a relevant specialty in place of the
Professional Doctorate (DClinSci) Section B
• The Royal College of Pathologists will accept the research
component of the Professional Doctorate (DClinSci) in a
relevant specialty as the written option for the FRCPath Part 2
Supporting training, Maintaining standards, Improving outcomes
Today’s joint statement for all
CSs in HSST
ICS project
The NSHCS clarified that trainees could utilise elements from
FRCPath Part 2 and/or the DClinSci Section C as the basis of
their ICS Project report. The NSHCS also intends to work in
partnership with MAHSE to develop the assessment framework
for the ICS Project.
Supporting training, Maintaining standards, Improving outcomes
ICS project
School and MAHSE are seeking approval
• The ICS project to be Section C1 of the DClinSci
• Section C of the DClinSci to consist of C1 (the ICS project) and
C2 (the research project: thesis and viva voce)
• C1 will be jointly assessed by MAHSE and NSHCS-nominated
representatives from scientific community
• Presentation and discussion will be conducted in the workplace
• C1 must be completed by all CS in HSST
Supporting training, Maintaining standards, Improving outcomes
Decision pending
Physiological Sciences, Physical Sciences and
Biomedical Engineering, Clinical Bioinformatics
• Year 4 clinical skills assessment
Decisions pending regarding:
• Delivery model
• Assessment method
• Assessment criteria
Supporting training, Maintaining standards, Improving outcomes
Awards for Life Sciences
Assessments
Workplace-based assessment,
Certificate of Completion of
FRCPath (Parts 1 and 2), ICS project
HSST (CCHSST)
(Section C1 of DClinSci)
CCHSST plus Diploma in
Leadership and
Management in HCS
As above plus Section A of DClinSci
CCHSST plus full DClinSci
Requirements for CCHSST plus
Sections A and C of DClinSci
Notes:
• DClinSci Section C can be presented in fulfilment of FRCPath Part 2 research component
• FRCPath Part 1 can be presented in fulfilment of DClinSci Section B
Awards for Physiological Sciences,
Physical Sciences and Biomedical
Engineering, Clinical Bioinformatics
Assessments
Workplace-based
Trainees with a recent and relevant PhD assessment, Sections A and B
of DClinSci, ICS project
CCHSST plus Diploma in Leadership
(Section C1 of DClinSci), Y4
and Management in HCS
assessment
Workplace-based
Trainees without a recent and relevant assessment, Sections A, B
PhD
and C of DClinSci, ICS
project (Section C1 of
CCHSST plus full DClinSci
DClinSci), Y4 assessment
Note:
• Decision pending for Year 4 clinical skills assessment
• Trainees who believe they have a recent and relevant PhD and therefore do not need to take the
full DClinSci should inform the NSHCS as soon as possible after registration on HSST programme
Annual Review of Progression
• Trial in HSST been postponed until further notice
• Trial in STP will give stakeholders and school an
understanding of the process and resource
requirements
• School will make ARP resources available
• CS in HSST and their supervisor may wish to
complete the ARP documentation and process as
a learning event
Supporting training, Maintaining standards, Improving outcomes
Summary
• Various pathways through HSST – first cohorts are pathfinders and will help to shape programme
• Important that you use these 5 years to choose and
complete assessments and projects that help your
progression and transition to a CCS post
• The flexibility of the programme is intended to support
learning and create opportunities – not create uncertainty
• Important at this level that you can demonstrate you are a
self-directed learner, with ownership of your learning and
assessment at consultant/doctoral level
• Take advantage of the opportunities offered by MAHSE
and RCPath to gain high-level qualifications and awards
Supporting training, Maintaining standards, Improving outcomes
NSHCS and MAHSE handbooks ready for
release; further updates pending
Questions, comments?
Supporting training, Maintaining standards, Improving outcomes