Resource package and guide - The University of Adelaide

Curriculum Renewal Project – Health Sciences
Resource Package and Guide1
Overview - the stages of Curriculum Renewal
Stage 1: Review the current curriculum - Curriculum mapping is the beginning of a broader and
comprehensive process of curriculum renewal that involves 4 stages
 Step 1 - map and analyse the relevant components of the specified program(s)
 Step 2 - collate the material and collectively analyse the results in view of the
purpose of the review
Stage 2: Agree on the preferred curriculum
 collectively determine the preferred characteristics of the new curriculum
Stage 3: Renew the curriculum
 reshape the curriculum overall and within components (learning outcomes,
assessment, and teaching and learning arrangements) to fit the agreed expectations
Stage 4: Document the changes
 complete necessary documentation and submit through the appropriate channels.
Stage 5 – Implementation.
This set of resources partially covers Stage 1, Steps 1 and 2 (in bold) of a whole curriculum renewal
process as set out above.
Together the diagrams on the following two pages provide an overarching framework for curriculum
renewal:
1. An overview of the relationships and interdependence of aspects of curriculum, course and
program design elements within a quality assurance framework, and an
2. Overview of the processes of curriculum renewal.
For further information and resources on curriculum renewal please refer to the Curriculum Renewal
Road Map 2013.
1
This document was originally developed as a stand-alone guide to curriculum renewal. It is reproduced here
with some minor amendments. Some parts of the document are also included in other parts of the website to
facilitate access to specific information.
Resource package and guide – Health Science
Page 1
Curriculum Renewal Framework - an overview of the relationships and interdependence
of aspects of curriculum within a quality assurance framework – health sciences
GENERAL
University of Adelaide outcomes
University of Adelaide Graduate Attributes and strategic initiatives for
learning and teaching are embedded in the qualification – the
University’s unique proposition to students
Program outcomes
PROGRAM
COURSE/
STREAM
 Align with the TEQSA Threshold Standards (AQF)
 Align with Threshold Learning Outcomes – Health (TLOH – D, M ,N,
OH) In this case, TLOH are a proxy for Program outcomes.
 Program design meets University policy for an undergraduate
degree
 Are structured to enable development of skills and knowledge over
the life of the Program
Course/Stream learning outcomes
 State what the student should be able to know and do on successful
completion of the Course/Stream
 Collectively enable Program Outcomes to be met over the period of
the Program
Course learning and teaching design
LEARNING
ACTIVITIES
ASSESSMENT
SPECIFIC
 Creates opportunities for Course Learning Outcomes to be achieved
 Contributes to, scaffolds and enables Program Learning Outcomes to
be developed
 University Learning and Teaching priorities are embedded, including
academic literacies, eLearning, work integrated learning/career
readiness, research skills development, Small Group Discovery
Experience
Assessment criteria and approach
Confirm that the student has achieved, or is on the way to achieving,
the Course/stream and Program Learning Outcomes
The Graduate has achieved the Program Learning
Outcomes and University requirements and has
had the unique University of Adelaide experience.
Resource package and guide – Health Science
Page 2
Overview of the processes of curriculum renewal
Note: In this project the desired state is still being defined. The set of templates/tools (mechanics) supports development of a clearly defined viable new state and decision
making about contingent changes through the next stages. Validation and Consultation within and external to the working party are critical to both the Review and Renew
stages of the process. This is not a purely linear process and must be seen as cyclical and iterative to maintain the quality and relevance of curriculum.
Resource package and guide – Health Science
Page 3
Resources developed July 2013 to October 3013
Tools for mapping assessment tasks against the Threshold Learning Outcomes (TLO) for the
Dentistry, Medicine, Nursing and Oral Health Programs
The premises behind the design of the tool(s) to support Steps 1 & 2 of Stage 1 of the Stages of
Curriculum Renewal for Health Sciences are:








The Threshold Leaning Outcomes for the discipline (i.e. medicine, dentistry, nursing or oral
health) are the proxy learning outcomes for the Programs (Bachelor of Medicine and Bachelor
of Surgery (MBBS – 6 year program, 144 units), Bachelor of Dental Surgery (BDS – 5 year
program, 120 units), Bachelor of Nursing (BN – 3 year program, 72 units); and, Bachelor of Oral
Health (BOH, 3 year program, 72 units)
A framework of common assessment principles is in place – see Appendix 1 for an example
By configuring the information in x and y axes in certain ways the relationships and the
strengths of relationships between aspects on the axes can be established and interrogated. A
matrix of relationships displayed graphically is more readily interpreted than pages of
curriculum documentation.
A spread sheet provides opportunities to enter both stable and differentiated or evolving
information that can be presented in different ways.
Hyperlinks can be inserted into cells to provide more information on the contents of the cell.
Comments can also be attached to the cell.
Information can be in numbers or words – and formulas (rules) can be applied to highlight or
summarise what is in a cell or a set of cells.
Graphics and tables can be generated from the spread sheet, if useful.
How the information is then aggregated, interrogated and interpreted (processes) will be codeveloped with the Faculty learning and teaching staff.
Summaries, samples and links to the templates
Summaries
The basic tool consists of Graduate attributes and threshold learning outcomes program mapping
template, a spread sheet template which is pre-populated with the TLO statements and related
accreditation standards for each of the four disciplines in scope. Assessment tasks can be identified
against each TLO in the columns. There is also a column for aligning the University’s graduate
attributes with each accreditation standard (see Sample 2 below).
In another version of the template, DMNO TLO professional competencies assessment Bloom's
verbs, the key verbs from each professional competency are placed against assessment tasks of
increasing complexity, based on Blooms taxonomy (see Samples 3 and 4 below).
More columns and rows may be added to the template depending on the purpose of the mapping
exercise, for instance, additional columns to record which graduate attribute(s) or course learning
outcome(s) align with each discipline accreditation standard. Sample 5 shows the myriad ways the
spread sheet might be presented and populated. The presentation Using the mapping template
demonstrates the process incrementally.
Resource package and guide – Health Sciences Stage 2
Page 4
A supplementary tool, Graduate attributes and threshold learning outcomes program mapping
template consists of two spread sheet templates which enable finer grained tracking of where and
when the University’s Graduate Attributes are introduced, developed or assessed over a whole
Program in Sheet 1 (Sample 6) with a similar way of tracking the TLO through courses in Sheet 2
(Sample 7). Instructions for using them are included within the templates. A guide to interpreting the
data is at the end of this document
.
Resource package and guide – Health Sciences Stage 2
Page 5
Samples - Stage 2 mapping tools
Sample 1- Spread sheet design – based on ‘Harmonising’ paper
Threshold learning outcome
AQF qualification type (level) of competence required
Assessment of
developing knowledge, skills and competence
Discipline accreditation
standard
Assessment
task(s) a
Assessment
task(s) b
Assessment
task(s) c
Assessment of
competence
Clinical Assessment
task(s) d
1
2
3
4
5
Adapted from Threshold learning outcomes: A framework for incorporating professional
accreditation and AQF standards into assessment blueprinting/mapping in healthcare
disciplines, OLT, 2013 (in-press).
Sample 2 – Graduate attributes and threshold learning outcomes program mapping template is a
spread sheet populated with threshold learning outcomes and related discipline accreditation
standards, ready for assessment task identification. The spreadsheet CR-HS-Example-mappingProfComp-GA demonstrates alignment between TLO and Graduate Attributes.
Resource package and guide – Health Sciences Stage 2
Page 6
Sample 3 – The spreadsheet DMNO TLO professional competencies assessment Bloom's verbs links TLO ‘retrieve,
critically evaluate and apply evidence in the performance of health related activities’ with the key active verbs in the
Program accreditation standards to guide kinds of assessment tasks for each of the four disciplines. This format may be
used for comparison/calibration purposes.
Resource package and guide – Health Sciences Stage 2
Page 7
Sample 4 – uses a spread sheet CR-HS-Example-mapping-ProfComp-GA to populate TLO and Professional Accreditation statements for Dentistry,
then is completed by the Faculty with sample types/ levels of assessment tasks and showing alignment with the University’s graduate attributes.
Threshold learning outcome
Upon completion of their program of study, healthcare graduates
at professional entry-level will be able to:
Retrieve, critically evaluate, and apply evidence in the
performance of health-related activities
Discipline accreditation standard - Dentistry
AQF qualification type (level) of competence required
Assessment of developing knowledge, skills
and competence (knows. knows how, shows
how)
Assessment of
competence
(does)
Graduate
attribute
alignment 5
Literature
review
SAQ4
Research
project
Clinical case
study
Practise evidence-based dentistry
92
71
LONA3
9
GA 1,2,3,4,8
Use contemporary information technology for documentation,
continuing education, communication, management of information
and applications related to health care
7
7
7
7
GA 5
Evaluate and integrate emerging trends in health care as
appropriate
Formulate treatment plans which integrate research outcomes
with clinical expertise and patient views
7
7
9
9
GA 1,2,3,6.7.8
LONA
9
LONA
9
GA 1,2,3,4,8
1 Learning outcomes assessed at AQF level 7
2 Learning outcomes assessed at AQF level 9
3 Learning outcomes not assessed
4 Short answer questions
5 The University of Adelaide Graduate Attribute(s) aligned with and assessed in this learning outcome.
Resource package and guide – Health Sciences Stage 2
Page 8
Sample 5, Using the mapping template (Slide 4), demonstrates how the spread sheet can be set up or adapted for a range of mapping purposes at course
and/or program level (using Medicine as an example)
Hyperlink to Adelaide University MBBS
Assessment Blueprint document, which
identifies where, when and how clinical
and non-clinical assessments are
organised within the Program as a whole.
Assessment task(s) a, b etc. can be hyperlinked to the
actual assessment task in MyUni, to any assessment
rubrics and to pieces of student work (evidence).
Hyperlink to Course Learning Outcomes in
the course documentation or enter them
directly into this document
The active verbs in the TLO
inform the kind of
assessment task and
identify an AQF level
Hyperlink to AQF
website to review
AQF level
Hyperlink to University of Adelaide Graduate
Attributes. Could also link to any other
mapping instrument for graduate attributes
Add or delete assessment task columns
as required
Add or delete CLO and/or UAGA columns
depending on purpose of the mapping
Enter course or program code
COURSE or PROGRAM title and code and other relevant information e.g. assessment period. Year level
Threshold learning outcome
Upon completion of their program of study, healthcare graduates at
professional entry-level will be able to:
Demonstrate professional behaviours
Discipline accreditation standard – Medicine
Describe the principles and practice of professionalism and leadership in
health care
AQF qualification type (level) of competence required
Assessment of developing knowledge, skills and
competence (knows, knows how, shows how)
Course Learning
Outcomes or
course code
E.g. CLO 1,2,6
Assessment task(s)
a
Resource package and guide – Health Sciences Stage 2
Assessment
task(s) c
describe Exam
Enter AQF level e.g.
AQF 7
Add link to student
work (evidence)
Explain the main principles of ethical practice and apply these to
learning scenarios in clinical practice. Communicate effectively about
ethical issues with patients, family and other health care professionals
Identify the boundaries that define professional and therapeutic
relationships and\ demonstrate respect for these in clinical practice
Assessment
task(s) b
explain
AQF 7
SAQ
identify
AQF 7
Exam
apply to
scenarios
AQF 9
MCQ, MEQ
OSCE
Assessment of
competence (does)
Clinical assessment
task(s) d
University of
Adelaide
Graduate
Attributes
UAGA mapped to
TLOS standard
LONA = learning
outcome not
assessed
e.g. GA 7
communicate
AQF 9
Supervisor reports
OSCE
GA 1,4, 8
demonstrate
AQF 9
Supervisor reports
GA 1,7,8
Page 9
Sample 6: Spreadsheet Graduate attributes and threshold learning outcomes program mapping template Sheet 1 for mapping (if this level of detail is
needed) graduate attibutes in courses across a whole program - showing where/when in a program the University’s Graduate Attributes are introduced,
developed and/or assessed. Directions for using it are embedded in the spreadsheet, Instructions for interpreting the spread sheet are in ‘How to use…’
Resource package and guide – Health Sciences Stage 2
Page 10
Sample 7: Spreadsheet Graduate attributes and threshold learning outcomes program mapping template Sheet 2 for mapping (if this level of detail is
needed) TLOH in courses across a whole program - showing where/when in a Program or course the Treshold Learning Outcome is introduced, developed
and/or assessed. Instructions for using it are embadded in the sreadpsheet. Instructions for interpreting the spread sheet are in ‘How to use…’
A row may be added here containing the more detailed
specific accreditation standards for the discipline, each
with its own set of I, D and A columns.
Resource package and guide – Health Sciences Stage 2
Page 11
Guide to using the resources (draft)
Graduate attributes and threshold learning outcomes program mapping template
What is in the spread sheet?
Each of the four disciplines Medicine, Dentistry, Oral Health and Nursing has a tab. Open the
corresponding tab to work in a particular discipline. The data from the accreditation standards in the
TLOH columns are current as of 1 October 2013, but as accreditation standards change every few
years please check before using.
(The 5th tab is set up to look at one TLOH only - Deliver safe and effective collaborative healthcare, it
is partially completed for one the four disciplines - as an example.)
The green shaded area represents the beginning of a segment for one of the TLO common domains
by discipline and provides the column headings for recording a number of assessment tasks within
that segment. There is also a column on the left for recording alignment with the University’s
Graduate Attributes. The Graduate Attributes have been aligned with the threshold learning
outcomes in the spread sheet CR-HS-Example-mapping-ProfComp-GA.
Reporting achievement of learning outcomes through assessment tasks is done under the same six
threshold learning outcomes for each discipline.
The six common domains are:


Demonstrate professional behaviours
Assess individual and/or population health status and, where necessary, formulate,
implement and monitor management plans in consultation with
patients/clients/carers/animal owners/communities
 Promote and optimise the health and welfare of individuals and/or populations
 Retrieve, critically evaluate, and apply evidence in the performance of health-related
activities
 Deliver safe and effective collaborative healthcare
 Reflect on current skills, knowledge and attitudes, and plan ongoing personal and
professional development
The rows represent the groupings of discipline accreditation standards under each of the six
common domains. They are stated as professional entry-level learning outcomes.
Using the spread sheet
Sample – Spread sheet populated with TLO and Professional Accreditation statements for Dentistry,
then filled out by faculty with sample types/ levels of assessment tasks and showing alignment with
the University’s graduate attributes(listed in Appendix 2).
Threshold learning outcome
Upon completion of their program of
AQF qualification type (level) of
competence required
Resource package and guide – Health Sciences Stage 2
Page 12
study, healthcare graduates at professional
entry-level will be able to:
Retrieve, critically evaluate, and apply
evidence in the performance of healthrelated activities
Discipline accreditation standard Dentistry
Practise evidence-based dentistry
Assessment of developing
knowledge, skills and
competence (knows. knows
how, shows how)
Literature
review
92
Assessmen
t of
competen
ce (does)
SAQ4
Research
project
Clinical
case study
71
LONA3
9
Graduate
attribute
alignment
5
1,2,3,4,8
GA 5
Use contemporary information technology
7
7
7
7
for documentation, continuing education,
communication, management of
information and applications related to
health care
GA 1,2,3,6.7.8
Evaluate and integrate emerging trends in
7
7
9
9
health care as appropriate
GA 1,2,3,4,8
Formulate treatment plans which integrate
LONA
9
LONA
9
research outcomes with clinical expertise
and patient views
1 Learning outcomes assessed at AQF level 7
2 Learning outcomes assessed at AQF level 9
3 Learning outcomes not assessed
4 Short answer questions
5 The University of Adelaide Graduate Attribute(s) aligned with and assessed in this learning outcome.
Add columns if the purpose of the mapping requires more, (e.g. to display course or stream level
learning outcomes aligned with a professional accreditation standard or to display the alignment
with the University’s Graduate Attributes)
Across the X axis and in the light green area where it says ‘Assessment task a, b, etc.’ list the various
assessment tasks that assess one or more of the accreditation standards in the curriculum. Add
more columns if there are more assessment tasks.
Abbreviations for the types of assessment commonly used in the Faculty include:
CBL = Case-based learning – tutor report
CRE = Clinical reasoning examination
CS = Clinical skills report
MCQ = Multiple choice question
MEQ = Modified essay question
MHU = Medical home units attachment report
MPPD = Medical Professional and Personal Development journal
SHU = Surgical home units attachment – tutor report
OSCE = Objective Structured Clinical Examination
PCH = Paediatrics and child health – tutor report
SAQ = Short answer question
SCT = Script concordance test
Resource package and guide – Health Sciences Stage 2
Page 13
Each cell is then allocated an AQF level to denote the highest level of student achievement in
relation to each assessment task expressed as an AQF equivalent level as per the AQF descriptors
(see Appendix 3).
It is then possible to demonstrate, with ease, the highest level of student achievement relative to
the AQF across an entire TLO for each of the four disciplines, and where this occurs and how it is
assessed.
Information – other than an AQF level - may be assigned to X,Y axis cells. If so, directions like those
above would need to be written.
Putting it all together
For example - preliminary mapping to enable program comparison/alignment across a TLO domain
using the spreadsheet DMNO TLO professional competencies assessment Bloom's verbs.
The spread sheet can be reconfigured as in tab MDON#5 to cover one domain only (in this case the
focus of one of the LTICS themes – communication through ‘Deliver safe and effective collaborative
healthcare’) The spread sheet has been set up so it is easy to reconfigure the elements by disciple or
by domain depending on the purpose of the mapping or renewal exercise.
Directions for how this aggregated information, once assembled, would be interrogated and
interpreted for the purposes of learning and teaching in the integrated clinical school model still need
to be developed.
As a starting point, the questions developed for the case studies in the Harmonising project (pp 14.
15) could be adapted to interrogate and interpret the data in the templates.
1.
2.
3.
4.
5.
6.
Where are learning outcomes assessed in the curriculum?
What criteria do you use?
What assessment tools/approaches do you use?
What does the data set look like?
How is the standard determined for achieving learning outcomes?
How do these learning outcomes currently match the AQF?

What is the degree of potential alignment between existing individual program curriculum
mapping/recording of learning outcomes and the threshold learning outcomes?
What is the degree of alignment between the draft framework of common assessment
principles and program level assessment activities?
What are the participant perceptions of the feasibility of achieving common data sets of
teaching and related assessment activities that could meet the requirements of both
professional accreditation and institutional academic quality assurance activities?


Resource package and guide – Health Sciences Stage 2
Page 14
How to use: Program Mapping - University of Adelaide Graduate Attributes - Sequencing
Spread Sheet Graduate attributes and threshold learning outcomes program mapping template
Sheet 1
These instructions are included in the template.
The columns in this spread sheet represent The University of Adelaide Graduate Attributes.

Each attribute has been divided into Introduced or Developed or Assessed to map out how
and where each attribute is addressed in the program.
 Introduced = course learning outcomes do not focus on this attribute – but aspects of course
delivery and student experience may contribute. Certain attributes may be tacitly addressed
but not actively taught or assessed.
 Developed = course learning outcomes and learning and teaching activities focus on
preparing students to achieve the GA in a subsequent or related course – there may be
formative assessment, which sits with development.
 Assessed = a summative assessment task assesses student learning outcomes in relation to
the Graduate Attribute.
 Empty = this Graduate Attribute is not addressed in the course.
The rows in this spread sheet are for the list of courses in a program organised by year levels.
Completing the template
1. Enter the course codes of your program into Column A (organised by 1st Yr, 2nd Yr etc)
2. For the first course in the list identify the way each attribute is addressed in the course by
entering the number 1 into the corresponding cell (See example below) for an example).
3. Repeat this for all courses listed as a part of the program across all of the graduate attributes
Interpreting the spread sheet




Once the template is complete you will see that the cells with numbers entered will change
colour.
This will help to show the pattern of Graduate Attribute development and determine the
areas where there are gaps in the support for the development of a Graduate Attribute.
Across the years within a program you generally would generally see an appropriate pattern
of the Graduate Attribute occurring in the appropriate years (e.g. introduced in early years,
developed in middle years and assessed in later years).
The tallies for each year block of courses give a snapshot of the distribution of attributes
within each year.
Key to Interpreting Graduate Attributes sequencing data
Interpreting how well and where Graduate Attributes or Threshold Learning Outcomes
for Health are addressed across a Program (adapted from Griffith University Program
level mapping tool) http://www.griffith.edu.au/learning-teaching/studentsuccess/graduate-attributes/mapping-graduate-attributes
NOTE: this interpretation model can be used for any graduate/program or major learning
outcomes schema where a set of courses makes up something bigger e.g. a major or a program
that has a set of overarching learning outcomes or attributes statements. But first, the data about
the set of courses needs to be presented in a format that can be interrogated efficiently.
Resource package and guide – Health Sciences Stage 2
Page 15
No/few courses addressing a graduate attribute within a program - an attribute that
may be considered under-represented within a program. This suggests a need to choose
some (or some more) courses in which to embed this attribute development.
No/few graduate attributes being addressed within a course - a course that addresses
only a limited number of the graduate attributes (e.g. only knowledge and skill
development, and none of the others). This might prompt a course review to identify if it
is possible or relevant to integrate any further graduate attributes into the course’s
curriculum.
All courses within a program addressing a graduate attribute - an attribute could be
considered over-represented in a program because all of the courses address the
attribute. This might encourage a shift in focus for some courses or influence the future
design/ redesign of courses within the program. However, in some cases it may be
appropriate to have every course address a particular graduate attribute e.g.
‘comprehensive knowledge and skills relating to their discipline’.
Too many graduate attributes being addressed within a course - a course in which all
the graduate attributes are being addressed. This may prompt a review of this course to
identify if it is possible to focus more specifically on some rather than all of the graduate
attributes, since it is typically not necessary to address all the graduates attributes in any
single course. It may be appropriate in some instances for a course to address all of the
graduate attributes e.g. a capstone course designed for developing and assessing the full
range of professional or disciplinary skills.
Sequencing the development of graduate attributes across a program - the courses, in a
series across year levels, addresses the same graduate attribute. This provides an
opportunity for this program to consider sequencing the incremental development of the
graduate attributes across these courses.
No sequencing of the development of graduate attributes across a program - an
attribute is only addressed in the first years of the program and not the final years of a
program (this situation could be reversed also with attention to a graduate attribute
occurring only in Iater years). This suggests that there may be gaps in the support for the
development of this attribute and it may require a review of course content to address
these gaps.
How to use the Program Mapping – Threshold Learning Outcomes - Sequencing Spread
Sheet Graduate attributes and threshold learning outcomes program mapping templates Sheet 2
These instructions are included in the xlxs template.
The Columns in this spread sheet represent the Threshold Learning Outcomes for Health professions
(TLO).
Each TLO has been divided into Introduced, Developed and Assessed segments.

Introduced = course learning outcomes do not focus on this attribute – but aspects of course
delivery and student experience may contribute. Certain learning outcomes may be tacitly
addressed but not actively taught or assessed.
Resource package and guide – Health Sciences Stage 2
Page 16



Developed = course learning outcomes and learning and teaching activities focus on
preparing students to achieve the TLO in a subsequent or related course – there may be
formative assessment, which sits with development.
Assessed = a summative assessment task assesses student learning outcomes in relation to
the TLO.
Empty = this TLO is not addressed in the course.
The Rows in this spread sheet are for the list of courses in a program organised by year levels. Add
more sheet rows, as needed
Completing the template
1. Enter the course codes of your program into Column A (organised by 1st Yr, 2nd Yr etc)
2. For the first course in the list identify the way each learning outcome is addressed in the
course by entering the number 1 into the corresponding cell.
3. Repeat this for all courses listed as a part of the program across all of the TLOs
Interpreting the spread sheet




Once the template is complete you will see that the cells with numbers entered will change
colour.
This will help to show the pattern of TLO development and determine the areas where there
are gaps in the support for the achievement of the TLO upon completion of the relevant
degree.
Across the years within a program you should generally see an appropriate pattern occurring
in the appropriate years (e.g. Introduced in early years, Developed in middle years and
Assessed at the level of the TLO in later years).
The tallies for each year block of courses gives a snapshot of the distribution of the
introduction, development of assessment of the TLO within each year.
Interpreting the TLOS in a major or program (adapted from Griffith University Program
level mapping tool)
Interpreting how well and where Graduate Attributes or Threshold Learning Outcomes
for Health are addressed across a Program (adapted from Griffith University Program
level mapping tool) http://www.griffith.edu.au/learning-teaching/studentsuccess/graduate-attributes/mapping-graduate-attributes
NOTE: this interpretation model can be used for any graduate/program or major learning
outcomes schema where a set of courses makes up something bigger e.g. a major or a
program that has a set of overarching learning outcomes or attributes statements. But
first, the data about the set of courses needs to be presented in a format that can be
interrogated efficiently.
No/few courses addressing a TLOS within a major/program – a TLOS may be considered
under-represented within a major/program. This suggests a need to choose some (or
some more) courses in which to embed this development.
Resource package and guide – Health Sciences Stage 2
Page 17
No/few TLOS being addressed within a course – a course that addresses only a limited
number of the TLOS (e.g. only knowledge and skill development, and none of the others).
This might prompt a course review to identify if it is possible or relevant to integrate any
further TLOS into the course’s curriculum.
All courses within a major/program addressing a TLOS - a TLOS could be considered
over-represented in a major/program because all of the courses address the attribute.
This might encourage a shift in focus for some courses or influence the future design/
redesign of courses within the major/program. However, in some cases it may be
appropriate to have every course address a particular TLOS e.g. ‘scientific knowledge:
demonstrating well developed knowledge in at least one disciplinary area.
Too many TLOS being addressed within a course – a course in which all of the TLOS are
being addressed. This may prompt a review of this course to identify if it is possible to
focus more specifically on some rather than all of the TLOS, since it is typically not
necessary to address all the TLOS in any single course. It may be appropriate in some
instances for a course to address all of the TLOS e.g. a capstone course designed for
developing and assessing the full range of professional or disciplinary skills.
Sequencing the development of TLOS across a major/program - each of the courses, in a
series across year levels, addresses the same TLOS. This provides an opportunity for this
major/program to consider sequencing the incremental development of the TLOS across
these courses.
No sequencing of the development of TLOS across a major/program – a TLOS is only
addressed in the first years of the major/program and not the final years of a
major/program (this situation could be reversed also with attention to a TLOS occurring
only in Iater years). This suggests that there may be gaps in the support for the
development of this learning outcome and it may require a review of course content to
address these gaps.
Resource package and guide – Health Sciences Stage 2
Page 18
Appendix 1: a framework of assessment principles
As part of the Harmonising project a framework of common assessment principles was developed.
Development of the framework acknowledged the importance of the following assessment
principles in relation to academic standards and professional accreditation expectations. Assessment
program development should be guided by:

use of blueprints/mapping that clearly articulate the relationship between the learning
outcomes and the assessment strategies

a combination of multiple assessment modes including direct observation

emphasis on criterion-referenced assessments

authentic, valid and reliable assessment methods

use of expert assessors who have participated in some form of calibration process

clearly articulated standards for individual or combined assessments using appropriate
methods.
Harmonising higher education and professional quality assurance processes for assessment of
learning outcomes in health – Final Report (2013), P 20 (in-print) Harmonising Final Report
Resource package and guide – Health Sciences Stage 2
Page 19
Appendix 2: University of Adelaide Graduate Attributes
The University’s statement of Graduate Attributes includes the following:

Knowledge and understanding of the content and techniques of a chosen discipline at
advanced levels that are internationally recognised.

The ability to locate, analyse, evaluate and synthesise information from a wide variety of
sources in a planned and timely manner.

An ability to apply effective, creative and innovative solutions, both independently and
cooperatively, to current and future problems.

Skills of a high order in interpersonal understanding, teamwork and communication.

A proficiency in the appropriate use of contemporary technologies.

A commitment to continuous learning and the capacity to maintain intellectual curiosity
throughout life.

A commitment to the highest standards of professional endeavour and the ability to take a
leadership role in the community.

An awareness of ethical, social and cultural issues within a global context and their importance
in the exercise of professional skills and responsibilities.
Resource package and guide – Health Sciences Stage 2
Page 20
Appendix 3: Comparison of Australian Qualifications Framework (AQF)
Requirements
AQF Learning Outcomes Qualification Type Descriptors
Comparison between qualification types at levels 6 (Advanced Diploma), 7 (Bachelor degree), 8
(Graduate Certificate and Graduate Diploma), 9 (Masters degree) and 9E (Masters degree extended)
KNOWLEDGE
6.

broad theoretical and technical knowledge with some depth in the underlying principles and
concepts in one or more disciplines

a broad and coherent body of knowledge, with depth in the underlying principles and
concepts in one or more disciplines as a basis for independent lifelong learning

will have advanced/specialised knowledge within a systematic and coherent body of
knowledge that may include the acquisition and application of knowledge and skills in a new
or existing discipline or professional area

a body of knowledge that includes the understanding of recent developments in a discipline
and/or area of professional practice
knowledge of research principles and methods applicable to a field of work and /or learning
7.
8.
9.

9E.


a body of knowledge that includes the extended understanding of recent developments in a
discipline and its professional practice
knowledge of research principles and methods applicable to the discipline and its
professional practice
SKILLS
6.




cognitive skills to identify, analyse and evaluate information and concepts from a range of
sources
cognitive, technical and creative thinking skills to demonstrate abroad understanding of
knowledge and ideas with some depth in a discipline
cognitive, communication and analytical skills to interpret and transmit responses to
sometimes complex problems
communication skills to make a clear and coherent presentation of knowledge and ideas
with some intellectual independence
7.




cognitive skills to review, critically analyse, consolidate and synthesise knowledge
cognitive and technical skills to demonstrate a broad understanding of knowledge with
depth in some areas
cognitive and creative skills to exercise critical thinking and judgement in identifying and
solving problems with intellectual independence
communication skills to present a clear, coherent and independent exposition of knowledge
and ideas
8.

cognitive skills to review, analyse, consolidate and synthesise knowledge and identify and
provide solutions to complex problems
Resource package and guide – Health Sciences Stage 2
Page 21




cognitive skills to think critically and to generate and evaluate complex ideas
specialised technical and creative skills in a field of highly skilled and/or professional practice
communication skills to demonstrate an understanding of theoretical concepts
communication skills to transfer complex knowledge and ideas to a variety of audiences

cognitive skills to demonstrate mastery of theoretical knowledge and to reflect critically on
theory and professional practice or scholarship
cognitive, technical and creative skills to investigate, analyse and synthesise complex
information, problems, concepts and theories and to apply established theories to different
bodies of knowledge or practice
cognitive, technical and creative skills to generate and evaluate complex ideas and concepts
at an abstract level
communication and technical research skills to justify and interpret theoretical propositions,
methodologies, conclusions and professional decisions to specialist and non-specialist
audiences
technical and communication skills to design, evaluate, implement, analyse and theorise
about developments that contribute to professional practice or scholarship
9.




9E





cognitive skills to demonstrate mastery of theoretical knowledge and to reflect critically on
theory and professional practice
cognitive, technical and creative skills to investigate, analyse and synthesise complex
information, problems, concepts and theories and to apply established theories to different
bodies of knowledge or practice
cognitive, technical and creative skills to generate and evaluate complex ideas and concepts
at an abstract level
communication and technical research skills to justify and interpret theoretical propositions,
methodologies, conclusions and professional decisions to specialist and non-specialist
audiences
technical and communication skills to design, evaluate, implement, analyse and theorise
about developments that contribute to professional practice
DEMONSTRATE APPLICATION OF KNOWLEDGE AND SKILLS
6.




with initiative and judgement in planning, problem solving and decision making in
paraprofessional practice
to adapt knowledge and skills in a range of contexts and/or for further studies in one or
more disciplines
to adapt fundamental principles, concepts and techniques to known and unknown situations
with responsibility and accountability for own learning and work and in collaboration with
others within broad parameters
7.



with initiative and judgement in planning, problem solving and decision making in
professional practice and/or scholarship
to adapt knowledge and skills in diverse contexts
with responsibility and accountability for own learning and professional practice and in
collaboration with others within broad parameters
8.

to make high level, independent judgements in a range of technical or management
functions in varied specialised contexts
Resource package and guide – Health Sciences Stage 2
Page 22


to initiate, plan, implement and evaluate broad functions within varied specialised technical
and/or creative contexts
with responsibility and accountability for personal outputs and all aspects of the work or
function of others within broad parameters
9.



with creativity and initiative to new situations in professional practice and/or for further
learning
with high level personal autonomy and accountability
to plan and execute a substantial research-based project, capstone experience and/or piece
of scholarship
9E.



with creativity and initiative to new situations in professional practice and/or for further
learning
with high level personal autonomy and accountability
to plan and execute a substantial research-based project, capstone experience and/or
professionally focused project
Resource package and guide – Health Sciences Stage 2
Page 23
Appendix 4: Recommended resources
Learning Outcomes and Constructive Alignment
Anderson, LW, Krathwohl, DR, Airasian, PW, Cruikshank, KA, Mayer, RE, Pintrich, PR, Raths, J &
Wittrock, MC 2000, A taxonomy for learning, teaching, and assessing: a revision of Bloom's
taxonomy of educational objectives, Pearson, Allyn & Bacon, NY.
Atherton, JS 2013, Learning and teaching; SOLO taxonomy, viewed March 2014,
<http://www.learningandteaching.info/learning/solo.htm>.
Baume, D 2009, Writing and using good learning outcomes, Leeds Metropolitan University, Leeds,
viewed 4 March 2014, <http://repositoryintralibrary.leedsmet.ac.uk/open_virtual_file_path/i3128n162822t/Writing%20and%20using%20goo
d%20learning%20outcomes.pdf>.
Biggs, J 2002, Aligning the curriculum to promote good learning, Constructive Alignment in Action:
Imaginative Curriculum Symposium, LTSN Generic Centre, 4 November 2002, viewed 4 March 2014,
<http://78.158.56.101/archive/palatine/files/1023.pdf>.
Biggs, J & Tang, C 2007, Teaching for quality learning at university, 3rd edn, Open University Press
McGraw-Hill Education, UK.
Clark, D Bloom's taxonomy of learning domains, viewed 4 March 2014,
<http://www.nwlink.com/~donclark/hrd/bloom.html#SOLO>.
Heer, R A model of learning objectives based on a taxonomy for learning, teaching, and assessing: a
revision of Bloom's taxonomy of educational objectives, Center for Excellence in Learning and
Teaching, Iowa State University, viewed 4 March 2014,
<http://www.celt.iastate.edu/teaching/RevisedBlooms1.html>.
Macquarie University, Setting learning outcomes, viewed 4 March 2014,
<http://staff.mq.edu.au/teaching/curriculum_assessment/assessment/toolkit/setting_outcomes/>.
Macquarie University, Writing learning outcomes in units, viewed 4 March 2014,
<http://mq.edu.au/iLearn/resources/units_learning_outcomes.htm>.
Race, P, Brown, S & Smith, B 2005, ‘Designing learning outcomes and linking them to assessment’,
extract from 500 Tips on Assessment: 2nd edn, Routledge, London, viewed 4 March 2014,
<http://phil-race.co.uk/most-popular-downloads/>.
University of Adelaide, Guide to writing learning outcomes, viewed 4 March 2014,
<http://www.adelaide.edu.au/learning/staff/curriculum/objectives/>.
University of Adelaide, University of Adelaide graduate attributes, University of Adelaide, viewed 4
March 2014, <http://www.adelaide.edu.au/learning/strategy/gradattributes/>.
Development and assessment of graduate attributes
Griffith University, Griffith graduate attributes, Griffith University, viewed 4 March 2014,
<http://www.griffith.edu.au/learning-teaching/student-success/graduate-attributes>.
Mehay, R & Burns, R 2009, Miller Pyramid and Prism, gp-training.net, viewed 4 March 2014,
<http://www.gp-training.net/training/educational_theory/adult_learning/miller.htm>.
Resource package and guide – Health Sciences Stage 2
Page 24
Miller, GE 1990, ‘The assessment of clinical skills/competence/performance’; Academic Medicine;
vol. 65, no. 9, pp. S63-S67, viewed 4 March 2014, <http://winbev.pbworks.com/f/Assessment.pdf>.
Race, P, Brown, S & Smith, B 2005, ‘Designing learning outcomes and linking them to assessment’,
extract from 500 Tips on Assessment: 2nd edn, Routledge, London, viewed 4 March 2014,
<http://phil-race.co.uk/most-popular-downloads/>.
University of Adelaide 2012, Assessment types, University of Adelaide, viewed 4 March 2014,
<http://www.adelaide.edu.au/learning/staff/assessment/introduction/assessmentTypes.pdf>.
University of Sydney, Assessment resources, University of Sydney, viewed 4 March 2014,
<http://www.itl.usyd.edu.au/assessmentresources/default.htm>.
University of Sydney, Assessment tasks of increasing complexity, University of Sydney, viewed 4
March 2014,
<http://www.itl.usyd.edu.au/assessmentresources/increasing_complexity_assessment.htm>.
University of Sydney, Assessment tasks of increasing complexity/matching, University of Sydney,
viewed 4 March 2014,
<http://www.itl.usyd.edu.au/assessmentresources/increasing_complexity_matching.htm>.
University of Sydney, Blooms revised taxonomy with matched sample verbs, learning outcomes and
assessment tasks, University of Sydney, viewed 4 March 2014,
<http://www.itl.usyd.edu.au/assessmentresources/Blooms_taxonomy.pdf>.
Assessment and group work
Australian Universities Teaching Council 2002, Assessing groupwork, University of Melbourne,
viewed 4 March 2014, <http://www.cshe.unimelb.edu.au/assessinglearning/03/group.html>.
Crebert, G, Patrick, CJ, Cragnolini, V, Smith, C, Worsfold, K, & Webb, F 2011. Teamwork Skills Toolkit,
2nd edn, Griffith University, viewed 4 March 2014,
<http://www.griffith.edu.au/__data/assets/pdf_file/0008/290870/Teamwork-skills.pdf>.
Isaacs, G 2002 Assessing group tasks, University of Sydney, viewed 4 March 2014
<http://www.itl.usyd.edu.au/assessmentresources/pdf/Link11.pdf>.
Macquarie University, Assessment tool kit, Macquarie University, viewed 4 March 2014,
<http://staff.mq.edu.au/teaching/curriculum_development/assessment/toolkit/>.
Health Sciences and Threshold Learning Outcomes
Australian Learning and Teaching Council 2011, Learning and teaching academic standards project
report, Australian Government, viewed 4 March 2014,
<http://www.olt.gov.au/system/files/resources/LTAS_report_architecture_building_education_scie
nce_2011.pdf>.
Boud, D 2010, Assessment 2020: seven propositions for assessment reform in higher education,
Australian Learning and Teaching Council, viewed 4 March 2014,
<http://www.olt.gov.au/system/files/resources/Assessment%202020_final.pdf>.
Boursicot, KAM, Roberts, T & Burdick, WP 2010, ‘Structured assessments of clinical competence’, in
T Swanwick (ed), Understanding medical education: evidence, theory and practice, Wiley-Blackwell
and the Association for the Study of Medical Education, Oxford, pp. 246–258.
Resource package and guide – Health Sciences Stage 2
Page 25
Department of Industry, Innovation, Science and Tertiary Education 2009, Transforming Australia’s
higher education system, Australian Government, viewed 4 March 2014,
<http://www.innovation.gov.au/HigherEducation/ResourcesAndPublications/TransformingAustralias
HigherEducationSystem/Pages/default.aspx>.
Jolly, B 2010, ‘Written examinations’, in T Swanwick (ed), Understanding medical education:
evidence, theory and practice, Wiley-Blackwell and the Association for the Study of Medical
Education, Oxford, pp. 208–231.
Norcini, J 2010, ‘Workplace assessment’, in T Swanwick (ed), Understanding medical education:
evidence, theory and practice, Wiley-Blackwell and the Association for the Study of Medical
Education, Oxford, pp. 323–245.
O’Keefe, M & Henderson, A 2011, ‘Identifying common learning outcomes in health through crossdisciplinary collaboration’, paper presented at the ANZAHPE conference, Alice Springs, 27 June-1
July.
O’Keefe, M & Henderson, A 2012, ‘Being TEQSA ready—harmonising the layers of regulation’,
Campus Review, 19 March, viewed 4 March, 2014
<http://www.campusreview.com.au/blog/2012/03/being-teqsa-ready-harmonising-the-layers-ofregulation/>.
O’Keefe, M, Henderson, A & Pitt, R 2011, Learning and teaching academic standards statement for
health, medicine and veterinary science, Australian Learning and Teaching Council, Sydney, viewed 4
March 2014, <http://www.olt.gov.au/system/files/resources/altc_standards_HMVS_210611.pdf>.
PBworks, Discipline Standards in Australia 2013, viewed 4 March 2014,
<http://disciplinestandards.pbworks.com/w/page/52657697/FrontPage>.
Resource package and guide – Health Sciences Stage 2
Page 26