Embedded Assessment PowerPoint

Academic Foundations
Assessment
Using Embedded Assessment
1
Current Data
„
„
„
Dr. Khaleel student survey data
Dr. Hardt student survey data
Anecdotal data regarding student, faculty
and administrative perceptions of general
education
2
Program Assessment and Revision
„
„
Objectives defined
Essential components:
Skills development and application
Cultural development
Intellectual growth and development
Bloom’s Taxonomy of Thinking
3
Program Assessment and Revision
„
„
„
Five categories developed
Student outcomes set for each category
Assessment matrix developed to:
A) Assess proposed courses for
appropriateness
B) Enable course developers to ensure that
their course meets Academic Foundation
objectives and that they have appropriate
assessment methods in place
4
Assessment of Student Outcomes
„
„
„
Tool or tools are needed in order to assess
student-based outcomes
Need to assess outcomes from individual
Academic Foundations courses as well as
long term program outcomes
Many tools exist, none may be perfect
5
Embedded Assessment
„
Type I
Data gathered on individual performance in
Academic Foundations courses
Since courses accepted in Academic Foundations
were subject to rubric-based approval, overall
student performance in these courses is a valid
contributor to program assessment
Student performance in classes could be analyzed
as a function of gender, age, ethnic background,
academic major etc….
6
Embedded Assessment
„
Type II
Data gathered from standardized tools used in Academic
Foundations courses
A) Assesses Academic Foundations outcomes
specific for that subcategory
B) Standardized within the subcategory for
consistency
C) Designed by faculty within the subcategory
D) Yields quantifiable data
E) Contributes to course grade
7
Embedded Assessment
„
Type III
Data gathered from standardized tools used in upper division
majors classes
A) Cumulative assessment of all Academic
Foundation objectives
B) Standardized university-wide for consistency
C) Could be administered in whole or in parts
D) Quality of participation contributes to course
grade
E) Subcategories evaluated by different
departments
F) Evaluation need not be done that semester
8
Advantages
„
„
„
„
„
„
„
The approach provides more than one source of
data
The approach fosters broad faculty involvement
The approach utilizes an existing framework of
courses with no need for out of class assessment
The approach creates a likelihood for students
being motivated to participate
The approach will yield data that is quantitative
The approach is amenable to many formats (i.e.
assessing every student in every course or
assessing courses on an alternating basis)
The tools used could be comprehensive, or subdivided into subtests to avoid being too
cumbersome.
9
Disadvantages
„
„
„
Designing the appropriate tools could be
difficult
Convincing faculty to participate with
enthusiasm could be a challenge
Do such tools assess ongoing skills and
understanding?
10
11
Faculty committees identify the most appropriate matrix
items for their subcategory
1 _______________
2________________
3________________
4________________
5________________
6________________
7________________
8________________
9________________
10_______________
11_______________
12_______________
13_______________
14_______________
15_______________
16_______________
17_______________
18_______________
19_______________
20_______________
21_______________
22_______________
23_______________
24_______________
1_______________
2_______________
3_______________
4_______________
5_______________
6_______________
25_______________
26_______________
27_______________
28_______________
29_______________
30_______________
12
Academic Foundations Committee ensures that all
Academic Foundation matrix areas are covered
Global Academic Skills
Mathematics English
_____
_____
_____
_____
_____
_____
_____
_____
Info. Literacy
_____
_____
_____
_____
Natural Sciences
Life Sci Physical Sci
_____
_____
_____
_____
_____
_____
_____
_____
Social Sciences History & Cultural Diversity Arts & Humanities
Social Sciences
History
_____
_____
_____
_____
_____
_____
_____
_____
Cultural
Cultural Diversity
_____
_____
_____
_____
Arts
Humanities
_____
_____
_____
_____
_____
_____
_____
_____
13
Faculty Committees Design Subcategory Tools
Using Academic Foundations Objectives,
Matrix Outcomes and Bloom’s Taxonomy
Matrix
1 __________
2 __________
3 __________
4 __________
5 __________
6 __________
Subcategory-specific
Academic Foundations
Objectives
14
Ten Embedded Assessment Tools Provide
Assessment Data for Academic Foundations Courses
Global Academic Skills
Mathematics English
_____
_____
_____
_____
_____
_____
_____
_____
Info. Literacy
_____
_____
_____
_____
Natural Sciences
Life Sci Physical Sci
_____
_____
_____
_____
_____
_____
_____
_____
Social Sciences History & Cultural Diversity Arts & Humanities
Social Sciences
History
_____
_____
_____
_____
_____
_____
_____
_____
Cultural
Cultural Diversity
_____
_____
_____
_____
Arts
Humanities
_____
_____
_____
_____
_____
_____
_____
_____
15