TO:
Department Chairs and Program Directors
FROM:
Deans, Lori Knapp, Deputy VPAA, Kathleen Morley, University
Director of Assessment, and Gladys Schyrnemakers and Philip
Wong, Co-Chairs of the Brooklyn Campus Outcomes Assessment
Committee
DATE:
October 2010
RE:
Assessment of Student Learning at the Program Level: Timeline
and Processes
Ongoing commitment from faculty to outcomes assessment is imperative for two
primary reasons. One, it allows for the continuous improvement of the teaching
and learning environment. Two, it is vital to meeting Middle States assessment
standards. The curriculum belongs to the faculty. Faculty leadership in outcomes
assessment is critical to its improvement. Our next Middle States site visit is in
2012-13. This gives us two academic years to meet assessment standards that
entail the completion of a cycle of collecting and analyzing data on student
learning, and implementing curricular or pedagogical changes based on data
results (“closing the loop”).
Academic programs, including graduate programs, should anticipate submitting
assessment related information twice a year, every year on a permanent basis.
Each fall, programs are asked to indicate what will be assessed and how during
that current academic year. Each spring, programs are asked to report the actual
data, interpretation and proposed actions for teaching and learning.
These annual assessment efforts have been organized into three-year assessment
plans. Effective fall 2009, we began a three-year cycle of assessment of student
learning at the program level. In May 2010 programs submitted data based on
assessments undertaken in AY09-10. By November 15, 2010, programs will be
adding to what was submitted in May 2010 (if your program was asked for
Brooklyn • C.W. Post • Arnold & Marie Schwartz College of Pharmacy and Health Sciences • Brentwood • Riverhead • Rockland • Westchester • Global College •
Tilles Center for the Performing Arts • Kumble Theater for the Performing Arts
revisions since May 2010, please add to the latest version submitted). This is a
cumulative three-year report (AY09-10 through AY11-12).
We have a new addition to last year’s report and a semi-new request. We are
asking programs to add a brief narrative at the beginning of the report explaining
the rationale for the three-year assessment plan. This narrative is an opportunity
to explain how the proposed assessments address both end of program learning
and learning acquired across the curriculum. It is also an opportunity to
communicate important context for the program. Also, as we have indicated in a
number of meetings, we are asking programs to begin keeping a record of their
engagement in the assessment process (see Step Seven).
Please complete the following steps for the November 15, 2010, submission:
STEP ONE: Add a brief narrative addressing the rationale to the three-year assessment
plan. Please see revised assessment template for instructions. Note that you will simply
cut-and-paste the new rationale section in the attached revised template to the program’s
most recent version of the cumulative three-year assessment plan.
STEP TWO: Check to see that last year's report has the following:
- Academic program mission statement
- Five program learning goals (to be assessed AY09-10 through AY11-12)
- Complete information in the AY09-10 table, making any requested revisions
- Copies of measurement tools (test items, rubrics, survey items, etc.) used in AY09-10
STEP THREE: Meet to discuss the action steps proposed in May 2010 on the AY09-10
assessment report. Make specific plans about what actions will be taken by whom. Be
prepared to report what was actually done in response to these proposed action steps in
the May 2011 plan.
STEP FOUR: Meet to discuss what will be assessed and how in AY10-11.
STEP FIVE: Complete the AY10-11 table in the assessment plan (remember that you are
adding to last year's document). Identify goals, objectives, and measures to be applied in
AY10-11. Also, attach the measurement tools (test items, rubrics, survey items, etc.) to
be used in AY10-11.
STEP SIX: Email the updated three-year assessment plan (which includes AY09-10 and
AY10-11 information) to the appropriate Outcomes Assessment Committee Liaison (see
Brooklyn • C.W. Post • Arnold & Marie Schwartz College of Pharmacy and Health Sciences • Brentwood • Riverhead • Rockland • Westchester • Global College •
Tilles Center for the Performing Arts • Kumble Theater for the Performing Arts
http://www2.brooklyn.liu.edu/oa/committee.html for a list of liaisons) with a cc: to the
Dean, and if in Conolly to the Division Head, by November 15, 2010.
STEP SEVEN: Keep an electronic folder of assessment materials for the academic
program, e.g., documentation of participation in faculty development opportunities
related to assessment, faculty discussions about assessment data, curricular and
pedagogical changes based on assessment data, engagement in assessment committee
work (at program, campus, or university levels), assessment reports (including
assessment sections of self studies), and internal and external feedback on assessment
reports.
Attached are four documents to assist you. The first, Sample Program Learning
Assessment Plan, illustrates what information is needed to complete a three-year
assessment plan. Each goal has two student learning objectives, and each student
learning objective has two measures, at least one of which is direct. The second
attachment, the assessment template, Program Learning Assessment Plan form,
illustrates what each program will complete in the course of three years. This
blank form can also be found at http://liu.edu/Academic-Affairs/OutcomesAssessment.aspx. The third, Rubrics Overview, offers a quick introduction to
rubrics and includes links to both sample and blank rubrics. The final document
is the article, “Assessing Your Program Level Assessment Plan,” by Susan
Hatfield. This article provides a nice context for assessment of student learning.
As previously indicated, each program will assess two student learning goals in
AY10-11. This annual assessment will be submitted in two phases. In Phase I,
programs will submit goals, objectives, and measures, including measurement
tools, by November 15. In Phase II, programs will submit assessment results by
May 31. Deans will also be providing analysis of these reports to the Deputy
VPAA, the University Director of Assessment, and Co-Chairs to the Faculty
Branch of the Outcomes Assessment Steering Committee.
Brooklyn • C.W. Post • Arnold & Marie Schwartz College of Pharmacy and Health Sciences • Brentwood • Riverhead • Rockland • Westchester • Global College •
Tilles Center for the Performing Arts • Kumble Theater for the Performing Arts
The timetable for this year is:
November 15: Phase I - Programs will submit Phase I for AY10-11 of the assessment
template, along with the completed information for AY09-10 and measurement tools
for both AY09-10 and AY10-11, electronically to the appropriate Outcomes
Assessment Committee Liaison. The liaison will forward to the Dean, and if
appropriate Division Head, through the School/College’s Shared Drive.
December 6: Deans will forward electronically an analysis of the quality and
relevance of the work performed to Lori Knapp, Kathleen Morley, Gladys
Schrynemakers, and Philip Wong.
May 31: Phase II - Programs will submit Phase II for AY10-11 of the assessment
template electronically to the appropriate Outcomes Assessment Committee Liaison,
the Dean, and Division Head, if appropriate.
June 21: Deans will forward electronically an analysis of the quality and relevance of
the work performed to Lori Knapp, Kathleen Morley, Gladys Schrynemakers, and
Philip Wong.
June 30: All Departmental Reports and Dean’s analyses will be posted on Sharepoint.
Please note that additional information is available on the Academic Affairs
Assessment website, http://liu.edu/Academic-Affairs/Outcomes-Assessment.aspx,
including a PowerPoint presentation, Introduction to Assessment of Student
Learning, which provides links to information about rubrics and other
measurement tools. Feel free to contact us with questions. We are looking
forward to working closely with you in this coming year.
Cc: Chairs of Faculty Senate and Pharmacy Council.
Enclosures: Sample Program Learning Assessment Plan; Blank Program Learning
Assessment Plan; Rubrics Overview; Assessing Your Program Level Assessment Plan
Brooklyn • C.W. Post • Arnold & Marie Schwartz College of Pharmacy and Health Sciences • Brentwood • Riverhead • Rockland • Westchester • Global College •
Tilles Center for the Performing Arts • Kumble Theater for the Performing Arts