Assessment of Student Learning Book

Assessment of
Student Learning
Created 2000
Revised 2002, 2005, 2010, 2014
Published 2015
Table of Contents
Introduction to Assessment of Student Learning at VCSU
3
Institutional Learning Goals and Outcomes
4
Learning Outcomes Assessment at VCSU
6
University Wide Assessment Framework
7
Academic Program Assessment of Student Learning
11
General Education Assessment of Student Learning
16
Classroom Assessment of Student Learning
20
Student Affairs Assessment of Student Learning
22
History of Ability Assessment
24
Valley City State University
Page 2 of 28
Introduction to Assessment of Student Learning at VCSU
Institutional assessment begins with the mission at Valley City State University:
Valley City State University is a public, regional university offering exceptional
programs in an active, learner-centered community that promotes meaningful
scholarship, ethical service, and the skilled use of technology. As an
important knowledge resource, the University offers programs and outreach
that enrich the quality of life in North Dakota and beyond. Through flexible,
accessible, and innovative baccalaureate and master's programs, VCSU
prepares students to succeed as educators, leaders, and engaged citizens in
an increasingly complex and diverse society (9/2013)
“Assessment is the systematic gathering of information about student learning, using
the time, knowledge, expertise, and resources available, in order to inform decisions
that affect student learning (Walvoord 2010, p. 2).”
In 2014, Valley City State University reviewed expectations for student learning at the
General Education, academic program, student affairs, and institutional levels. As a
result of this review, new goals and outcomes have been adopted at the institutional
and General Education levels. Program Learning Outcomes and measures have been
aligned to these new Institutional Learning Goals and Learning Outcomes.
Valley City State University has established three Institutional Learning Goals that
students are expected to achieve through their courses and activities. They will
achieve these goals through two identified Learning Outcomes for each goal.
Learning Goal: Skills
• Learning Outcome--Intellectual Skills: Students will demonstrate competence
in solving problems, communicating effectively, and showing respect for
diverse perspectives.
• Learning Outcome--Technological Skills: Students will utilize technology to
enhance learning, performance, and productivity.
Learning Goal: Knowledge
• Learning Outcome--Broad Knowledge: Students will demonstrate knowledge
from a variety of academic fields.
• Learning Outcome--Specialized Knowledge: Students will demonstrate
proficiency in the terminology, theories, methods, tools, literature, complex
problems, and application in a specific field of study.
Learning Goal: Application
• Learning Outcome--Civic Engagement: Students will develop civic insight and
informed responses that contribute to ethical service.
• Learning Outcome--Applied Learning: Students will synthesize [integrate]
skills and knowledge to demonstrate proficiency through practice and
experience.
Valley City State University
Page 3 of 28
The American Association for Higher Education (AAHE) Principles of Good Practice for
Assessing Student Learning guide VCSU’s assessment activities. The principles are:
1. The assessment of student learning begins with educational values.
2. Assessment is most effective when it reflects an understanding of learning as
multidimensional, integrated, and revealed in performance over time.
3. Assessment works best when the programs it seeks to improve have clear,
explicitly stated purposes.
4. Assessment requires attention to outcomes but also and equally to the
experiences that lead to those outcomes.
5. Assessment works best when it is ongoing, not episodic.
6. Assessment fosters wider improvement when representatives from across the
educational community are involved.
7. Assessment makes a difference when it begins with issues of use and illuminates
questions that people really care about.
8. Assessment is most likely to lead to improvement when it is part of a larger set of
conditions that promote change.
9. Through assessment, educators meet responsibilities to students and to the
public.
(American Association for Higher Education, 2010)
The Director of Institutional Research and Assessment, Assessment Committee,
General Education Council, Curriculum Committee, Faculty Senate, faculty,
Student Affairs, and students share responsibility for assessing and improving
student learning at VCSU. This booklet describes the various assessment
processes and activities.
Institutional Learning Goals and Outcomes
The Assessment Committee met in July 2014 to review and propose revisions to
Institutional Learning Outcomes. The committee reviewed the Defining
Commitments (Mission, Vision, University Purposes, and Core Values) and the
Lumina Foundation’s Degree Qualifications Profile (DQP), outlining six Institutional
Learning Outcomes within the broad goals of Knowledge, Skills, and Application.
Academic and student affairs programs reviewed their student learning
expectations to ensure that assessment measures highlighted the learning most
prominent within the programs. Students are required to demonstrate their
learning through the digital portfolio required of seniors prior to graduation.
Valley City State University
Page 4 of 28
The documents and processes resulting from these reviews significantly altered
the shape of Valley City State University learning assessment at the institutional,
General Education, and program levels.
The matrix below, highlights assessment target areas for each of the Learning
Outcomes. Pursuant to the campus-specific technology mission, technological skills
will be assessed in each of the noted program areas. Broad Knowledge and
Intellectual Skills will be targeted in General Education assessment. Specialized
Knowledge and Applied Learning will be a focus of the academic programs. Civic
Engagement will be targeted in Student Affairs program assessment.
Institutional
Learning
Goals
Skills
Institutional Learning Outcomes
Intellectual Skills: Students will
demonstrate competence in
solving problems,
communicating effectively, and
showing respect for diverse
perspectives.
Technological Skills: Students
will utilize technology to
enhance learning, performance,
and productivity.
Broad: Students will
demonstrate knowledge from a
variety of academic fields.
Knowledge
Application
Specialized: Students will
demonstrate proficiency in the
terminology, theories, methods,
tools, literature, complex
problems, and application in a
specific field of study.
General
Education
Learning
Outcomes
Academic
Program
Learning
Outcomes
Student
Affairs
Learning
Outcomes
TARGET
TARGET
TARGET
TARGET
TARGET
TARGET
Civic: Students will develop civic
insight and informed responses
that contribute to ethical
service.
Applied: Students will
synthesize [integrate] skills and
knowledge to demonstrate
TARGET
TARGET
Valley City State University
Page 5 of 28
proficiency through practice and
experience.
Table 1: University Learning Outcome Assessment Matrix
Learning Outcomes Assessment at VCSU
Learning Outcomes assessment occurs in four main areas at VCSU:




Classroom Assessment of Student Learning
General Education
Program Planning and Review
Student Affairs
The respective staff, faculty, council, or committee review data and evidence to
assess learning and are responsible to make necessary changes to improve
student learning.
The Director of Institutional Research and Assessment, along with the Assessment
Committee, coordinates assessment of academic and non-academic student
learning activities with information from program reviews and Annual Program
Updates (APU’s), portfolios, and surveys to inform the reflection and planning in
each area, leading to the implementation of new teaching strategies, course
revisions, program improvements, and curricular changes. See Figure 1.
This process acknowledges and strengthens the integral relationships between
General Education and major programs and documents the overall effectiveness
of student learning at VCSU.
Valley City State University
Page 6 of 28
Figure 1: Student Learning Assessment
University-Wide Assessment Framework
As the scope of assessment widens, it involves multiple committees, academic
and student affairs programs in a well-planned and organized cycle. Central to this
process is the central collection point or person for the data and the accountability
of committees and academic and non-academic programs for reporting,
disseminating, and publishing the summative results of the assessments.
The Director of Institutional Research and Assessment serves as the central office
for campus assessment. The Assessment Committee advises the Director while
serving as a conduit between the Director and programs. The roles of this office
include: conducting and reporting on student surveys, assisting with the annual
General Education Review, Program Review, and Annual Program Update, and
Student Affairs Annual Report processes. In addition, this office has facilitated in
creating Student Affairs Learning Outcomes; established dashboards for reporting
enrollment, retention, program completion, survey results; and assisting in
accreditation processes.
Aims of University-Wide Assessment:
 Provide a continuous source of essential information for instructional
improvement and assessment of student academic achievement
 Provide information for making institutional decisions about budget, strategic
planning, faculty development, and program changes
 Provide a framework for Learning Outcomes assessment across academic
and non-academic programs
 Provide a well-planned systematic process for data collection
Undergraduate Assessment of Student Learning
Learning Outcome assessment at VCSU is designed to develop an overall
understanding of student achievement. The Learning Outcomes provide a
framework for tracking growth in student learning from initial work in the General
Education courses, the academic and non-academic programs, and the Senior
Portfolio. University-Wide Learning Outcome assessment allows the University to:




Demonstrate the development of each Learning Outcome during the
undergraduate educational experiences at VCSU
Ensure a consistent and quality educational experience for all students
Assess learning experiences in General Education courses and strengthen
the links between General Education and major
Effectively provide data for Institutional Review and Curriculum Planning
Valley City State University
Page 7 of 28
The University-Wide Assessment Framework Includes:



Student surveys: Surveys are conducted in the fall for incoming freshmen,
in the spring with upper level general education students, and both fall and
spring with graduating seniors. The formative surveys were implemented
Fall 2009 for the purpose of showing students’ perceived growth.
Portfolios: Every graduating senior must submit a digital portfolio. Portfolios
are based on the program Learning Outcomes within the student’s major
field of study and are evaluated by the faculty in the student’s academic
major. The portfolio review provides programs with information about
student growth in their areas and provides validation of the program’s
Learning Outcomes project assessment.
Program Review: General Education, academic programs, non-academic
programs participate in annual reviews. The Director of Institutional
Research and Assessment helps facilitate these reviews.
University-Wide Assessment consists of information gathered from student
surveys, Senior Portfolios, program assessment, General Education assessment,
and a variety of other sources. The results from these formative and summative
assessment measures are made available to academic units throughout the
institution.
Figure 2: University-Wide Assessment
Figure 2 illustrates that the Director of Institutional Research and Assessment,
Assessment Committee, APAC, and the Executive Team apply the data to the
Valley City State University
Page 8 of 28
strategic planning process and budget decisions. The Curriculum Committee, the
General Education program, and academic programs also use the data for
program improvement and classroom assessment.
University-Wide Assessment is a valuable tool in budget and strategic planning,
course modifications, changes in faculty assignments, curricular decisions, and
faculty development opportunities.
Assessment System Diagram:
The following diagram depicts the Valley City State University Assessment System,
developed in accordance with the description within Walvoord (2010, p. 32).
Data-informed decisions may include faculty revising course projects to improve
student learning. Programs may revise requirements in accordance with discipline
or field standards. Campus leaders may adjust program resources in accordance
with enrollment trends or pursue strategic initiatives to meet stakeholder needs.
Figure 3 below highlights areas addressing three fundamental questions:



Data: What types of student learning data are available?
Digestion: How is the data collected, analyzed, and disseminated?
Decisions: How does the data inform decisions on policies, planning, and
budgeting?
Valley City State University
Page 9 of 28
Figure 3: Assessment System Diagram (Revised April 2015)
Valley City State University
Page 10 of 28
Principal Indicators for Institutional Assessment:
The individuals and processes noted within this section set forth the framework for
collecting, disseminating, and utilizing student learning assessment data at VCSU.
The Director of Institutional Research and Assessment, Assessment Committee,
General Education Council, academic and non-academic departments/programs,
and Cabinet/Executive Team members all serve to provide a continuous
assessment and feedback loop for improving student learning.
The following instruments are used for assessment at VCSU:
Learning Outcome Assessment
 Student Learning Outcome Survey
 Rubric for Senior Portfolio
 Noel-Levitz Surveys (NSSE, SSI, PSOL)
Academic departments and programs
 Program reviews
 Student Learning Outcomes
 NSSE Student Engagement Survey results by major
VCSU provides resources and support for the assessment process through:
 Director of Institutional Research and Assessment: Assists with gathering
institutional data, the portfolio evaluation process, and program assessment
 Assessment Committee: Advises the Director of Institutional Research and
Assessment while serving as a conduit between the director and programs
 Regular trainings, workshops, and other activities:
 Faculty development resources: Assist individuals and departments working
to develop or improve assessment activities
 VPAA office: Enhances effective decision making and fosters accountability
by integrating the planning and budgeting process with the results of
assessment
 Mini-grants: Support research and evaluation activity by individuals, majors,
or departments
 Data maintenance: Data is summarized and published annually or by term.
Academic Program Assessment of Student Learning
Program assessment activities are used to review and understand teaching (learning)
effectiveness within a program. The VCSU Learning Outcomes framework and
national standards aid in the development and assessment of program goals and
student outcomes. Assessment of these goals and student outcomes feed into the
Valley City State University
Page 11 of 28
overall program review. Program review identifies strengths and challenges, develops
goals for program direction, determines budget and curriculum changes, and other
program revisions. Program revisions are implemented while continuous assessment
of student Learning Outcomes occurs. Figure 4, below, illustrates the cycle of
program review and assessment.
Figure 4: Program Review and Assessment
Aims of the Program Review:









Assure program effectiveness
Assess Program Learning Outcomes
Provide an overview of the current program
Identify strengths and challenges
Develop short and long term goals for program direction
Determine (provide rational for) budget and curriculum changes
Develop or review program goals to guide program planning
Provide continuous assessment of student learning and outcomes
(methods of implementation and effectiveness of assessment)
Provide evidence of learning and program quality
Learning Outcome Assessment and Program Review
Learning Outcome assessment at the academic program level is designed to develop
an overview of student competencies in the major. The Learning Outcomes provide a
framework for examining and understanding of student learning in the program. With
the VCSU Institutional Learning Outcomes imbedded into the program content,
divisions/departments can document student learning.
Valley City State University
Page 12 of 28
All programs have developed Learning Outcome maps identifying (by project and
course) the program Learning Outcomes in the program of study. Students must
demonstrate the program Learning Outcomes, aligned with Institutional Learning
Outcomes, at an advanced level in their digital portfolios when they graduate.
Programs will then examine program learning outcome proficiencies demonstrated in
the Senior Portfolios to measure their students’ competencies against the University
norm and make decisions about curriculum and student learning in their programs.
Program data collection will measure the effectiveness of these changes.
The Process of Program Planning and Review:
Faculty complete two complementary program review activities. The first, the Annual
Program Update, provides documentation of short term goals, annual assessment
data, and annual budget/curricular decisions. These are due in September of each
year. The second, the formal program review, completed approximately every six
years, provides a comprehensive review of the program, shapes long-term goals and
assesses program viability. The Director of Institutional Research and Assessment
reviews results of both activities through processes outlined below. A summary of
program reviews is submitted annually to the North Dakota University System office.
The Annual Program Update
Faculty identify short-term goals for their programs. In the Fall of each academic year
programs are asked to report on the achievement of these plans, provide
assessment data for their Learning Outcome measures and portfolio review, and
recommendations for the future. Information contained within the annual program
update must accompany budget or curricular requests.
The update must include the following information:







Annual student information--# in major; # graduates
Success of recent graduates
Learning Outcomes—annual data
Annual portfolio data
Narrative: short term annual goal and progress made/success
Updates on actions identified in program’s strategic plan
Short term goals set for upcoming year
The Director of Institutional Research and Assessment reviews Annual Program
Updates annually with the following rubric, summarizing recommendations for the
VPAA, Assessment Committee, APAC and the Cabinet. The rubric follows in Table 2.
Program Data
Developing—Needs
Attention
Data is collected
without regard for
purpose or selectivity;
Workable
Target
Data has been selected
and collected for specific
purposes; annual data is
Annual data (as identified in
“Workable”) is added to the
Valley City State University
Page 13 of 28
Learning
Outcomes
graphics are hard to
read and trends are
not readily visible.
Learning Outcomes
are identified.
added to the tables, which
are formatted for easy
reading.
Learning Outcomes are
identified, along with
assessment processes for
each. Baseline data is
presented.
Program
Learning
Outcome
Map
Other
Assessment
Map includes
outcome for each
required course in
major
Praxis II scores are
reported
Map identifies specific
project for each required
course in major
Program
Goals—Long
Range
Long range goals are
stated but not
connected to strategic
plan
Short term goals are
missing or are stated
too generally to
document
achievement.
Long range goals are
drawn from strategic plan
Program
Goals—short
term
Reflection
Included little or no
reflection found.
In addition to Praxis II
scores, department has
identified other
assessment processes to
track
Plan identifies several
specific short term goals;
expected results may need
to be defined or processes
may need improvement to
produce measurable
results.
Reflection discusses
annual activity,
incorporating assessment
data, progress on program
goals, and the yearly
achievements of faculty
and students in the
program.
tables and trends are both
noted and discussed.
Learning Outcomes and
their assessment processes
are identified; baseline data
is presented and tied to
action plan (short term
goals)
Should include how the
review and use of the map
caused changes in the
projects.
Program has developed a
set of connected
assessments that
document program
effectiveness and provide
meaningful data to support
curricular and budget
requests.
Progress on long range
goals identified in strategic
plan is documented.
Program faculty identify one
or two actions achievable
during the course of the
academic year. Goals are
stated specifically and
results are observable.
Reflection discusses
accountability from previous
year and should include
changes and the result of
changes on the quality of
the program. Over time this
should be the overview.
Table 2: Annual Program Update Rubric
Formal Program Review
Formal program review generally occurs on a six-year cycle, although some
programs are reviewed more frequently because of the rapidly changing nature of
the field or the demands of accreditation. The VPAA has established the program
review on a six year rotation.
*The State Board of Higher Education does not require program reviews for
stand-alone minor programs, though Annual Program Updates are required. State
Board approved Certificates must complete a program review. Program
Valley City State University
Page 14 of 28
accreditation reports serve as a program review for programs requiring outside
accreditation.
State Board of Higher Education Policy 403.1.2 mandates a formal program review
including the following information/processes:
1. A comprehensive self-study by the program faculty, a discussion of the
evaluation results with the relevant dean or vice-president, a written
statement of the evaluation's findings, and a written action plan describing
follow-up activities. Each succeeding evaluation of a given program shall
address the extent to which the program has successfully dealt with the
concerns of the preceding evaluation;
2. Diverse assessment activities, such as:






A site visit and review by a qualified consultant from another institution
A review by one or more faculty members from another program within
the institution
An assessment of student learning (for example, pre- and post-tests,
performance on professional or Graduate Record examinations, or other
appropriate methods)
A survey of program alumni to determine their current positions and
opinions of the program
A survey of current students to determine whether the program is
meeting their needs
Review and advice from the program advisory council or other
representatives of the employers of program graduates
The formal program review at VCSU must include the following information:






Program goals, external standards, and strategic plan
Learning Outcome maps and related assessment data from Annual
Program Updates
Student data and student survey/evaluation results; success of graduates
Additional assessment activities (see a-f, above): each program should
provide three separate assessment activities, with data collected annually.
Assessment of Program Quality—strengths/weaknesses/
opportunities/challenges
Recommendations; new long-term goals
Program Review Process
Table 3 illustrates the Program Review process. Program Reviews must be submitted
no later than June 30 of the year they are due.
Who Reviews
What
When
Purpose
Valley City State University
Page 15 of 28
1.
Program Faculty
Director of IR and
Assessment, VPAA
Entire
Program
Review
No later than
Sept 30
following
completion
Budget information
Quality Review
Program Planning
Strategic Planning
Executive
Team/APAC
3.. Assessment
Committee
4. Curriculum
committee
Summary
October
FYI/ Inform Decisions
Summary
October
Summary
October
Verification of
Assessment Plan
Close Curricular loop
5.
Summary
LastDecember
after
completes
review
2.
NDUS Chancellor
Process assurance/quality
overview
Table 3: Program Review Process
The Director of Institutional Research and Assessment reviews the formal program
review submissions each year and writes an executive summary before meeting with
the VPAA and program leaders to discuss the program review and recommendations.
The executive summary of the program review and recommendations is shared with
the Assessment Committee, Curriculum Committee, APAC, Executive Team, Cabinet,
and is forwarded to the NDUS Chancellor, in accordance with SBHE policy 403.1.2.
General Education and the Assessment of Student Learning
The General Education Council met in June 2014 to review and propose revisions to
assessment in the General Education program, based on the American Association of
Colleges and Universities (AACU) Liberal Education and America’s Promise (LEAP)
Essential Learning Outcomes. As a result of this and subsequent meetings, the
General Education Council outlined ten Learning Outcomes within the three General
Education Learning Goals of Literacies, Values, and Habits.
The General Education curriculum at VCSU is a unique blend of a menu of courses.
Faculty and the General Education Council have been instrumental in refining and
implementing the Learning Outcomes and Goals. General Education Faculty have
identified Learning Outcomes to be developed in their respective courses as well as
specific student projects within the course. Upon completion of the course, these
projects are used to assess the level of competency of identified Learning
Outcome/s.
The General Education Council has oversight responsibilities for the General
Education curricula and works with faculty to review syllabi, assure breadth of
coverage, and affirm commitment to the Learning Outcomes model.
Valley City State University
Page 16 of 28
With continual review, the courses and experiences that make up the General
Education curricula reflect the values of the university culture, a commitment to the
University’s mission, as well as the expectations of its faculty for all students. Table 4
lists the ten Learning Goals and their definition.
General
Education
Learning Goals
Values
Literacies
Habits
General Education
Learning Outcomes
Outcome Statement
Appreciation of the
arts/Aesthetics
The ability to understand, recognize the value in, and be
affected by the products of human endeavor, including the
visual, musical, literary, and performing arts.
Ethics
The conscientious determination of what makes an act
right or wrong, that includes an understanding of the value
system used for that decision, the ramifications, and the
importance of acting in accordance with established
principles.
Diversity
The acknowledgement of and respect for differences.
Communication
The conscious use of structural and presentational skills to
convey an intended message to a specific audience
through verbal, non-verbal and/or written expression.
Creative and
A comprehensive skill set that allows one to reach an
Critical Thinking
informed opinion, conclusion, and/or decision based on
observation, research, imagination, synthesis, and
reflections.
Quantitative
The number sense, mathematical understanding, and
Literacy
problem-solving abilities required for logical and analytical
thinking, and the ability to construct and communicate
viable arguments using numerical evidence.
Technological Skills The ability to research, use, and assess the appropriate
technology to solve a problem, and to understand how
technology impacts individuals and society.
Collaboration
The ability to work responsibly with others to achieve a
common goal and promote group success.
Civic Engagement
Participation in the life of a community in order to improve
conditions for others or to shape the community’s future.
Holistic Health
The well-being of body, mind, and spirit, to enhance the
quality of life for self and others.
Table 4: General Education Learning Goals and Outcomes (Revised February
2015)
Table 5 illustrates the alignment of the General Education Learning Goals and Outcomes with the
Institutional Learning Goals and Outcomes. The Specialized Knowledge ILO and the Application
Institutional Learning Goal (comprising Civic Engagement and Applied Learning) are not aligned at the
General Education level since they are assessed within the programs.
Institutional
Learning Goals
Knowledge:
Institutional
Learning Outcome
Broad Knowledge:
General Education
Learning Goals
Values
General Education
Learning Outcomes
Appreciation of the
Arts/Aesthetics
Valley City State University
Page 17 of 28
Ethics
Diversity
Skills:
Specialized
Knowledge:
Intellectual Skills
Habits
Holistic Health
Literacies
Communication
Creative and Critical
Thinking
Quantitative Literacy
Habits
Collaboration
Civic Engagement
Technological Skills:
Application
Literacies
Technological Skills
Civic Engagement
Applied Learning
Table 5: Institutional and General Education Goals and Outcomes (Revised
April 2015)
Assessment activities help elevate campus awareness and are a valuable
means in fostering curricular change to enhance the General Education
program. These processes provide a means of ensuring that General Education
Learning Outcomes are being met through course curricula.
The Aims of General Education Assessment:




Promote a learner-centered classroom environment
Assure a quality General Education program that meets student needs
Examine University-wide student progress in each of the General Education
Learning Outcomes
Develop the integration of technology for success
The Learning Outcomes and General Education
General Education courses comprise almost one-third of a student’s VCSU
coursework. These courses provide the distinctive mark of the University’s
culture and values, setting the foundation for a student’s journey into a major
and on to graduation. General Education course syllabi must list a Learning
Outcome project measuring student learning. Each General Education course
must meet at least one of the Learning Outcomes established by the General
Education Council and may address up to three Learning Outcomes.
General Education’s Cycle of Assessment and Revision
The General Education Council is responsible for the program review. This
review, with recommendations for revision, is presented to the General
Valley City State University
Page 18 of 28
Education Program Faculty, the Vice-President for Academic Affairs, and the
Academic Policies and Affairs Committee (APAC), which then discuss and act on
the findings of the program review. Faculty make program decisions, while APAC
provides the VPAA with input for budget decisions and strategic planning.
In Spring 2013, the General Education Council and Director of Institutional
Research and Assessment began conducting annual meetings with General
Education faculty to review courses in their respective areas as recommended
by Walvoord (2010). The meetings are intended to reaffirm General Education
course connections, evaluate projects for strengths and concerns, identify
General Education course changes, and determine actions that the department
desires from the institution in regard to General Education offerings. The
Director of Institutional Research and Assessment provides student projects to
the departments to facilitate department review of their General Education
courses. The Director of institutional Research takes meeting minutes and
returns them to the departments for additional feedback prior to being finalized.
The Director of Institutional Research and Assessment compiles a summary
report of findings for the General Education Council, Assessment Committee,
Curriculum Committee, APAC, and Executive Team.
Assessment data from the annual General Education assessment meetings and
other appropriate measures are collected annually, with discussion, revision,
and subsequent implementation as necessary. Assessment results are
disseminated to the General Education faculty, the General Education Council,
Curriculum Committee, APAC, and Assessment Committee. The process
depicted in Figure 5 below recurs annually.
Valley City State University
Page 19 of 28
Figure 5: Assessment of General Education
Principal Indicators for Assessing Student Learning in General Education:






General Education syllabus template
General Education project template including project description, and
assessment tool (rubric)
General Education Learning Outcome Map
The General Education Council and Director of Institutional Research and
Assessment facilitate an annual General Education review.
The student’s assessment of his/her progress in the Learning Outcomes
indirectly assesses freshman, sophomores, and seniors.
Other survey instruments providing relevant data include: Noel-Levitz
Student Satisfaction Inventory, Priorities Survey for Online Learners, the
National Survey of Student Engagement, and graduate/employer surveys.
Classroom Assessment of Student Learning
Classroom assessment techniques are brief activities designed to elicit
feedback that shows the instructor how effectively students are learning. This
feedback assists the instructor in improving teaching methods and helps the
instructor target learning so as to build on student strengths and bridge or
complete gaps in student knowledge. Through shared feedback, students can
better understand their learning processes and become more effective,
reflective learners. Classroom assessment may also provide the basis for
classroom research.
The Aims of Classroom Assessment:






Inform the instructor about student learning
Meet course objectives
Promote learner-centered classroom environment
Encourage reflection in both teaching and learning
Ensure quality education
Evaluate the effectiveness of learning tools and identify ways to improve
their use
Valley City State University
Page 20 of 28
Figure 6: Classroom Assessment
Figure 6 illustrates the cycle of continuous improvement made possible through
classroom assessment of student learning. Classroom Assessment Activities,
along with information the instructor gathers from sources outside the
classroom, including program review, the institution’s learning outcome
assessment, and faculty development resources, provide information for
instructor reflection to improve the learning environment.
Reflection on this information leads to revision and planning, both short term
decisions about a particular class or teaching approach, and long term revisions
of the entire course and its relationship to the program curriculum.
Implementation of the changes leads the instructor back to classroom
assessment activities, to determine the effectiveness of the changes and the
continued effectiveness of student learning in the classroom.
The Learning Outcomes and Classroom Assessment
Every undergraduate course offered at VCSU includes a project in its syllabus
designed to help the student demonstrate one of the six Institutional Learning
Outcomes. These courses and their projects are mapped on program maps, to
assist both students and faculty in understanding how the Learning Outcomes
are developed throughout a student’s four year experience at VCSU. Faculty are
encouraged to develop a rubric and reflective element for these projects to
assist students in understanding and improvement.
Suggestions for Classroom Assessment Activities:

A reflective journal, or reflective activities: These may tie to the Learning Outcome
Project, or simply allow both faculty and students to monitor comprehension and
growth over the semester.
Valley City State University
Page 21 of 28




Short term “one-minute” lesson responses: These measures can be used to
check comprehension, identify knowledge gaps, and locate student learning
needs. A number of these activities are described in Angelo and Cross’s text,
Classroom Assessment Techniques: A Handbook for College Teachers, (1993).
Three copies of this resource book are available for overnight checkout at the
VCSU Library Reserve desk.
Holistic “how’s the class going” activities (also described in Classroom
Assessment Techniques): Help students and faculty identify effective learning
activities, understand and work with student concerns, and solve human
communication problems which may interfere with active student learning.
Assessment activities should not be linked to accountability: Grades on tests,
quizzes, and projects should not be considered classroom assessment data,
because they focus on the final product rather than the learning that preceded
the activity. For the same reason, the faculty evaluation report, used for tenure
and promotion, should not be used as a tool to assess the effectiveness of
student learning in the classroom.
Student Writing Assessment: Walvoord (2014) provided guidance for programs
and faculty on assessing student writing.
Student Affairs Program Assessment of Student Learning
In 2014, all Student Affairs programs developed Program Learning Outcomes,
aligning with the Institutional Learning Outcomes. These outcomes are as follows:
VCAB
 VCAB Coordinators will coordinate successful campus events.
 VCAB Members will attend meetings, share opinions and assist with event
preparations and participation.
Diversity and Student Success
 Students will facilitate creation of a more inclusive environment through
effective application of concepts related to diversity.
 Students will effectively implement techniques to improve their academic
success at VCSU.
Career Services
 After attending the “career search portion” of the portfolio class, 85% of the
students will feel very/extremely prepared in their ability to conduct a global
job search.
 After attending the “Job Search for Educators,” 80% of the students will feel
very/extremely prepared to conduct an effective job search.
 After participating in an internship experience, 85% of the students will have a
clearer path identified for themselves.
Valley City State University
Page 22 of 28
Counseling Services
 Students will be able to demonstrate familiarity about the availability of
mental health services on VCSU campus.
 VCSU students will gain an increased awareness of diversity concerning GLBT
populations.
Enrollment Services
 Conduct a successful campus tour.
 Complete preparation in order to provide prospective students with a
successful campus tour.
Financial Aid
 Students will understand the differences in federal loans and their
responsibilities regarding repayment.
 Students will demonstrate financial literacy in managing financial aid awards
to prevent loan defaults.
 Students will have an understanding of money management to assist with
college expenses.
 Students will understand credit cards and know the pitfalls to watch for.
Housing
 Resident Assistants that complete RA Training will have a deep understanding
of the skills necessary to carry out the duties of a resident assistant.
 Resident Assistants will successfully work together to create opening week
programs for campus students in order to enhance the first six weeks of the
student experience.
Valley City State University
Page 23 of 28
History of Ability Assessment
Early History: The 1995-96 Assessment Plan updated the 1994 report to NCA and
identified the ways the FIPSE grant (which focused on assessment) was guiding the
University toward an ability-based assessment model. The contacts with Alverno
College and the grants led to the organization of a set of campus forums and
encouraged open discussion of teaching and learning, and their outcomes. These
discussions referred to as Learner-Centered Education (LCE) meetings, set in motion
processes that took the then known, “Foundation Studies Objectives” and
transformed them (though a series of changes) into the currently known and used
Abilities. With the development of the Abilities and their related skills, faculty began
to embrace the concept of assessment in terms of student Learning Outcomes.
One of the most significant developments was the identification of the relationship
between courses in Foundation Studies and the 17 Foundation Studies objectives
(see pages 37-8 in the Focused Visit Report). The 17 Foundation Studies Objectives
were reworded as Abilities, and then ultimately transformed into eight Abilities for the
demonstration of fundamental, content-related competencies. The Abilities, and their
related twenty skills and five levels, were defined and developed in the Abilities,
Skills, and Levels booklet 2000 and revised in 2003 and again in 2006.
The Abilities
Aesthetic Engagement
Collaboration
Communication
Effective Citizenship
Global Awareness
Problem Solving
Wellness
Technology Literacy
The Skills




















Receptivity
Responsiveness
Positive Interdependence
Leadership
Written
Visual
Spoken
Performance
Provides Services to Others
Teaches Others
Facilitates Change
Works with Diversity
Understand System Interrelationships
Research
Creative/Critical Thinking
System Analysis
Self-Management
Self-Worth
Computational and Communication
Technology
General Technology
Table 6: The Eight Abilities and 20 Skills (1998-2014)
General Education: The General Education program (formerly Foundation Studies) is
reviewed by the Curriculum Committee. The transformation of the Foundation
Studies objectives into the eight Abilities in 1995 formed the basis of an ability-based
assessment model. General education courses were assigned Abilities, based as
Valley City State University
Page 24 of 28
closely as possible on the relationship of the course to the original Foundation
Studies objectives.
Faculty committees assigned to each Ability described the expected outcomes and
assigned levels of development within each skill. The faculty reached consensus on
the Abilities and their related skills during the spring of 1999, with the completion
and approval of the Abilities, Skills and Levels booklet. A compilation of this faculty
effort was published in May 2000 and beginning in Fall 2000, all courses in the
general education program include a project tied to the course Ability. Following
several reviews of the Ability projects completed by students, the faculty were again
engaged in the Ability process. Each Ability and skill was reviewed and several skills
were removed while others were redefined. Changes were recorded in the Abilities,
Skills, Levels document and approved by the Faculty Senate in 2004 and 2006.
Also in the summer of 2006, VCSU sent a three member team to the HLC
Assessment Workshop “Making a Difference in Student Learning: Assessment as a
Core Strategy” near Chicago. At this workshop the team planned an implementation
for assessment of the Abilities at the General Education level. The process was
implemented during the 2006-07 academic year. Table 3 indicates the eight Abilities
and the current agreed-upon skills used to demonstrate these Abilities.
The Ability
Assessed
Communication
Spring, 2008
Global Awareness
Fall, 2008
Aesthetic Engagement
Spring, 2009
Problem Solving
Fall, 2009
Technology Literacy
Spring, 2010
Effective Citizenship
Fall, 2010
Wellness
Spring, 2011
Collaboration
Spring, 2011
Table 7: Rotation of General Education Abilities (2008-2011)
The Curriculum Committee later concluded that this four year cycle is too slow in
gathering sufficient data. Beginning in 2011, all eight Abilities are assessed during
the annual Summer Institute.
The Abilities and the Senior Portfolio: The Abilities provide a strong link between the
general education program and the majors. Each division and major has identified
the three to five Abilities significant to high achievement in its area. Students are
expected to demonstrate these particular Abilities in their digital portfolio at
graduation. Interested students began developing digital portfolios in 1997, and
faculty participation was encouraged through Title III funding. At the same time, the
expanded capacity of the network enabled a much richer and diverse commitment to
student and faculty digital portfolios. The commitment of the faculty to this
Valley City State University
Page 25 of 28
assessment measure became visible with the addition of the digital portfolio as a
graduation requirement in the 1998- 2000 Bulletin. The first graduating seniors
affected by this requirement graduated in spring 2002. Faculty began development
of evaluation tools and processes to assure that the digital portfolios demonstrate
that students are meeting the requirements of their major field of study. The
reflective statements required as part of the portfolios have affected the amount of
reflective writing expected by faculty in other assignment. (Corwin, 2004) Portfolios
have continued as the culminating senior experience for all undergraduate students..
University-Wide Abilities Assessment: Since the Abilities provide the framework for
study in both the general education program and the majors, the 2001 Assessment
of Student Learning Plan outlines an institution-wide assessment process of the
Abilities at entry, midpoint, and graduation. Initial data was collected in the summer
of 2001 for one Ability.
 In 2002 Joe Tykwinski, CIO and Dr. Terry Corwin review available portfolio software
for VCSU use. Among those reviewed was a software created by Rose-Hulman
Institute of Technology. None of the available software was a good fit for the
portfolios and VCSU student projects.
 In 2002, a student survey was developed to assess the student’s perception of the
eight Abilities.
 In 2003 Gloria Rogers, the Vice President for Institutional Research, Planning and
Assessment at Rose-Hulman Institute of Technology, was brought in to work with
faculty on rubric writing for the assessment of the Abilities and the Portfolios.
 Also in 2003 assessment rubrics were written for each of the Abilities and a plan to
gather 100 projects from courses at the freshmen through senior level for each
Ability was put in place.
 Gaining access to the projects for assessment purposes proved difficult.
 In 2003-2004 a VCSU technology specialist created software for the purpose of
being able to access student projects. However, the software could not be supported
over the long term because of updates to the VCSU’s network and was never used by
the students.
 Ability Maps were created for each major by the Division in 2001. Maps were
updated in 2004, 2007, and 2010.
 Teams of three faculty began assessing Communication and Global Awareness
projects beginning in summer 2004. The process was continued in 2005 and 2006
assessing two Abilities each year as depicted in the following table:
The Ability
Communication
Global Awareness
Assessed
Summer, 2004
Summer, 2004
Valley City State University
Page 26 of 28
Aesthetic Engagement
Summer, 2005
Problem Solving
Summer, 2005
Technology Literacy
Summer, 2006
Effective Citizenship
Summer, 2006
Wellness
Collaboration
All eight Abilities
Summer 2009
All eight Abilities
Summer 2010
Table 8: University-Wide Rotation of Ability Assessment (2004-2010)
 In 2005 all divisions developed and began to use a 5 point evaluation rubric for
portfolios assessment. Each division gathered and maintained the data from the
portfolio rubrics.
 Beginning in 2005, the North Dakota University System began sponsoring Noel-Levitz
Satisfaction Surveys and the NSSE (National Survey of Student Engagement) to all
campuses on alternate years, providing nationally normed assessment data to VCSU.
 By 2006 two problems immerged with the assessment plans. 1) Access to projects
for the project assessment process 2) VCSU lacked a system to input data, collate
the data, and make it available to campus stake holder.
 In 2007 the School of Education and Graduate Studies worked with VCSU’s
Information Technology Center to create a data system for storing the data needed
for an NCATE visit in 2008.
 In 2009 VCSU began using the same system to store and manipulate the data for
University-wide and General Education assessment.
 Also in 2009 the rubrics for the portfolios were updated based on suggestions by the
divisions on how the results could be used for assessment. In addition to the
National Surveys, three areas of assessment were identified as critical to UniversityWide Assessment. 1) Student survey of Abilities at the freshman, General Education,
and senior level 2) Portfolio assessment by each Division/School at graduation 3)
Project assessment at the General Education and Senior level for all Abilities. The
number of projects assessed was lowered to allow the assessment of all of the
Abilities each summer for both General Education and senior projects.
 In 2009 assessment data for all three assessments were entered into the data
system for the first time.
 In 2010 project assessment rubrics were modified to better accommodate the
assessment of both General Education and senior projects with the same instrument.
 In 2011 Assessment data from the National Assessment surveys and the three
University-Wide Assessments distributed to Division/School.
Valley City State University
Page 27 of 28
 In 2011, the General Education Committee was established to review proposed
General Education program changes, oversee General Education assessment, and
align the General Education program with other campus programs and initiatives.
 In 2011, General Education and Senior projects were assessed for each Ability during
the Summer Institute. These institutes would also be held in 2012 and 2013, before
moving to program-level assessment based upon Walvoord (2010).
 In May 2012, a Director of Institutional Research and Assessment was hired to direct
university assessment efforts.
 Summer Institute sessions were held in May 2012 and May 2013 for faculty review
of General Education projects and Senior portfolio student projects.
 The VCSU 2012-2014 catalog was the first to feature Program Learning Outcomes
for each academic program.
 In Fall 2012, VCSU adopted an assessment text: Assessment Clear and Simple: A
practical guide for Institutions, Departments, and General Education by Barbara E.
Walvoord, (2010). 2nd ed. San Francisco: Jossey Bass.
 A January 2013 message from the Vice President for Academic Affairs noted that
Annual Program Updates and Program Reviews must include a record of discussion
among program faculty regarding the portfolio assessment results as it relates to
program and course outcomes; including a reflection upon the meaning of the
assessment and any recommendations for modification at the program and course
level that are deemed appropriate.
 In Spring 2013, VCSU implemented annual program level assessment of General
Education courses, modeled after the General Education review format in Walvoord
(2010). The General Education Council and Director of Institutional Research and
Assessment facilitated this review.
 Spring 2013 General Education review recommendations included the development
of measurable program outcomes and mapping General Education courses.
 The Vice President for Academic Affairs, Director of Institutional Research and
Assessment, and the Assessment Committee, through the committee members in
each division, conducted a review of course syllabi to ensure compliance with a
checklist of essential guidelines, including course outcomes, course projects, and
appropriate standards, a component that is especially important for fulfilling National
Council for the Accreditation of Teacher Education (NCATE) requirements.
 In Fall 2013, academic programs submitted assessment plans with measurable
program outcomes. The Director of Institutional Research and Assessment reviewed
the plans with a rubric approved by the Assessment Committee. Pursuant to this
review, faculty members received feedback on needed revisions.
 In Fall 2013, after campus discussions and a 2-year myeFolio pilot stemming from
the Fall 2011 Higher Learning Commission report, VCSU adopted myeFolio as an
“enterprise-level University data management and analysis system” to assist in the
Valley City State University
Page 28 of 28





collection and assessment of course projects and senior portfolios (Higher Learning
Commission, 2011, p. 22).
Recommendations from the Spring 2014 General Education review included
exploration of an interdisciplinary General Education ethics course, implementation
of a continuous process for review and approval of General Education courses, and
strengthening General Education as a core program.
The Vice President for Academic Affairs, presented to the April 28, 2014 Assessment
Committee on institution and General Education assessment. She noted that the
General Education Committee would be meeting in Summer 2014 to review and
revise the General Education program in accordance with the American Association
of Colleges and Universities (AACU) Liberal Education and America’s Promise (LEAP)
Essential Learning Outcomes (ELO). The Assessment Committee was also asked to
review the Lumina Foundation’s Degree Qualifications Profile (DQP) as an example to
guide revision of institution wide Learning Outcomes in a Summer 2014 meeting.
The General Education Council met June 4, 2014 to review and propose revisions to
assessment within the General Education program, based on the American
Association of Colleges and Universities (AACU) Liberal Education and America’s
Promise (LEAP) Essential Learning Outcomes. The General Education Committee
outlined eleven Learning Outcomes within the categories of Literacies, Values, Habits
and Breadth of Knowledge. These were later reduced to ten Learning Outcomes.
The Assessment Committee met July 11, 2014 to review and propose revisions to
University Learning Outcomes. The Assessment Committee reviewed the Defining
Commitments (Mission, Vision, University Purposes, and Core Values), outlining six
institution wide Learning Outcomes (Broad Knowledge, Specialized Knowledge,
Intellectual Skills, Technological Skills, Civic Engagement, and Applied Learning)
within three broad goals (Knowledge, Skills, and Application).
The Interim President and the Director of Institutional Research and Assessment met
with the Vice President for Student Affairs and Student Affairs program directors on
July 21, 2014, to facilitate creation of Learning Outcomes for each Student Affairs
unit. The July 11 Assessment Committee draft of Institutional Learning Outcomes
was provided as a guide.
References
Angelo, T.A., & Cross, K.P. (1993). Classroom assessment techniques: A handbook
for college teachers, 2d. ed, (San Francisco, CA: Jossey-Bass.
American Association for Higher Education (2010). Principles of good practice for
assessing student learning.
(http://www.uni.edu/assessment/documents/aaheprinciples.pdf)
Valley City State University
Page 29 of 28
Corwin, T. (2005). “Electronic Portfolios” Best Technology Practices in Higher
Education, Edited by Les Lloyd Information Today, Inc. 3-15.
Higher Learning Commission. (2011). Assurance section: Report of a comprehensive
evaluation visit.
Walvoord, B. E. (2014). Assessing and improving student writing in college: A guide
for institutions, general education, departments, and classrooms. San
Francisco, CA: Jossey-Bass.
Walvoord, B. E. (2010). Assessment Clear and simple: A practical guide for
Institutions, Departments, and General Education. 2nd ed. San Francisco:
Jossey Bass.
Valley City State University
Page 30 of 28