SJSU Student Affairs Assessment/LOBA Template, Spring 2014

7/11/14
SJSU Student Affairs Assessment/LOBA Template, Spring 2014
Department/Program: University Housing Services (UHS)
Preparer/Title: Matthew Rees, Associate Director, Organization and Planning
Phone Number: 408.795.5619
Email: [email protected]
I. Mission
University Housing Services strives to create a residential community that supports and enhances
academic success, fosters the learning and development of our students, and promotes student
involvement and civic engagement. As a department, our practices promote efficiency, operational
effectiveness and fiscal responsibility.
2. Goals
Our goal is to create inclusive living learning environments that promote academic success and provide
opportunities for residents to develop and enhance life skills. These skills include communication,
developing positive inter personal relationships, multicultural competencies, time management, conflict
resolution and an understanding of the value of civic engagement.
3. Spartan Points of Pride for UHS








UHS and the Residence Hall Association (RHA) provided a nine day Fall Welcome Week program
and five day Spring Welcome Week program full of educational and social events.
Presented several annual events over the course of the year including Love Fest, Love Does Not
Discriminate, Geek Week, Hate Does Not Have A Home Here , and Take Back the Night Undie
Run
Worked with consultants, FD&O, and Housing staff and students to gather input and feedback
on the design of a new residence hall to support first year students which will begin construction
in June, 2014.
Collaborated with Student Involvement staff to co-present the 2nd annual Leadership Dialogues
semester long series in Spring 2014
RHA held the annual Battle of the Buildings community challenges throughout the year with
strong resident attendance and participation
RHA sponsored annual student leadership retreat for hall government executive board members
Successful implementation of our new residential management database, Star Rez
Record number of Returning Resident contracts (1581)
4. Professional Leadership/Community Engagement
Kait Mahler, Assistant Residence Life Coordinator
Co-Presenter, Student Affairs’ Annual Professional Development Day, “Teamwork Makes Dream Work”
1
7/11/14
Bob Just, Residence Life Coordinator
Advisor of the Month, Residence Hall Association, SJSU
Co-Presenter, Student Affairs’ Annual Professional Development Day, “Teamwork Makes Dream Work”
Amber Brady, Residence Life Coordinator
UHS Professional Staff Member of the Year, National Residence Hall Honorary, SJSU
Rocco Fragomeni, Reisdence Life Coordinator,
Director's Award for Inclusive Excellence, University Housing Services
Residential Life Staff Member of the Year, National Residence Hall Honorary, SJSU
Thi Ngo, Assistant Residence Life Coordinator
Director's Award for Exemplary Service to the Housing Community, University Housing Services
Sheldon Fields, Assistant Residence Life Coordinator
Hall Government Advisor of the Year, Residence Hall Association, SJSU
Timothy Nurge, Assistant Residence Life Coordinator
Associated Students 55 Award, Associated Students, SJSU
Rachel Delucchi, Assistant Director, Administrative and Conference Services
Above and Beyond Award, Division of Student Affairs, SJSU
Natina Gurley, Assistant Director for Residential Life
Presenter, SJSU Student Leadership Conference, “Civility & Social Media: The Crash at the Intersection
Co-Presenter, COPES, “Communicating to the Third (3rd) Degree”
Presenter, Student Affairs Professional Development Day, “Tweeters Are Leaders: What Does Your
Virtual Leadership Say About You?”
Presenter, Leadership Dialogues, “Civility & Social Media: The Crash at the Intersection”
Presenter, WACUHO Annual Conference & Exposition, “Developing Dialogue: Inclusivity Training
Reconsidered”
5. Utilization Assessment Activities, 2013-2014
Program/Activity
Assessed
“Hate Doesn’t
Have A Home
Here”
Assessment Type
Population
Pre Test/Post Test
Classics and CVC
Suites Residents
Collection
Timeframe
April 2014
Findings
Collection
Timeframe
February 2014
Findings
See 8c
6. Satisfaction Assessment Activities, 2013-2014
Program/Activity
Assessed
Mid Year Student
Satisfaction Survey
Assessment Type
Population
Survey
All On Campus
Residents
See 8c
2
7/11/14
EBI (Educational
Benchmarking Inc.)
Survey
All On Campus
Residents
May 2014
See 8c
7. Learning Outcomes
Learning Outcome
Method/Measure
Findings/Conclusions
Ability to manage
time, study and solve
problems
Personal Growth
(consequences of
alcohol and drug use)
Diverse Interactions
(opportunities and
benefits )
Personal Interactions
(developing positive
personal
relationships)
Overall Learning (on
campus living
experience)
EBI Surveys/Improvement
in comparison to prior
year
EBI Surveys/Improvement
in comparison to prior
year
EBI Surveys/Improvement
in comparison to prior
year
EBI Surveys/Improvement
in comparison to prior
year
To be administered in
May 2014
EBI Surveys/Improvement
in comparison to prior
year
Recommendations/Next
Steps
See 8d
To be administered in
May 2014
See 8d
To be administered in
May 2014
See 8d
To be administered in
May 2014
See 8d
To be administered in
May 2014
See 8d
*EBI includes the learning outcome categories above in their survey. They are set categories with
questions predetermined by EBI
8. Applied Knowledge
After attending the “Hate Doesn’t Have a Home Here” program, 80% of participants will be able to
identify three examples of forms of oppression on a post test.
8b. Assessment Method Measure
Direct Assessment – pre/post tests
8c. Findings/Conclusions(due 5/14)
“Hate Doesn’t Have A Home Here”
Students participating in this residence hall program were asked to complete a pre test prior to and post
test after the program. On the test, participants were asked to identify three forms of oppression.
The learning outcome created and directly assessed was:
3
7/11/14
After attending the “Hate Doesn’t Have a Home Here” program, 80% of participants will be able to
identify three examples of forms of oppression on a post test.
Below are the results of the Pre and Post Test:
Test
Participants
Able to Identify
Three Forms of
Oppression
Participants
Able to Identify
Two Forms of
Oppression
Participants
Able to Identify
One Form of
Oppression
# of Tests
Completed
43 (38.05%)
Participants
Unable to
Identify A
Form of
Oppression
5 (4.42%)
Pre Test
19 (16.81%)
46 (40.7%)
Post Test
16 (15.68%)
49 (48.03%)
30 (29.41%)
7 (6.86%)
102
113
Although 80% of participants were unable to identify three forms of oppression on the post test, a
greater percentage were able to identify at least two forms of oppression on the post test (63.71%) than
the pre test (57.51%).
Future direct assessment efforts will set more realistic goals and provide greater structure in order to
increase resident participation throughout the activity and assessment process from beginning to
completion. Incentives were offered which times seemed to be the participants’ focus more than the
program itself or completing either test. We will need work at better balancing both priorities with
future assessment activities.
As already planned, forms of oppression, diversity and social justice will continue to be a priority
programmatically. In addition professional and student staff will continue to receive significant training
in these areas as well so that they can work effectively with our diverse resident population.
Mid-Year Student Satisfaction Survey
In February 2014 through survey monkey, all student residents (3610) were asked to respond to the
questions below regarding how they perceive living on campus has impacted their learning in certain
areas. The question was part of the “Mid-Year Student Satisfaction Survey” which we’ve administered
each year since 2010. Most questions in the survey addressed our returning resident sign up process
and satisfaction with programs and services. However, the question below specifically addressed
learning outcomes.
The question and learning outcomes were identified based on those in the EBI and are areas in which
we’ve sought to improve. All participants were asked:
“To what extent has living on campus enhanced your ability to…”
Develop Interpersonal
Relationships
Not At All (1)
7.78%
Slightly (2)
21.11%
Moderately (3)
44.07%
Extremely (4)
27.04%
4
7/11/14
Study More Effectively
16.3%
21.48%
48.89%
13.33%
Manage Your Time
More Effectively
Improve Interpersonal
Relationships
Solve Your Own
Problems
Resolve Conflicts
12.59%
18.52%
52.59%
16.30%
8.96%
19.40%
48.88%
22.76%
8.58%
13.81%
54.85%
22.76%
11.94%
15.67%
55.60%
16.79%
Approximately 8% (270) of our student resident population completed the survey. For each category,
most residents selected “moderately.” The same result occurred with our Spring 2013 survey.
In comparison to the Spring 2013 results:

The number of residents that selected “moderately” increased by at least 8% in the following
categories: 1) Solve Your Own Problems and 2) Resolve Conflicts.

The number of residents that selected “moderately” slightly increased (2.1% to 3.9%) in the
following categories: 1) Study More Effectively, 2) Manager Your Time Effectively, 3) Improve
Interpersonal Relationships

The number of residents that selected “moderately” slightly decreased (2.1%) in the following
category: 1) Developing Interpersonal Relationships.
Future surveys will need to include a greater number of participants (at least 10% of resident
population) so that more data is collected and the results more viable.
EBI – Resident Assessment
In May 2014, the EBI Resident Assessment was made available to 1918 residents in the Classics and
Suites buildings. The Resident Assessment specifically targets students living in traditional and suite
style facilities rather than those in Apartment style housing. University Housing Services has been
administering the EBI since 2001.
The survey includes satisfaction questions focusing on specific components of an on campus housing
program, as well as a predetermined set of learning outcomes. Questions are grouped into “factors”
and scored on a scale of 0 to 7.
Below are the learning outcomes (ie. factors) identified, and our results from the 2013-2014 assessment.
5
7/11/14
Learning Outcome
Ability to manage time, study and solve problems
Personal Growth (consequences of alcohol and drug
use)
Diverse Interactions (opportunities and benefits )
Personal Interactions (developing positive personal
relationships)
Overall Learning (on campus living experience)
2013- 2014
Mean
4.95
5.25
Recommendations and Next
Steps
See 8d
See 8d
5.22
5.07
See 8d
See 8d
4.62
See 8d
Approximately 14% (266) of those able to take the assessment completed it.
There was a slight decrease (<1.0) in the mean for each learning outcome in comparison to results from
the 2012-2013 assessment. The greatest decrease was in “Overall Learning” (.61) and Personal
Interactions (.45). Declines in the other learning outcomes were less than .25.
Also, for the 2013-2014 EBI included additional questions not used in prior Resident Assessments to
determine the mean of each learning outcome with the exception of “Personal Interactions.” For this
reason, it is hard to derive a direct comparison between the results from this year and prior years.
8d. Recommendations/Next Steps

Identify ways to increase survey participation so that more data can be collected and analyzed

Review current learning outcomes and make revisions as needed based on the needs of the
resident population as well as department, division and campus priorities

Utilize current data in planning for AY 2014-2015 and to identify potential areas of success and
those which need improvement

Explore opportunities for increasing direct assessment efforts

Implement a residential curriculum that will allow us to better develop learning outcomes, and
increase our ability to assess effectiveness, delivery methods and student learning.
6