External Evaluation Report “Fast Forward” Grant San Juan College YEAR 3 2013/14 Laura Godfrey, External Evaluator Table of Contents Introduction .......................................................................................................................................................... 3 Overview of External Evaluation Report ...................................................................................................................... 3 Adequacy of Data.......................................................................................................................................... 3 Audit Readiness ............................................................................................................................................. 3 Timely Reporting .......................................................................................................................................... 4 Relationship with Department of Education Program Officer ..................................................... 4 Critical Question 1: To what extent has the College achieved the objectives set forth in the proposal within the timelines specified? Goal 1: Improve Degree Completion for Native American AA/AS Student ................................................... 5 Goal 2: Improve Transfer Rates for Native American Students ........................................................................ 8 Goal 3: Improve Course Success Rates in key AA/AS disciplines..................................................................... 10 Goal 4: Expand capacity to better serve Native American AA/AS Students.............................................. 11 Goal 5: Improve ability of SJC personnel to collect, analyze and use data to better serve Native American students................................................................................................................................................................ 13 Critical Question 2: To what extent has the College delivered high quality programming?....................................................................................................................................................15 Critical Question 3: To what extent has the College used data to improve program? .....................................................................................................................................15 Critical Question 4: To what extent has the College fulfilled the legislative intent of the Title III Act? .................................................................................................................................................18 Critical Question 5: To what extent has the College used grant-funded initiatives to fulfill its mission? .............................................................................................................................................18 External Evaluator’s Conclusions ............................................................................................................19 Electronic Attachments: Audit Readiness Review Articulation Agreements Transfer Center Evaluation 2 External Evaluator Report, 2014 Fast Forward Grant, Year 3 San Juan College Overview During the third year of its Title III NANTSI grant (Accelerating AA/AS Degree and Certificate Completion for Native American Students - locally named “Fast Forward”), San Juan College has continued to implemented the program as outlined in the grant and made significant progress towards meeting the objectives delineated in the grant. All of the key personnel plus the External Evaluator have met frequently to refine the implementation and evaluation of the program. The Senior Director of the Center for Student Engagement (the PI for the Fast Forward Grant) has been actively involved in all aspects of the grant, meeting with grant staff and the External Evaluator on a regular basis. This high level administrative support is key for collaboration between programs, timely feedback on data, analyzing data to improve programs and refining the evaluations conducted. All aspects of the grant are in compliance with the timelines established in the proposal and where indicated the college has worked with the program officer to make changes in the wording of objectives. The grant is “audit-ready” with full documentation available and easily accessible. The team has established comprehensive evaluation and tracking systems for all aspects of the project. Responsibilities are clearly delineated for collecting and reporting both quantitative and qualitative data. Adequacy of Data The External Evaluator has reviewed all data sources and data collected. Data for this report has been provided by: the Institutional Research Department, the Grants Compliance Office, the Project Director/Staff, and the External Evaluator. The data reported is reliable and accurate. Data sources for the Annual Performance Report include: Attendance/participation information collected by project staff Audit Review Records collected by project director and reviewed by Grants Compliance Office and External Evaluator Data collected or analyzed by the External Evaluator includes: Bisti Writing Project Summer Programs, College Trip Evaluations, Transfer Office Records, Transfer Center Evaluation by participants. In addition the Fast Forward office maintains a dashboard on the Student Exit Survey and the Alternative Formats Survey all of which have been reviewed by the Evaluator. Audit Readiness In addition to collecting data that documents progress towards achieving program objectives, the College funds a full time Grants Compliance Officer who is responsible for 3 “regulatory compliance of all college grants”. Each year there is an annual review of audit documents by the External Evaluator in conjunction with the Grants Compliance Office. The College requires each grant program to compile a record keeping system for 16 items on the “Audit Review Checklist”(Appendix 1) Items include: approval documents, budget files, procedures manuals, inventories of equipment, travel reports, budget ledgers, project participants and all financial, performance and annual reports. The audit-readiness checklist for the Fast Forward program has been reviewed by the Project Director and the Grants Compliance Officer. The Evaluator has confirmed that the Fast Forward grant is in compliance with SJC policies, procedures and financial documentation requirements and is “audit-ready. Timely Reporting The College has submitted thorough, accurate reports to the granting agency in a timely manner. The Annual Performance Report (APR), which was submitted by the grantee in January 2015, contains complete results for the goals and objectives delineated in the grant. The External Evaluator has reviewed the APR and is satisfied that the grantee has systematically collected quantitative and qualitative data demonstrating substantial progress towards meeting all of the performance measures. In the instances where benchmarks could not be met a thorough analysis has been completed and adjustments to targets or programs made accordingly. Relationship with ED Program Grants Officer The project staff has maintained a very positive working relationship with the Department of Education Program Officer. During Year 2 the College applied for and was awarded changes in Objectives and Timelines thereby establishing better baselines and more realistic objectives. These changes required careful analysis and a good working relationship with the Department of Education Program Grants Officer. In total five objectives (1a, 1d, 3a, 4a, and 5b) and four timelines (1b, 2a, 4c, and 5c) were modified with approval of the Grants Officer. These changes reflect a desire for precision on the part of the grantee and they have allowed for better evaluation this year since the objectives now reflect more accurately the workings of the institution. 4 Critical Question for Evaluation The External Evaluator has prepared this report using the following critical questions as the framework for reviewing all of the data. 1. To what extent has the College achieved the objectives set forth in the proposal within the timelines specified? 2. To what extent has the College delivered high quality programming? 3. To what extent has the College used data to improve programs? 4. To what extent has the College fulfilled the legislative intent of the Title III Act? 5. To what extent has the College used grant-funded initiatives to fulfill its mission? CRITICAL QUESTION 1: To what extent has the College achieved the objectives set forth in the proposal within the timelines specified? Goal 1: Improve degree completion for Native American AA/As Students Activity Objective(s) 1a. By September 2014, increase the number of Native American students who graduate with AA/AS degrees within three years to 23 Results for Year 2 Actual =10 Target = 23 1b. By September 2014, increase the percentage of first-time, full-time AA/AS degree-seeking Native American students who complete an AA or AS within three years to 5% Actual = 3.1% Target =6% 1c. By September 2014, increase the percentage of first-time, full-time AA/AS degree-seeking Native American students who complete any SJC degree or certificate within three years to 8% Actual = 8.4% Target = 8% 1d. By September 2013, improve the ratio of first-time, full-time Native American AA/AS enrolled students per each first-time, full-time Native American AA/AS graduate to 24 Actual = 32.3 Target = 23 5 External Evaluator’s Analysis of Goal 1: The only objective the grantee met for goal one is 1c - increasing the percentage of first time, full time AA/AS degree seeking Native American students who complete any SJC degree or certificate. It is noteworthy that while the College exceeded the target of 8% degree completion rates fell from 8.8% in 2013 to 8.4%; a small decrease but worth watching. In reviewing the data an interesting trend emerged. The number of Native students who graduated with a degree within three years (1a) fell from 13 in 2012 to 8 in 2013 then rose slightly to 10 in 2014. The percentage completion for AA/AS degrees (1b) of Native students also fell from 4.5% in 2012 to 2.7% in 2013 and rose slightly to 3.1% this year. Completion for any degree (1c) fell from 9.9% in 2012 to 8.8% in 2013 to 8.4% in 2014. Further analysis shows that, unfortunately, this downward trend for degree completion is a college-wide problem. Degree completion is down for all SJC students, not just Native American students; thus the grant’s target population mirrors larger college wide trends. For example college wide results for the grant objective show: The number of all SJC students who graduate with AA/AS within 3 years fell from 45 in 2011 to 22 in 2012 (Native American students fell from 13 to 8). In 2013/14 the number of all students who graduated within 3 rose to 34 (Native students rose from 8 to 10) The evaluator believes that these trends indicate factors beyond the control of the grant such as increasing employment opportunities with the improving economy resulting in more students returning to the workforce rather than completing degrees. This is a welldocumented trend in higher-education enrollment/completion patterns. Activities to improve performance As an outcomes oriented institution, SJC has taken college-wide steps to address root causes for the lack of degree completion for Native American AA/AS students. Additional research beyond the requirements of the grant was conducted and information shared with College stakeholders in positions to impact degree completion rates. Cohort Student Initiative –the academic progress of Native American students from Fall 2011 and Fall 2012 cohorts was reviewed by the FF Research Assistant to determine why so few Native American students were getting a degree within 3 years. One-on-one contacts were made students from American Indian cohorts to encourage and accelerate degree completion. The findings were often surprising with students frequently having 100 or more credits but no degree. Often STEM majors were very short of their degree requirements but had accumulated lots of credits across the curriculum. Sometimes students in this study clearly stated they did not have a desire to graduate within 3 years. 6 Other students who did want to graduate soon were advised to switch majors to accelerate graduation. Accumulating a lot of credits without graduating is problematic beyond the scope of the FF grant objectives because students “spending down” their financial aid while not attaining a degree which then becomes an obstacle to further education or degrees. SJC sought and received approval from the Program Officer to replace the SJC Research Specialist with a Program Advisor. This is a shift from gathering information to acting on information. This position has been filled and the Program Advisor will further implement the Cohort Student Initiative. The information from the Cohort Student Initiative raises questions about the advising that students receive. At SJC the model for AA/AS degree seeking students has been that students are advised in the Advising and Counseling Center until they have 24 credits. They are then transferred to a faculty “core advisor” in an academic field. However there are no “holds” or requirements that a student see an advisor so the process becomes quite informal after 24 credits with many students taking classes without awareness of their progress towards a degree. Several improvements have been put forward to improve advising at SJC Advising is moving to a “Case Management” approach whereby advisors will have a deeper understanding and personal relationship with a smaller core or students rather than advising randomly whoever walks in the door. The Advising Center prepares a checklist for faculty Core Advisors with information on each student’s gpa, number of credits and other factors that impact graduation and financial aid. Better communication with students is being promoted through numerous outlets. Program Evaluations are on the Portal including a “Progress to Degree” option that is easy for students to access and use. There have been increased postings on Facebook which also has analytic data on degree completion student can use. “Canvass” is being explored as a method of communicating with students. Gatekeeper courses, those with the highest D’s, F’s and Withdrawals, are being identified so that more resources can be allocated to ensuring student success in them. The College recently instituted a requirement that any student who is enrolled in a developmental course must also enroll in a Learning Skills (LRNS) class. Part of the LRNS curriculum will be mapping out degree requirements for each student and making them aware of sequencing and prerequisites. New Student Orientation will now include information about how to track progress towards a degree and the impact on financial aid of accumulating “random” credits. There has been some initial conversation about placing “holds” on students who reach a critical number of credits without attaining a degree. Ideas about ways to require students to see an advisor have also been discussed. 7 As mentioned above SJC sought and received approval from the Program Officer to replace the SJC Research Specialist with a Program Advisor. This is a shift from gathering information to acting on information. This position has been filled and the Program Advisor will further implement the Cohort Student Initiative. In addition, increasing the number of “Articulation Agreements” with 4-year colleges and universities throughout the region is an ongoing effort from the Fast Forward Director. During Year 3 four additional articulation agreements were signed with New Mexico Highlands University bringing to 22 the total number of agreements with NMHU. An articulation agreement in Engineering was signed with New Mexico Tech and an agreement in Nursing was signed with the University of New Mexico. (See Appendix 2 for a full list of articulation agreement created through Fast Forward). Goal 2: Improve transfer rates for Native American students Activity Objective(s) 2a. By September 2014, increase the percentage of first-time, full-time degreeseeking Native American students who successfully transfer to four year colleges by 14.5% Results for Year 3 Actual = 7.1% Target = 14.5% External Evaluator’s Analysis of Goal 2: The grantee was also significantly below the target for Goal 2, improving transfer rates for Native students. Results for 2014 show a slight increase from 5.1% to 7.1% but are still significantly below the ever-increasing target. The grantee has yet to achieve the baseline of 13.1% from the Fall 2007 cohort. Again, the grant trend mirrors the larger institutional trend of fewer students continuing their education. Overall at SJC in 2011 9.3% of students successfully transferred, in 2013 only 8.3% transferred and in 2014 10% transferred. In an effort to improve transfer rates the grantee has added several activities over the past two years. First the grantee established a full time Transfer Center in a highly visible location with a full time staff person. The number of student contacts with the Center, the types of questions asked and the actions taken have been carefully tracked. The evaluator finds that the office usage has steadily increased. During year 3 of the Fast Forward grant there were 317 visits with one-on-one transfer advisement. Additional visits were made that were brief walk-ins, emails or phone call. In the Spring of 2014 the External Evaluator conducted an extensive online survey of all students who had visited the Transfer Center. Forty-four students responded. Full results are available in Appendix 2. In summary nearly 40% of students visited the Center three or 8 more times, 36% visited twice and 25% visited once. What did students ask about? Students could check more than one response. Results indicate 78% asked for information about transferring to a specific college or university; 71% sought general information about transferring; 56% asked about how SJC credits will transfer; and 33% asked about financial aid and transferring. Was the information helpful? Results indicate 41% found the information they received from the Transfer Center very helpful; 45% found it helpful; and 11% though it was not very helpful. 98% of students who visited the Transfer Center found the staff in the center to be very approachable and 90% said their questions were answered in a timely manner. 86% would recommend the Center to friends who are thinking about transferring. The Transfer Center will definitely have an impact on transfer rates according to the students who visited it. 73% said they are transferring to a 4-year college or university, another 18% are not sure yet and only 9% are not transferring. In addition to in-person visits, the Transfer Center web site was accessed 12,424 times; a 16% increase from the previous year. The evaluator finds the Transfer Center to be an effective program with significant positive impacts. Other activities to increase students transferring include: Eight workshops were conducted on transferring with 102 students attending. The first annual Transfer Week was held including 250 students who attended the Transfer Fair with 40 college/scholarship representatives. Thirty-two faculty/staff and 153 students participated and committed to complete a degree in three years for the “Commit to Complete” Campaign which was developed and implemented by the Transfer Center.. College Exploration Trips for students who are interested in transferring. Five trips were sponsored and were well attended with 32 Native students visiting Fort Lewis College, the University of New Mexico, Fort Lewis College, Colorado School of Mines or New Mexico State University. Native American Center Transfer Pathways have been established with Native American/multicultural programs at NM Highlands University main campus, NM State University and Eastern NM University. Pathways connections with Admissions were formalized with NM Highlands, NM State, Eastern NM University, Weber State University and Santa Fe University of Art and Design. A year-long health science partnership was coordinated with the University of New Mexico’s Center for Native American Health program. Twenty-three students participated and two have transferred to UNM. 9 The Fast Forward Grant has also made significant progress in establishing articulation agreements that will facilitate transfer from SJC to four-year universities as discussed in Goal 1 with full results available in Appendix 2. In summary the Evaluator finds that the Fast Forward program has instituted numerous highly effective programs to enhance students’ ability to transfer to four-year colleges or universities. Goal 3: Improve course success rates in key AA/AS disciplines Activity Objective(s) 3a. By September 2014 Improve course success rates for all students in English, Business, Science and Mathematics to 67% Results for Year 3 Actual = 60.1% Target = 67% External Evaluator’s Analysis of Goal 3: The evaluator finds this goal interesting because the grant has limited program activities that impact course success. The College’s other Title III grant, the “Launch” grant, has numerous programs aimed at improving success rates for Native students in math and science and can show direct correlations between programs and student success. However success for “all students” in numerous disciplines seems more dependent on enrollment trends, institutional support services (such as tutoring, mentoring, faculty mentoring, etc) and high school preparation than on a single grant with no direct programming that aligns with the goal. Nonetheless the Fast Forward grant has contributed to the institution’s ability to serve its Native students through maintaining the Native American Student Profile that provides extensive data for Administrators and Faculty to use to better serve these students. The second issue of the Profile was updated in Year 3 and Dashboards of Native Success Rates was also updated. Badly needed calculators were purchased for the Student Success Center using Fast Forward grant funds. In addition the very successful professional development activities (Goal 4b) such as the Bisti Writing Project, national conferences that focus on Native American student success and Fast Forward sponsored workshops should impact overall success for Native students. 10 Goal 4: Expand capacity for San Juan College to better serve Native American AA/AS Students Activity Objective(s) 4a. By September 2014, increase the percentage of AA/AS General Education sections offered outside of M-Th 8:00 am – 4:00 pm traditional format to 45% Results for Year 3 Actual = 35% Target = 45% 4b. By September 2014, increase the number of full-time and adjunct faculty who participate in grant-sponsored faculty development to 20 Actual = 42 Target = 20 4c. By September 2014, increase the number of students who participate in grant-sponsored assessment of technology skills to 1000 Actual = 1,022 Target = 1000 4d. By September 2014, increase the number of students who participate in grant-sponsored remediation of technology skills to 250 Actual = 24 Target = 250 4e. By September 2014, increase the number of distinct web pages enhanced by this grant to 50 Actual = 61 Target = 50 External Evaluator’s Analysis of Goal 4: A critical component of the Fast Forward grant is to expand San Juan College’s capacity to better serve Native American AA/AS students. Goal 4 deals with a range of activities including data collection. Objective 4A “to increase the percentage of AA/AS Gen Ed sections offered outside the traditional format” depends of upper-level administrative decisions about which courses to schedule when. To help inform these decision during Year 2 the Fast Forward grant conducted an extensive survey, the Community Input Survey with 622 respondents from a wide range of local organizations, businesses, and individuals. The Community Input Survey included questions about course scheduling and enrollment. Currently only 35% of courses are offered outside of the traditional M-Th 8 – 4 format, short of the grant’s targeted 45%. However, this is an increase from 2011/12 when only 34.7% of courses were offered outside the traditional format. Results from the Community Input Survey indicated there is a desire for AA/AS programs as well as evening and weekend classes. Instructor-based and Online courses were the most desired and interest was evenly divided across all the six Schools of the College. 11 Based on results from the Survey In 2013/14 Saturday College is now being offered at the East Campus and more late-start classes were offered in the Fall of 2014. Another tool for class scheduling, Class Tracks, was purchased with Fast Forward funds. Class Tracks not only facilitates scheduling classes, it also analyzes patterns of enrollment for maximum quality management. For objective 4a, the evaluator again questions the impact the Fast Forward program can have beyond providing good data to support changes. The decision to offer more courses outside the traditional format rests with the senior administration and will be based on multiple factors beyond this grant’s scope. Objective 4b, increasing faculty development opportunities, is an area of great success. The target for this year was for 20 faculty participants; 42 unduplicated faculty participated in grant-sponsored faculty development activities. Furthermore when professional staff is included the numbers are even more impressive. These grant-sponsored activities included: Conferences including the National Association of Developmental Education, the Native American Student Advocacy Institute, the National Indian Education Association and the National Association of Branch Campus Administrators (15 participants) Bisti Writing Project (13 faculty) Fast Forward-sponsored workshops including Native Leader Speaker Series, the Learning Symposium, the American Indian Cohort Student Initiative Presentation, and a presentation on the Eastern MN Bachelor of Applied Arts and Science Degree (42 participants) All Professional Development activities are routinely evaluated for effectiveness. The Bisti Writing Project was evaluated in years 1 and 2 and will be evaluated again in year 4 when the number of participants reaches a critical number to have statistical relevance. The evaluator has reviewed past evaluations and finds that participants rate the programs very highly. Objectives 4c,” increasing the number of students who participate in grant-sponsored assessment of technology skills” and 4d, “the number of students who participate in grantsponsored remediation of technology skills” are closely related. While the number of students who participated in the survey was right on target, many fewer than anticipated participated in the remediation. In 2014 during New Student Orientation students were required to complete “A Technology Readiness Assessment, Smarter Measures”. This administration technique 12 greatly increased the number of students assessed. It also proved to be a much more accurate assessment with the result that only 24 students actually needed remediation. Apparently students are entering college with proficiency in technology beyond what was anticipated in the grant. Over the three years of the grant one of the greatest impacts of Fast Forward relates to 4e, “increasing the number of distinct web pages enhanced”. For this objective the grantee has far exceeded benchmarks with 61 distinct web pages enhanced for this grant period alone. The previous Web Developer served as Chairwoman of the Web Advisor Council which was focused on a redesign of the SJC website. This is a tribute to the outstanding quality of web design assistance offered by the Fast Forward program. Another example of how Fast Forward is impacting the institution positively is the cost-share to purchase a new ecatalog system. And finally in an effort to determine preferred communication channels amongst the on-campus students a survey was conducted. The results showed that Facebook is the preferred channel for student communication. Goal 5: Improve the ability of SJC personnel to collect, analyze and utilize student data to better serve Native American students. Activity Objective Results for Year 3 5a. By September 2014, administer retention assessments to 1000 students Actual = 1,304 Target = 1,000 5b. By September 2014, survey a representative sample of 25% of Native American students regarding satisfaction and needs Actual = 31% Target = 25% 5c. By September 2014, based on surveys of SJC personnel, 70% of survey respondents will indicate they are using grant-sponsored data in strategic planning for the year Actual = 68% Target = 70% 5d. By September 2014, build at least 10 customizable reports Actual = 77 Target = 10 13 External Evaluator’s Analysis of Goal 5: Improving the College’s ability to collect, analyze and utilize student data to better serve Native American students has been a strength of the Fast Forward Grant. The retention assessment (5a), the Noel Levitz College Student Inventory, was administered during New Student Orientation in Fall 2013 to incoming students. The College gathered data on 814 students, surpassing the goal of 750. In the Spring of 2014 the Community College Survey of Student Engagement was administered to 810 SJC students, of which 31% were Native American. In an effort to be more efficient the grantee sought and was allowed a change in objective 5b to the language above. This change from a fixed number of students to a representative sample of 25% allowed the grantee to dovetail with San Juan College’s established cycle for student surveys, collect data on Native students from those same surveys and have a comparison basis with the overall SJC population. The evaluator sees this as a positive change allowing greater integration with ongoing institutional research. The College administered the Noel Levitz Student Satisfaction Inventory. There were nearly 47% Native students who responded giving the grantee, and the College, a large sample to disaggregate for analysis. The College’s cycle for surveys includes the Community College Survey of Student Engagement (CCSSE) in alternate years. The evaluator also notes that both the SSI and CCSSE have nationally-normed data that will be extremely beneficial for the College. Collecting data is fine but it is the use of data that is critical for institutional improvement. Based on the Fast Forward grant’s survey of 54 SJC personnel in key decision-making positions, 68% of respondents indicated they are using grant-sponsored data in strategic planning. This is a significant increase from last year when only 59% were using grantsponsored date and is very near the target of 70%. The grantee has done an excellent job of building a solid infrastructure for collecting data and increasingly that data is being used to inform decisions. An outstanding area of achievement for the Fast Forward grant has been the ability to provide customizable reports. These reports allow decision makers to get answers to specific questions in a timely manner. Like all institutions, the Institutional Research Office is overwhelmed and cannot provide all of the data needed in a timely manner. The Fast Forward grant has provided valuable services through customizable reports. In 2013/14 the grantee provided 77 such reports, far exceeding the benchmark of 10. Specifically Dashboards were updated on the Native American Graduate Survey, Native American Student Success Rates and the Native American Student Profile. Customizable reports were created on American Indian cohorts to track retention, success and completion rates. 14 Critical Question 2: To what extent has the College delivered high quality programming? Program Evaluations: Grant staff has been diligent in collecting data on the quality of its programs. Specifics mentioned above are evaluations of College Exploration Trips which students rate very highly. The Evaluator conducted a comprehensive survey of student satisfaction regarding the Transfer Center, which was also rated very highly. Full results are available in Appendix 3. The Bisti-Writing Program will be evaluated every other year so that numbers are large enough to be statistically valid and faculty have time to incorporate techniques in their classes. The evaluator has reviewed all of the activities undertaken by the grant and is very impressed by the range of activities conducted by the Fast Forward staff. Each activity is correlated with one (or more) of the grant objectives. Each activity also has an evaluation plan and names the person responsible. A list of activities taken from the APR include: COMPONENT 1: Increasing Post-Secondary Success Transfer Center and Transfer Initiatives (Objectives 1a, 1b, 1c, 1d, 2a, and 3a) • Three Hundred-Seventeen (317) students received one-on-one transfer advisement. • Eight Student Workshops were conducted on transferring. These workshops were attended by 102 students. • The 3rd Annual Native Leaders Speaker Series was held on April 09, 2014. San Juan College graduate, Dr. Stanley Atcitty, was the featured speaker. Over 40 students and faculty members attended this lecture. • The first annual Transfer Week was held, including over 250 students who attended the Transfer Fair with 40 college/scholarship representatives. • The Transfer Center coordinated the annual “Commit to Complete” campaign in which 153 students committed to complete their degree within three years. Building Partnerships with Native American Servicing Four-Year Institutions (Objectives 1a, 1b, 1c, 1d, 2a) • Collaboration meetings were held between SJC and New Mexico Highlands University main campus, New Mexico State University, Eastern New Mexico University, Weber State University, and Santa Fe University of Art and Design. These collaboration meetings discussed student preparation, creating a transfer network, transfer articulations, the transfer process, and available student support services. These partnerships are in addition to the nine collaborations that were developed in years one and two of the grant. 15 • Two meetings of the Fast Forward Native American Advisory Council were held. The Advisory Council continues to provide great advisement for the operations of the grant. • Five total Student College Exploration Visits were made to the University of New Mexico, Fort Lewis College, Colorado School of Mines, and New Mexico State University. Altogether, 32 students participated on these trips. • A year-long health science partnership was coordinated with the University of New Mexico’s Center for Native American Health Program. Twenty-three students participated in this partnership and two of those students did transfer to UNM-CNAH. • Four additional Guaranteed Admission Agreements were signed with New Mexico Highlands University. • Two new Articulation Agreements were signed with New Mexico Institute of Mining and Technology in Engineering and with the University of New Mexico in Nursing. Developing Alternative Delivery Formats (Objectives 1a, 1b, 1c, 1d, 2a, 3a, 4a) • A community survey was administered in year two to gauge student and community interest in offering various alternative formats of instructional delivery. The survey results led to: • An initiative called "Saturday College" was established by the college to help students complete a Liberal Arts A.A. degree through a hybrid model of face-to-face Saturday sessions and weekly online assignments. • An increase in the number of late start classes being offered for the fall semester. • ClassTracks, a course schedule program, was purchased to schedule courses, but the program also analyzes course scheduling for maximum quality management. Strengthening Professional Development for Faculty (Objectives 3a, 4b, 5c) • Fifteen faculty and staff members participated in various national conferences which focused on Native American and applied learning educational strategies. • The Bisti Writing Project again provided a professional learning community (PLC) summer institute for 13 SJC faculty and adjunct faculty during a five day-workshop. This year’s workshop explored Writing Across the Curriculum & Working with Diverse Learners. • Forty-two faculty participated in Fast Forward-sponsored workshops, including a presentation on the Bachelors of Applied Arts and Science Degree at Eastern New Mexico University, the American Indian Cohort Student Initiative Presentation, the Learning Symposium, and the Native Leaders Speaker Series Faculty Presentation. Creating a Technology Readiness Assessment and Remediation Program (Objectives 4c, 4d) 16 • A Technology Readiness Assessment, SmarterMeasures, was administered in New Student Orientation and a few selected on-line courses to 1448 students. This was a change from the previous year when it was administered by the Online Grassroots Committee in only selected online courses. • Based on the Technology Readiness Assessment, 24 students were recruited into technology coaching through the Student Achievement Center. Enhancing Interactive Electronic Student Resources (Objectives 2a, 4e) • Webpage additions and enhancements were made in 61 areas. • Academic program content was prepared for a new e-Brochure system that is linked to the SJC website. • Assisted in researching and selecting an online student catalog system that will link to the SJC website. • Fast Forward participated in a cost-share to purchase a new e-Catalog system, Digital Architecture, Inc. • The Transfer Center website was accessed 12,424 times; a 16% increase from the previous year. COMPONENT 2: Enabling More Data-Based Decision Making Conducting a Pilot Research Project: Retention Assessment (Objective 5a) • A retention assessment continued to be administered as part of New Student Orientation to assess the non-cognitive concerns of incoming students. Altogether, 1304 students completed the assessment. Collecting Extensive Quantitative and Qualitative Data to Improve Native American Student Success (Objectives 1a, 1b, 1cc, 1d, 2a, 3a, 5b, 5d) • Dashboards were updated on the Native American Graduate Survey, Native American Student Success Rates, and the Native American Student Profile. • Customizable reports were created on American Indian cohort students to track retention, course success, and degree completion rates. • Revisions and distribution of the 2014 American Indian Graduate Survey were made. The 2014 Native American Student Profile was created and a 2015 draft was created. Empowering Data-Based Decision Making (Objectives 3a, 5a, 5b, 5c, 5d) • Implementation of the Cohort Student Initiative began in 2013-14 to identify and advise American Indian students categorized in the Fall 2011 and 2012 First Time, Full Time cohorts. 17 • Student Success Courses’ impact on American Indian Student Retention Data and Trends among 2010 American Indian Cohort were shared with the Learning Leadership Team, which is comprised of the Vice President of Learning, the Associate Vice President, and the Deans of the schools. As a result, the position of the Research Specialist was recommended to be changed to a Program Advisor. CRITICAL QUESTION 3: To what extent has the College used data to improve programs? The Fast Forward grant is a data-driven program on all levels. At the micro level all activities, such as those listed above, are evaluated for effectiveness and results systematically used to improve programs. In particular programs that provide direct services to students such as the Transfer Office, the College Visits program and the Bisti Writing Project, collect feedback from participants, analyze the feedback and use it to improve programs. At the macro level the Fast Forward grant provides data to decision makers at the College. For example grant staff have extensively collected data on alternative formats for courses. This data has been presented to the highest- level administrators who will ultimately make such decisions. The Fast Forward staff has also conducted all of the surveys outlined in the grant and provided results to College officials. CRITICAL QUESTION 4: To what extent has the College fulfilled the legislative intent of the Title III Act? The purpose of the legislation is to enable Native American-serving institutions, like San Juan College, to improve and expand their capacity to serve Native American and lowincome individuals. All of San Juan College’s Fast Forward grant activities, programs and personnel are directly engaged in fulfilling the legislative intent of the Title III Act. There is no variance from the legislative intent and the evaluator believes the College is doing an exemplary job of putting Title III theory into good practice. CRITICAL QUESTION 5: To what extent has the College used grantfunded initiatives to fulfill its mission? All of the programs and activities that are part of the Fast Forward grant directly relate to San Juan College’s mission as an institution serving Native American Students. The mission of the College reads, “Inspire and support lifelong learning to achieve personal and community goals by providing quality education, services and cultural enrichment”. Grantfunded activities, extensively discussed earlier, will improve San Juan College’s service to Native students. Fast Forward grant initiatives specifically related the College’s mission include: 18 Quality Education: Professional development opportunities help faculty improve their instructional methods, quality of education and classroom pedagogy. The updated Native American Profile and Dashboards on student success rates enable data based decisions regarding students’ educational needs and challenges. The “Cohort Student Initiative” tracks American Indian cohort groups on their academic progress, retention, course completion and degree completion. The “Finish What You Start” college campaign focuses on increasing student degree completion rates. Quality Services: The grant has formalized advising to support students in the transfer process by creating a central Transfer Center on campus and an interactive Transfer Center website. The grantee has communicated transfer information and opportunities to students through classroom visits, workshops, bulletin boards, flyers, posters, transfer exploration trips and sponsorship of Transfer Week. Through its Facebook page the Transfer Center has expanded students communication to include social media. The Fast Forward grant has supported quality services by participating in Native American Center events and Activities, and participating in College-wide events such as Student Rush, Student Resource Days, Convocation, etc. Cultural Enrichment: The Fast Forward grant staff has been actively involved in the College’s cultural enrichment opportunities. They have participated in and supported the Native American Center with events and activities. They assisted with SJC Pow-Wow, and assisted with college information booths at the SJ County Fair and Northern Navajo Nation Fair. The Grant sponsored the third- annual Native Leaders Speaker Series attended by students, faculty, staff and community members. Evaluator’s Conclusions: During Year 3 the grantee has made progress in meeting the objectives but in some cases has not met the annual performance benchmarks. This report contains an analysis of objectives that were not met but a more thorough analysis of why and why not needs to be conducted by the Fast Forward Director and the Senior Director of the Center for Student Engagement, the PI for the grant. The Evaluator concludes that for the Objectives where the grantee has direct programming there is success and significant impact. However many of the Objectives in the grant are larger institutional objectives (such as completion rates and transfer rates) that the grantee has minimum ability to impact in any statistically relevant way. In many cases, downward 19 trends in the grant mirror downward trends at the institution; grant and institutional enrollment and completion trends should be analyzed together. In conclusion, the grantee is offering high quality services aligned with grant objectives. A systematic evaluation process has been followed and results reported in a timely manner. Participants in grant-sponsored activities rate them highly and indicate they are effective. The grantee is extremely conscientious in using data to improve programs. Overall, the grant is well-managed, responsive to input and a great benefit to San Juan College in fulfilling its Mission. ELECTRONIC ATTACHMENTS: Audit Readiness Review Articulation Agreements Transfer Center Evaluation 20 San Juan College, Fast Forward Grant Articulation Agreements and MOU’s with Four-Year Institutions Degree SJC Program of Study School Degree Program of Study AAS AA AA AA AA AS AS AA AAS AA AAS AAS AAS AAS AAS AAS AA AAS Adv Petroleum Production Operations Business Administration Business Administration Business Administration Business Administration Chemistry Chemistry Criminal Justice Digital Media Human Services Natural Gas Compression 1 Natural Gas Compression 2 Natural Gas Compression 3 Petroleum Production Operations 1 Petroleum Production Operations 2 Petroleum Production Operations 3 Psychology Occupational Safety NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU NMHU BBA BBA BBA BBA BBA BA BS BA BA BSW BBA BBA BBA BBA BBA BBA BA BBA Oil and Gas Accounting Management Managerial Finance Marketing Chemistry Chemistry Criminal Justice Media Arts Social Work Oil and Gas Oil and Gas Oil and Gas Oil and Gas Oil and Gas Oil and Gas Psychology Oil and Gas Sep-13 MOU: Guaranteed Admissions Agreement NMHU Oct-13 AS Oct-13 AS Biology Biology NMHU NMHU BA BS Biology Biology Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Sep-13 Oct-13 AS Oct-13 AS General Science Pre-Medical Science NMHU NMHU Apr-14 Jul-14 MOU: Guaranteed Admissions Agreement Memorandum of Understanding NMT UNM Feb-15 AAS Feb-15 AAS AAS AA AA AA Industrial Maintenance Mechanics Industrial Process Operator Instrumentation & Controls Early Childhood Early Childhood Elementary Education NMHU NMHU NMHU NMHU NMHU NMHU BS BS Biology Biology Engineering Nursing BBA BBA BBA BA BA BA Oil and Gas Oil and Gas Oil and Gas Early Childhood Multicultural Education, Birth-Age 4 Early Childhood Multicultural Education, Age 3 - Grade 3 Elementary Education Transfer Center Evaluation S14 SurveyMonkey Q1 How many times did you visit the Transfer Center? Answered: 44 Skipped: 2 Once Twice Three or more times 0% 10% 20% 30% 40% Answer Choices 50% 60% 70% 80% 90% 100% Responses Once 25.00% 11 Twice 36.36% 16 Three or more times 38.64% 17 Total 44 1/9 Transfer Center Evaluation S14 SurveyMonkey Q2 I had questions about (check all that apply) Answered: 46 Skipped: 0 General information... Information about... Information about how my... Information about financ... Other (please specify) 0% 10% 20% 30% 40% Answer Choices 50% 60% 70% 80% 90% 100% Responses General information about transferring 71.74% 33 Information about transferring to a specific college or university 78.26% 36 Information about how my SJC credits will transfer 56.52% 26 Information about financial aid and transferring 32.61% 15 Other (please specify) 6.52% 3 Total Respondents: 46 # Other (please specify) Date 1 voting registration 7/23/2014 11:21 AM 2 college visits 7/16/2014 3:49 PM 3 college visits 7/16/2014 3:41 PM 4 I never visited the transfer center 7/16/2014 12:18 PM 5 scholarships and grants 7/16/2014 11:49 AM 6 fieldtrips 7/9/2014 5:09 PM 7 information about specific BA programs 7/7/2014 12:18 PM 2/9 Transfer Center Evaluation S14 SurveyMonkey Q3 The information I received from the Transfer Center was Answered: 44 Skipped: 2 Very Helpful Somewhat helpful Not very helpful Useless 0% 10% 20% 30% 40% Answer Choices 50% 60% 70% 80% 90% 100% Responses Very Helpful 40.91% 18 Somewhat helpful 45.45% 20 Not very helpful 11.36% 5 Useless 2.27% 1 Total 44 3/9 Transfer Center Evaluation S14 SurveyMonkey Q4 The people in the Transfer Center were very approachable Answered: 44 Skipped: 2 Strongly Agree Agree Disagree Strongly Disagree 0% 10% 20% 30% 40% Answer Choices 50% 60% 70% 80% 90% 100% Responses Strongly Agree 47.73% 21 Agree 50.00% 22 Disagree 2.27% 1 Strongly Disagree 0.00% 0 Total 44 4/9 Transfer Center Evaluation S14 SurveyMonkey Q5 The people in the Transfer Center answered my questions in a timely manner Answered: 45 Skipped: 1 Strongly Agree Agree Disagree Strongly Disagree 0% 10% 20% 30% 40% Answer Choices 50% 60% 70% 80% 90% 100% Responses Strongly Agree 37.78% 17 Agree 53.33% 24 Disagree 8.89% 4 Strongly Disagree 0.00% 0 Total 45 5/9 Transfer Center Evaluation S14 SurveyMonkey Q6 I would recommend the Transfer Center to friends who are thinking about transferring Answered: 45 Skipped: 1 Strongly Agree Agree Disagree Strongly Disagree 0% 10% 20% 30% 40% Answer Choices 50% 60% 70% 80% 90% 100% Responses Strongly Agree 35.56% 16 Agree 48.89% 22 Disagree 15.56% 7 Strongly Disagree 0.00% 0 Total 45 6/9 Transfer Center Evaluation S14 SurveyMonkey Q7 Are you transferring to a 4-year college or university? Answered: 45 Skipped: 1 Yes No Not Sure Yet 0% 10% 20% 30% 40% Answer Choices 50% 60% 70% 80% 90% 100% Responses Yes 73.33% 33 No 8.89% 4 Not Sure Yet 17.78% 8 Total 45 7/9 Transfer Center Evaluation S14 SurveyMonkey Q8 Please tell us what further assistance we could offer students who are considering transferring. Answered: 28 Skipped: 18 # Responses Date 1 Hmm just keep up the good work! 7/31/2014 1:37 PM 2 I had send in a reply to this survey before, (around two weeks ago) and I hope this one goes thru. 7/24/2014 8:34 AM 3 Suggestions on how to get a bachelors degree or even a masters degree and what class to take before transferring. 7/24/2014 6:53 AM 4 more information on the college of university they are wanting to transfer to. 7/21/2014 11:48 PM 5 Be more efficient about sending transcripts. I had to have mine sent multiple times before my university actually received it. 7/19/2014 12:22 PM 6 I would like have my counselor help me to make an arrangement to get my college credits to be transferred. 7/18/2014 11:35 AM 7 N/A 7/18/2014 9:42 AM 8 more information on credits transferring to a specific university. 7/17/2014 11:51 AM 9 Clear, precise, and dependable information. 7/16/2014 6:23 PM 10 NA 7/16/2014 5:37 PM 11 You guys are doing a great job. 7/16/2014 3:49 PM 12 You guys are doing a great job. 7/16/2014 3:41 PM 13 Anything more than just being told to talk with the university when they come for the transfer fair. 7/16/2014 3:11 PM 14 i think the transfering center is well set up. 7/16/2014 2:27 PM 15 I never visited the Transfer Center, that is why I didn't do the survey the first time. I can not give answers to questions I have not experienced or have knowledge. I started my classes at NMHU back in January of 2014. Dr. Salazar was extremely helpful in making sure I had the proper classes in order to transfer to NMHU. 7/16/2014 12:18 PM 16 One of the biggest challenges of transferring is affording the next school. San Juan College is uniquely inexpensive, so students need more resources to help them figure out how to fund further education. Please include more scholarship and grant information and fairs! 7/16/2014 11:49 AM 17 thanks :) 7/16/2014 10:50 AM 18 Offer to pay admission application fees 7/16/2014 9:39 AM 19 No comment. 7/16/2014 9:15 AM 20 More information about universities out of state. 7/16/2014 9:13 AM 21 housing options 7/9/2014 5:09 PM 22 Updates the transfer information books from the differenet colleges. Update the college catlog information because it does not explan what does or does not tranfer to the other colleges. Because I had the choice from San Juan College catlog to either or and find out that the college I want to transferring to takes only one . For example like English 211 or English 218. Fort Lewis will only take English 218 not English 211 to transfer and nobody knows this tell it is to late. 7/8/2014 7:26 PM 23 Have more open houses on the topic of Transferring 7/7/2014 9:10 PM 24 Transfer students need more resources about how to find and apply for scholarships, and how to make their education at a new college affordable. 7/7/2014 7:48 PM 8/9 Transfer Center Evaluation S14 SurveyMonkey 25 I came into the transfer center seeking information about degree programs versus emphasis in something, but no one was able to provide me with a true understanding of what it meant to get an emphasis in. I had also wanted to know which would look better and once again I got no real feedback. Furthermore, it was a toss up on the friendliness. Some of them seemed genuine in their interest in helping me, but others were rude and tried rushing me out the door. 7/7/2014 1:03 PM 26 Transfer center is seen as a place for help and support to Native Americans only. This is due to source of funding, promotional pictures, guest speakers, and activities. Where can other non Native students go to get help with transferring to a four year school? 7/7/2014 12:29 PM 27 How to obtain info from next level of college. Who to contact about programs students are interested in. 7/7/2014 12:18 PM 28 Help finding classes that will academically transfer. 7/7/2014 12:06 PM 9/9
© Copyright 2025 Paperzz