2016-17 Program Review Handbook 1 Table of Contents Overview Program review schedules Process descriptions Comprehensive Annual Update 2016-17 Timeline at a glance Web-Enabled Program Review (WEPR) Checklist and Tips for Success in Writing Program Review Checklist for Validating the Program Review Program Review Definitions and Clarifications Fall 2016 Resources (see U:drive - L:\ProgramReview\2016-17\Resources) Institutional Standards Refreshment cycles Technology: Faculty/staff computers Computer labs Projectors Software “Smart Classrooms” Equipment Scheduled Maintenance List DVC Strategic Plan Integration Council Ranking Rubric Facilities Review List B&G Ticket List SysAid Ticket List Professional Development Expenditures by program Equipment Expenditures by program 2 Overview During academic year 2014-2015, a Program Review Task Force, led by the Academic Senate and other representatives, met many times to revise the program review templates and processes used by Administrative Program Review, Instructional Program Review, and Student Services Program Review. The goals of the revision were to better align timelines and processes, to improve the consistency and quality of the information provided to the (then) Integration Council (now Program Review Committee, PRC) and to develop a sustainable model for program review. The outcomes of this process improvement Task Force were incorporated into 2015-16 Program Review. Writers of program review were asked to comment and reflect on the process and template and suggest further improvements. The Program Review Committee reviewed these suggestions in Spring 2016. Based on this feedback, enhancements were made to the WEPR during Summer 2016. Purpose of program review: The purpose of program review is to focus instructional, student services, and administrative units on their role in fulfilling the mission of the college and achieving the goals and objectives of the strategic plan, consistent with the core values of the college. To do so, each unit will: 1. Reflect on its purpose or mission, its relation to the college mission and its current and/or potential impact on strategic plan goals and objectives; 2. Review and analyze unit data in terms of: a. Areas in which the unit currently impacts strategic plan goals and objectives, consistent with the core values of the college - this should include an analysis of costs and impact of activities implemented in previous cycles; b. Areas in which the unit's impact should be strengthened, based on the data. 3. Develop unit-level activities to address the areas identified in 2b. Strategies and activities should be clearly connected to data analysis and reflection on unit purpose and/or mission; 4. Analyze current resources to determine whether they can be re-purposed effectively to implement unit level activities; develop resource requests and cost projections if it is demonstrated that current resources are not sufficient to implement these activities. Program review is not intended to address "maintenance of effort" activities – these should be addressed through day-to-day operational procedures of the college or individual unit (including Help Desk tickets, Buildings and Grounds tickets, technology refreshment cycles, Facilities Review procedures, etc.). If there are “maintenance of effort” activities that are not being addressed through current operational procedures that impact student success or institutional effectiveness, units should include the activities and associated resource requests in their unit analysis and plan. 3 Program Review Process Overview: All programs participate in a comprehensive program review on a four-year cycle, 25% of programs each year All eligible programs may participate in the resource allocation process each year For instructional program review, the instructional “unit” is defined and evaluated by the faculty, with input of staff, if appropriate For student services program review, the “unit” or “program” is defined and evaluated by Student Services deans and managers For administrative program review, the “unit” is defined by administration and evaluated by administration with input of faculty and staff if appropriate What is the difference between Annual and Comprehensive Reviews? The Program Review Committee will review all Section I submitted, whether from Annual or Comprehensive reviews as part of the Resource Allocation process. Programs in annual review are NOT REQUIRED to complete the narrative sections of Section II and Section III, as the entirety of the program review will not be subject to validation. However, it is expected that plans outlined in Section I, and requests for resources, are substantiated by a review, discussion and analysis of the data and information contained in Section III. Annual reviews are to be reviewed at the division level prior to submission to ensure that plans and resource requests have the support of the division. Programs in comprehensive review are REQUIRED to complete all sections and receive review and feedback through the Validation process. 4 Program Review Schedules Administrative Program Review Administrative Unit Vice President, Business and Administrative Services Vice President, Student Services Vice President, Instruction Applied and Fine Arts Division Office Business Services and Cashier’s Office Math and Computer Science/Business Division Office Bookstore Professional Development English and Social Science Division Office Food Services Information Technology and Services Foundation Biological/Health Sciences and Physical Sciences/Engineering Division Office Kinesiology/Athletics/Dance Division Office Library President's Office San Ramon Campus Administration Maintenance and Operations Distance Education Marketing and Communications Year 2016-17 2016-17 2016-17 2016-17 2016-17 2017-18 2017-18 2017-18 2017-18 2017-18 2018-19 2018-19 2018-19 2018-19 2018-19 2019-20 2019-20 2019-20 2019-20 2019-20 Instructional Program Review Dean Toni Fannin Division AFA Program/Unit Name Art and Art History Art Digital Media, Broadcast Communication Arts, and Film AFA AFA Drama Foreign Language AFA AFA Humanities and Philosophy Music AFA Communications Studies Subject Codes Included ART, ARTHS ARTDM BCA FILM DRAMA ARABC/CHIN/FRNCH/ GRMAN/ITAL/JAPAN/ LATIN/PERSN/PORT/ RUSS/SPAN/TAGLG HUMAN/PHILO MUSIC MUSX COMM YR 19-20 16-17 17-18 18-19 18-19 19-20 17-18 5 Mike Holtzclaw SRC Computer Information Systems and Business SRC Applied Arts and Social Science SRC Language Arts SRC Math and Science Rick Robison L Library Obed Vazquez ENGL ENGL ENGL SS SS SS SS SS SS SS English English as a Second Language Journalism Administration of Justice Early Childhood Education Economics History Political Science Psychology Social Sciences Despina Prapavessi BUS BUS Culinary Arts Business MCS MCS Mathematics Computer Science Computer Science Kinesiology Christine Worsley Tish Young Tish Young PE BHS BHS BHS BHS BHS BHS Dental Assisting Dental Hygiene Biological Science and Oceanography Nutrition Horticulture Health Science and Addiction Studies ECON+ BUS+ CIS CNT KNACT SOCIO+ ART/ARTHS CARER/ COUNS HIST PSYCH COMM ENGL SIGN/JRNAL SPAN CHEM+ BIOSC+ MATH LT LS ENGL ESL JRNAL ADJUS EDUC, SIGN, ECE ECON HIST (& GEOG 130) POLSC PSYCH SOCSC/ANTHR SOCIO CULN BUS/BUSAC/BUSIM/BUSMG /BUSMK/RE MATH COMSC CNT DANCE/KNACT/KNCMB/ KNDAN/KNICA/KINES DENTL DENHY BIOSC/OCEAN NUTRI HORT ADS HSCI 16-17 18-19 17-18 19-20 16-17 17-18 17-18 18-19 19-20 16-17 19-20 18-19 19-20 16-17 18-19 17-18 18-19 19-20 16-17 17-18 18-19 18-19 17-18 19-20 17-18 19-20 6 Tish Young PSE PSE COUNS Counseling HVACR/PLUMB/STMFT ARCHI IDSGN CONST ENGIN ENGTC CHEM ELECT/ELTRN ENSYS ASTRO GEOG (FA15-2 sections GEOG-130) GEOL PHYS PHYSC COUNS/CARER SPEDU IO Special Education Cooperative Education Interdisciplinary SPEDU COOP INTD PSE PSE PSE PSE PSE Beth Hauscarriague Emily Stone Kim Schenk Apprenticeship Architecture and Industrial Design PSE PSE Construction Engineering and Engineering Technology Chemistry Electricity/Electronics and Energy Systems Astronomy Geography PSE PSE Geology Physics and Physical Science 19-20 17-18 17-18 17-18 17-18 19-20 16-17 18-19 16-17 17-18 19-20 18-19 16-17 18-19 Student Services Program Review DEPARTMENT Assessment Financial Aid ISAS Student Life Career Services Counseling - Courses Counseling - Services Transfer Services A&R CalWORKs EOPS/CARE Relations Schools/Welcome Services DSS - SPEDU DSS/Workability III TRiO - UB/ETS Learning Communities: PUENTE UMOJA 16-17 17-18 18-19 19-20 X X X X X X X X X X X X X X X 7 Program Review Process Descriptions COMPREHENSIVE Program Review Process 2016-20 Administrative Program Review (APR) Process APR team membership: -Writing the APR includes classified input as appropriate. Training in APR and Validation templates APR Validation team membership: -Composed of 2 full-time administrators, 2 fulltime faculty members, 2 classified staff, and 2 students. The validation team may determine the chair Administrative units failing to meet the deadline will not be included in resource allocation processes. Instructional Program Review (IPR) Process IPR team membership: -Composed of a minimum of two faculty and 1 classified if appropriate, and one student, if possible -IPR Chair determined by the Instructional Unit IPR Validation team membership: -Composed of a minimum of 2 full-time faculty members, the division dean and classified, if possible. The division validation team rosters will be forwarded to the Academic Senate for approval. IPRs will be assigned to divisions for validation. All divisions will be given program reviews to validate based proportionally on the number of FT faculty in the division. The validation teams will determine the chair The division will determine how the validations will be accomplished within the timelines of the process. Training will be offered for writing the IPR and the validation process (coordinated between Staff Development, Instruction Office and Academic Senate) Divisions may require division review of comprehensive IPR prior to final submission, and may establish a timeline for such review. Annual updates require divisional review prior to submission. Units failing to meet the deadline will not be included in resource allocation processes. These units may be referred to the Program Revitalization Process. Student Services Program Review (SSPR) Process SSPR writing team membership: determined by the unit Deans and managers access forms and data; request specialized data Program review and validation training Validation Team Membership SSPR Validation Team is composed of managers, faculty, and classified personnel. Validation teams are chaired by the Vice President of Student Services Division validation team roster is finalized by the Vice President of Student Services Validation Chair distributes copies of SSPRs with validation forms to the validation teams. Validation team questions/clarifications will be forwarded to Student Services unit(s). The division will determine how the validations will be accomplished within the timelines of the process. Group work will be offered during September, October, and November covering the SSPR, and the validation process through the Student Services manager’s meetings Student Services units failing to meet the deadline will not be included in resource allocation processes. Copies will be available on the Student Services website. 8 Validation: The validation team will ensure that the self-study report is complete, analysis and plans are data driven and aligned with the strategic plan, and resource requests are tied to plans. The Validation Team has three options: 1. ACCEPT – The Validation Team accepts the APR and is forwards the completed and signed Validation Form to the Office of the President. 2. CONDITIONALLY ACCEPT - APR is conditionally accepted, pending revisions that must be completed within established timelines. The APR has minor inaccuracies/changes that can be corrected. The Validation Team reviews the amended APR and, if accepted, forwards the completed and signed Validation Form to the Office of the President 3. REJECT - The APR contains inaccurate information and/or is largely incomplete. Substantial revision would be required for acceptance. The APR is not submitted to the Office of the President, and is not eligible for the program review process. President’s Office will post final versions of the validated APRs on the U-drive by February 3, 2017. Validation: The validation team will ensure that the self-study report is complete, analysis and plans are data driven and aligned with the strategic plan, and resource requests are tied to plans. . The validation team has three options: 1. ACCEPT – The Validation Team accepts the IPR/HPR, and forwards the completed and signed Validation Form to the Instruction Office. 2. CONDITIONALLY ACCEPT – IPR/HPR is conditionally accepted, pending revisions that must be completed within established timelines. The IPR has minor inaccuracies/changes that can be corrected. The Validation Team reviews the amended IPR/HPR and, if accepted, forwards the completed and signed Validation Form to the Instruction Office. 3. REJECT - The IPR/HPR contains inaccurate information and/or is largely incomplete. Substantial revision would be required for acceptance. The IPR/HPR is not submitted to the Office of the President, and is not eligible for the program review process. Instruction Office will post final versions of the IPR/HPR’s on the U-drive by February 3, 2017. Validation: The validation team will ensure that the self-study report is complete, analysis and plans are data driven and aligned with the strategic plan, and resource requests are tied to plans. The Validation Team has three options in review of the SSPR: 1. ACCEPT - The Validation Team accepts the SSPR, and forwards the completed and signed Validation Form to the Vice President of Student Services. 2. CONDITIONALLY ACCEPT – SSPR is conditionally accepted pending revisions that must be completed with established timelines. The self-study report contains some inaccurate and/or is lacking in certain sections. The Validation Team reviews the amended SSPR and, if accepted, forwards the completed and signed Validation Form to the Instruction Office. 3. REJECT - SSPR is rejected and must be resubmitted in the next year’s SSPR cycle. The self-study report contains inaccurate information and/or is largely incomplete. Substantial revision would be required for acceptance. The IPR/HPR is not submitted to the Office of the President and is not eligible for the program review process. Office of the Vice President of Student Services will post validated SSPRs to the U-drive by February 3, 2017. 9 ANNUAL UPDATE Program Review Process 2016-20 APR, IPR, SSPR Process: Any program not in comprehensive program review process may complete an annual update in order to revise program strategies and activities that result in a request for resource allocation. The Annual Update to Program Review is the same template as the Section I in the Comprehensive Program Review. Annual Updates to Program Review require division review prior to final submission; divisions establish a timeline for such review Annual Updates to Program Review are due to the President’s Office, Office of the Vice President of Instruction or Office of the Vice President of Student Services by the date established for submission of comprehensive reviews. Final versions of the signed Annual Update to Program Review will be posted to the U-drive. 2016-17 Program Review Timelines at a Glance Program Review Timeline - APR Date Monday, August 29, 2016 Sept-Oct Monday, November 28, 2016 Thursday, January 5, 2017 Friday, January 6, 2017 Monday, January 9-Friday, January 13, 2017 Tuesday, January 17-Friday, January 20, 2017 Monday, January 23, 2017 Friday, January 27, 2017 Wednesday, Feb 1, 2017 Wednesday, Feb 1, 2017 Friday, February 3, 2017 Program Review Timeline - IPR Date Monday, August 29, 2016 Monday, August 29, 2016 Sept-Oct Wednesday, November 23, 2016 Wednesday, November 30, 2016 Friday, December 9, 2016 Activity APR template available Training in APR and Validation templates Validation team members appointed by appropriate constituency leaders and roster submitted to President’s Office Validation Team meets to begin validation process APR comprehensive and annual due to President’s office Validation sub-groups read APRs Units make revisions/corrections Responses returned to Validation Team Final Validation Team meeting Validated comprehensive program reviews due to President’s Office (1 signed hardcopy) Reviewed annual update program reviews due to President’s Office (1 signed hardcopy) PRs (Comprehensive and annual) posted to the Portal Activity Department Chair grants access to IPR team/s Validation team rosters submitted to Office of the VP of Instruction Training in IPR and Validation templates Comprehensive IPRs due to VP Instruction PRs available to validation teams Validation teams meet with PR leads; all-college variable FLEX 10 Friday, December 16, 2016 Wednesday or Thursday, January 18 or 19, 2017 Wednesday, Feb 1, 2017 Wednesday, Feb 1, 2017 Friday, February 3, 2017 Program Review Timeline - SSPR Date August-September Thursday, September 15, 2016 Monday, October 3, 2016 Monday, October 3, 2016 Friday, December 2, 2016 Wednesday, December 14, 2016 Friday, January 27, 2017 Wednesday, Feb 1, 2017 Wednesday, Feb 1, 2017 Friday, February 3, 2017 Requests for revisions delivered to PR leads Second validation team meetings with PR leads if necessary Validated comprehensive program reviews due to the Office of the Vice President of Instruction (1 signed hardcopy) Reviewed annual update program reviews due to the Office of the Vice President of Instruction (1 signed hardcopy) PRs (Comprehensive and annual) posted to the Portal Activity Program review and validation training Baseline data finalized Budget data finalized Validation roster finalized SSPRs submitted to Deans of Student Services (1 signed hardcopy) Copies of SSPRs distributed to validation teams Follow-up final review and revision with validation team Validated comprehensive program reviews due to the Office of the Vice President of Student Services (1 signed hardcopy) Reviewed annual update program reviews due to the Office of the Vice President of Student Services (1 signed hardcopy) PRs (Comprehensive and annual) posted to the Portal Integration Council Deadlines: Preliminary Rankings Final Report to College Council Resource Allocation Process Deadlines: Budget Committee Recommendations to College Council College Council Recommendations to College President President Approval May 2017 September 2017 October 2017 November 2017 December 2017 11 Using Web-Enabled Program Review (WEPR) GENERAL NOTES: WEPR works best in the browsers FireFox, Chrome or Safari. It does not function optimally in Internet Explorer. It can be helpful to develop your text in a WORD document and then paste it into the WEPR text boxes. You must disable “smart quotes” in WORD. WEPR does not support Rich Text Format (.rtf). Report issues with WEPR immediately to the Instruction Office so that support and/or troubleshooting can be provided. Complete Section III first, then Section II, then Section I. You will use the analysis of data and reflection on the utilization of resources from Section III, along with the SelfReflection from Section II to formulate program improvement strategies and activities for Section I. The Program Review Committee ONLY reads Section I; that is why it is first in the document. How do I find WEPR 2.0 and my pdfs? 1. Getting there Web-enabled program review forms are found at the following URL: http://web.dvc.edu/wepr/ 2. Signing in Click the “sign in” link and use your 4CD log-in and password, just like you use for WebAdvisor, Outlook Web Access, etc. 3. Accessing forms You will be working in the “online form”. The pdfs update automatically throughout the day. Department chairs and program leads have been granted access to “edit” in WEPR. This means that they are able to enter text/information in any fillable field. Individuals with access to any section can grant access to others up to that level of access. They can also lower access for anyone with the same or lower access than themselves, except when that access has been granted at an administrative level. Individuals cannot change their own access level. 12 To add a user, locate the correct employee ID in the 4CD directory (linked to every page in WEPR). If you encounter difficulties, contact Kim Schenk [email protected]. To work in the form, select Online Form; to grant access, select Grant Access…. To set access level, select “add a new user”. You need the employee ID for this step. You find that through the link: 4CD Directory. 4. Sections of the Program Review Each program review consists of 4 major sections: 1. Section I – Unit Plan 2. Section II – Overview 3. Section III- Data and Unit Analysis 4. Validation and Recommendation Form For all units, Sections I and II are identical. Section III is differentiated for: Administrative Hybrid (Counseling and Library) Instructional Learning Communities Student Services 13 Instructional program reviews may have multiple Section IIIs in order to present data and analysis on individual subjects within a multi-subject unit. Single subject code: Multi Subject Code: 5. Completing the Program Review Sections The Unit Plan (Section I) will be developed based on analysis of data (Section III) and reflections from the Overview (Section II). It is recommended that you complete the sections in this order: FIRST: Section III SECOND: Section II THIRD: Section I The Integration Council will ONLY REVIEW Section I. Validation Teams and Division review is responsible to ensure that plans and resource requests presented in Section I are wellsubstantiated by evidence and reflection documented in Sections II and III. Instructions/tips for all sections: Using the TAB key after each entry and moving to the next entry facilitates saving. Text is added by selecting the Edit radio button in the upper right menu. Instructions: Depending on individual permission levels, you are able to view, edit, or enter data. Most users will have “edit” or “view” access. Edit access permits entry of analysis and commentary in most text boxes. Select the “edit” option and the text boxes, radio buttons, and/or drop-down menus that require input/commentary will turn pink on that page. As soon as a change to a box is made and you leave that box (TAB works great), the information that you have entered is saved and the box will turn green. 14 Section III - INSTRUCTIONS Section III – Data Analysis 1. The District Research Office has established that a percentage point difference of 3% or greater is considered significant for research purposes. Units that note trends in the data indicating a difference up-or-down of 3% or more will want to review carefully and provide analysis and commentary. 2. Section III A.1 – These data are input by the Instruction Office. Data for 11-12 and 12-13 were carried over from previous Program Reviews cycles and were not revised if the configuration of the IU changed for the 2015-16 or 2016-17 Program Review cycle. 3. Section III A.3 and D.1 – Data in these rows are input by the Instruction Office: Data for 11-12 and 12-13 were carried over from previous Program Reviews and were not revised if the configuration of the IU changed for the 2015-16 or 2016-17 Program Review cycle. In some cases, the value N/A (Not Available) is entered, since the change in configuration means that the historical data is not available. 4. For all other measures in Section III, all five years of data are supplied by District Office Research and have been updated according to the units as designed for 2016-17. This means that the data in the 2016-17 program reviews will not correspond one-to-one with data in previous program reviews since: a. programs have re-aligned or changed “included” disciplines b. each data pull yields slightly different numbers because Colleague is a dynamic system 5. The value NV = Null Value. This data element appears when the data query yields no result and the database has a “blank”. NV is not equivalent to “0” – zero. Since the data query can return a value of “0” for student achievement, another value needed to be identified for “null” results. Note that there may be some 11-12 and 12-13 “0”results that were previously posted and carried over. In most cases, those should be considered “NV”. As the years roll forward, those results will drop off… 6. C.1 Row 4 – The SLOAC changed the SLO process effective 2013-14, so prior to that year, the data element is not relevant and thus the entry “N/A” – not applicable, is entered In Section III.D - Reflection on resources acquired in past cycles: indicate impact on college initiatives: Student Success Student Learning Inclusive Excellence Institutional Effectiveness Other Key College Initiative. 15 A drop-down menu is included to ensure that impact is recorded relative to these initiatives. Click in the text box and a drop-down menu will appear. (Robert’s program doesn’t let me take a picture of the drop down, but here is what happens when you make a selection:) Depending on the specific program review (APR, HPR, IPR, SSPR), Section III will contain 4-8 subsections. Each sub-section requires input/commentary. DO NOT leave any text box empty. Enter “Not Applicable” or “No Response at this Time” to indicate that you have reviewed but have no comment. Section II - Instructions Section II is descriptive and reflective and will help the validators understand your program. Provide as much detail as you think is important for an “outsider” to fully grasp how your program serves the community. 16 Section I - Instructions Remember that the PRC will ONLY read Section I. You have done the hard work of analyzing student achievement, reflecting on past changes that were designed to improve those outcomes, discussing challenges and successes with colleagues and formulating new plans to continue program improvement efforts. Summarize those discussions in the text boxes provided in Section I.A1 and 2 and B 2.3. and 4 Section I.B.1: This section is your forward-looking planning and requires clear links of program-level strategies and activities to DVC’s Strategic Plan Goals and Objectives. The drop down will prompt you to select the relevant Goal 1 and Objective 1 that relates to your strategy/activity. For example: Strategic Plan Goals and Objectives GOAL 1: The college will foster excellence by integrating best practices in academic programs and student support services. Objective 1: Increase the number of students who successfully complete courses Objective 2: Increase the number of students who earn certificates and degrees and transfer to four-year institutions Objective 3: Increase equity in student success Objective 4: Improve students’ experience navigating the college systems Objective 5: Implement promising innovations while maintaining best practices and institutionalizing successful ones. GOAL 2: The college will align its governance, operational and planning processes to ensure institutional effectiveness. Objective 1: Move the college towards increased evidenced-based inquiry and decision-making. Objective 2: Evaluate and adapt decision-making processes to be increasingly transparent, collaborative and efficient. Objective 3: Continue to foster a culture of collaboration. GOAL 3: The college will effectively direct and augment its resources to increase student learning and success. Objective 1: Continue to revise the budget process to responsible, flexible and sustainable. 17 Objective 2: Plan, implement and evaluate a forward-thinking technology plan and IT operations that provide professional maintenance and advance innovation Objective 3: Increase and diversify funding sources Objective 4: Design, construct and maintain buildings and grounds to provide quality and sustainable learning/working environments GOAL 4: The college will develop and implement a human resources plan to maximize the employee expertise required to support the institution’s commitment to excellence and equity. Objective 1: Develop an integrated human resources plan for faculty, classified, and managers Objective 2: Optimize human resource decisions to improve student success and institutional efficiencies Objective 3: Offer a professional development program that supports best practices, stimulates innovative practices and develops the skills, knowledge, and abilities of our employees. Section I.D and E record the programmatic needs that support your ability to achieve the activities and strategies in Section I.B.1. You indicate that relationship by entering the number of the related program strategy/activity here: WEPR will allow you to indicate up to ten “critical needs” in both Section I.D and Section I.E. A ranking of “1” is high and a ranking of “10” is low. Indicate whether the request is “Innovation”, “Replacement” or “Maintenance of Effort”. “Innovation” means that the request is something new that you believe will positively impact the program in some way. “Replacement” means that the request is to update, repair, or replace current items. “Maintenance of effort” means that the request is recommended to be placed on a regular replacement cycle because obsolescence in predictable. 18 Checklist and Tips for Success in Writing your Program Review Getting Started ☐ Do I have Firefox or Chrome installed on my computer? ☐ Do I know how to access the U-drive (on-campus and off) to find important information, documents and the PDF’s? Do I know how to check saved material on the PDF’s on the Udrive? ☐ Do I know when my completed Comprehensive Program Review is due? ☐ Does my Comprehensive Program Review require division review? Do I know what the timeline is for that? ☐ Do I know when my completed Annual Program Update is due? ☐ Annual Program Updates require division review. Do I know what the timeline is for that? ☐ Do I know how to access my Program Review on the DVC website from campus and from home? ☐ Do I have access to log onto WEPR as a program review writer? ☐ Have I familiarized myself with the PRC Ranking Rubric for Program Review to describe and justify my requests? For example, do I know the difference between Technology, Supply/Operating Budget, and Equipment requests? Section I: Program/Unit Plan or Update ☐ Do the strategies identified in the program plan align with the directive, core values, and goals of the strategic plan? Do they align with areas of focus identified in section II? Are the projected outcomes clearly defined, and will the evaluation method effectively measure the outcomes? Is the timeline reasonable? ☐ Do the impact statements in section I.B.2 and B.3 adequately connect the strategies/activities to student learning outcomes and achievement examined in Section III.C.1 and 2? EXAMPLE: Cite a student learning outcome that students are struggling to master. In the plan, is there an strategy that requires a supply or piece of equipment? For instance: The Communication Studies department evaluated the SLO: “Students completing the course will be able to support an idea using presentation aids correctly and confidently.” Instructors evaluated the students using a rubric during a presentation and students were also surveyed regarding their confidence level in their presentation aids. The results showed that students who used presentation aids not reliant on technology were both more confident and more successful in achieving the learning outcome. However, 19 students who used technology based presentation aids (power point, video clips, etc) were severely hampered by the faulty media equipment in the classrooms, most notably in the three Performing Arts classrooms in which most classes are held. Students reported that they began to avoid using technology aids due to the slow connections and faulty equipment, and faculty reported that the effectiveness of the aids were greatly diminished by the technological troubles associated with the faulty and aged equipment. The faculty determined that the equipment was negatively impacting learning in their classes and used this SLO evidence to request improved equipment, IT support, and maintenance in these three classrooms. ☐ Are my resource requests aligned with specific activities/strategies identified in the unit plan? ☐ Does the ranking in critical needs section of the Section I appropriately reflect the most urgent needs of your program, based on the Program Plan? ☐ Does my IU include both CTE and GE programming? Have I provided clear plans that address each program? Have I indicated any resource requests that are solely on behalf of my CTE program? Section II: Overview ☐ Have I updated the program description to account for any changes, accomplishments, and/or new challenges since the last program review cycle? Have I accounted specifically for my program’s accomplishment of the goals set forth in the last program review cycle? Would someone who is unfamiliar with my program have a good idea of who we are and what we do after reading this section? For example, the validation team? ☐ Does the analysis of student learning inform my unit self-reflection? (SLO and PLO assessment and plans) ☐ Does the unit self-reflection include a description of strategies/activities to improve student equity? ☐ Does my IU includes both CTE and GE programming? If so, have I explained the unique needs and characteristics of both? Different student populations? Different resource requirements? Section III: Data Analysis NOTE: Program review does not permit analysis of data at the course, section, day/night levels. For more specific information on sections and variables, consult the enrollment reports located on the U:drive. ☐ Have I reviewed comments and requests from the last program review cycle in order to assess current and projected needs for the next 4-year cycle? 20 ☐ Have I addressed and resolved any doubts or questions I have about the data (either by contacting the Instruction Office or by making a comment in the appropriate box)? ☐ Have I provided commentary and analysis of data in Sections A-C that follows logically from the data itself and respond thoughtfully to it, in consideration of the college’s strategic directive, values and goals? ☐ Have I provided commentary and analysis of data in Section D that addresses the impact of resources allocated in previous cycles in terms of the strategic plan directive, values, and goals? ☐ If my IU includes both CTE and GE programming, have I provided explanation and commentary? ☐ Have I avoided bundling “unlike” items? ☐ For example: First priority: 1 set of microscopes Second Priority: 1 projector $ 60,000.00 () $ 500.00 () NOT: First priority: 32 microscopes, 1 projector $60,500.00 () Second priority: new van, 60 football helmets $100,000.00 () Do I know how to find the price or estimated price of an item requested? Reviewing and Finishing Up ☐ Have I taken into account that program review is now on a 4-year cycle and have I addressed the needs of my program accordingly, including short-term and long-term goals? ☐ Have I left any blank spaces? If I have no comment have I said so, so that the validation team know that I have addressed the section? For example “No response at this time.” ☐ Do I have all the required signatures? If not, do I have a plan for how I will get them all in time to turn in my completed program review? ☐ Do I know where to turn in my completed program review? Additional items to remember? ☐ ☐ ☐ 21 Checklist for Validating the Program Review Getting Started ☐ Do I have Firefox or Chrome installed on my computer? ☐ Do I know how to access the U-drive (on-campus and off) to find important information, documents and the PDF’s? Do I know how to check saved material on the PDF’s on the Udrive? ☐ Do I know how to access my Program Review on the DVC website from campus and from home? ☐ Do I have access to log onto WEPR as a validator? ☐ Have I familiarized myself with the PRC Ranking Rubric for Program Review to describe and justify my requests? For example, do I know the difference between Technology, Operating Budget/Supply and Equipment requests? ☐ Do I know when “Validation Day” is? ☐ Do I know when my completed Validation is due? Section I: PLAN ☐ Do the strategies identified in the program plan align with the directive, core values, and goals of the strategic plan? Do they align with areas of focus identified in section II? Are the projected outcomes clearly defined, and will the evaluation method effectively measure the outcomes? Is the timeline reasonable? ☐ Do the impact statements in section I.B.2 and B.3 adequately connect the strategies/activities to student learning outcomes and achievement? ☐ plan? Are the resources requested aligned with specific activities/strategies identified in the unit ☐ Does the ranking in critical needs section of Section I align with the most urgent needs of the program, based on the Program Plan? Section II: OVERVIEW 22 ☐ Does the overview tell someone unfamiliar with the program what the area does? Did they leave anything out that you can think of? If they make statements about the program, are they specific and clear? ☐ Does the unit self-reflection identify strengths and areas for improvement with respect to its role in achieving the goals of the strategic plan that are substantiated by data from Section III, or other data included as an addendum to the program review? ☐ Does the unit self-reflection include a description of strategies/activities to improve student equity? Section III: DATA ANALYSIS ☐ Does the commentary and analysis of data in Sections A-C follow logically from the data itself and respond thoughtfully to the data, in consideration of the college’s strategic directive, values and goals? ☐ Does the commentary and analysis of data in Section D address impact of resources allocated in previous cycles in terms of the strategic plan directive, values, and goals? Finishing up ☐ Has the unit left any blank spaces or pink areas? Are all dollar amounts for requests detailed, itemized, and not bundled together? If there is no comment have they said so? For example “No response at this time.” For example: First priority: 1 set of microscopes Second Priority: 1 projector $ 60,000.00 () $ 500.00 () NOT: First priority: 32 microscopes, 1 projector $60,500.00 () Second priority: new van, 60 football helmets $100,000.00 () ☐ Has the Validation Team agreed upon a rating for the program review and entered it in Part A of the validation form? ☐ Has the Validation Team agreed upon a Validation Team Recommendation and entered it in Part D of the validation form? ☐ Does the validation form have all of the required signatures? If not, do I have a plan for how I will get them all in time to turn in the completed validation form? ☐ Do I know where to turn in my completed validation form? 23 Program Review Definitions and Clarifications Fall 2016 HUMAN RESOURCES (Section 1, D.1 and D.2) Benefits rates for 16-17: Part-time/adjunct employees – 15% Full-time employees – 25% EQUIPMENT (Section I, E.1) Business Procedure 11.03 Equipment items are those with an individual value of $1,000 or greater. Tax, shipping and handling is included in the cost of the item. Equipment is defined as tangible property which can be used for a year or more without material change in form or appreciable deterioration of physical condition. Many programs at DVC use equipment that is specific to academic or CTE courses such as photovoltaic systems, electronic music keyboards, microscopes, and spectrometers, etc. For the purposes of Program Review, enter any non-instruction or noninformational technology with a value of over $1,000 in this category. The cost of disposal for a piece of equipment should be indicated at 10% of the purchase price. Equipment quotes All requests for equipment should be based on research and legitimate quotes. This information does not have to be submitted with the Program Review, but will be useful if the request is approved and a purchase requisition developed. Quotes should include tax, shipping and any other costs. If equipment requires installation by a specialist, a quote for that work should also be included. In the program review, indicate the lowest price obtained. 1. Orders (including tax and shipping) valued $1,000-$4,999 (total purchase) only require one quote. This may be from a vendor, print outs from a website, or cut sheets from a business. 2. Orders (including tax and shipping) over $5,000 require three comparable quotes. These may be from vendors, print outs from websites or cut sheets from a business. INFORMATION TECHNOLOGY (Section I, E.2 and E.3) Note: only include expansion (“new-new”) of current assets in your program review. The following current assets: personal work computers, computer labs and projectors have been placed on a “refreshment schedule” and will be replaced in order of priority as established by age/usage, etc., overseen by the Technology Committee and reviewed by the PRC. The refreshment cycle list is on the U:drive (L:\ProgramReview\2016-17\Resources) From the Technology Plan: Technology is a broad subject that applies to many aspects of teaching, learning, research, communication, and operations at DVC. Such technologies are typically categorized as instructional technology or information technology. Instructional technology is associated with resources for teaching and learning (academic) and information technology is associated with resources for communication and operations (administrative). Both instructional and information 24 technologies typically include computers, servers, software, databases, printers, networks, network applications, storage devices, video projectors, video conferencing, and the like. Many such technologies are used for both academic and administrative purposes (e.g., computers, networks, email, etc.). For the purposes of Program Review, requested items under the category of TECHNOLOGY should fall within the description above (instructional and information technologies). For the standard technology items listed below, it is not necessary to obtain a quote. The cost of disposal for a piece of technology should be indicated at 10% of the purchase price. STANDARD PRICES FOR TECHNOLOGY ITEMS PC Desktop SSF 3020 - $650 w/ 5-year warranty Laptop Latitude 15 - $1300 MAC/APPLE Desktop w/ 4yr warranty iMac 21 - $1450 / iMac 27 - $2525 Laptop MacBook Pro 13-inch - $1500 Printers $475 - $1800+ (based on model; toner and 3 year warranty) Scanners $250+ (based on model and requirement) LCD Projectors $2500 - $3200 (does not included installation) Document Camera $600 Software Pricing based on requirement and quantity ALL software orders are to be process through the Information Technology and Services Department SUPPLIES (Section I, E.8 and E.9) Business Procedure 11.03 Supply items are those with a value less than $1,000 inclusive of tax, shipping and handling. Supply items, small equipment, services for repair and/or maintenance are the most common type of purchases the District makes. Such purchases range from individualized items purchased on an asneeded basis to large consolidated one-time purchases. These items should be indicated in the Operating Budget section of the program review, with the note that the current Operating Budget is insufficient to support the purchase. One-time vs. Ongoing expenses (Section I, E.8 and E.9) The Resource Allocation Process has thus far been used for the disbursement of one-time funds. Requests for supplies, software licenses, etc. that are on-going should be included in a request for augmentation to the Operating Budget, not as stand-alone, one-time items under equipment or technology. 25 2016-2017 Definitions for “ONLINE” in IPR A.1 Total # of unit courses offered online: The number of courses approved for online delivery that were offered 100% online (no face-to-face) in the academic year. A.1 Total # of unit sections offered online: The total number of sections offered 100% online (no face-to-face) in the academic year. A.3 Total unit FTEF Online: Sum of FTEF from sections defined as distance ed. Per Chancellor's Office distance education is defined as sections with at least 51% online instruction. B.1 Total unit /Discipline – Online: The percentage of students in unit 100% online (no face-to-face) courses that receive A, B, C, CR or P grade. B.6 Total unit /Discipline – Online The percentage of students in unit 100% online (no face-to-face) that receive A, B, C, D, F, CR, NC, I, P, or NP grade. C.4 Number of courses approved for online All unit courses approved by the Curriculum Committee for online delivery listed in the annual catalog and addendum. Resources - L:\ProgramReview\2016-17\Resources Institutional Standards Refreshment cycles Technology: Faculty/staff computers Computer labs Projectors Software “Smart Classrooms” Equipment Scheduled Maintenance List DVC Strategic Plan Program Review Committee Ranking Rubric Facilities Review List B&G Ticket List SysAid Ticket List Professional Development Expenditures by program Equipment Expenditures by program 26
© Copyright 2026 Paperzz