Minnesota Department of Health
2nd Annual Program
Evaluation Workshop
June 8, 2010
Housekeeping and Welcome
• Welcome
• The Evaluation Workgroup designed the
new process around continuous
improvement.
• This is not training, rather an update on
lessons learned, improvements made,
and trends observed.
• Before next year’s workshop, we will
revisit the need for a thorough evaluation
training.
New Staff - Evaluators
Angie Wheeler
Michelle Messer
Evaluation Schedule
Evaluation Process
•
•
•
•
•
•
•
•
Notification and Request for Materials.
Administrative Review (not on-site).
Field Review.
Administrative Review (on-site).
Draft Report.
Comments.
Final Report.
Appeals.
5 Trends Observed
• Employee Illness.
– V and D, Big 4, Training.
• Handwashing and Glove Use.
• Proper Cooling.
• Roasts – Prime Rib.
– According to the code 4626.0340 (2).
• Menu Review.
– Ask about mushrooms, shellfish, etc.
Changes to Frequency Matrix
Old
New
Changes to Scoring
Refresher
Scoring Levels
• Program Elements:
Scoring of individual
evaluation criteria.
• Program Area: Scoring
of Food, Lodging,
Pools, MHP/RCA, and
Youth Camps
separately
• Overall Program
Status: Combined
scores for all program
areas.
Changes to Scoring
LEVEL TWO: SCORING OF INDIVIDUAL PROGRAM
AREAS (i.e., FOOD, LODGING, POOLS, etc.): Acceptable
range changed from 90 to 100 percent to 80 to 100
percent of required items
Changes to the Tools – MDH Specific
•
•
•
•
•
Additional MDH-specific criteria was added
based upon our responsibilities in the Delegation
Agreement.
Reviewed ordinances within 30 days.
Coordinated a review of the Food Code
following the release of each new FDA Model
Food Code or Supplement.
Has referred complaints that MDH receives
concerning matters under others’ jurisdiction.
Has been available to advise on issues covered
under the Delegation Agreement.
Performed program evaluations as required.
Changes to the Tools – Standard Two
Additional Training
• b. The Board has enrolled in FDA Program
Standards. – New white item
• c. Describe the percentage of staff that
have taken ICS classes (minimum of ICS
100 & 200.) – New white item
Changes to the Tools – Standard Two
Additional Training
• d. Describe other training that staff have
received such as MNTrac courses
completed. - New white item
• c. Board has notified MDH within 10
business days of staff’s departure, if
staffing is insufficient to perform the
obligations of the Delegation Agreement. –
Changed to yellow from white
Changes to the Tools – Standard Three
Written & Implemented Policies
• c. The Board’s inspection report describes
compliance activities. – Removed
• e. The Board has submitted to MDH any
copies of variances granted, within 30
days of issuance. – New yellow item
PPMRS/Evaluation Project
• Local Public Health Planning and Performance
Measurement Reporting System (LPH PPMRS)
• PPMRS aims to:
– describe key aspects of Minnesota's public
health system.
– provide consistent and accurate information
that can be used to improve delivery of public
health.
– provide accountability and meet the reporting
requirements of the Minnesota Local Public
Health Act.
PPMRS – Stage One
• Each Delegated Agency will be given an
administrator’s access name and password that can
be used to access the system via the internet.
• System will guide the administrator through a stepby-step self-assessment using the evaluation tools.
• Self-assessments may be accessed at any time.
Information is confidential until submitted.
• System allows information to be saved and updated
so subsequent self-assessments can be completed
more efficiently
PPMRS - The Future
• System tracks evaluation schedule and
automatically notifies agencies of an upcoming
evaluation.
• Tracks materials submitted for evaluation and
requests missing information.
• Scores the evaluation and runs frequency
calculations.
• Automatically updates EHS contact lists.
• Creates standard individual and aggregate
reports.
MDH Self Evaluation
• Wendy Spanier and Blake Nordin
Evaluation Feedback
• Local programs that have already been
evaluated using new materials and
protocol.
Model Documents/Policies
• Currently available
– Ordinances
– Staffing plans
– Mutual aid agreement
– Corrective action and enforcement policies
• Needed:
– Single person agency corrective action and
enforcement policy.
For more information:
• Mike Nordos,
[email protected],
651-201-4511
• Michelle Messer,
[email protected],
651-201-3657
• Angie Wheeler,
[email protected],
651-201-4843
Germ City at the State Fair
• KARE 11 this year’s sponsor
– 4 hour shift
– ticket to the Fair and a tee-shirt
– friends, family members age 12 & over
welcome
– “Today’s volunteers are from…”
• Volunteers contact
[email protected],
651-201-4509