Performance – What is it?
(and how do I manage it)
Bec Jackson
ACE National Senior Policy Officer
Terry Thomson
Business Analyst - APM
September 17th 2010
Once upon a time….
25%
21%
18%
20%
14%
15%
10%
9%
12%
11%
6%
5%
4%
5%
0%
1.0
1.5
2.0
2.5
3.0
3.5
Star Rating
4.0
4.5
5.0
In a program far far away…
Employment assistance
(NB: weightings are separate)
KPI 1: Efficiency
Retention between DPI and 12 months
Retention between 12 and 18 months where no outcome
KPI 2: Effectiveness
13 week employment outcome
26 week employment outcome
VET 13 week outcome
Average hours per week in work (higher better)
Average weekly wage from work (higher better)
12 month employment status
(5%)
(5%)
(30%)
(40%)
(5%)
(5%)
(5%)
(5%)
Workers in Maintenance
(NB: weightings are cumulative)
KPI 1: Effectiveness/Efficiency
Remain in employment and leave maintenance
KPI 2: Effectiveness
Remain in employment – same or better earnings
Remain in employment
(10%)
(30%)
(60%)
KPI 3: Quality of Disability Open Employment services (pass/fail)
The New Framework
KPI
DMS
Weighting
ESS
Weighting
Responsive
5
5
Time taken to achieve
employment outcome
5
5
Effectiveness
2.1
Job Placements
5
5
2.2
13 week Full Outcome
25
20
2.3
13 week Pathway
Outcome
5
5
2.4
13 week Bonus
Outcome
5
5
2.5
26 week Full Outcome
35
30
2.6
26 week Pathway
Outcome
26 week Bonus
Outcome
5
5
5
5
Ongoing Support
5
15
Efficiency
1.1
1.2
2.7
2.8
Performance
Measure
The New Framework
KPI
DMS
Weighting
ESS
Weighting
Responsive
5
5
Time taken to achieve
employment outcome
5
5
Effectiveness
2.1
Job Placements
5
5
2.2
13 week Full Outcome
25
20
2.3
13 week Pathway
Outcome
5
5
2.4
13 week Bonus
Outcome
5
5
2.5
26 week Full Outcome
35
30
2.6
26 week Pathway
Outcome
26 week Bonus
Outcome
5
5
5
5
Ongoing Support
5
15
Efficiency
1.1
1.2
2.7
2.8
Performance
Measure
So how do we turn that into a star
rating…..
Simple!!!!
Just like this…..
INTERIM = C(1) + C(2)*PREV + C(3)*INDIG + C(4)*MALE +
C(5)*AGE + C(6)*AGE*AGE + C(7)*ALST1 + C(8)*ALST2 +
C(9)*ALST3 + C(10)*ALST4 + C(11)*ALST5 + C(12)*ALST6 +
C(13)*DIS + C(14)*EDU1 + C(15)*EDU2 + C(16)*EDU4 +
C(17)*EDU5 + C(18)*NESB1 + C(19)*NESB2 + C(20)*NESB3
+ C(21)*METRO + C(22)*BIGSLA +
C(23)*DAYAVIS1*DAYAVIS1 + C(24)*DAYAVIS1 +
C(25)*UEDUR1 + C(26)*UEDUR1*UEDUR1 +
C(27)*EMGROW + C(28)*I1 + C(29)*I2 + C(30)*I3 + C(31)*I4
+ C(32)*I5 + C(33)*I6 + C(34)*I7 + C(35)*I8 + C(36)*I9 +
C(37)*I10 + C(38)*I11 + C(39)*I12 + C(40)*I13 + C(41)*I14 +
C(42)*I15 + C(43)*I16 + C(44)*UERATE + C(45)*METROIND
The Formula
• Outcomes are the most crucial component of performance
• Focus on Job Placement and Outcome
• Playing around the edges isn’t the key – address that last,
never first
Understanding KPI’s
Numerator
Denominator
*important to note that you must have minimum numbers of
20 in the denominator for rating
Understanding KPI’s
1.1 Responsiveness
A count of participants in the denominator who have a valid
commencement date
A count of participants who were referred between 1 March
2010 and last day of the month preceding the end of the
performance period (excluding referrals that were exited for
the reasons detailed in Attachment D of the Star Rating
Guidelines)
Understanding KPI’s
1.2 Time taken to achieve employment outcome
The sum of total days between commencement date and the
employment anchor date for an approved 13 week full
employment outcome (excluding time spent on suspensions,
in qualifying training and whilst in the Productivity Places
Program (or equivalent in VIC).
Count of participants who have an approved claim for a 13 wk
full employment outcome
Understanding KPI’s
2.1 Job Placements
Count of participants in the denominator who have an
approved claim for a job placement
Count of participants who have commenced in DES from 1
March 2010 to the last day of the performance period
Understanding KPI’s
2.2 13 Week Full Outcome
Count of participants in the denominator who have an
approved claim for a 13 week full outcome
Count of participants who have commenced in DES and
duration in assistance is at least 13 weeks (excluding all
periods of suspension)
Understanding KPI’s
2.6 26 Week Full Outcome
Count of participants in the denominator with an approved
claim for a 26 week full outcome
Count of participants who have commenced in DES and
duration in assistance is at least 26 weeks (excluding all
periods of suspension)
Understanding KPI’s
2.8 Ongoing Support
Flexible Ongoing Support
Count of participants included in the denominator who are
still current in ongoing support phase + those who have
exited ongoing support as independent worker
Count of participants with an approved claim for at least one
instance of flexible ongoing support
Understanding KPI’s
2.8 Ongoing Support
Moderate or High Ongoing Support
Count of participants included in the denominator who are
still current in ongoing support phase + those who have
exited ongoing support as independent worker
Count of participants who have a valid commencement date
in the ongoing support phase of assistance
Understanding KPI’s
2.8 Bonuses
Count of participants included in the denominator who are
still Count of participants in the denominator for which there
is an approved claim for a bonus 13 week full or pathway
outcome plus a count of Indigenous participants who achieve
an approved claim for a 13/26 week full or pathway outcome
Count of participants for which there is an approved claim for
a 13 week full or pathway outcome
The Bands
Toto – I don’t think we’re in Kansas anymore
-50%
- 20%
+20%
+40%
Timelines
First performance feedback (informal)
• Six monthly follow stars release
Nov/Dec 2010
First star ratings to 31 December 2010
• To providers for internal use
Feb 2011
Interim stars to 31 March 2011
• End March , end September
May 2011
First Published Stars to 30th June
Aug 2011
So how do we track it?
Tools at your disposal:
DES Reports – EA Reporting
• DES Caseload
• DES Jobseeker
• DES Appointment & Session Availability
• DES Claims
• DES Market Share
So how do we track it?
Tools at your disposal:
DES Reports – Health Checks
Provider administrative and performance data
• Modeled on star rating performance measures
• No regression applied
• Site level + ESA level
• Comparative data to National & ESA
Reports
Caseload
DES Caseload
DES Job Seeker
Diary
DES Appointment
DES Session Availability
Payments
DES Adjustment Note
DES Claims Current
DES Remittance advice
Referral
DES Provider Market Share
Vacancy
Employer BDF
Vacancy Report
Make sure this isn’t you in
June 2012!