Case Studies – Australia
Ross Attrill – International IDEA
Voter Education Evaluation
 The electoral educators all seemed very passionate
about the importance of what they were delivering.
However, they were less passionate about the
evaluation aspect of their role.
 There did not appear to be consistent support
for evaluation amongst all electoral educators
and there did not appear to be any
consistently applied approach to evaluation
The Case Studies
 Evaluation Methodology for Electoral
Education Programs - 2008
 Youth Election Survey
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 Electoral Education Context - Three Main Streams
 Electoral Education Centres (EECs)
 School and Community Visits Program(SCVP)
 Teacher Training - “Your Vote Counts” (YVC)
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 Choose Clear Objectives for the Program
 Participants Should:
 Understand the role of the AEC;
 Understand the concept of representation in a democracy;
 Be aware of Compulsory enrolment;
 Be aware of Compulsory voting;
 Understand Preferential voting (alternative vote); and
 Understand the concept of Formality (Validity)
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 How the Results Will be Used:
 Review and update the content of the education sessions.
 Measure the degree of participant/customer satisfaction with
the AEC program.
 Assess the appropriateness of the delivery and content of the
AEC education sessions for all audiences.
 Provide data and information for inclusion in various executive
reports and the AEC’s Annual report.
 Inform the development of business plans.
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 Performance Indicators
1. Participant feedback that indicates improved knowledge and
increased understanding of electoral matters. Target 95% for
SCVP and YVC sessions, maintaining or exceeding previous
years' results for EEC sessions.
2. Audience satisfaction with the education program. Target 95%
for SCVP and YVC, high level of audience satisfaction for EEC
sessions.
3. Percentage of 17 and 18 year old participants in EEC sessions
who are more likely to vote at the next election. Target 75%.
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 Pre - session Evaluations
 Baseline Data
 The ideal time to measure pre program knowledge
against the key program objectives is immediately
prior to participation in the program.
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 Post-Session Evaluation - Timing
 What is the best time to conduct the evaluation?
 immediate,
 post session follow up
 review questionnaire at a much later date - Teachers
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 How much is enough?
 Number of evaluation responses should ensure the results
obtained are robust.
 Suggestion that a minimum of 400 evaluations per year in each
EEC and in the SCVP
Case Study 1 - Evaluation Methodology for
Electoral Education Programs - 2008
 Questionnaire Design
 short and ideally completed in 5 minutes or less.
 record essential demographic information
 measure attendee knowledge against the key program objectives.
 test attendee knowledge against the key program objectives
rather than ask them to self-assess.
 tailored for each target audience
Case Study 2 - Youth Electoral Study (YES)
2004
 Rationale
 To investigate reasons for youth disengagement with
political process and institutions
 To provide data on which to base a revised Youth Voter
Education program
Case Study 2 - Youth Electoral Study (YES)
2004
 Areas Investigated
 The influence of family on Engagement
 The influence of school on Engagement
 The influence of Political Parties on Engagement
 The influence of Political Knowledge on Engagement
Case Study 2 - Youth Electoral Study (YES)
2004
 Methodologies
 Review of existing literature
 Case Studies - based on in depth group interviews
 National School Survey - 154 schools, 4600 students
Case Study 2 - Youth Electoral Study (YES)
2004
 Focus Questions
 What sorts of political actions do you take part in?
 Rank voting against other events in terms of
excitement
 Rank the effect of your family on your political
participation?
 Do you feel like you have enough knowledge to
participate in political processes
Case Study 2 - Youth Electoral Study (YES)
2004
Outcome
Australian Electoral Commission
Youth Communication Strategy
2007 -10
Conclusions
 Each evaluation methodology must be appropriate to what is
being evaluated
 Each will use different approaches in order to capture the data
needed
 In general, there are some rules that should be followed:
 Choose clear program objectives
 Decide how the results will be used
 Choose challenging but achievable performance indicators
 Get the timing right
 Collect baseline data
 Design your survey tools carefully
 Ensure that the process of data collection is as painless as possible
for everyone
Thank you
and
good luck!