Review and Discussion
Alternative Accountability CCSSO NCSA
June 2016
What are the opportunities?
• Better represent the valued outcomes of
alternative schools which:
– Serve diverse students
– Have varied areas of emphasis
• More appropriately differentiate performance
via thoughtful selection of:
– Measures
– Performance standards
– Design decisions
• Incentivize the actions that matter most
• Customize supports
Alternative Accountability CCSSO NCSA
June 2016
What are the threats?
• Obfuscate performance if the system is
poorly specified and standards are not
appropriate
• Finding “signal in the noise,” particularly
given mobility and n-size issues
• Lack of comparability
• Potential for corruption
Alternative Accountability CCSSO NCSA
June 2016
Similarity and Flexibility
• In thinking about design alternatives,
consider these questions:
– To what extent should elements of the
alternative school model be similar to the
general model? Do you expect any of the
outcomes to be comparable to the general
model?
– To what extent should the model be
standardized versus allowing alternative school
leaders flexibility to determine indicators
and/or evidence?
Alternative Accountability CCSSO NCSA
June 2016
Similarity and Flexibility
Some examples that illustrate the range of
approaches depending on the value of
standardization and comparability.
More
Standardized
Less
Standardized
More Similar
Less Similar
Adjust Current System. For example,
carry over elements in the current
model but with different weights
and/or performance thresholds.
Menu System. Keep current categories
but allow flexibility to select
established indicators from among a
range of options or according to defined
rules.
Modify Current System. For
example, carry over same old
elements (adjusted or not), but
add some new indicators.
Portfolio System. Provide
schools maximium flexiblity to
sumbit evidence to
demonstrate achievement and
progress.
Alternative Accountability CCSSO NCSA
June 2016
Evaluation Strategies
• Check assumptions in theory of action
• Stability of scores
• Weak relationship to variables that should NOT
be associated with performance (e.g. n-size,
demographics)
• Differentiation
• Qualitative evaluation
• Review longitudinal impact
Alternative Accountability CCSSO NCSA
June 2016
Discussion
Thank you to the presenters!
What questions or comments do you have?
Alternative Accountability CCSSO NCSA
June 2016