Performance assessment for school leaders: comparing field trial and implementation results
Journal of Educational Administration
ISSN: 0957-8234
Article publication date: 30 August 2019
Issue publication date: 16 January 2020
Abstract
Purpose
The purpose of this paper is to compare two years of results for one state’s performance-based assessments for principal licensure Performance Assessment for Leaders (PAL). This includes the field trial (2014–2015) and first year of statewide implementation (2015–2016) when passing score requirements and fees were added. Survey results on candidates’ career aspirations provide concurrent validation.
Design/methodology/approach
Two years of PAL submissions (n=569 candidates) were scored by trained, certified scorers. Task and total score results were compared by year, preparation pathway and gender. Online feedback survey results on career aspirations for (n=146 candidates) were compared by year.
Findings
The results show that PAL assessments measure independent dimensions of leadership, differentiate candidates on leadership knowledge and skills, and confirm PAL’s internal validity. Implementation year scores were higher than field trial scores, and preparation program candidates scored better than non-program candidates did. Candidate career aspirations were stronger in the implementation year than during the field trial.
Research limitations/implications
The study is limited to one state’s candidates, but findings are generalizable based on the wide range among candidates’ districts (demographically and economically).
Practical implications
The results are promising for the leadership preparation and assessment field, demonstrating the effectiveness of performance assessment for authentic evaluation of leadership candidates’ knowledge and skill and overall readiness for initial leadership work.
Originality/value
This is the first large scale performance assessment for aspiring leaders designed for state licensure decisions. It is being replicated in another state and shown promise for both formative and summative leadership assessment.
Keywords
Acknowledgements
This research was made possible by contract support from the Massachusetts Department of Elementary and Secondary Education. Copies of the PAL technical report, Massachusetts Performance Assessment for Leaders (PAL) Technical Report Summary of Validity and Reliability Studies for 2014–2015 Field Trial of PAL, are available from the department or from the authors. Correspondence concerning this research should be addressed to Margaret Terry Orr (morr4@fordham.edu)
Citation
Orr, M.T., Hollingworth, L. and Beaudin, B. (2020), "Performance assessment for school leaders: comparing field trial and implementation results", Journal of Educational Administration, Vol. 58 No. 1, pp. 38-59. https://doi.org/10.1108/JEA-05-2018-0087
Publisher
:Emerald Publishing Limited
Copyright © 2019, Emerald Publishing Limited