Simulating self-selection in public management research: implications from caseworker discretion in the child welfare system
International Journal of Public Sector Management
ISSN: 0951-3558
Article publication date: 16 August 2021
Issue publication date: 26 October 2021
Abstract
Purpose
The purpose of this study was to measure the bias on a binary option's effect estimate that appeared in the types of questions asked and in the placement changes of public service users.
Design/methodology/approach
The author designed Monte Carlo simulations with the analytical strategy of latent trait theory leveraging a probability of care-placement change. The author used difference-in-difference (DID) method to estimate the effects of care settings.
Findings
The author explained the extent of discrepancy between the estimates and the true values of care service effects in changes across time. The time trend of in-home care for the combined effect of in-home care, general maturity, and other environmental factors was estimated in a biased manner, while the bias for the estimate of the incremental effect for foster care could be negligible.
Research limitations/implications
This study was designed based on individual child-unit only. Therefore, higher-level units, such as care setting or cluster, county, and state, should be considered for the simulation model.
Social implications
This study contributed to illuminating an overlooked facet in causal inferences that embrace disproportionate selection biases that appear in categorical data scales in public management research.
Originality/value
To model the nuance of a disproportionate self-selection problem, the author constructed a scenario surrounding a caseworker's judgment of care placement in the child welfare system and investigated potential bias of the caseworker's discretion. The unfolding model has not been widely used in public management research, but it can be usefully leveraged for the estimation of a decision probability.
Keywords
Acknowledgements
The author thanks Dr Russell Almond for laying the groundwork for this research and is grateful to Dr Insu Paek, Dr Hongwook Suh and dear friends, Christine Ouma and Hulya Yurekli, for critically reading the manuscript. The author also thanks Dr Deanna Malatesta, Dr Craig Smith and anonymous reviewers who provided comments that improved the manuscript. The author is grateful to Dr Sascha Sheehan who hosted a brown bag meeting at the College of Public Affairs (CPA), University of Baltimore for the research presentation. Additionally, the author is grateful to Dr Alan Lyles, Dr George Julnes and Dr Tom Darling for stimulating discussions during the preparation of this manuscript.The author would like to specifically highlight the ongoing and unwavering support of darlings, George Speers and Aliyah Speers. The author asks them, “Shall we go on a trip to Korea once the pandemic is over? I want to see my mom.”
Citation
Nam-Speers, J. (2021), "Simulating self-selection in public management research: implications from caseworker discretion in the child welfare system", International Journal of Public Sector Management, Vol. 34 No. 6, pp. 673-687. https://doi.org/10.1108/IJPSM-10-2020-0292
Publisher
:Emerald Publishing Limited
Copyright © 2021, Emerald Publishing Limited