Preliminary Evaluation of Structured Professional Judgment to Assess Removal in Child Protection Practice

Article Sidebar

PDF
Published: Jan 4, 2016
DOI: https://doi.org/10.1080/1936928X.2015.1093572

Main Article Content

Lillian de Bortoli
James Ogloff
Jan Coles
Mariead Dolan

Abstract

This study is a pilot validation of a newly devised evidence-based clinical instrument that assists professional judgment for decisions relating to child removal. The Child Protection Removal Assessment (ChiPRA) instrument adopts a structured professional judgement (SPJ) approach to decision-making and was developed from a literature review of studies identifying factors associated with severe child abuse. A study comparing the predictive validity of ChiPRA and an actuarial instrument was conducted using court file data from 298 child protection cases. A logistic function from all ChiPRA items, χ² (11) = 147.546, p < 0.000, correctly classified 86.3% of cases (Area Under the Curve [AUC] = 0.799, p < 0.000, 95% confidence interval: 0.738–0.859). The abuse subscale of the actuarial instrument yielded a modest but significant AUC (0.595, 95% CI: 0.530–0.660). Results indicate an increased reliance upon dynamic factors by magistrates when determining child removal. SPJ instruments warrant further research including prospective studies measuring reliability and validity studies.

Article Details

How to Cite
de Bortoli, L., James Ogloff, Jan Coles, & Mariead Dolan. (2016). Preliminary Evaluation of Structured Professional Judgment to Assess Removal in Child Protection Practice. Journal of Forensic Social Work, 5(1-3), 29–48. https://doi.org/10.1080/1936928X.2015.1093572
Issue
Vol. 5 No. 1-3 (2015)
Section
Articles
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

  • No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

References

Australian Bureau of Statistics. (2008). 4102.0: Australian Social Trends, 2008. Retrieved from http://www.abs.gov.au/ausstats/abs@.nsf/mf/3101.0

Australian Bureau of Statistics. (2013). 3101.0: Australian Demographic Statistics, September 2012. Retrieved from http://www.abs.gov.au/ausstats/abs@.nsf/mf/3101.0

Australian Institute of Health and Welfare. (2013). Child protection Australia 2011-12 (Child Welfare series). Canberra, Australia: Author.

Baird, C., & Wagner, D. (2000). The relative validity of actuarial- and consensus-based risk assessment systems. Children and Youth Services Review, 22, 839-871. DOI: https://doi.org/10.1016/S0190-7409(00)00122-5

Baird, C., Wagner, D., Healy, T., & Johnson, K. (1999). Risk assessment in child protective services: consensus and actuarial model reliability. Child Welfare, 78, 723-748.

Barber, J., Trocme, N., Goodman, D., Shlonsky, A., Black, T., & Leslie, B. (2007). The reliability and predictive validity of consensus-based risk assessment. Montreal, Quebec, Canada: Centres of Excellence for Children's Well-Being.

Bath, H. (2007). Northern Territory Community Services High Risk Audit. Darwin, Australia: The Thomas Wright Institute.

Beech, A., Friendship, C., Erikson, M., & Hanson, R. (2002). The relationship between static and dynamic risk factors and conviction in a sample of UK child abusers. Sexual abuse: A Journal of Research and Treatment, 14, 155-167. DOI: https://doi.org/10.1177/107906320201400206

Bhatti-Sinclair, K., & Sutcliffe, C. (2012). What determines the out-of-home placement of children in the USA? Children and Youth Services Review, 34, 1749-1755. DOI: https://doi.org/10.1016/j.childyouth.2012.05.004

Borum, R., Lodewijks, H., Bartel, P., & Forth, A. (2010). Structured Assessment of Violence Risk In Youth (SAVRY). In R. Otto, & K. S. Douglas (Eds.), Handbook of violence risk assesment (pp. 63-79). New York, NY: Routledge.

Brandon, M., Belderson, P., Warren, C., Howe, D., Gardner, R., Dodsworth, J., & Black, J. (2008). Analysing child deaths and serious injury through abuse and neglect: what can we learn? A bienniel analysis of serious case reviews 2003-2005. Nottingham, UK: Department for Children, Schools and Families.

Brandon, M., Sidebotham, P., Ellis, C., Baily, S., & Belderson, P. (2011). Child and family practitioners' understanding of child development: lessons learnt from a small sample of serious care reviews. London, UK: University of East Anglia. DOI: https://doi.org/10.1037/e604072011-001

Children's Court of Victoria. (2011). Annual report 2010-2011. Melbourne, Australia: Children's Court of Victoria.

Children's Court of Victoria. (2012). Family division-child protection. In P. Power (Ed.), Research materials. Retrieved from http://www.childrenscourt.vic.gov.au/sites/default/files/Research_Materials_5_FD_Child_Protection_0.pdf

Cleaver, H., Unell, I., & Aldgate, J. (2011). Children's needs-parenting capacity. Child abuse: Parental mental illness, learning disability, substance misuse, and domestic violence. London, UK: The Stationery Office.

Coid, J. W., Yang, M., Ulrich, S., Zhang, T., Sizmur, S., Farrington, D., & Rogers, R. (2011). Most items in structured risk assessment instruments do not predict violence. The Journal of Forensic Psychiatry and Psychology, 22, 3-21. DOI: https://doi.org/10.1080/14789949.2010.495990

Cummins, P., Scott, D., & Scales, B. (2012). Protecting Victoria's vulnerable children inquiry. Victoria, Australia: Department of Premier and Cabinet.

Davidson-Arad, B. (2001). Predicted changes in children's quality of life in decisions regarding the removal of children at risk from their homes. Children and Youth Services Review, 23, 127-143. DOI: https://doi.org/10.1016/S0190-7409(01)00130-X

De Bortoli, L. (2014). Child removal in child protection practice: comparing structured professional judgement and actuarial risk assessment instruments (PhD thesis, Monash University, Melbourne, Australia) Retrieved from DOI: http://arrow.monash.edu.au/vital/access/manager/Repository/monash:128561.

De Bortoli, L., & Dolan, M. (2015). Decision making in social work with families and children: developing decision-aids compatible with cognition. British Journal of Social Work, 45, 2142-2160. DOI: https://doi.org/10.1093/bjsw/bcu087

Delfabbro, P., Fernandez, E., McCormick, J., & Kettler, L. (2013). Reunification in a complete entry cohort: A longitudinal study of children entering out-of-home care in Tasmania, Australia. Children and Youth Services Review, 35, 1592-1600. DOI: https://doi.org/10.1016/j.childyouth.2013.06.012

Department of Human Services. (2011a). Protecting children, changing lives. Supporting the child protection workforce. Melbourne, Australia: Victorian Government Department of Human Services.

Department of Human Services. (2011b). Child protection workforce. The case for change. Melbourne, Australia: State of Victoria.

Department of Human Services. (2012). Best interests case practice model: Summary Guide. Melbourne, Australia: State Government of Victoria.

DeRoma, V. M., Kessler, M. L., McDaniel, R., & Soto, C. M. (2006). Important risk factors in home-removal decisions: Social caseworker perceptions. Child and Adolescent Social Work Journal, 23, 263-277. DOI: https://doi.org/10.1007/s10560-006-0047-8

Dietrich, D., Berkowitz, L., Kadushin, A., & McGlogin, J. (1990). Some factors influencing abusers' justification of their child abuse. Child Abuse and Neglect, 14, 337-345. DOI: https://doi.org/10.1016/0145-2134(90)90005-E

Dolan, M., & Doyle, M. (2000). Violence risk prediction: Clinical and actuarial measures and the role of the Psychopathy Checklist. The British Journal of Psychiatry, 177, 303-311. DOI: https://doi.org/10.1192/bjp.177.4.303

Donald, T., & Jureidini, J. (2004). Parenting capacity. Child Abuse Review, 13, 5-17. DOI: https://doi.org/10.1002/car.827

Douglas, K. S., Ogloff, J. R. P., & Hart, S. D. (2003). Evaluation of a model of violence risk assessment among forensic psychiatric patients. Psychiatric Services, 54, 1372-1379. DOI: https://doi.org/10.1176/appi.ps.54.10.1372

Douglas, K., & Reeves, K. (2010). Historical-Clinical-Risk-Management-20 (HCR-20) violence risk assessment scheme. Rational, application and empirical overview.

In R. Otto, & K. Douglas (Eds.), Handbook of violence risk assessment (pp. 147-185). New York, NY: Routledge.

Douglas, K., & Skeem, J. (2005). Violence risk assessment: Getting specific about being dynamic. Psychology, Public Policy, & Law, 11, 347-383. DOI: https://doi.org/10.1037/1076-8971.11.3.347

Forrester, D., & Harwin, J. (2006). Parental substance misuse and child care social work: findings from the first stage of a study of 100 families. Child & Family Social Work, 11, 325-335. DOI: https://doi.org/10.1111/j.1365-2206.2006.00415.x

Gambrill, E. (2005). Critical thinking in clinical practice: improving the quality of judgments and decisions. Hoboken, NJ: John Wiley & Sons.

Gillingham, P. (2009). Practitioner perspectives on the Family Risk Evaluation Tool: An aide to decision making or ''just another form to fill in''? Developing Practice, 23, 47-54.

Gillingham, P. (2011). Decision-making tools and the development of expertise in child protection practitioners: are we 'just breeding workers who are good at ticking boxes'? Child & Family Social Work, 16, 412-421. DOI: https://doi.org/10.1111/j.1365-2206.2011.00756.x

Gillingham, P., & Humphreys, C. (2010). Child protection practitioners and decision-making tools: Observations and reflections from the front line. British Journal of Social Work, 40, 2598-2616. DOI: https://doi.org/10.1093/bjsw/bcp155

Grove, W., & Meehl, P. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy and Law, 2, 292-323. DOI: https://doi.org/10.1037/1076-8971.2.2.293

Hart, S., & Boer, D. (2010). Structured professional judgement guidelines for sexual violence risk assessment: The Sexual Violence Risk-20 (SVR-20) and Risk for Sexual Violence Protocol (RSVP). In R. Otto, & K. Douglas (Eds.), Handbook of violence risk assessment (pp. 269-294). New York, NY: Routledge.

Heilbrun, K., Yasuhara, K., & Shah, S. (2010). Violence risk assessment tools: Overview and critical analysis. In R. Otto, & K. Douglas (Eds.), Handbook of violence risk assessment (pp. 1-18). New York, NY: Routledge.

Hetherington, T. (1999). Child protection: A new approach in South Australia. Child Abuse Review, 8, 120-132. DOI: https://doi.org/10.1002/(SICI)1099-0852(199903/04)8:2<120::AID-CAR524>3.0.CO;2-F

Johnson, K., & Scharenbroch, C. (2012). Family risk evaluation validation: A prospective study. Prepared for Queensland Department of Communities, Child Safety Services. Madison, WI: Children's Research Centre.

Johnson, K., Wagner, D., & Wiebush, R. (2000). South Australia Department of Family and Community Services: Risk assessment revalidation Study. Madison, WI: Children's Research Center.

Monahan, J. (1995). The clinical prediction of violent behavior. Northvale, NJ: John Aronsin Inc.

Mossman, D. (1994). Assessing predictions of violence: being accurate about accuracy. Journal of Consulting and Clinical Psychology, 62, 783. DOI: https://doi.org/10.1037/0022-006X.62.4.783

Munro, E. (2008). Effective child protection. (2nd ed.): London, UK.

Munro, E., & Manful, E. (2010). Safeguarding children: a comparison of England's data with that of Australia, Norway and the United States. Childhood Wellbeing Research Centre. London, UK: Department of Education.

NSPCC. (2012). NSPCC policy on child neglect. Retrieved from https://www.nspcc.org.uk/Inform/resourcesforprofessionals/neglect/policy_wda92078.html

Random.Org. (1998-2012). Random.Org. Retrieved from http://www.random.org/

Rice, M., & Harris, G. (2005). Comparing effect sizes in follow-up studies: ROC area, Cohen's d, and r. Law and Human Behavior, 29, 615-619. DOI: https://doi.org/10.1007/s10979-005-6832-7

Scannapieco, M., & Connell-Carrick, K. (2005). Understanding child maltreatment. An ecological and developmental perspective. New York, NY: Oxford University Press. DOI: https://doi.org/10.1093/acprof:oso/9780195156782.001.0001

Sheehan, R. (2001). Magistrates' decision-making in child protection cases. Aldershot, UK: Ashgate Publishing Company.

Sidebotham, P. (2001). An ecological approach to child abuse: a creative use of scientific models in research and practice. Child Abuse Review, 10, 97-112. DOI: https://doi.org/10.1002/car.643

Victorian Child Death Review Committee. (2011). Annual report of inquiries into the deaths of children known to Child Protection 2011. Melbourne, Australia: Author.

Wagner, D. (1997). South Australia Department of Family and Community Services: Risk Assessment Validation Study. Madison, WI: Children's Research Center.

Wong, S., Olver, M., & Stockdale, K. (2009). The utility of dynamic and static factors in risk assessment, prediction, and treatment. In J. Andrade (Ed.), Handbook of violence risk assessment and treatment: New approaches for mental health professionals (pp. 83-120). New York, NY: Springer Publishing Company.

Wood, J. (2008). Report of the Special Commission of Inquiry Into Child Protection Services in New South Wales. Sydney, Australia: State of NSW through the Special Commission of Inquiry Into Child Protection Services in NSW.