Suzanne Kerns

Workplace-based clinical supervision as an implementation strategy to support evidence-based treatment (EBT) in public mental health has received limited research attention. A commonly provided infrastructure support, it may offer a relatively cost-neutral implementation strategy for organizations. However, research has not objectively examined workplace-based supervision of EBT and specifically how it might differ from EBT supervision provided in efficacy and effectiveness trials. Data come from a descriptive study of supervision in the context of a state-funded EBT implementation effort. Verbal interactions from audio recordings of 438 supervision sessions between 28 supervisors and 70 clinicians from 17 public mental health organizations (in 23 offices) were objectively coded for presence and intensity coverage of 29 supervision strategies (16 content and 13 technique items), duration, and temporal focus. Random effects mixed models estimated proportion of variance in content and...

Several states have made considerable investments into large-scale implementation of evidence-based treatments (EBTs), yet little is known about key success indicators for these implementation efforts such as cost and sustainability. To that end, the present study examined the economic impact of statewide implementation of multisystemic therapy (MST; Henggeler, Schoenwald, Borduin, Rowland, & Cuningham, 2009), a family- and community-based behavioral EBT for serious juvenile offenders in New Mexico. Participants were 1,869 youth who received MST across 23 teams during the study period. We conducted a cost-benefit analysis using metrics from state data sources that compared the cost of MST to its benefits (i.e., avoided expenses from pre- to posttreatment) in two domains: (a) behavioral health services (i.e., Medicaid claims) and (b) juvenile crime (i.e., taxpayer expenses, tangible and intangible expenses to crime victims). MST costs were based on Medicaid claims, which were reimbur...

Despite increasing interest in supervision as a leverage point for bolstering public mental health services, the potential influence of supervisory alliance on organizations and direct service providers remains understudied, particularly in the context of supporting evidence-based treatment (EBT) use. This study examined agreement and discrepancy between supervisor and clinician ratings of alliance associated with clinicians' perceptions of psychological climate and emotional exhaustion. Results indicated that discrepancies in alliance ratings were common and associated with clinicians' perceptions of psychological climate. These findings have important implications for collaboration among supervisors and clinicians within a community mental health organizational context and the provision of EBTs.

Supervisors are an underutilized resource for supporting evidence-based treatments (EBTs) in community mental health. Little is known about how EBT-trained supervisors use supervision time. Primary aims were to describe supervision (e.g., modality, frequency), examine functions of individual supervision, and examine factors associated with time allocation to supervision functions. Results from 56 supervisors and 207 clinicians from 25 organizations indicate high prevalence of individual supervision, often alongside group and informal supervision. Individual supervision serves a wide range of functions, with substantial variation at the supervisor-level. Implementation climate was the strongest predictor of time allocation to clinical and EBT-relevant functions.

Organizations adopting an evidence-based, research-based, or promising practice must systematically support its implementation. When actively applied, three frameworks identified by the National Implementation Research Network (NIRN) support effective service delivery: intervention components, implementation drivers, and stages of implementation (Bertram, Blase, & Fixen, 2014; Fixsen, et al., 2005). In this paper, we briefly review these frameworks, and offer examples from three states that integrated and financed evidence based practices (EBPs).

Federal, state, and foundation funding sources increasingly mandate the use of evidence-based practices (EBPs). However, confusion and uncertainty limit response to these mandates in systems of care. These two papers briefly present fundamental facts on the rationale for using EBPs within behavioral health service systems. The first paper clarifies definitions while addressing notable misconceptions about EBPs. The second addresses the critical importance of implementation factors that can positively or negatively affect EBP outcomes. Together, these papers offer examples, strategies, frameworks and tools for selecting, funding, implementing, improving, and sustaining evidence-based and promising practices within systems of care.

Efforts to implement evidence based practices (EBP) are increasingly common in child-serving systems. However, public systems undertaking comprehensive improvement efforts that aim to increase availability of multiple practices at the same time may struggle to build comprehensive and user-friendly strategies to develop the workforce and encourage adoption, faithful implementation, and sustainability of selected EBPs. Given that research shows model adherence predicts positive outcomes, one critical EBP implementation support is systematic quality, fidelity, and compliance monitoring. This paper describes the development and initial implementation of a quality assurance framework for a statewide EBP initiative within child welfare. This initiative aimed to improve provider practice and monitor provider competence and compliance across four different EBPs, and to inform funding and policy decisions. The paper presents preliminary data as an illustration of lessons learned during the q...

Youth in the child welfare system (CWS) have substantially higher rates of mental health needs compared to the general population, yet they rarely receive targeted, evidence-based practices (EBPs). Caseworkers play the critically important role of "service broker" for CWS youth and families. This study examines preliminary caseworker-level outcomes of Project Focus Colorado (PF-C), a training and consultation program designed to improve access to EBPs for CWS youth. PF-C evaluation occurred in four child welfare offices (two intervention [n = 16 caseworkers] vs. two practice-as-usual, wait-list control [WLC; n = 12 caseworkers]). Receipt of PF-C was associated with significantly increased caseworker knowledge of (a) EBPs, (b) child mental health problems, (c) evidence-based treatment components targeting mental health problem areas, and (d) mental health screening instruments, compared to WLC. Dose of training and consultation was associated with greater ability to correct...

ABSTRACT Children and youths in the foster care system have high rates of emotional and behavioral health needs. While use of mental health services is higher than average for children and youths in care, gaps remain in efficiently linking children and youths in need of services with effective and responsive treatments. Two exploratory studies conducted through a state–academic partnership are considered with the aim of identifying priority strategies to improve collaboration among child welfare caseworkers and mental health service providers. A statewide sample of 127 child welfare caseworkers (study 1) and 148 mental health providers (study 2) participated. Results indicate that there are effective and innovative resources and infrastructure within both state systems. However, challenges exist. Caseworkers indicate limited training in identifying mental health needs, uncertainty about how to apply screening results to case planning, and concerns about the roles, relationships, and communication with mental health providers. They report variability in the extent of available evidence-based services. Mental health providers indicate multiple challenges in working with state dependent youth, including communicating and coordinating with child welfare caseworkers and families. They report shared and team meetings to be helpful in promoting collaboration. Providers want more training on the child welfare system and the unique needs of children and youths in foster care. Implications are discussed.

We evaluated the effect of Primary Care Positive Parenting Program (Triple P) training on pediatric residents and the families they serve to test 2 hypotheses: first, training would significantly improve resident skill in identifying and addressing discrete parenting and child behavior problems; and second, parents would report an improvement in their sense of self-efficacy, use of positive discipline strategies, and their child's behavior. Study participants included pediatric residents from 3 community clinics of a pediatric residency program, as well as English-speaking parents of children aged 18 months to 12 years without a diagnosed behavior disorder cared for by study residents. Residents were randomized to receive Primary Care Triple P training either at the beginning or end of the study period. The measured resident outcomes were self-assessed confidence and skills in giving parenting advice. The measured family outcomes were parent sense of self-efficacy, child externalizing behavior, and discipline strategies. Primary Care Triple P training had a positive, significant, and persistent impact on residents' parenting consultation skills (mean increase on Parent Consultation Skills Checklist 48.11, 95% confidence interval [CI] 40.07, 57.36). Parents visiting intervention-trained residents demonstrated improved disciplinary practices compared to parents visiting control residents (mean change in Child Discipline Survey 0.322, 95% CI 0.02, 0.71), with stronger differential effects for parents with lower baseline skills (mean Child Discipline Survey change 0.822, 95% CI 0.48, 1.83). No differences were found for child behavior or parenting sense of confidence. Training residents in Primary Care Triple P can have a positive impact on consultation skills and parent disciplinary practices. This finding adds strength to the call for increased residency training in behavioral pediatrics.

Youth in the foster care system have substantially higher rates of mental health needs compared to the general population, yet they rarely receive targeted, evidence-based practices (EBPs). Increasingly emerging in the literature on mental health services is the importance of “brokers” or “gateway providers” of services. For youth in foster care, child welfare caseworkers often play this role. This study examines caseworker-level outcomes of Project Focus, a caseworker training and consultation model designed to improve emotional and behavioral outcomes for youth in foster care through increased linkages with EBPs. Project Focus was tested through a small, randomized trial involving four child welfare offices. Caseworkers in the Project Focus intervention group demonstrated an increased awareness of EBPs and a trend toward increased ability to identify appropriate EBP referrals for particular mental health problems but did not have significantly different rates of actual referral to...