The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.202100089

Abstract

Objective:

Criminal recidivism is common among patients in mental health residential treatment programs. Moral reconation therapy (MRT) has empirical support for reducing criminal recidivism by modifying antisocial cognitions and behaviors; however, its implementation potential in noncorrectional settings has been rarely studied. This potential was examined in a three-site effectiveness-implementation trial of MRT for justice-involved veterans receiving residential mental health treatment in the U.S. Veterans Health Administration.

Methods:

Semistructured interviews were conducted with 36 veterans who received MRT and 13 residential program staff who were involved in its implementation during the trial. Interviews were guided by the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework and a focus on patient engagement and context. Content analysis was used to identify facilitators of and barriers to MRT implementation in residential mental health treatment.

Results:

Participants viewed MRT as unique and complementary to usual residential care, with benefits beyond recidivism reduction. However, time intensity of the MRT curriculum, challenges in adapting its content and format, and long-term costs of maintaining MRT were viewed as barriers to implementation. To facilitate implementation, participants suggested streamlining the MRT curriculum, adding motivational components, and establishing partnerships in- and outside the health care system.

Conclusions:

The findings suggest strategies and modifications to MRT, which, if shown to be effective, may facilitate its wider implementation in mental health residential treatment programs.

HIGHLIGHTS

  • This was the first study to examine the implementation potential of moral reconation therapy (MRT) in residential mental health treatment programs.

  • Stakeholders viewed MRT as an approach that is unique but still complementary to usual residential mental health care for justice-involved veterans.

  • Adaptations to MRT are likely needed to facilitate its wider implementation in residential treatment.

A history of criminal justice involvement is common among patients in mental health residential treatment (1, 2), particularly among patients receiving care from the U.S. Veterans Health Administration (VHA). For example, 70%−75% of veterans in mental health treatment programs report a history of incarceration, most of whom report multiple lifetime charges (35). Links between mental illness and criminality are often driven by shared factors, such as adverse family environments, impoverished neighborhoods, and other societal forces (68). Mental illness, however, is a poor predictor of criminal recidivism, because justice-involved adults with mental illnesses have the same criminogenic risks as the general population of justice-involved adults (9). Accordingly, there is a need to implement interventions to reduce criminogenic risk among justice-involved adults with mental illness.

Cognitive-behavioral therapy (CBT) approaches to modify criminogenic thinking are considered best practices for reducing criminal recidivism among justice-involved adults (1013). Criminogenic thinking is a robust risk factor for recidivism (10) and has been linked to criminal justice involvement among veterans (1417). Moral reconation therapy (MRT) is a CBT- and group-based intervention for modifying criminogenic thinking (18) and has empirical support for reducing criminal recidivism among incarcerated adults (19, 20). Led by a trained facilitator, MRT includes open-enrollment groups that welcome new members at any time and uses a workbook to assist participants with completing 12 steps of moral development (e.g., healing damaged relationships and goal setting). Participants complete workbook assignments between group sessions and present their work at the next session. Completion of each MRT step takes approximately two sessions; thus, completion of all 12 steps of MRT requires participants to attend on average 24 sessions (18). A meta-analysis of 33 studies (20) observed that the recidivism rate was reduced by one-third among those who received MRT, relative to those in control conditions.

MRT was originally developed for individuals with substance use disorders in correctional settings (18). Less attention has been paid to the implementation potential of MRT for patients receiving mental health care in noncorrectional settings. Residential treatment programs may be an ideal context in which to study MRT implementation, because they serve a high proportion of justice-involved adults (5). However, barriers to patient engagement may exist when implementing MRT in residential settings (21), and provider concerns regarding MRT’s relevance for patients in these programs may be barriers to MRT adoption (22). It is also unclear how the facilitators of and challenges to implementation of MRT generally compare with those of CBT for individuals with mental illness (23, 24). For example, a study found (24) that implementation of a lifestyle intervention for inpatients with serious mental illness was facilitated by positive attitudes of staff and patients toward the intervention and that intervention complexity and lack of resources and organizational support were barriers to implementation.

The Present Study

We sought to identify facilitators of and barriers to implementing MRT in mental health residential treatment programs. We conducted a process evaluation to inform a multisite randomized controlled trial (RCT) on the effectiveness of MRT to reduce risk for recidivism among justice-involved veterans (25). The process evaluation was part of a hybrid 1 effectiveness-implementation trial, in which the primary focus was to test MRT’s effectiveness and also to gather data on its implementation potential to provide guidance to health care systems on best practices for wider implementation of MRT in mental health residential treatment programs. The evaluation was informed by the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework (26), which includes collection of qualitative data from both patients and providers to identify factors that may affect an intervention’s potential for implementation and impact (27).

Methods

Design and Procedures

Parent RCT.

This study was conducted in the mental health residential treatment programs of three VHA medical centers. Patients were eligible if they had been arrested and charged or released from incarceration during the past 5 years. Across the sites, 341 patients were enrolled and randomly assigned to receive usual care in the residential program (N=169) or usual care in the residential program plus two MRT group meetings per week for 12 weeks (N=172). Usual care was comparable across sites and consisted of patients living in the program for 3–6 months, attending individual and group therapy sessions (7 hours per day, 5 days per week) to address mental health or substance use problems through CBT approaches (e.g., relapse prevention), and receiving case management or linkage to services to address employment and housing problems. Because of the high rates of posttraumatic stress disorder (PTSD) among veterans, some individual and group sessions also used evidence-based treatments for PTSD (e.g., cognitive processing therapy and prolonged exposure).

Process evaluation.

A one-time semistructured phone interview was conducted with patients who had been randomly assigned to the MRT condition and with frontline providers and leadership at each site who were involved in MRT’s implementation (referred to collectively as “staff”). For the patient sample, we enrolled a range of patients at each site; patients were selected on the basis of their level of engagement in MRT groups. Specifically, at month 12 of the RCT, the cross-site distribution of the number of MRT groups attended was reviewed to identify the lower, median, and upper quartiles to define low, moderate, and high levels of engagement, respectively. Low engagement was defined as attending three or fewer MRT group sessions, moderate engagement as attending six to nine sessions, and high engagement as attending ≥14 sessions. Using stratified purposeful sampling within these groups (28), we randomly selected patients at each site and contacted them by phone shortly after their participation in the MRT group had concluded. Using purposeful criterion sampling at each site, we reached out by phone to frontline providers who facilitated the MRT groups during the RCT and to residential program leadership after all MRT groups at that site had concluded. Phone interviews were conducted by research assistants and lasted approximately 30 minutes. All interviews were audio recorded (with the patients’ and staff members’ permission). Patient interviews were conducted from April 2017 to September 2018. Staff interviews were conducted from October 2018 to May 2019. All participants provided verbal informed consent, and all procedures were approved by the VA’s Central Institutional Review Board.

Sample

Sixty-eight patients were contacted and invited to participate. Of those contacted, 36 (53%) agreed to participate. Among these 36 patients, 13 (36%) were classified as low engagers in MRT, nine (25%) as moderate engagers, and 14 (39%) as high engagers. Patient participants had a mean±SD age of 48±12 years. Most of the patients were men (N=33, 92%), and their race-ethnicity was non-Hispanic White (N=18, 50%), Black or African American (N=13, 36%), Asian (N=1, 3%), Hispanic or Latinx (N=1, 3%), or Native American (N=1, 3%). Participants reported a lifetime median of nine criminal charges and 7.5 months of incarceration. According to the admission and discharge notes in their medical records, 97% (N=35) had been diagnosed as having a substance use disorder, 67% (N=24) as having PTSD, 64% (N=23) as having a mood disorder, 19% (N=7) as having an anxiety disorder, 14% (N=5) as having a personality disorder, and 89% (N=32) as having co-occurring substance use and mental disorders. At baseline, the mean T-score on the General Criminal Thinking index from the Psychological Inventory of Criminal Thinking Styles, calculated in reference to norms from incarcerated offenders (29), was 57.3±11.6, indicating a moderate level of criminal thinking.

Across sites, 15 staff members were contacted and invited to participate in the semistructured interview, of whom 13 (87%) agreed. Ten (77%) of those who agreed were frontline staff who had facilitated MRT groups during the trial, and three (23%) were residential program leaders who oversaw the implementation of the groups. These staff participants included six social workers (46%), two psychologists (15%), one psychiatrist (8%), one nurse manager (8%), one justice outreach specialist (8%), one peer specialist (8%), and one rehabilitation specialist (8%). Most of the staff participants were men (N=9, 69%) and non-Hispanic White (N=9, 69%).

Interview Guide

The patient and staff interviews were informed primarily by the RE-AIM framework (26), which consists of five domains for identifying factors that may influence an intervention’s potential for implementation and widespread impact: reach (how to reach the target population with the intervention), effectiveness (how to know the intervention is effective), adoption (organizational support for an intervention’s implementation), implementation (fidelity of an intervention’s delivery), and maintenance (sustainability of an intervention beyond a research study). The RE-AIM planning tool was used to ask questions of participants within these domains (30). Questions from the reach domain focus primarily on access rather than engagement. Because of the potential significance of the latter for MRT implementation in noncorrectional settings (21), we modified the tool to include a separate domain that focused on patient engagement. In addition, to more directly evaluate participants’ perceptions of the organizational fit of MRT for patients in residential treatment programs (22), we added the context domain from the Promoting Action on Research Implementation in Health Services (PARIHS) framework (31). Questions from the patient interview guide were focused on reach, patient engagement, effectiveness, and context. Questions from the staff interview guide focused on the same domains as the patient interviews, plus adoption, implementation (i.e., fidelity), and maintenance (see online supplement).

Analysis

Audio recordings of the patient and staff interviews were transcribed verbatim by a centralized transcription service in the VHA. Three of the study authors (D.M.B., J.S.S., S.J.) analyzed the transcripts by using the framework method, a form of content analysis that allows for systematic reduction of textual data (32, 33). To organize the textual data, this method uses matrixes, in which rows correspond to cases, columns correspond to interview questions or codes, and cells contain summaries of the data. In applying this method, separate matrixes were first created in Microsoft Excel for the patient and staff interviews. In each matrix, rows represented participants, and columns represented interview questions, grouped by implementation domain. Second, two analysts (J.S.S., S.J.) reviewed half of the transcripts and entered summaries of the data into the relevant cells of the spreadsheets. Each analyst then reviewed the entered data from the other analyst to confirm completeness and accuracy of the summarized content. Third, all three analysts independently reviewed 25% of both the patient and staff interview transcripts and developed an initial list of facilitators of and barriers to implementation of MRT in mental health residential treatment. This step included identifying actual facilitators of and barriers to implementing MRT during the trial, as well as potential facilitators and barriers to be explored in the future (initial review of the staff data revealed no differences in this analysis domain between frontline providers or leaders; therefore, the data from these respondents were combined). Fourth, the analysts used a consensus-based process to merge their independently derived facilitators of and barriers to implementing MRT. Fifth, each analyst reviewed the patient and staff matrixes and used the list of facilitators and barriers to code the relevant cells of the matrixes.

Coding meetings were held weekly to review consistency and to allow for addition of inductive codes (i.e., facilitators or barriers that emerged from additional review of the textual data). After consensus was reached, and the facilitators and barriers were revised to their final structure, the analysts independently assigned each facilitator or barrier to one of the implementation domains from the RE-AIM or PARIHS frameworks and engaged in a consensus process to rectify disagreements.

Results

Facilitators of Implementing MRT in Mental Health Residential Treatment Programs

The facilitators of implementation are described below. Illustrative quotes and the implementation domains corresponding to each facilitator are provided in Table 1.

TABLE 1. Facilitators of implementing moral reconation therapy (MRT) in residential mental health treatment programs

FacilitatorImplementation
domain
Sample quotations
Internal and external motivationReach, patient engagement“A lot of it depends on internal motivation. How serious they are about changing what they’ve become.” [high-engaging patient, ID–640004] “The idea that it is looked favorably upon by a court is going to play well with people who have been in legal trouble, . . . but I don’t know that MRT can make you ready or willing to change.” [high-engaging patient, ID–518105] “I don’t think MRT has a part built in like [motivational interviewing]. It would be interesting if there were added motivational pieces that help people gauge, where are they? What benefit do they see?” [staff, ID–102] “Motivating on the inside about the importance of [MRT] and then getting that internalized motivation to continue on their own. Motivational interviewing was a significant part of it. The more motivational interviewing that was included during the initial stages, the better the results. Those are the ones who continued.” [staff, ID–302]
Complementarity with residential programmingAdoption, context“I wasn’t just going to another ‘in general’ class. This was more in-depth. There was a lot of stuff that I hadn’t seen before.” [moderately engaged patient, ID–518091] “I felt that it was something completely different from what was going on with the other groups, light years beyond and above what other groups were doing. [high-engaging patient, ID-518040] “We haven’t really found good interventions that work with and try to reduce some of the legal involvement that [veterans] have. [MRT] actually filled up a big gap.” [staff, ID–303] “It was a different treatment modality we weren’t currently offering, and we have a need for it because we take a large number of incarcerated veterans right out of jail.” [staff, ID–202]
Benefits beyond recidivismReach, effectiveness, adoption“It’s helped improve my relationships. I was able to address some of the people I affected the most.” [high-engaging patient, ID–640030] “[MRT helped with] my drug use. And how I have to deal with my family, how to deal with other people.” [high-engaging patient, ID–640004] “Not everybody has been to jail, but that doesn’t mean that most of us haven’t gone that low. They just didn’t get caught. I firmly believe that it’s something everybody here can benefit from.” [moderately engaged patient, ID–640101] “Some of them seemed to really grasp the concept, started to make different life choices, move on to permanent employment, graduate from the program, obtain their own housing and avoid reincarceration.” [staff, ID–202] “I feel like there’s a lot of parts to MRT that have that whole health implementation kind of process, and so it’s not just [recidivism]. It could actually be helpful in several other areas in your life.” [staff, ID–302]
Broad network of collaboratorsAdoption, maintenance“Encourage collaboration with the Veterans Justice Programs (VJP) and outpatient services. Having it partnered with the legal system could help for those veterans who are under a [diversion] program.” [staff, ID–301] “I think having collaboration with VJP would be helpful.” [staff, ID–104] “Providing it as outpatient groups and keeping it as part of VJP and maybe having probation officers in the courts say the expectation is you’re going to participate in this treatment.” [staff, ID–103]

TABLE 1. Facilitators of implementing moral reconation therapy (MRT) in residential mental health treatment programs

Enlarge table

Internal and external motivation.

Both patient and staff participants reported that internal and external motivation were key to the reach and patient engagement domains. Patients who had moderate or high levels of engagement in MRT noted that their own internal motivation to make changes in their lives was the driving factor for their participation. Staff participants highlighted the value of external motivators to patient engagement (e.g., court-related incentives for attendance) but also noted the importance of enhancing internal motivation for patients who had low engagement. For example, some staff noted that MRT does not contain any motivational interviewing components and suggested adding such elements to facilitate reach and patient engagement.

Complementarity with residential programming.

In the context of the adoption and context domains, patient and staff participants reported that MRT fit well with existing services in the residential programs and also added value. Staff participants liked that MRT followed principles of CBT and peer-support models of recovery but also filled a gap in programming by helping patients to consider how their thinking and behavioral choices contributed to their justice system involvement. All staff participants who facilitated MRT groups during the RCT expressed a desire for the groups to continue in their program after the trial. Patients with moderate and high levels of engagement in MRT also spoke positively about the content of the curriculum and felt that it was unique and complementary to the other services they received in the residential program.

Benefits beyond recidivism.

In terms of the effectiveness domain, although MRT is broadly focused on reducing risk for recidivism, participants reported other perceived benefits. For example, patients with moderate or high levels of engagement in MRT perceived that the therapy helped improve their decision-making and communication skills and, in turn, their relationships with others. Staff participants described MRT as having a positive impact on several areas of functioning, including substance use, mental health, employment, and housing. Furthermore, staff felt that MRT’s reach and adoption in other programs could be facilitated by promoting these benefits to generate buy-in from other staff and by offering the groups to residents who were not currently involved in the criminal justice system.

Broad network of collaborators.

To facilitate MRT adoption and maintenance in a residential program, staff participants stressed the value of creating partnerships with a broad network of collaborators. For example, staff noted the importance of collaborating with outpatient services in VHA to facilitate better continuity of care for patients entering and exiting the residential program. In addition, staff stressed the importance of creating partnerships with legal services, such as treatment courts, both inside and outside VHA.

Barriers to Implementing MRT in Residential Treatment Programs

The barriers to MRT implementation in mental health residential treatment programs are described below. Illustrative quotes and the implementation domains corresponding to each barrier are provided in Table 2.

TABLE 2. Barriers to implementing moral reconation therapy (MRT) in residential mental health treatment programs

BarrierImplementation domainSample quotations
Time-intensive curriculumReach, patient engagement“MRT could be a program that runs on its own because there is a lot of work involved. The only reason I dropped out was because of the workload . . . juggling the [residential program] and MRT was too much.” [low-engaging patient, ID–640050] “[MRT] had a lot of good things to offer. The problem for me was [that] handling the [residential program] contract and doing [MRT] at the same time was a bit overwhelming.” [low-engaging patient, ID–640003] “It is a framework to base everything else around. A treatment program needs to be built around MRT. Not just doing it in addition to other treatment. It loses its importance, and then to people it’s just another thing.” [staff, ID–301] “The amount of work [in MRT]. There’s already so much that they’re doing in the program. It can get overwhelming.” [staff, ID–101]
Challenges to adapting content and formatAdoption, implementation, maintenance“Some felt challenged by memorization required in early testimonies, which may have affected attendance.” [staff, ID–102] “[We need to] develop a condensed version of the protocol. If we know we’ve only got six sessions with a person, then there’s some other brief or condensed protocol that we could use.” [staff, ID–303] “I would abbreviate it. I would figure out which sessions are the most beneficial for that population, particularly veterans coming out of prison or jail, and then lower the number of sessions to gain additional buy-in and for them to consistently come.” [staff, ID–105]
Long-term costs and required resourcesMaintenance“Money for workbooks—that is going to be the main issue. The material is straightforward so you could have people learn to facilitate it without going through a formal certification training. That would make it easier and would reduce cost.” [staff, ID–301] “You have to have money for the books. You have to have money for the training. You have to be able to give people the time to do the training and the expense of going to the training sites. Those are barriers.” [staff, ID–201]

TABLE 2. Barriers to implementing moral reconation therapy (MRT) in residential mental health treatment programs

Enlarge table

Time-intensive curriculum.

Patient and staff participants viewed the length and intensity of the MRT curriculum as a barrier to patient engagement. Patients with low levels of MRT engagement reported that the workload was overwhelming, particularly because of competing demands from the residential program and other patient priorities (e.g., finding housing or employment). Both patient and staff participants also perceived MRT as an intervention that would function better as the foundation on which a residential program was designed rather than as a treatment incorporated into the program’s existing curriculum.

Challenges to adapting content and format.

Staff participants reported aspects of the MRT content and format that would present challenges to MRT adoption, implementation, and maintenance in residential programs. For example, some staff noted that, in contrast to other CBT-based curricula used in the program, MRT has rigid rules for step completion, such as memorization of testimonials, that are too difficult for those with cognitive impairment and presented challenges to full fidelity to MRT. Other staff noted that the group format limited opportunities for one-on-one sessions between group facilitators and group members. Staff participants also reported a need for the treatment protocol to be more flexible, either in terms of allowing only some MRT steps to be incorporated into the residential program curriculum as feasible, or creation of a condensed version of the protocol.

Long-term costs and required resources.

Staff participants highlighted the long-term costs and required resources for MRT maintenance in residential programs. For example, because the intervention is copyrighted by Correctional Counseling, Inc., funds are required to purchase the patient workbooks. Staff also reported that multiple group facilitators are needed to sustain an MRT group over time and noted the registration costs associated with training and certifying staff in MRT.

Discussion

This study sought to identify facilitators of and barriers to implementation of MRT in mental health residential treatment programs. Of particular interest was identifying factors that affected patient engagement in MRT. Across the reports from patient and staff participants, the time demands of the MRT curriculum were highlighted as a key factor for low patient engagement. In addition to the required therapeutic activities of those in residential treatment, patients often have other priorities, such as finding stable housing and employment before program discharge. Consequently, engagement in an intensive intervention such as MRT, which is focused on changing criminogenic thinking, may be perceived as lower on the hierarchy of needs for some patients. Similar challenges to engagement have been raised with other intensive interventions for substance use and mental disorders (34).

To boost patient engagement and expand the reach of MRT, staff participants stressed the importance of providing external motivation for group attendance as well as fostering patients’ internal motivations. Accordingly, it may be recommended that residential programs partner with a treatment court to provide external incentives for engagement in MRT (while being mindful of coercion) (35, 36). Programs may also consider pairing MRT with motivational interviewing to help patients consider the benefits of behavioral changes associated with criminal activity and to share in decision making to facilitate engagement (37, 38).

In regard to organizational support for MRT adoption, patient and staff participants uniformly viewed MRT as complementary to usual care in mental health residential treatment programs (i.e., grounded in a CBT approach and emphasis on peer support) but also as having incremental value to the standard curriculum of these programs, because of its focus on modifying criminogenic thinking. Further contributing to the potential for an organization to adopt MRT was the perception among both patients and staff members that the intervention could have benefits beyond recidivism reduction, particularly for outcomes that are more in the purview of residential treatment (i.e., substance use and mental health). With respect to effectiveness, it may be important to explore outcomes other than recidivism risk in future RCTs of MRT in residential treatment settings (e.g., interpersonal relationships). In regard to reach, it may be valuable to expand the eligibility for MRT groups in residential programs beyond individuals who have been recently or currently involved in the criminal justice system (e.g., on parole or probation). Alternatively, because of the increased history of arrest among veterans with co-occurring substance use and mental disorders (39), further adaptation of MRT for these patients to optimize implementation and clinical outcomes of the intervention may be needed. The high rates of PTSD among the sample also raise questions about the application of MRT to veterans versus nonveterans and the potential need to further adapt MRT for veterans with PTSD.

For mental health residential treatment programs that choose to adopt MRT, a key question is how to best implement it to ensure fidelity and long-term maintenance of the intervention. Given the intensive nature of MRT, one recommendation to facilitate implementation in the residential programs was to streamline the MRT content to allow programs to incorporate elements of the intervention as needed or to create a shortened version. Such efforts will require research to determine which elements of MRT could be modified without limiting the intervention’s effectiveness and which elements are core MRT components that should not be modified (40). To maintain MRT in a residential program over time, another recommendation was to establish a network of collaborators within and outside the health care system. For example, partnerships with entities of the criminal justice system, such as treatment courts, could provide a consistent referral stream into a residential program (21). The required costs of adopting and sustaining MRT are not trivial, however, and will require health care systems to account for the costs of the patient workbooks and staff training and certification.

We acknowledge some limitations of this study. First, the study was focused on justice-involved veterans receiving care in the VHA. Therefore, the extent to which our findings can be generalized to nonveterans or other health care systems is unclear. Nonetheless, the geographic diversity of the study sites likely enhanced the generalizability of the findings to other VHA mental health residential programs. Second, patients were not selected into the study on the basis of the level of criminogenic needs. Use of MRT among general arrestees may differ in indications for implementation than use among those with high criminogenic needs (e.g., general arrestees may perceive MRT as less relevant and may therefore engage less in the intervention). Notably, however, patient participants reported a moderate level of criminal thinking. Third, the current data could not speak to whether MRT is effective for reducing recidivism among residential patients, which is relevant to whether it is practical to implement MRT with this population. Fourth, although age was not reported as a factor affecting MRT acceptability, we note that the sample was middle-aged. Because engagement in criminal behaviors decreases with age, the impact of age on MRT acceptability should be explored in future studies.

Conclusions

Although MRT was viewed by both patients and staff as complementary to usual care in residential treatment programs, adaptations to the MRT curriculum are likely needed to facilitate implementation of the intervention on a wider scale. If such a modified version of MRT was shown to be effective, it could be combined with implementation strategies focused on establishing partnerships with services within and outside the health care system. Going forward, research on the implementation potential of MRT for justice-involved adults in mental health treatment must consider the larger context of the treatment needs (e.g., substance use, mental health, housing, and unemployment problems) that can increase risk for recidivism among patients in these settings (41). To merit more widespread implementation in residential programs, it will be necessary to establish that interventions such as MRT (which target criminogenic thinking) have a significant impact on reducing recidivism compared with other evidence-based treatments.

Health Services Research and Development, Center for Innovation to Implementation, VA Palo Alto Health Care System, Palo Alto, California (Blonigen, Smith, Javier, Timko, Nevedal); Department of Psychiatry and Behavioral Sciences (Blonigen, Timko) and Center for Primary Care and Outcomes Research (Javier), Stanford University School of Medicine, Stanford, California; Center for Mental Healthcare and Outcomes Research, Central Arkansas Veterans Affairs Healthcare System, North Little Rock, and Department of Psychiatry, University of Arkansas for Medical Sciences, Little Rock (Cucciare); Clinical Psychology Program, Palo Alto University, Palo Alto, California (Filice); Veterans Justice Programs, Veterans Health Administration (VHA), Washington, D.C. (Rosenthal); Health Services Research and Development, Center for Health Care Organization and Implementation Research, Bedford VA Medical Center, Bedford, Massachusetts, and University of Massachusetts Chan Medical School, Worcester (Smelson).
Send correspondence Dr. Blonigen ().

This work was supported by a U.S. Department of Veterans Affairs (VA) merit award to Dr. Blonigen and Dr. Smelson from VA Health Services Research and Development (HSR&D; IIR 14-081). Dr. Timko was supported by a senior research career scientist award from VA HSR&D (RCS-00-001).

Correctional Counseling, Inc., provided training in moral reconation therapy and was paid for consultation on the effectiveness trial but was otherwise not involved in the evaluation. These views represent the opinions of the authors and not necessarily those of the VHA.

The authors report no financial relationships with commercial interests.

References

1 Malone DK: Assessing criminal history as a predictor of future housing success for homeless adults with behavioral health disorders. Psychiatr Serv 2009; 60:224–230LinkGoogle Scholar

2 White MC, Chafetz L, Collins-Bride G, et al.: History of arrest, incarceration and victimization in community-based severely mentally ill. J Community Health 2006; 31:123–135Crossref, MedlineGoogle Scholar

3 Blonigen DM, Macia KS, Smelson D, et al.: Criminal recidivism among justice-involved veterans following substance use disorder residential treatment. Addict Behav 2020; 106:106357Crossref, MedlineGoogle Scholar

4 Smelson DA, Kline A, Kuhn J, et al.: A wraparound treatment engagement intervention for homeless veterans with co-occurring disorders. Psychol Serv 2013; 10:161–167Crossref, MedlineGoogle Scholar

5 Weaver CM, Trafton JA, Kimerling R, et al.: Prevalence and nature of criminal offending in a national sample of veterans in VA substance use treatment prior to the Operation Enduring Freedom/Operation Iraqi Freedom conflicts. Psychol Serv 2013; 10:54–65Crossref, MedlineGoogle Scholar

6 Morgan RD, Scanlon F, Van Horn SA: Criminogenic risk and mental health: a complicated relationship. CNS Spectr 2020; 25:237–244Crossref, MedlineGoogle Scholar

7 Freedman D, Woods GW: Neighborhood effects, mental illness and criminal behavior: a review. J Politics Law 2013; 6:1–16Crossref, MedlineGoogle Scholar

8 Stevens M: Preventing at-risk children from developing antisocial and criminal behaviour: a longitudinal study examining the role of parenting, community and societal factors in middle childhood. BMC Psychol 2018; 6:40Crossref, MedlineGoogle Scholar

9 Skeem JL, Steadman HJ, Manchak SM: Applicability of the risk-need-responsivity model to persons with mental illness involved in the criminal justice system. Psychiatr Serv 2015; 66:916–922LinkGoogle Scholar

10 Bonta J, Andrews DA: The Psychology of Criminal Conduct, 6th ed. New York, Routledge, 2016CrossrefGoogle Scholar

11 Aos S, Miller M, Drake E: Evidence-Based Adult Corrections Programs: What Works and What Does Not. Olympia, WA, Washington State Institute for Public Policy, 2006Google Scholar

12 Landenberger NA, Lipsey MW: The positive effects of cognitive behavioral programs for offenders: a meta-analysis of factors associated with effective treatment. J Exp Criminol 2005; 1:451–476CrossrefGoogle Scholar

13 Milkman H, Wanberg K: Cognitive Behavioral Treatment: A Review and Discussion for Corrections Professionals. Aurora, CO, US Department of Justice, National Institute of Corrections, 2007Google Scholar

14 Black DW, Carney CP, Peloso PM, et al.: Incarceration and veterans of the first Gulf War. Mil Med 2005; 170:612–618Crossref, MedlineGoogle Scholar

15 Bovasso GB, Alterman AI, Cacciola JS, et al.: The prediction of violent and nonviolent criminal behavior in a methadone maintenance population. J Pers Disord 2002; 16:360–373Crossref, MedlineGoogle Scholar

16 Kasarabada ND, Anglin MD, Stark E, et al.: Cocaine, crime, family history of deviance: are psychosocial correlates related to these phenomena in male cocaine abusers? Subst Abus 2000; 21:67–78Crossref, MedlineGoogle Scholar

17 Blonigen DM, Bui L, Elbogen E, et al.: Risk of recidivism among justice-involved veterans: a systematic review of the literature. Crim Justice Policy Rev 2016; 27:812–837CrossrefGoogle Scholar

18 Little GL, Robinson KD: Moral reconation therapy: a systematic step-by-step treatment system for treatment resistant clients. Psychol Rep 1988; 62:135–151Crossref, MedlineGoogle Scholar

19 Blodgett JC, Fuh IL, Maisel NC: A Structured Evidence Review to Identify Treatment Needs of Justice-Involved Veterans and Associated Psychological Interventions. Menlo Park, CA, VA Palo Alto Health Care System, Center for Health Care Evaluation, 2013Google Scholar

20 Ferguson LM, Wormith JS: A meta-analysis of moral reconation therapy. Int J Offender Ther Comp Criminol 2013; 57:1076–1106Crossref, MedlineGoogle Scholar

21 Blonigen DM, Shaffer PM, Smith JS, et al.: Recidivism treatment for justice-involved veterans: evaluating adoption and sustainment of moral reconation therapy in the US Veterans Health Administration. Adm Policy Ment Health 2021; 48:992–1005Crossref, MedlineGoogle Scholar

22 Blonigen DM, Rodriguez AL, Manfredi L, et al.: Cognitive-behavioral treatments for criminogenic thinking: barriers and facilitators to implementation within the Veterans Health Administration. Psychol Serv 2018; 15:87–97Crossref, MedlineGoogle Scholar

23 Jolley S: Implementing cognitive-behavioral therapy for people with psychosis: local and national initiatives in the United Kingdom. Psychiatr Serv 2018; 69:952–955LinkGoogle Scholar

24 Deenik J, Tenback DE, Tak ECPM, et al.: Implementation barriers and facilitators of an integrated multidisciplinary lifestyle enhancing treatment for inpatients with severe mental illness: the MULTI study IV. BMC Health Serv Res 2019; 19:740Crossref, MedlineGoogle Scholar

25 Blonigen DM, Cucciare MA, Timko C, et al.: Study protocol: a hybrid effectiveness-implementation trial of moral reconation therapy in the US Veterans Health Administration. BMC Health Serv Res 2018; 18:164Crossref, MedlineGoogle Scholar

26 Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999; 89:1322–1327Crossref, MedlineGoogle Scholar

27 Curran GM, Bauer M, Mittman B, et al.: Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care 2012; 50:217–226Crossref, MedlineGoogle Scholar

28 Palinkas LA, Horwitz SM, Green CA, et al.: Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Adm Policy Ment Health 2015; 42:533–544Crossref, MedlineGoogle Scholar

29 Walters GD: The Psychological Inventory of Criminal Thinking Styles (PICTS). Allentown, PA, Center for Lifestyle Studies, 2013Google Scholar

30 Forman J, Damschroder IJ, Robinson CH, et al.: RE-AIM Plus: Expanding the RE-AIM Framework for Real-Time Program Evaluation. Ann Arbor, MI, Ann Arbor VA HSR&D Center for Clinical Management Research, 2010Google Scholar

31 Stetler CB, Damschroder LJ, Helfrich CD, et al.: A guide for applying a revised version of the PARIHS framework for implementation. Implement Sci 2011; 6:99Crossref, MedlineGoogle Scholar

32 Gale NK, Heath G, Cameron E, et al.: Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol 2013; 13:117Crossref, MedlineGoogle Scholar

33 Averill JB: Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res 2002; 12:855–866Crossref, MedlineGoogle Scholar

34 Bellack AS, Bennett ME, Gearon JS, et al.: A randomized clinical trial of a new behavioral treatment for drug abuse in people with severe and persistent mental illness. Arch Gen Psychiatry 2006; 63:426–432Crossref, MedlineGoogle Scholar

35 Lamberti JS: Preventing criminal recidivism through mental health and criminal justice collaboration. Psychiatr Serv 2016; 67:1206–1212LinkGoogle Scholar

36 Parhar KK, Wormith S, Derkzen DM, et al.: Offender coercion in treatment: a meta-analysis of effectiveness. Crim Justice Behav 2008; 35:1109–1135CrossrefGoogle Scholar

37 Davis TM, Baer JS, Saxon AJ, et al.: Brief motivational feedback improves post-incarceration treatment contact among veterans with substance use disorders. Drug Alcohol Depend 2003; 69:197–203Crossref, MedlineGoogle Scholar

38 Wain RM, Wilbourne PL, Harris KW, et al.: Motivational interview improves treatment entry in homeless veterans. Drug Alcohol Depend 2011; 115:113–119Crossref, MedlineGoogle Scholar

39 McNiel DE, Binder RL, Robinson JC: Incarceration associated with homelessness, mental disorder, and co-occurring substance abuse. Psychiatr Serv 2005; 56:840–846LinkGoogle Scholar

40 Wiltsey Stirman S, Baumann AA, Miller CJ: The FRAME: an expanded framework for reporting adaptations and modifications to evidence-based interventions. Implement Sci 2019; 14:58Crossref, MedlineGoogle Scholar

41 Blodgett JC, Avoundjian T, Finlay AK, et al.: Prevalence of mental health disorders among justice-involved veterans. Epidemiol Rev 2015; 37:163–176Crossref, MedlineGoogle Scholar