Resources / Study / Innovation for Court ADR

Just Court ADR

The blog of Resolution Systems Institute

Author Archive

The Research Year in Review

Jennifer Shack, December 20th, 2018

Over the past year, I presented you with new research (and a little old research) that covered three broad areas: evaluations of ADR programs, evaluation of the efficacy of particular ADR processes, and research about particular aspects of ADR that can inform our practice.

Program Evaluations

Shamelessly, I promoted evaluations I completed in Washington, DC and Illinois. In Washington, DC, I found that early mandatory child protection mediation led to a much greater probability that parents would agree to stipulate to the facts of the case, thus precluding the need for a trial. Parents were also likely to be more compliant with services (such as parenting class or addiction therapy) and visitation requirements. Parents who participated left with a greater understanding of their responsibilities in the case and the points of view of the others at the table. Most also felt mediation was helpful to them.

In Illinois, we learned that program design was an important factor in how much impact a foreclosure mediation program had on homeowners facing foreclosure. Those programs in which the homeowners were given a date and time to arrive for their first pre-mediation session led to higher participation rates and to a higher proportion of homeowners facing foreclosure saving their homes. Across all programs, homeowners left their first pre-mediation session with a better understanding of the foreclosure process and felt they were treated with the dignity that the courts were wanting for them.

I also told you about the results of a study of Michigan’s civil case evaluation and mediation programs. It found that, with the exception of tort cases, cases using case evaluation and mediation were more likely to result in settlement than those that went through the traditional court process. Nonetheless, judges and attorneys who were surveyed were less enthusiastic about case evaluation than those surveyed in 2011 had been, indicating that they had less faith in the effectiveness of the process. This was not the case with mediation, for which their high opinion remained steady.

Research on Processes

In 2018, we learned that research on teen courts needs to be improved if we are to learn if it is effective. We also learned that parenting coordination shows promise for reducing post-decree court activity.

A round-up of 35 studies on teen courts that started as an attempt to understand what program characteristics were most effective ended as a plea for more uniformity in how teen court programs are studied. They found that not only do differences among programs make it difficult to understand program effectiveness, but that the methodology and definitions used in the studies themselves make it impossible to draw conclusions.

A review of 13 studies of parenting coordination found that the process shows promise for reducing post-decree court activity for divorce cases involving high-conflict families. The authors, however, noted that the studies suffered from small samples, limited generalizability and weak methodologies. They pointed to the need for better research and the development of an underlying theory of parenting coordination in order to not only better understand the effect of the process, but also to standardize its practice.

Research on Aspects of ADR

Recent research looked at prejudice and bias in mediation, and what influences litigants’ decisions regarding what dispute resolution process to use.

Prejudice and bias were the subject of a 2017 issue of SMU Law Review. Nancy Welsh lamented the lack of self-determination in mediation and looked at social science research to question whether mediation really provides procedural justice in a world of inequality, bias and prejudice. Gilat J. Bachar and Deborah R. Hensler took a slightly different tack in their article. They looked at empirical research on ADR and determined that this research indicates that both women and minority men fare worse in mediation than white men.

Donna Shestowsky continued her research into how litigants end up using a particular process to resolve their disputes. This time, she let us know that litigants are most likely to rely on their attorney when deciding on which process to use. This has important implications for lawyers and litigants, as lawyers don’t always understand their clients’ interests.

I’m looking forward to sharing more research with you in 2019. Happy Holidays, everyone!

Findings from an Evaluation of Eight Foreclosure Mediation Programs

Jennifer Shack, December 5th, 2018

As I mentioned last month, I recently completed a comprehensive evaluation of eight foreclosure mediation programs in Illinois. One great benefit of evaluating eight programs with different approaches to resolving the same cases is that it allowed me to uncover program design factors and other variables that promote program success. The three big takeaways from the evaluation are that proper program design is essential, provision of services has an impact on homeowner outcomes, and data is crucial to program improvement. The evaluation was a final look at the eight programs that were funded by the Illinois Attorney General, encompassing up to four years for each program. Seven of the eight programs used relatively uniform data that was collected on the same online case management system. Further, I worked with each program to define the variables used so that we had a clear understanding of the meaning of each variable. This allowed me to develop uniform measures for the programs that enabled comparisons of program performance across them.

First, some basic findings. The eight programs helped 4,766 homeowners, representing 23% of all foreclosure filings in their jurisdictions. They saved 1,100 homes. Once homeowners entered the programs, 21% to 40% saved their homes, depending on the program. More than 90% of homeowners who completed surveys said that they gained a better understanding of their options and how to work with their lenders. Almost all homeowners felt that they were treated fairly and with respect. Most felt that they were able to talk about the issues and concerns that were most important to them and almost all felt the mediator understood what was important to them. Most were satisfied with their experience.

Now to the takeaways. Program design played a significant role in how many homeowners a program was able to help and how many homeowners participated in the program. The two variables are different because most programs helped homeowners to understand their options and the foreclosure process, even if they could not or decided not to participate. Those programs that told homeowners that they must appear for their initial session and provided a date and time for that had significantly higher proportions of homeowners appear and participate than programs that had them contact the program in other ways. And those programs that told homeowners they had to call the program coordinator, provided a deadline to do so and sent additional reminders had significantly higher proportions of homeowners contact the program and participate than those programs that informed the homeowners of the program and told them how to start the process to participate.

Participation rate is very important, not just because higher participation means that more homeowners are helped. The greater the proportion of homeowners facing foreclosure who participate in the program, the greater the proportion of homeowners who save their homes.

Other aspects matter as well. Having the homeowners meet with a representative for their lender from the outset appears to improve program completion rates and possibly improves the probability that participating homeowners save their homes. Within individual programs, those homeowners who worked with a housing counselor are more likely to complete the program. Those who worked with attorneys were much more likely to complete the program. Interestingly, they weren’t more likely to save their homes.

It was very gratifying to see that those programs that made changes based on the data they were collecting and the recommendations from my first evaluation were improved by those changes. For example, the 19th Circuit and 20th Circuit programs made changes to the manner in which homeowners contacted and entered the program, significantly improving participation. The 16thand 19th Circuits worked with mediators to improve their skills, leading to fewer mediator issues and more participants leaving mediation with a good experience.

For a quick take on the evaluation, see the Executive Summary.
To access a digital summary of the evaluation, click here.
For the Full Evaluation, download PDF .

Top Criteria for Litigant Selection of Dispute Resolution Process

Jennifer Shack, September 28th, 2018

When litigants were asked soon after their case was filed what would influence their decision about what dispute resolution method they would use for their case, they most commonly said they would be relying on their lawyer’s advice, according to research conducted by Donna Shestowsky. As Shestowsky notes in her article, “Inside the mind of the client: An analysis of litigants’ decision criteria for choosing procedures” (Conflict Resolution Quarterly, Fall 2018) [sub. req.], this has important implications for lawyers and litigants, as lawyers don’t always understand their clients’ interests.

This is the fourth in a series of articles presenting different aspects of her research into the decision-making of litigants in civil cases. Previous articles reported that litigants prefer mediation, looked at what they wanted from a dispute resolution process, and discussed their lack of awareness of what options were available to them. The research is based surveys of litigants in three jurisdictions (in California, Oregon and Utah), that had mediation and arbitration options available to the surveyed litigants.

For this aspect of the research, 335 litigants completed surveys soon after their case was filed. Among the questions were those inquiring into how they would decide which dispute resolution process to use. Within three weeks of the closing of the case, they were called to conduct a survey about the processes they used and the reasons they used them. The litigants provided numerous factors influencing their process selection at the outset of the case, with their lawyer’s advice being the most common, cited by 25% of the respondents. The second most common response, given by 19% of litigants, was that they wanted to minimize economic costs. These two reasons held steady when the litigants were surveyed after the case closed. That is, those litigants who said their lawyer’s advice and/or economic costs were what would lead them to choose a particular dispute resolution process said that they were the factors that led them to ultimately select a process.

Shestowsky finds the significance of litigants relying on their lawyer’s advice in previous research. Tara Relis had earlier found that lawyers don’t always understand their clients’ interests. Similarly, Russell Korobkin and Chris Guthrie uncovered differences between how lawyers and non-lawyers assess whether to settle or litigate a case. This, for Shestowsky, means that unless the lawyers uncover their interests before advising their clients, they may not be acting in a way that best suits their clients when promoting one dispute resolution process over another. Another study also proves relevant in this context. In Arizona, Roselle Wissler found that lawyers were more likely to recommend mediation to their clients if they themselves had experience with the process. Thus, lawyers may simply not feel comfortable recommending a process that may fit best with what their clients want.

Given that litigants rely on their lawyer’s advice, Shestowsky recommends that lawyers “should attempt to understand their clients’ interests, values, and objectives before sharing their personal evaluations of procedures to avoid imposing their own views.” And when their values differ from those of their clients, they should defer to their clients’ values.

Looking at Process and Outcome to Improve an Effective Program

Jennifer Shack, August 28th, 2018
I recently had the great pleasure of evaluating Washington D.C.’s Child Protection Mediation Program. The court was interested in getting a better understanding of the issues involved in the process, such as whether the timing of mediation should be changed and whether the process was working for the participants. Therefore, the evaluation was a comprehensive examination of the outcomes and impact of mediation, as well as the program process from referral to completion of mediation.

To conduct the evaluation, I interviewed parents and judges, observed mediations and court hearings, developed post-mediation surveys and analyzed court files and program data. RSI Executive Director Susan Yates and I also conducted focus groups with groups of professionals who participate in mediation (guardians ad litem, parent’s attorneys, Assistant Attorneys General and social workers) as well as with program mediators. The results of the evaluation, Improving an Effective Program: A Comprehensive Evaluation of the Superior Court of the District of Columbia Child Protection Mediation Program, pointed to the program effectively achieving its goals, but needing to address some issues surrounding the program process.

Mediation in this program is mandatory and is supposed to occur within 30 days of the initial hearing. The goals for mediation, as expressed by the attorneys, social workers and judges, are to:

  • Make progress on the legal issues in the case and reach agreement on the stipulation (an agreement as to the facts of the case that takes the place of trial)
  • Help parents to understand their situation and their responsibilities going forward
  • Increase professionals’ understanding of the case, the parents and the family’s situation
  • Enhance communication among the professionals
  • Provide parents with an opportunity to talk about their concerns and be heard
The court and professionals agree that mediation at this early stage of the case brings all those involved in the case together at an opportune time to discuss the issues involved and progress that should be made at a time when they normally would not be focused on the case. This allows them to exchange more information, update services and visitation, and ensure that professionals are being held accountable for their tasks. Additionally, mediation is seen as a unique forum for parents to be important in the process and to speak about their concerns and be heard. When mediation is conducted early in the case, the exchange of information and parents’ input help professionals make better decisions. Mediators assist in this process by facilitating the discussion, clarifying and summarizing the points being made, reframing position statements in a more positive way, and, at times, supporting the professionals’ goals for the parents.

The results show that the program is generally achieving its goals. Of significance, parents who mediate are twice as likely to stipulate before trial as those who don’t mediate. Further, it is likely that they are more compliant with services, although limitations to the data make it impossible to state this with certainty. Limitations to the data also made it difficult to draw conclusions about mediation’s effect on time to permanency. The evidence, however, points to mediation not having an effect on the time it takes for a child to have a permanent home.

Other results indicate that the percentage of mediations ending with a signed stipulation declined from 2013-2014 to 2017, from 44% to 25%. This was most likely due to a policy change at Child and Family Services Agency in 2015, which judges and professionals said led to only the most challenging cases being brought to court. Despite this, approximately half of the mediations in 2017 ended with some progress on the stipulation.

Importantly, both parents and professionals are gaining understanding through mediation. Almost all parents who completed surveys after mediation said they better understood the points of view of the others at the mediation, as well as what they had to do next. The vast majority of professional participants who completed surveys believed that they gained understanding of others’ points of view and the parents’ situations. In their survey responses, almost three-quarters of parents said they trusted that those involved in their case wanted to do what was best for their children. Parents who were interviewed shed light on the effect of mediation on their level of trust in the professionals. Half of the parents interviewed trusted the professionals before they participated in mediation. Mediation for them was an opportunity to see once more that they could trust them. Of the other half, three entered mediation lacking trust in at least one of the professionals and nothing in mediation led them to change their minds; while for a two, mediation did change their minds from seeing the professionals as being against them to learning they could be trusted.

More than three quarters of the parents were satisfied with the mediation and 83% believed it was helpful to them. Both parents and professionals believed they had an opportunity to talk about what was most important to them and that they were understood. Most parents believed the mediator and, more importantly, the professionals, treated them fairly and with respect. All professionals believed that the mediator treated them fairly and with respect.

Despite the success the program has in achieving its goals, the program process can be improved. One such opportunity lies in the timing of mediation. There was general agreement among professionals that mediation shouldn’t take place within 10 or 15 days of the initial hearing because enough time needs to elapse in order to make the most effective use of mediation. Mediation too soon means that not enough time has elapsed for new information to be available or for parents and professionals to have started taking the steps required of them in the initial case plan. Without these, discussion in mediation is less productive. On the other hand, there was little interest in extending the deadline much beyond 30 days because some of the benefits of mediation are lost if it takes place too late. Generally, almost all professionals thought mediation around 30 days was an ideal time. Despite this, about 1/3 of mediations were scheduled either within 15 days or after the 30-day deadline. It was recommended that the court increase the deadline to 40 days so that more mediations could be held after 15 days had elapsed, but still not too late to keep the case moving forward.

The biggest complaint among the professionals in the focus groups was that mediations didn’t start on time. A review of the data found that most of the time, the delay is due to either a professional or parent arriving late. The mediation was often further delayed because a parent’s attorney needed to speak with his or her client. The recommendation to address this was to require that parents and their attorneys arrive 30 minutes before the scheduled time for mediation.

After speaking with the professionals and mediators in focus groups, it became clear that everyone could benefit from opportunities to learn from each other as well as others, and that many wanted this to happen. The focus groups became an opportunity for the participants to find out how their peers were approaching issues in mediation, and to find out what was possible. The focus group participants talked about wanting to gain more information or to explain to others what their own role is. Mediators mentioned areas of uncertainty for them. Professionals discussed areas in which they felt mediators could improve. All of this points to a need for an ongoing education program for both professionals and mediators, which was recommended.

The mediation program was first put in place in 1998 as a pilot. It has evolved over time, but hadn’t been comprehensively evaluated in more than a decade, and those evaluations were outcome-oriented, meaning that the process hadn’t been examined in a methodical way. This evaluation demonstrated that looking at both outcomes and process were essential to assessing the program and determining what could make it better.

For a quick take on the evaluation, see the Executive Summary.

For a full discussion and all statistics, see the Full Evaluation.

Verified by ExactMetrics