Resources / Study / Innovation for Court ADR

Just Court ADR

The blog of Resolution Systems Institute

Posts Tagged ‘evaluation’

New Mediator Self-Reflection Tool

Susan M. Yates, January 9th, 2019

The Supreme Court of Virginia has developed a wonderful new self-reflection form for mediators. While the Court developed this tool for their certified mediators as part of their re-certification process, it is a valuable tool for any mediator (just ignore the instructions about continuing mediator education credits). There is a lot of content, so if you are using this on your own you will probably want to pick and choose among the questions. This new tool coordinates with Virginia’s excellent Mediator Self-Reflection Treasury.

Even though mediators work very closely with people when we mediate, typically no one else in the room shares our mediator perspective. There are exceptions, such as co-mediation or when we are observed by new mediators, but mediation can be an isolated activity (made especially so by the limits of confidentiality). This isolation makes self-reflection particularly important.

I can imagine many uses for these tools beyond self-reflection. A group of mediators could pick a few of the questions to discuss over lunch. For co-mediators, the tools could aid their debriefing. The forms might help a new court or community mediation program get clear about what they expect from mediators. The tools will probably spark other ideas when you read them.

Many thanks to the good people of the Supreme Court of Virginia for taking the time to produce and share these tools. They are a real gift to the mediation community.

Findings from an Evaluation of Eight Foreclosure Mediation Programs

Jennifer Shack, December 5th, 2018

As I mentioned last month, I recently completed a comprehensive evaluation of eight foreclosure mediation programs in Illinois. One great benefit of evaluating eight programs with different approaches to resolving the same cases is that it allowed me to uncover program design factors and other variables that promote program success. The three big takeaways from the evaluation are that proper program design is essential, provision of services has an impact on homeowner outcomes, and data is crucial to program improvement. The evaluation was a final look at the eight programs that were funded by the Illinois Attorney General, encompassing up to four years for each program. Seven of the eight programs used relatively uniform data that was collected on the same online case management system. Further, I worked with each program to define the variables used so that we had a clear understanding of the meaning of each variable. This allowed me to develop uniform measures for the programs that enabled comparisons of program performance across them.

First, some basic findings. The eight programs helped 4,766 homeowners, representing 23% of all foreclosure filings in their jurisdictions. They saved 1,100 homes. Once homeowners entered the programs, 21% to 40% saved their homes, depending on the program. More than 90% of homeowners who completed surveys said that they gained a better understanding of their options and how to work with their lenders. Almost all homeowners felt that they were treated fairly and with respect. Most felt that they were able to talk about the issues and concerns that were most important to them and almost all felt the mediator understood what was important to them. Most were satisfied with their experience.

Now to the takeaways. Program design played a significant role in how many homeowners a program was able to help and how many homeowners participated in the program. The two variables are different because most programs helped homeowners to understand their options and the foreclosure process, even if they could not or decided not to participate. Those programs that told homeowners that they must appear for their initial session and provided a date and time for that had significantly higher proportions of homeowners appear and participate than programs that had them contact the program in other ways. And those programs that told homeowners they had to call the program coordinator, provided a deadline to do so and sent additional reminders had significantly higher proportions of homeowners contact the program and participate than those programs that informed the homeowners of the program and told them how to start the process to participate.

Participation rate is very important, not just because higher participation means that more homeowners are helped. The greater the proportion of homeowners facing foreclosure who participate in the program, the greater the proportion of homeowners who save their homes.

Other aspects matter as well. Having the homeowners meet with a representative for their lender from the outset appears to improve program completion rates and possibly improves the probability that participating homeowners save their homes. Within individual programs, those homeowners who worked with a housing counselor are more likely to complete the program. Those who worked with attorneys were much more likely to complete the program. Interestingly, they weren’t more likely to save their homes.

It was very gratifying to see that those programs that made changes based on the data they were collecting and the recommendations from my first evaluation were improved by those changes. For example, the 19th Circuit and 20th Circuit programs made changes to the manner in which homeowners contacted and entered the program, significantly improving participation. The 16thand 19th Circuits worked with mediators to improve their skills, leading to fewer mediator issues and more participants leaving mediation with a good experience.

For a quick take on the evaluation, see the Executive Summary.
To access a digital summary of the evaluation, click here.
For the Full Evaluation, download PDF .

Saving Homes, Building Understanding

Eric Slepak-Cherney, November 29th, 2018

Resolution Systems Institute is proud to share its latest publication, Saving Homes, Building Understanding: An Evaluation of the Eight Foreclosure Mediation Programs Funded by the Illinois Attorney General. This new evaluation looks at four-plus years of data across eight different programs to provide a comprehensive analysis of foreclosure mediation in Illinois, and to highlight how differences in program models impacted outcomes. (more…)

Reflecting on RSI Focus Groups in Washington, DC

Susan M. Yates, March 1st, 2017

Last week I had the honor of accompanying Jennifer Shack, RSI’s remarkable Director of Research, to Washington, DC. Jen is the principal investigator on an RSI evaluation of the child protection mediation program[1] in the DC Courts. I came along to facilitate the focus groups that are part of the evaluation. Each of the focus groups brought together a distinct group of lawyers who participate in mediation regularly: Guardians ad litem, lawyers for parents and prosecutors. The focus groups provided insight into how differing interests shape how mediation is perceived.

I found that my mediation skills, honed over many years, made it easy to shift into the role of focus group facilitator. Asking open-ended questions, encouraging everyone to participate and keeping the conversation moving were all familiar. Unlike mediation, the group didn’t have a goal of reaching agreement and I found that to be kind of liberating! What was more surprising to me was that it was difficult to remove my trainer/teacher “hat.” When a participant made a comment based on a misunderstanding of mediation, I had to resist the urge to engage in a conversation to educate the participant about mediation.

The groups of lawyers came from very different perspectives and often had different goals for mediation. (more…)

Getting the Story Right with Data to Make the Right Decisions

Jennifer Shack, October 20th, 2016

I’m a data geek. I love poring over data and running analyses to see what story unfolds. On the national level, data can tell us the story of our rise as an industrial power and how that changed how people lived and worked. On a local level, it can tell the story of how the closing of a factory affects the fabric of a community and the institutions that bind it. For foreclosure mediation programs, the data can tell the story of how homeowners are affected by changes to the program. Thus, I was eager to find out how changes to the court rules in the 19th Judicial Circuit of Illinois at the beginning of this year would play out. What story would the data tell? (more…)