Resources / Study / Innovation for Court ADR

Just Court ADR

The blog of Resolution Systems Institute

Author Archive

New Resources Help Address Barriers to Diversifying Organization’s Mediator Roster

Stephen Sullivan, October 24th, 2025

RSI recently completed our evaluation of an equity audit implementation project by the Center for Conflict Resolution (CCR) in Chicago. CCR staff, board members and volunteers worked with a consulting partner to uncover barriers preventing their volunteer mediator roster from fully reflecting the diversity of the communities CCR serves. After identifying barriers, they made major changes to how CCR recruits and screens applicants to its Mediator Mentorship Program (MMP), which onboards mediators to volunteer at CCR. RSI evaluated the efficacy of CCR’s implementation and examined initial outcomes of the revamped process. 

Stephen Sullivan
RSI Researcher Stephen Sullivan will join CCR Volunteer Director Israel Putnam and former CCR Executive Director Cassie Lively to discuss this research at a 9 a.m. session Nov. 6 at the Association for Conflict Resolution conference in Philadelphia. Get conference details and register here.

We are excited to share that our evaluation report, Fostering Equity in a Volunteer Mediator Roster: An Evaluation of the Center for Conflict Resolution’s Equity Audit Implementation, is now available on RSI’s website. The report includes our findings from surveying, interviewing and observing staff, board members and volunteers who participated in the project and facilitated CCR’s new applicant screening and recruiting processes. 

In addition to the evaluation, we created a guide for community mediation centers, to help them learn from CCR’s efforts.In A Guide for Enhancing Mediator Roster Equity from Concept to Implementation, we document the strategies CCR staff, board members and volunteers took to address barriers to equity in the MMP. We describe which approaches were most effective and which were less effective, and we provide recommendations for staff at other community mediation centers (CMCs). 

A Guide for Community Mediation Centers

The guide contains step-by-step instructions to help mediation centers adapt CCR’s approaches to addressing barriers that could keep people from a variety of backgrounds from applying and participating fully as CMC mediators. It advises CMCs on how to build alignment among staff and volunteers on a set of equity-related goals; retool application materials to collect more accurate and relevant information about applicants to their programs; and create more effective screening processes to assess applicants’ mediation-related skill sets. 

CCR staff found that their experience with the equity audit and its implementation challenged previously held assumptions about how to best enhance diversity. For example, did you know that using predominantly written application materials might hamper efforts at diversifying mediator rosters? Or that activity-based group interviews might provide more relevant and useful information about applicants’ capacities to be successful mediators than traditional one-on-one interviews? 

In the guide, we explain what CCR staff learned about these issues and describe the creative solutions they devised to address them. One major solution is the Matching Event, CCR’s innovative new format for screening applicants to the MMP.

During a Matching Event, applicants participate in a series of stations involving activities designed to assess specific skills, such as being empathetic and being comfortable with conflict. Stations are facilitated by two CCR “Station Runners” (staff or volunteer mentors), with activities that range from describing the emotions of characters in a movie clip to role playing as parties in conflict. Station Runners use CCR’s newly crafted Matching Event Scorecard to rate the extent to which applicants meet these criteria.

CCR generously permitted RSI to include its Matching Event materials in the guide, so that others can understand how they work in greater detail. We also wrote step-by-step instructions to help CMCs craft their own Matching Events, should that fit their applicant assessment needs. 

Takeaways for CMCs 

RSI had two overarching aims with the evaluation: The first was to assess the successes and challenges involved with the process of implementing the audit recommendations; the second, to evaluate the effectiveness and results of implementation activities, such as staff training sessions and the Matching Events. While the evaluation’s findings and recommendations are geared toward CCR, they have broader implications for other CMCs interested in doing similar work. 

Below is a set of key takeaways for CMCs interested in making the role of community mediator accessible to more of the people with the skills to participate. These takeaways are based on what we learned from conducting the evaluation as well as working with CCR staff, board members and volunteers to create the guide.

A successful audit and implementation project requires collaboration, time and consistent communication. CCR staff, board members and volunteers needed plenty of time to review and reflect on the findings of the audit before they could take action. Collaboration helped to make the process more effective; by bringing different stakeholders together during workshops and meetings, CCR was able to build buy-in and ensure different aspects of the program were addressed. Staff and volunteers also benefited most when they were updated on the project’s progress. 

Meaningful change requires an open mind and flexibility. CCR leadership gave staff and volunteers wide latitude to make changes to program processes. As a result, staff and volunteers felt empowered to address barriers creatively and maintained investment in the project. Many of the barriers were long standing mindsets and processes; permission to make major changes was critical to the project’s success. 

Making processes more flexible does not reduce program rigor. One of the most noteworthy learning lessons for CCR was that a one-size-fits-all approach for participation in the MMP is not a prerequisite to maintaining quality program standards. By introducing flexibility to MMP processes and expanding outreach, CCR was able to create opportunities for volunteer mediators from diverse backgrounds to contribute to the organization while keeping rigorous requirements in place. 

Enhancing pathways to program participation is an ongoing dialogue and process. From the outset, CCR recognized that any changes made to the MMP as a result of this project would need to be revisited as their outcomes became clear. Building broader access to the program is a process; CCR has planned time for staff and volunteers to further reflect and make changes as needed. 

Tools Help Courts Explain ODR to the Public

Stephen Sullivan, May 12th, 2025

RSI has completed the second phase of the ODR Party Engagement (OPEN) Project! We are thrilled to share that our new communication tools to help courts educate self-represented litigants (SRLs) about ODR more effectively are now available. The tools can be accessed on our OPEN Project website.

The tools include RSI’s Model Notice to Defendant of Mandatory ODR, our Model ODR Explainer Video, and desktop and mobile website prototypes that contain our ODR Home Page, our Model ODR Self-Help Guide for Defendants, and our Model Account Registration Webpages.

Our Toolkit for Making ODR Make Sense to the Public provides step-by-step instructions for adapting our models or designing each model type based on our focus group and usability testing research.

OPEN Launch Party Recording
Learn all about RSI’s newest tools for improving court communications in this recording of our OPEN Launch Party webinar.

Designing New Court Communication Models

We partnered with an inclusive designer and an accessibility evaluator to ensure the models were easy to use and understand and accessible to individuals with disabilities. We structured the models around a simple workflow that provides a clear path for parties to follow to learn about and prepare for ODR. Importantly, we also scaffolded information about ODR across the models — we designed them to gradually introduce details about how ODR works, so parties do not feel overwhelmed.

To obtain feedback on the models from individuals similar to those most likely to use them, we conducted usability tests across the U.S. with a diverse set of participants whose backgrounds resembled those of SRLs with low literacy and low digital literacy. The final models reflect this collaborative approach among RSI, our design partner, an accessibility expert and 20 real users.

Usability Testing our Models

Overall, usability test participants found RSI’s OPEN Communication Models to be visually engaging, intuitive to navigate and, importantly, easy to read and understand. We asked participants to rate each of the models for how easy they were to understand; the final versions of the models received an average 4.8/5 rating.

Below are key findings from usability testing:

  • A mobile-first design is essential
    Overwhelmingly, our usability testers shared that they primarily access the internet using their smartphones. It is critical to create materials that are not just mobile-friendly but mobile-first in their design. This finding was further supported by participants’ enthusiasm for mobile-first features, such as the inclusion of a QR code on the Notice to simplify navigation to the website.
  • Testers’ confidence grew
    We found that as participants successfully navigated each model, their expressed confidence, understanding of ODR and sense of ease grew. Participants also demonstrated an interest in learning more about ODR, suggesting that our approach to scaffold information was effective at boosting participants’ engagement with the process.
  • Data privacy and security are top of mind
    Usability test participants responded very positively to our dedicated data privacy and confidentiality section on the model ODR Home Page. Providing concise and specific information about how ODR platforms address data privacy concerns can help alleviate users’ anxieties over these issues, even for those who are most hesitant about using the internet.
  • Simple materials enhance excitement for ODR
    Most of our usability test participants did not have any prior knowledge about ODR and were learning about it for the first time. After going through our materials, testers were not only able to accurately answer our questions about how ODR works, but also expressed their excitement for the prospect of ODR being available in their communities.

Recommendations to Courts

Feedback from our usability testers demonstrates that simple, easy-to-understand communication materials can positively impact parties’ understanding of and interest in ODR. Based on what we learned from usability testers and our work with an inclusive designer and an accessibility evaluator to design effective models, we developed a set of recommendations for courts to ensure that their communication materials can effectively be understood by SRLs. Check out our report, Designing a New Way to Communicate about ODR: Usability Testing Insights, to learn more about these recommendations and our usability test findings. 

Next Up: Support for Using Our Models

RSI is pleased to share that we have begun offering a technical assistance service to help courts and ADR organizations to enhance their communication materials about ADR programs. Contact us to learn more about the different ways we can help you communicate more effectively.

We are extremely grateful for the American Arbitration Association-International Centre for Dispute Resolution Foundation’s support for the OPEN Project and the dissemination of its findings.

‘I Think My 10-Year-Old Can Do This’: RSI’s Model ODR Communications Are User Tested

Stephen Sullivan, October 23rd, 2024

RSI recently completed user testing research for the ODR Party Engagement (OPEN) Project! We are excited to share insights from our experience conducting the testing and what we learned from participants about our model court communication materials.

User Test Study

As part of the OPEN Project Phase 2, RSI developed prototype materials — a webpage, a notice document, an informational video and an interactive guide — to help courts communicate more effectively about online dispute resolution (ODR). We worked with an inclusive designer to create materials that exemplify best practices based on designer expertise, OPEN Phase 1 findings and previous research. To ensure these materials were accessible and user-friendly, we planned a series of user tests to obtain feedback from actual users whose backgrounds resemble those of self-represented litigants.

Over the past two months, the RSI research team conducted user tests across the country. We recruited a total of 15 demographically diverse participants from distinct areas: a rural town in New Hampshire; Baltimore, MD; and the Santa Fe-Española area of New Mexico. Participants were instructed to use the materials to complete relevant tasks: read about ODR, watch the informational video, prepare for ODR as a defendant, and sign up for an account. While they tested the materials, RSI researchers observed and took notes on their behavior, listened to their thought process, and asked follow-up questions. We also disseminated post-test surveys and conducted semi-structured interviews about their experience with the materials.

Read more background on the ODR Party Engagement (OPEN) Project, from concept, to focus group feedback, to creation of tools for courts, in RSI’s earlier blog posts.

Real World Feedback

Feedback from the user tests helped us to identify strengths and weaknesses in each of the materials. Users overwhelmingly praised our video for its clarity, engaging visuals, concise discussion about ODR and appropriate length; the video averaged a 4.73/5 rating for how easily it was understood.

The sessions highlighted the importance of accessible visual design. Participants missed some of the information on our webpages because they lacked sufficiently visible indicators for clickable or interactive content. Higher saturated colors, consistent blue hyperlinked text and plus signs are some of the fixes we will implement in new versions of the webpages.

User testing also provides a beneficial opportunity for users to share their own creative ideas for improving the materials. During the sessions, these ideas encompassed: making the account login interface more accessible, identifying when repetitive information was useful or distracting, and enhancing the perceived trustworthiness of our notice document.

Participants were excited about the prospect of ODR being available to them. The relative ease of their testing experience only amplified this excitement; participants shared frustration with previous instances trying to navigate difficult-to-use court materials. In contrast, they found our materials to be simple to follow and understand, a sentiment shared even among those who were hesitant to use digital technologies generally. Describing the account creation pages, one participant in New Hampshire noted, “Yes, [I would feel confident helping a friend sign up for ODR using this system]. It’s really easy to use. I think my 10-year-old can do this.”

We will next return to our design partners to implement the feedback we received from user testers. RSI is grateful for the participants’ generosity and excitement for the project. We are planning to conduct one more round of user testing once the revised materials are completed to ensure any lingering issues are addressed before making the final models available for courts. RSI is also grateful to the American Arbitration Association-International Centre for Dispute Resolution (AAA-ICDR) Foundation for its funding of the OPEN Project.

How Can Community Mediation Centers Successfully Diversify Their Rosters?

Stephen Sullivan, August 7th, 2024

Community mediation centers have long recognized that parties feel seen and benefit from working with mediators who are from diverse backgrounds. Despite this, they have found it difficult to develop mediator rosters that reflect the communities they serve. The Center for Conflict Resolution (CCR) in Chicago is undertaking an innovative project to address this issue. The staff of CCR has engaged RSI to develop a guide to support other community mediation center staff in their efforts to increase equity in their mediator rosters, and to assess their implementation outcomes. Funding for this project has been generously provided by the American Arbitration Association-International Centre for Dispute Resolution Foundation (AAA-ICDR) Foundation. 

Ongoing DEI Assessment 

The Center for Conflict Resolution in Chicago has engaged RSI to create a guide to help community mediation centers diversify their mediator rosters.
RDNE Stock Project via Pexels

Over the past year, CCR has been working with an external diversity, equity and inclusion (DEI) partner to audit its mediator mentorship program (MMP). The MMP is an intensive, three-month training program that prepares participants to meet CCR’s performance-based evaluation standard. Participants then provide a minimum 18 months of mediation services through CCR’s programs. CCR’s primary goals are to increase the demographic diversity and inclusivity of its recruitment, selection, training and retention processes. Meeting these goals has required a comprehensive and holistic retooling of the program. For example, CCR staff are experimenting with new models for meeting program requirements, establishing new communication practices, and creating ways to accommodate different types of mediation skill sets. Measuring the success of these changes is critical; CCR is also developing new survey instruments and tools to determine impact.

RSI is assessing CCR’s progress in meeting its DEI goals, to document lessons learned and share what CCR staff would recommend to other organizations.  

Project Outcomes

RSI will communicate findings from our assessment of CCR’s efforts in two main ways: 1) a guide for community mediation centers, and 2) an evaluation report.

Through interviews with key CCR staff, review of audit documents, and analysis of demographic data, RSI will create a reference guide for community mediation centers to learn from CCR’s approach. The guide will include instructions and templates for engagement techniques, methods for measuring demographic data, and forms for screening and interviewing. Along with these materials, we will discuss how CCR staff members implemented changes and addressed challenges.

Our collaboration will also culminate in a final evaluation report, which will focus on insights from CCR’s new survey instruments. RSI will analyze survey data to determine which areas of the retooled program saw the most success and which areas require further refinement. Both the guide and the report will be disseminated widely, through CCR’s website, RSI’s website, the National Association for Community Mediation’s virtual library, conference presentations and social media. Ultimately, our goals are to understand existing exclusionary practices or biases within mediator programs and break down barriers to diversity, equity and inclusion in mediation practice.

We plan to share the guide for community mediation centers and our CCR evaluation in mid-2025. Follow RSI’s blog, newsletter and social media for the latest updates.

Verified by ExactMetrics