What is REM?
REM is a participatory group method for evaluating the impact of complex programs or collaboratives. The method engages program and community stakeholders to retrospectively and visually map the "performance story" (Mayne, 1999) resulting from a program or complex collaboration. The REM process combines elements of Appreciative Inquiry, mind mapping, group interviewing, and qualitative data analysis.
REM is not only a powerful tool for documenting both the intended and the unintended results of a program or collaborative, but a way to engage and re-energize community members around shared goals.
What does REM take?Because of its group participatory nature, conducting a Ripple Effects Mapping evaluation requires a combination of facilitation and evaluation skills. Session facilitators must have strong skills for engaging the group in meaningful discussion, creating open communication, and organizing time.
At the same time, the facilitators must use evaluation research skills such as group interviewing and analyzing qualitative data "on the fly," engaging the participants in the process of generating and refining thematic categories, and discovering causal pathways among the "ripples" or effects they report. Finally, it is helpful for session facilitators to have strong technology and typing skills to make the most effective use of the mind mapping software possible.
Is REM the right tool for me?REM is just one evaluation tool that should be combined with other program evaluation methods. Typically, a REM evaluation is most appropriate when the program or intervention is complex and involves a wide range of participants and stakeholders. Questions to ask include:
- Are there likely both intended and unintended effects?
- Is the intervention something people can attribute influence to, or at least identify contributions made?
- Do people already talk about the "ripples" from the intervention?
REM originsREM was used to conduct an impact analysis of the Horizons program, an 18-month community-based program delivered to strengthen leadership to reduce poverty. The method (Kollock, 2011) was piloted in Washington, Idaho and North Dakota Horizons communities to illustrate outcomes of the program over time. While there were minor process variations in each state, the REM technique in all three states utilized maps to illustrate to community members what was accomplished, as well as further their enthusiasm for taking action on issues.
- Darger, M. (2014). Capturing the ripples from community-driven business retention and expansion programs. Journal of Extension, 52(2). Retrieved from http://www.joe.org/joe/2014april/tt6.php
- Hansen Kollock, D.A., Flage, L., Chazdon, S., Paine, N., & Higgins, L. (2012). Ripple effect mapping: A "radiant" way to capture program impacts. Journal of Extension, 50(5). Retrieved from http://www.joe.org/joe/2012october/tt6.php
- Kollock, D. A. (2011). Ripple effects mapping for evaluation. Pullman, WA: Washington State University Extension. Retrieved from http://extension.wsu.edu/stevens/wp-content/uploads/sites/19/2013/12/REM.Complete.pdf
- Baker, B., Calvert, M., Emery, M., Enfield, R., & Williams, B. (2011). Mapping the impact of youth on community development: What are we learning? [PowerPoint slides]. Retrieved from http://ncrcrd.msu.edu/uploads/files/Mapping%20Impact%20of%20Youth%20on%20Com%20Dev%2012-3-10.pdf
- Buzan, T. (2003) The mind map book. London: BBC Books.
- Douthwaite, B., Alvarez, S., Thiele, G., & MacKay, R. (2008). Participatory impact pathways analysis: A practical method for project planning and evaluation (ILAC Brief 17). Retrieved from http://boru.pbworks.com/f/ILAC_Brief17_PIPA.pdf
- Emery, M., & Flora, C.B. (2006). Spiraling-up: Mapping community transformation with community capitals framework. Community Development: Journal of the Community Development Society, 37(1), 19-35.
- Eppler, M.J. (2006). A comparison between concept maps, mind maps, conceptual diagrams, and visual metaphors as complementary tools for knowledge construction and sharing. Information Visualization, 5,202-210.
- Hearn, S. (2010). Introduction to outcome mapping. Retrieved from http://www.outcomemapping.ca, Outcome Mapping Learning Community.
- Preskill, H., & Catsambas, T.T. (2006). Reframing evaluation through appreciative inquiry. Thousand Oaks, CA: Sage Publications.