Are We Making a Difference?

Preface - Melanie Greenberg How Do We Measure Peace? Whose Peace Are We Measuring? Introduction - Stacey L. Connaughton and Jasmine R. Linabary Interrogating “Peacebuilding Effectiveness” Defining Peacebuilding Understanding Peacebuilding “Effectiveness” Our Approach What is Effectiveness? Effectiveness for Whom? Lessons Learned Arguments and Innovations Conclusion References Section I: What is Effectiveness? Effectiveness for Whom? Chapter 1: The Greatest Myth of Peacebuilding Ineffectiveness - Jason Quinn Abstract Tracing the Origins of the Myth Measuring the Effectiveness of Final Peace Agreements Full Agreements (Uppsala Conflict Data Program) AbrogationArmed Conflict RecurrenceComprehensive Peace Agreements (Peace Accord Matrix Project) AbrogationArmed Conflict RecurrenceKreutz’s Conflict Termination Dataset What Lessons Can We Learn from the Myth of Peace Agreement Ineffectiveness? Future Directions Lessons Learned Reflection Questions References Chapter 2: An Ecofeminist Approach to Peacebuilding Effectiveness: An Example from Colombia's Peace Process - Soledad Granada Effectiveness of Peacebuilding from an Ecofeminist Perspective: Tools and Concepts Peacebuilding Effectiveness in Colombia from an Ecofeminist Perspective Social Organization: Intersection of the Social Movement around Peace Dealing with the Past and Working for the Future: Historical Memory and Legal Activism Improving Human-Nature Relationships: The Development and Security Nexus Conclusions Lessons Learned Reflection Questions References Chapter 3: A Socio-Economic Approach to Reducing Violence Against Women and Girls in Rural Tajikistan - Stuart Moir and Elizabeth Laruni Abstract Peacebuilding and SGBV Living In Dignity: An Effective Approach to Reducing SGBV Committed Within the Family the Project The Importance of Evidence in Designing an Effective Intervention The ZS Methodology The Results Lessons Learned Reflection Questions References Chapter 4: Whose Peace? Prioritizing Local Perspectives to Inform our Understanding of Peacebuilding Effectiveness - Megan Renoir, Scarlett Kassimatis, Alice Coulibaly, and Dimitri Kotsiras Abstract Best Practice in Defining Peacebuilding Effectiveness Reimagining Peacebuilding Effectiveness From Peace Writ Little to Peace Writ Large: Foundation Chirezi Conclusion Lessons Learned Reflection Questions References Chapter 5: Locally Useful Evidence: Re-Centering Knowledge Creation for Local Peace Work - Michael Sweigart, Kristina Hook, Margarita Tadevosyan, and Susan H. Allen Abstract Making Sense of Existing Literature Methodological Approach Power Imbalance in Shaping the Peacebuilding Evidence Base Disconnect Between Donors’ Requirements and Local Priorities on Evaluation Emphasis on the Value of Qualitative Data Contextual Knowledge and Sensitivity Promotion of Local Thematic Expertise Applied Implications for Convening Organizations Future Research Directions Lessons Learned Reflection Questions References Chapter 6: Are Peacebuilding Evaluators Making a Difference? Towards a Meta-Evaluative Agenda for Research on Peacebuilding Evaluation - Zach Tilton Abstract Background Key Concepts Defined Why Meta-Evaluative Research on Peacebuilding Evaluation? Research on Evaluation Conceptual Frameworks Toward an Agenda for Research on Peacebuilding Evaluation Peacebuilding Evaluation Theory Peacebuilding Evaluation Practice Peacebuilding Evaluation Consequences Conclusion Lessons Learned Reflection Questions References Section II: Lessons Learned Chapter 7: Illustrating Intended and Unintended Consequences of Peacebuilding in Locally Led Peacebuilding: The Role of Focus Group Methods in Participatory Evaluation - Meghana Rawat and Tiwalade Adekunle Abstract Participatory Approaches to Evaluation in Peacebuilding The Case of the Purdue Peace Project 2016: Pre-Election Focus Groups Fear of Poverty Due to ViolenceFear of Domestic Despair Due to ViolenceConcern about Illegal Voting and MisinformationConcern about the Changing Sociocultural Fabric of the Community2017: Post-Election Focus Groups Improvement in Household PeaceImprovement in Election PracticesImprovement in Community RelationshipsConclusion Lessons Learned Reflection Questions References Chapter 8: Assessing Peacebuilding Effectiveness: The Carter Center in Sudan and Uganda - Michael Papa Abstract Objectives of the Principals: TCC, Uganda, and Sudan Data Analysis Successes of TCC’s Peacebuilding Activities Restoration of Diplomatic Relations Trade Relations Repatriating Abducted Children, Prisoners of War, IDPs, and Refugees Guinea Worm Disease Eradication Ending Civil War in Sudan Failures of TCC’s Peacebuilding Activities Violent Sudanese-Ugandan Offensive Operations against the LRA Emergence of Civil War in Darfur Evaluation of Peacebuilding Effectiveness Lessons Learned Expectations of Conflicting Parties Involving All Key Players in Negotiations International Mediators Teaming up with Locals Conclusion Reflection Questions References Chapter 9: Post-Conflict Rehabilitation of Ex-Combatants: Assessing Effectiveness of Rehabilitation Programs in Nepal and District Swat, Pakistan, and Nepal - Ilam Khan and Bijaya Dahal Abstract Rehabilitation Program in Swat, Pakistan Sketching Out the Rehabilitation Centers in Swat Understanding the Process of Rehabilitation Post-Rehabilitation Assessment Rehabilitation and Reintegration Program in Nepal Challenges of Social Integration Conclusion Lessons Learned Reflection Questions References Chapter 10: Is Peacebuilding Education Making a Difference? Peace Education Interventions and their Impact in Lebanon - Caroline Brooks, Fadi Hallisso, and Ruth Simpson Abstract What Is Peace Education? Basmeh and Zeitooneh’s Approach to Peace Education Evaluation Techniques Context Overview TripoliShatila CampBekkaEvaluation Findings Evaluation FindingsSustainable Outcomes Are Difficult to Identify Because of the Short Timeframe of Implementation and Limited Longer-Term Follow-up with ParticipantsThere is Some Evidence of the Peacebuilding Impact on the Wider Community, but it is Limited Compared to Individual ImpactCritical Reflections on Peace Education Programming Lessons Learned Reflection Questions References Chapter 11: Woman, You Are Not Alone! An Effective Approach to Address Violence Against Women - Isabel Aguilar Umaña and Rick Jones Abstract The Social Dimensions of VAW Woman, You Are Not Alone! Women’s Self Help Groups Methodology-Evidence Reduced Physical, Emotional, and Sexual Violence Well-being Relationships Methodologies Effectiveness Conclusions Lessons Learned Reflection Questions References Chapter 12: The Challenges of Assessing Peacebuilding in Pakistan - Zahid Shahab Ahmed and Khan Zeb Abstract Theorizing Peacebuilding and Effectiveness The Need for Peacebuilding in Pakistan Results and Discussion The Access Issue Methodological Issues Time Limitations Ethical Dilemmas Funding Theory of Change Conclusion Lessons Learned Reflection Questions References Chapter 13: Coordination for Effective Peacebuilding: One NGO's Approach - Marcel Arsenault and Conor Seyle Abstract What Do We Know about Peacebuilding? Recognized But Not Materialized What Can NGO Do about This? OEF’s Model What Lessons Might There Be for the Larger System? Lessons Learned Reflection Questions References Chapter 14: Are We Making a Difference or Doing Harm? Practical Strategies for Assessing Peacebuilding Effectiveness to Drive Adaptation and Improvement - Tanya Ansahta Garnett and Camila Linneman Abstract What Is the CLA Framework? How Is the CLA Framework Useful for Evaluating Peacebuilding? CLA in Action: Case Study Examples Investing in National Discourse on Post-Conflict Development Priorities in Liberia Re-Envisioning Who Sets the Development Agenda in Uganda Rapid, Cost-Friendly, and Collaborative Evaluation Strategies in Liberia Learning and Adapting to Build Resilience in South Sudan Infusing “Do No Harm” Principles in Interventions in Liberia Conclusion Lessons Learned Reflection Questions References Section III: Arguments and Innovations Chapter 15: Using Event Data to Address Positive Bias in Evaluations - Steve Sheamer, Alexa Courtney, and Jenna J. Lindeke Abstract Data Challenges Data Availability Perceptions of Peace Versus Levels of Violence Proposed Approach Political Event Data Methods Measuring Effectiveness with Political Event DataResults and Discussion Contextual ApplicationsImplications 1. Program Suitability 2. Geographic Specificity 3. Key Metrics 4. Mixed-Methods 5. Building Evidence Future Directions Lessons Learned Reflection Questions References Chapter 16: The Most Significant Change Approach for Evaluating Peace Impacts - Maureen Taylor Abstract Background on the Most Significant Change (MSC) Approach How to Implement MSC Step 1: Raising Interest and Gaining Buy-in Step 2: Defining Domains of Change Step 3: Defining the Reporting Period Step 4: Collecting MSC Stories Step 5: Selecting the Most Significant of the Stories Step 6: Feeding Back the Results of the Selection Process Step 7: Verification of Stories Step 8: Quantification Step 9: Secondary Analysis and Meta-Monitoring Step 10: Revising the System Application of MSC to Peacebuilding in Liberia Lessons Learned and Best Practices Reflection Questions References Chapter 17: The Delphi Method as a Tool in Peacebuilding Assessment - Michael L. Kent Abstract History and Background of the Delphi Method The Delphi Method as a Peacebuilding Tool Overview of the Delphi Methodology Repeated Iterations Selecting Participants Inviting Participants Critical Points and Potential Pitfalls Methodological Complications Step-by-Step Instructions for Conducting a Delphi Study Preliminary Preparation Conclusion Lessons Learned Reflection Questions References Chapter 18: Participatory Action Research: Mutual Inquiry for Effective Local Peacebuilding - Thomas Hill, Katerina Siira, and Nicole Stoumen Abstract The Importance of Participatory Action Research Locally Led Peacebuilding: Participatory Action Research Case Studies in Libya and Colombia Libya Colombia Conclusion Lessons Learned Reflection Questions References Chapter 19: Gauging Harmony: Applying the Social Cohesion Barometer to Assess and Advance Peacebuilding - Bob Groelsema and Nell Bolton Abstract Social Cohesion as Construct, Aspiration and Lived Reality Origins and Composition of the Mini-Social Cohesion Barometer Origins Composition Applications of the Barometer The Barometer as a Baseline and Endline Indicator in CAR The Barometer as a Tool for Context Analysis in the Lake Chad Basin Discussion and Lessons Lessons Learned Reflection Questions References Chapter 20: From Education to Peacebuilding: Exploring the Role of Networks in Peacebuilding Work - Allyson Bachta, Karen Ross, and Jeffrey Pugh Abstract What We Know Our Project The Potential of Social Networks Case 1: Regional Institute on Nonviolent Action in the Americas, Ecuador Case 2: Jewish-Palestinian Encounter Participation, Israel Conclusions Lessons Learned Reflection Questions References Chapter 21: To Help Measure Peace, Measure Health - Yara M. Asi Abstract Health and Peace Health and Peace When Health Becomes a Target: The Case of Syria Watching a Society Recover: Health in Rwanda The Benefits of Measuring Peace with Health Which Health Measures Best Reflect Peace? Which Health Measures Best Reflect Peace? Conclusion Lessons Learned Reflection Questions References Chapter 22: A Global Framework to Measure Peace - Adrienne Lemon Abstract Creating Better Evidence on Peace An Inclusive Way to Understand Impact A Global Framework for Understanding Peace and Conflict: Three Pillars Lived Experience What is this Pillar?Why Does it Matter?Aligned Measures for Peace What Is This Pillar?Why Does It Matter?Shared Reflection and Adaptation What Is This Pillar?Why Does It Matter?The Cases: Piloting the Framework Practitioner Teams: Lessons from Africa, the Middle East, and Central Asia Setting up Systems: Resources to Make Measuring Peace Accessible A Vision for Better Evidence Aligning our Field without Constraining It Shifting the Paradox of Power and Authority in Peace Measurement Putting the Global Impact Framework to Use Lessons Learned Reflection Questions References Conclusion: Peacebuilding Effectiveness: The What, Who, How, and Why It All Matters - Stacey L. Connaughton and Jasmine R. Linabary Key Reflections: Questions on Peacebuilding Effectiveness What is “Effectiveness” in Peacebuilding? Is Effectiveness the Absence of Violence or the Presence of Positive Relations? Both? Is it about Effectiveness in the Short Term or the Longer Term? Are We Seeking Program-Level Change or Contributing to Peace Writ Large? Who Gets to Decide What Effectiveness Means? Who Is It For? Who Gets to Decide What Effectiveness Means? Who Is It For? How Do We Know We Have Achieved Peacebuilding Effectiveness? What Evidence Has Value? What is Practical and Ethical to Collect? Lessons Learned Embrace a Both/And Mentality on Peacebuilding Effectiveness Adopt Both Structure and Flexibility When Assessing Peacebuilding Effectiveness Ask the “Who” Questions and Interrogate Power Dynamics Limitations and Future Directions Conclusion References Appendix A Appendix B: Materials shared with IREX Partners at the MSC Workshop Step 1: Generating the Most Significant Change Stories Step 2: Selecting and Documenting the Best Stories to Represent Your Organization’s Impact Step 3: Submit the Stories to IREX Appendix C: Template for Story Submission Appendix D: Global Impact Framework Diagram Step 1: Design for Impact Step 2: Create a Learning Loop Step 3: Adapt Strategies to Transform Conflict Step 4: Share and Repeat Index About the Editors About the Contributors