The James Irvine Foundation Expanding opportunity for the people of California
Evaluation » Tools and Resources »

In this Section

Evaluation: Tools and Resources  

Overview
Our Approach
Program Evaluations
Foundation-wide Assessment
Tools and Resources

Irvine seeks to promote the effective use of evaluative techniques by nonprofits and other foundations by increasing access to evaluation tools and other resources.

 

Click to go directly to: Publications
Professional organizations
Online tools and resources

Publications

From Insight to Action: New Directions in Foundation Evaluation (2007)
There is growing interest in using evaluation as part of a feedback loop to adjust and correct program design in the middle of an ongoing program or initiative. This report by FSG Social Impact Advisors draws on discussions among members of the Evaluation Roundtable to highlight the ways that evaluation work is moving beyond the traditional goals of measuring results and impact. The report also presents several brief case studies of evaluation practices at some innovative foundations.
Click here for the report.

Evaluation As A Pathway to Learning: Current Topics in Evaluation for Grantmakers (2005)
This report, sponsored by Grantmakers for Effective Organizations, identifies ways that evaluation is increasing foundation and grantee effectiveness by providing timely information and actionable insights. The trends are based on nearly 100 interviews with foundation leaders and evaluators. Examples and case studies help to provide clear guidance for grantmakers looking to incorporate evaluation into the work of their foundation.
Click here for the report.

A Funder's Guide to Evaluation: Leveraging Evaluation to Improve Nonprofit Effectiveness (2005)
Traditionally, funders expect evaluation to show that resources are being used wisely. But evaluation can be a much more powerful tool — for both funders and nonprofits. Written by Peter York of the TCC Group, this funder’s guide, co-published by Grantmakers for Effective Organizations and the Fieldstone Alliance, promotes the concept of using evaluation as an organizational capacity-building tool. It includes examples and suggestions of ways grantmakers can partner with grantees for evaluation learning.
Click here for ordering information.

W.K. Kellogg Foundation Evaluation Handbook/Logic Model Development Guide CD (2005)
The W.K. Kellogg Foundation Evaluation Handbook is guided by the belief that evaluation should be supportive and responsive to projects, rather than become an end in itself. It provides a framework for thinking about evaluation as a relevant and useful program tool. The Logic Model Development Guide provides practical assistance to nonprofits engaging in logic modeling. Both of these products are written primarily for project directors who have direct responsibility for the ongoing evaluation projects. The handbook and logic model guide are available through the Kellogg Foundation’s Web site.

Marketing Your Knowledge: A Report of Philanthropy’s R&D Organizations (2003)
Philanthropic organizations struggle to get their knowledge used because they rely on the traditional "dissemination" model: creating knowledge, identifying potential recipients and sending it to them. This report, written by the Williams Group, proposes a "knowledge marketing" approach and identifies 10 effective practices. Knowledge marketers focus on knowledge demand rather than supply, seek informed action rather than information access, and employ a long-term, ongoing process rather than one-time products.
Download (PDF, 109 KB)

A Participatory Model for Evaluating Social Programs (2002)
Written by a team from UCLA's School of Public Policy and Social Research, this report describes a unique approach to evaluation that is gaining momentum in the nonprofit sector. The approach emphasizes client participation in every aspect of the evaluation process. In addition, it focuses on program implementation. Too often, and especially in evaluations of less-established programs, nonprofit executives or funders err in rushing to assess results when the focus should really be on solid program design and sound implementation. An evaluation of how a program is being implemented can produce information to pinpoint problems early on to improve program operations and results. Part case study and part instruction guide, this report is intended for use by nonprofits, foundations and professional evaluators alike.
Download (PDF, 94 KB)

"Shall We Dance: Program Evaluation Meets Organizational Development in the Nonprofit Sector" (2002)
First published in OD Practitioner, The Journal of the Organizational Development Network, this article provides guidance about how to integrate tenets of organizational development into foundation evaluation work. This approach is viewed as an important process for creating dynamic and self-renewing organizations.
Download (PDF, 113 KB)

When and How to Use External Evaluators (2002)
External evaluators are increasingly being used to help foundation staff set program goals, identify lessons, make midcourse adjustments and measure program effectiveness. Success, however, relies in part upon how well framed the consulting engagement is, and whether the consultant is a good match for the project. These materials should serve as a resource to program officers who may be new to evaluation to inform decisions about their allocation of resources and the use of external consultants for program evaluations. Includes a glossary of evaluation terminology.
Download (PDF, 462 KB)

Evaluation Terminology (2002)
A glossary of evaluation terminology, including descriptions of various types of evaluation.
Download (PDF, 80 KB)

Creating a Culture of Inquiry: Changing Methods — and Minds — On the Use of Evaluation in Nonprofit Organizations (2001)
This report describes the results of the Working on Workforce Development (WOW) Project, a four-year Irvine initiative to help nonprofit organizations use the tool of evaluation. The results provide valuable lessons for funders, evaluators, consultants, and others interested in organizational development and evaluation capacity-building. Written by consultants Georgiana Hernández and Mary G. Visher, the report describes how the project’s success had less to do with whether measurement systems were developed and more to do with whether the organizations were able to create a culture that valued the process of self-evaluation. The report reflects on these lessons and makes recommendations for how others embarking on this path might achieve the best results.
Download (PDF, 236 KB)

Utilization-Focused Evaluation: The New Century Text, Third Edition (1996)
Written by Michael Quinn Patton, this book offers a theoretical and practical orientation to evaluation and addresses the full range of evaluation issues, including identifying primary users of an evaluation, focusing the evaluation, making methods decisions, analyzing data, and presenting findings. Each chapter contains a review of the relevant literature and case examples to illustrate major points.
Click here for ordering information.

 

Professional organizations

Grantmakers for Effective Organizations (GEO) is a coalition of 1,200 grantmakers from 300 foundations committed to building strong and effective nonprofit organizations. GEO’s mission is to maximize philanthropy’s impact by advancing the effectiveness of grantmakers and their grantees. The organization does this by commissioning and contributing to research, developing programs and products, and building a community of practice that expands the resources available on nonprofit effectiveness. The GEO Web site contains a host of resources and links for grantmakers.

The American Evaluation Association (AEA) is an international professional association of evaluators devoted to the application and exploration of program evaluation, personnel evaluation, technology and many other forms of evaluation. The AEA defines evaluation as a process that involves assessing the strengths and weaknesses of programs, policies, personnel, products and organizations to improve their effectiveness. Their Web site contains numerous resources and information about the organization, membership, trainings, publications and their annual meeting.

 

Online tools and resources

The Harvard Family Research Project produces a quarterly evaluation periodical, The Evaluation Exchange. Articles are written by the most prominent evaluators in the field and address current issues facing program evaluators of all levels. The Evaluation Exchange highlights innovative methods and approaches to evaluation, emerging trends in evaluation practice, and practical applications of evaluation theory. It goes out to its subscribers free of charge four times per year.

Innovation Network (InnoNet) provides program planning and evaluation consulting, workshop-based training and online tools to nonprofits and funders. InnoNet's philosophy is that ongoing program evaluation is the most powerful and underused tool for enhancing the ability of nonprofits to create lasting change in their communities.

Online Evaluation Resource Library (OERL) was developed for professionals seeking to design, conduct, document or review project evaluations. OERL provides a large collection of plans, reports and instruments from past and current project evaluations; guidelines for how to improve evaluation design and practice; and a discussion forum for stimulating ongoing dialogue in the evaluation community.

Outcome Measurement Resource Network is a program of the United Way of America. The Resource Network is an online resource library that offers information, downloadable documents and links to resources related to the identification and measurement of
program- and community-level outcomes.

Note: This list of evaluation resources is intended for informational purposes only. Inclusion does not constitute endorsement by The James Irvine Foundation.

top of page