Photo: Diana Light

What are the three types of evaluation measures?

The three main types of evaluation methods are goal-based, process-based and outcomes-based.

fundingforgood.org - What are Evaluation Methods? - Funding for Good

Does chemo help stage 4 prostate cancer?

If your cancer has spread beyond your prostate to other areas of your body, your doctor may recommend: Chemotherapy. Chemotherapy can slow the...

Last updated Mar 31, 2019

Do doctors know how long you have left to live?

This probably goes without saying, but: Doctors don't know when you're going to die. I've had patients with a prognosis of six months to live who...

Last updated Feb 11, 2022

Promotion

Evaluation methods are the criteria for evaluating the success of a program or project. Evaluation methods are a critical tool for nonprofit organizations and businesses alike. When designed well, an evaluation provides staff, board members, and donors with a clear assessment of whether your organization is achieving its goals and objectives. In this article, we will define evaluation, answer frequently asked questions, provide guidance on designing an effective evaluation plan, and offer insights into the evaluation tools you should consider when designing your projects and programs.

What is an Evaluation?

Before developing your evaluation plan, it’s important to define both what evaluations are and how you intend to use them. We define evaluation as a process to measure the demonstrable effect of an intervention, for example the activities carried out as part of a project or program. Evaluations are a powerful tool to document and communicate the impact of your organization’s work. Like any good strategy, understanding your goals in undertaking an evaluation will help ensure you select the appropriate evaluation methods for your program or project.

Program vs Project: How they are different and why it matters

What are Evaluation Methods?

The three main types of evaluation methods are goal-based, process-based and outcomes-based. Goal-based evaluations measure if objectives have been achieved (We highly recommend S.M.A.R.T. Goals). Process-based evaluations analyze strengths and weaknesses. Outcomes-based evaluations examine broader impacts and often investigate what greater good was served as a result of the program or project.

Some things to consider when selecting evaluation methods are:

How will you utilize the evaluation? For example, will evaluation results inform internal strategies or will you primarily use results to communicate to external stakeholders? We recommend selecting evaluation methods that allow you to do both.

For example, will evaluation results inform internal strategies or will you primarily use results to communicate to external stakeholders? We recommend selecting evaluation methods that allow you to do both. What information will you need to make decisions based on evaluation results? For example, will your evaluation method need to capture the breadth of your project’s reach (such as number of people reached with information and resources), the depth of its effects (such as the impact on participants based on your intervention), or both?

For example, will your evaluation method need to capture the breadth of your project’s reach (such as number of people reached with information and resources), the depth of its effects (such as the impact on participants based on your intervention), or both? What information can feasibly be collected and analyzed? Not all information will be available. For example, if you are attempting to increase access to and utilization of healthy food in your community, you may be able to track broad trends of food availability in a specific geography and self-reported shopping behaviors of a subset of individuals. But you may not be able to quantify how many households changed their food shopping behavior pre- and post-intervention.

Not all information will be available. For example, if you are attempting to increase access to and utilization of healthy food in your community, you may be able to track broad trends of food availability in a specific geography and self-reported shopping behaviors of a subset of individuals. But you may not be able to quantify how many households changed their food shopping behavior pre- and post-intervention. How accurate will the information be? For example, if you are considering pre- and post-intervention surveys, will behavioral changes be self-reported or will you be analyzing participants’ knowledge on a particular topic?

For example, if you are considering pre- and post-intervention surveys, will behavioral changes be self-reported or will you be analyzing participants’ knowledge on a particular topic? Will the information be credible to top donors or management? You will want to consider the type of evaluation methods that your peers are using. For example, if you are an advocacy organization looking to create policy change, how can you show impact over a 6-12 month period when policy changes generally happen over a much longer, multi-year timeline?

What is an Evaluation Plan?

Once you have identified the purpose of your evaluation, it’s time to create an evaluation plan.

At Funding for Good, we define an evaluation plan as:

A written document that outlines the types of interventions you will undertake, the outcomes you hope to achieve, the criteria used to evaluate success, and the evaluation methods you intend to utilize.

A comprehensive evaluation plan should also detail:

Methods you will use to collect and monitor data for your evaluation (including who will be responsible for data collection) and monitor data for your evaluation (including who will be responsible for data collection) Methods you will use to analyze the evaluation information you collected the evaluation information you collected When the evaluation will be conducted (will you conduct evaluations quarterly, annually, or at project milestones)

Who will be conducting the evaluation (especially their qualifications and credentials)

Does coffee affect the prostate?

One to 3 cups a day can lower your odds of aggressive prostate cancer by nearly a third -- no matter what your health condition is. If you have or...

Last updated Jul 17, 2019

What mental issues do men face?

Men can experience a wide range of mental health conditions, but some common ones include: depression. generalized anxiety disorder. social anxiety...

Last updated Mar 18, 2022

Imagine Your Moment Of Freedom!

Fluxactive Complete is conveniently packed with over 14 essential prostate powerhouse herbs, vitamins and grade A nutrients which work synergistically to help you support a healthy prostate faster

Learn More »

Promotion

How and to whom you will disseminate the results of the evaluation

As you write your evaluation plan, it’s also important to ensure that internal stakeholders bring the right mindset. Evaluation is about being open to continuing feedback and adjusting your programs accordingly. That means your team must be willing to engage in collective learning–and be open to an honest assessment for programs and projects, including those that fail to demonstrate the level of desired impact.

Potential Evaluation Methods

Funding for Good has worked with hundreds of organizations to design programs, develop effective evaluation plans, and communicate both plans and results to donors and other stakeholders.

Some of the most common evaluation methods organizations use include:

Testing

Pre and Post Test

Test Against Control Groups

Participation

Attendance

Completion

Certificates

Follow-On Tracking

Data Collection

Surveys

Questionnaires

Interviews

Checklists

Feedback forms

Financial Reports

Cost to budget

Cost per unit of service

On time on budget

Performance

Grades

Graduation

Drop in recidivism

Job placement

Permits, inspections, certifications

Subjective (Qualitative)

Journals

Testimonials

Observations

Clippings

Strengthen Your Evaluation with Strategic Planning

When designing a new project or program, it’s important to consult your organization’s strategic plan. We define a strategic plan as: A roadmap for where an organization is going, how it will get there, and specific ways to determine if you have “arrived” at the destination. Your strategic plan will outline your organization’s goals, objectives, strategies, and programs over a 3-5 year period. Using your strategic plan as a planning tool, you can ensure that any new project and program is aligned with your overall goals, will be able to garner strong internal investment from board and staff, and that your organization has the current resources and capacity to sustain the new work. Your strategic plan will also be grounded in measurable objectives which can be used as a resource in creating your project or program evaluation plan. The more you are able to align evaluation methods across programs, the more economies of scale you will create for the hard work of monitoring and assessing program impact. If your organization doesn’t have a strategic plan, we recommend investing in one as soon as possible. Organizations with a written strategic plan double their chance of success.

Program Design and Evaluation Methods: Key Considerations

Funding for Good recommends developing your evaluation plan alongside your initial project and program design. In doing so, you will be able to embed evaluation methods into your program design, rather than tacking them on after your initiative is already in process. Often, we see organizations scrambling to develop an evaluation plan after a project is already in process. This can hinder your ability to accurately and efficiently measure the impact of your efforts. For example, if you are developing a new community STEM education program, you may want to embed pre- and post-program testing and surveys into your project. You will also need to ensure that staff work plans account for this evaluation activity. If you wait until the program has already started, you will likely miss key pre-intervention data, and staff may spend extra time trying to figure out how to adjust existing workflows.

Fundraising Fundamentals: Mighty Metrics

When designing your program or project and creating your evaluation plan, key questions you should consider are:

Program and project design:

What is the primary purpose of the program or project? For example, is your program focused on education, outreach, prevention, career readiness, economic development, etc. of the program or project? For example, is your program focused on education, outreach, prevention, career readiness, economic development, etc. What are the goals and objectives of the program or project? How to Write Quality Goals and Objectives Is your program or project part of your strategic plan? It’s critical that all new projects and programs tie into your organization’s long-term vision and mission. Otherwise, you risk mission creep. Is there a need for this program? Describe the need using statistics or community reports. Notice what data and metrics are used to document need, as these will be invaluable when you set out to evaluate impact. for this program? Describe the need using statistics or community reports. Notice what data and metrics are used to document need, as these will be invaluable when you set out to evaluate impact. Who is your target population ? We recommend getting as specific as possible, as you will need to know who you are serving in order to measure the effect of your work.

? We recommend getting as specific as possible, as you will need to know who you are serving in order to measure the effect of your work. How will your program design help meet the community need you identified?

help meet the community need you identified? Will the program model be evidence based? Evidence-based programming means that the program design or intervention has been tested previously and found to have a positive impact.

Program and project implementation:

Does cranberry juice affect blood sugar?

Cranberry juice is a nutritious beverage that many people enjoy. That said, it's high in sugar and can cause a blood sugar spike, which can be a...

Last updated Jun 24, 2021

Do dates unclog your arteries?

Dates, which are rich sources of phenolic radical scavenger antioxidants, also inhibit the oxidation of LDL (the so-called "bad cholesterol") and...

Last updated Feb 24, 2021

Promotion

What will be the frequency and intensity of your program? For example, will you be conducting one round of community outreach or will outreach be part of your day-to-day efforts? Do you want to serve 100 or 10,000 community members?

How will your target population be invited, registered, and retained?

Who will organize and implement your new program? Do you have adequate staff and/or volunteer capacity to support your effort? You will want to ensure that your program’s goals are aligned with your organizational resources. If your program is under-resourced, it may be a challenge to meet more ambitious objectives even if the program design is solid. What are the true costs associated with program implementation and reporting? You will need to consider personnel (salaries, fringe such as FICA, healthcare, etc.), program materials (such as curriculum creation and dissemination, as well as supplies), marketing materials, travel and transportation costs (for staff and participants), staff development or certifications needed, equipment, space, consultants and independent contractor services (this range from event management to graphic design to evaluation experts), insurance, liability and legal costs, and other miscellaneous expenses. Here’s a tip for those of you creating program and project budgets for grants: Be “Generally Specific”

associated with program implementation and reporting? You will need to consider personnel (salaries, fringe such as FICA, healthcare, etc.), program materials (such as curriculum creation and dissemination, as well as supplies), marketing materials, travel and transportation costs (for staff and participants), staff development or certifications needed, equipment, space, consultants and independent contractor services (this range from event management to graphic design to evaluation experts), insurance, liability and legal costs, and other miscellaneous expenses. Here’s a tip for those of you creating program and project budgets for grants: Be “Generally Specific” What risks may be posed by the project? This could include legal, liability, or reputational risks. What policies and procedures will need to be implemented within your organization or project to reduce risks?

What resources are critical for both the short-term and long-term success of the program? You should consider financial resources (will you be charging fees for service, will you seek grant funding, will you be soliciting individual donors), program materials or services, and community partnerships and collaboration.

Program and project evaluation:

What evaluation measures will you use to measure program success? Consulting the list of evaluation methods above, you may want to combine both qualitative and quantitative metrics.

Who will track program data and report to stakeholders and donors? What tools will you use to gather information (written surveys, digital surveys, databases, etc.) and who will be responsible for ensuring data is entered in a timely manner? Will you be relying on staff or volunteers for data management, analysis and reporting? Will you be working with an outside evaluation consultant or conducting all evaluation activities in-house? What additional expertise will you need to ensure you are able to fulfill your evaluation activities?

How will the organization share program impact with the greater community? How frequently will you share impact? This report of the MOVE Culver City pilot program is a great example of how robust evaluation can be used to communicate about the impact of an initiative, raise awareness about the program, and build support for future investments.

Program and project sustainability:

How will the organization sustain this new program? How will the program support your organization’s long-term mission and vision?

this new program? How will the program support your organization’s long-term mission and vision? What is your organization’s current and long-term capacity? Are your funding streams diversified? Do you have general operating support as well as project support grants and contributions? Does your organization have the appropriate financial systems and procedures in place?

Do you have funders specifically for this project or program? If so, how long are the commitments for and how much of the project or program budget is covered? If you don’t have anchor funders, do you have a fundraising strategy in place? If you don’t secure adequate funds, what will happen to the program?

Does the Board of Directors agree there is a need for the program and commit to supporting it?

Are the project or program goals reflected in your organization’s current strategic plan? If your organization doesn’t have a strategic plan, what is your timeline for developing one?

For more tips on program design, check out: Questions to Ask When Designing a Nonprofit Program Funding for Good is always ready to help. We provide Consultations On-Demand, develop custom solutions specific to Program Design, or offer comprehensive Strategic Planning services, including support for integrating evaluation methods into your organizations’ work.

fundingforgood.org - What are Evaluation Methods? - Funding for Good

Can you live 25 years with prostate cancer?

“This study proves that if a man's going to live 20-25 years and he's got intermediate prostate cancer, he has an opportunity to save his life,”...

Last updated May 16, 2021

Is 10 diapers a day normal?

For the first few weeks, a newborn baby may need up to 10 to 12 diapers a day. As the baby grows older, their need for diapers tends to decrease....

Last updated Jan 19, 2020

Imagine Your Moment Of Freedom!

Fluxactive Complete is conveniently packed with over 14 essential prostate powerhouse herbs, vitamins and grade A nutrients which work synergistically to help you support a healthy prostate faster

Learn More »

Promotion

How often should you drink cranberry juice for your kidneys?

Cranberry juice has been thought to help with kidney stones, but research suggests that it may actually increase kidney stones formation —...

Last updated Jan 22, 2022

Promotion

What is a health rating?

What is a Health Star Rating? The Health Star Rating is a front-of-pack labelling system that rates the overall nutritional profile of packaged...

Last updated Mar 3, 2020