Program Evalution

The overarching goal of any program evaluation is to provide a rigorous and continuous strategic assessment of the program among internal and external stakeholders. The outcomes from the research tools employed – observational, qualitative and quantitative – must provide an active and instantaneous listening ear to what is happening “on the ground” among those delivering the program and those for whom the program was developed.

Our Approach

STEWART and PARTNERS believes that the best programs are developed through the use of a rigorous research program among your target audience that moves from formative, qualitative research to understanding full range of attitudes and perceptions followed by quantitative study to validate program goals among target audiences.

Qualitative research: is used to identify key program strengths and weaknesses before the program is rolled out. We are looking to identify opportunities for improvement in program attributes and key communications messages that will build awareness and support for the program. We use all forms of qualitative interactions to gather this information, including focus groups, in-depth interviews, on-line communities and observational tools such as in-school monitoring.

Quantitative research: should be used to create a benchmark of attitudes and perceptions and for tracking studies to actively measure progress toward improving those attitudes and perceptions over time.

Key Considerations

When we develop a program assessment methodology, we consider the full range of your program’s measurable business and program objectives and outcomes. They might include:

  • Establishing the initial reaction to the offering
  • Developing a deeper understanding of the potential impact of selected program components
  • Establishing whether your target audience has a clear need for the offering
  • Defining expectations of the program offerings
  • Identifying the culture and environment in which the program is to work
  • Identifying how the offering might be fine-tuned or optimized in order to deliver the program on strategy
  • Building awareness and interest in the program
  • Building support for key program attributes and benefits
  • Moving the target audience to action
  • Building market share

Defining Success

There are a number of indicators we look for to measure the success or failure of any given program. Measures of success typically include:

  • Awareness and perceptions of the program
  • Extent to which the target audience is participating
  • Extent to which the components of the program are actually working properly
  • Extent to which the program’s communications efforts are effectively reaching and motivating the target audience
  • Belief that the program will help target audience improve their lives
  • Likelihood that the target audience will continue to participate in the program or support the programs goals and mission over time

STEWART and PARTNERS will work with your organization to build a dynamic research and strategic assessment program to provide opportunities for continual feedback from your stakeholder audiences to guide the implementation of your program.