11. There is not enough improvement in outcomes.

1. Are we doing the right things in the right way with our community?

• Best Processes Database
• Choosing and Adapting Community Interventions
• Providing Information and Enhancing Skills
• Enhancing Support, Incentives, and Resources
• Modifying Access, Barriers, and Opportunities
• Improving Services
• Changing Policies
• Changing the Physical and Social Environment

2. Are we documenting the activities (implementation of the intervention) used to address the problem or goal?

• Toolkit: Evaluating the Initiative

3. Have we identified and collected measures of success for short-term, intermediate, and long-term goals?

• Toolkit: Evaluating the Initiative

4. Are we certain that we have measured community level indicators properly and that we have measured the right ones?

• Rating Member Satisfaction
• Constituent Surveys of Outcomes: Ratings of Importance
• Conducting Interviews with Key Participants to Analyze Critical Events
• Gathering and Using Community-Level Indicators

5. Have we obtained feedback on the importance of community changes we have been bringing about?

• Constituent Survey of Outcomes: Ratings of Importance
• Gathering and Using Community-Level Indicators
• Providing Feedback to Improve the Initiative

6. Are the strategies and tactics being used (e.g., providing information, modifying access) strong enough to change behavior and community-level indicators of success?

• Analyzing Community Problems
• Developing Successful Strategies: Planning to Win
• Defining and Analyzing the Problem
• Identifying Strategies and Tactics for Reducing Risks
• Developing a Plan for Advocacy
• Behavioral Surveys
• Conducting Interviews with Key Participants to Analyze Critical Events
• Gathering and Using Community-Level Indicators

7. Are changes in place long enough to make a difference?

• Gathering Information: Monitoring Your Progress
• Strategies for the Long-Term Institutionalization of an Initiative: An Overview

8. Are the changes reaching the right target audience or a big enough part of the target audience?

• Toolkit: Implementing a Social Marketing Effort
• Social Marketing of Successful Components of the Initiative
• Analyzing Root Causes of Problems: The “But Why?” Technique
• Designing Community Interventions
• Identifying Targets and Agents of Change: Who Can Benefit and Who Can Help
• Understanding Risk and Protective Factors: Their Use in Selecting Potential Targets and Promising Strategies for Interventions
• Identifying Strategies and Tactics for Reducing Risks
• Gathering Information: Monitoring Your Progress

9. Are the changes big enough to make a difference for those who are most at risk for the concern?

• Involving People Most Affected by the Problem
• Gathering Information: Monitoring Your Progress
• Gathering and Using Community-Level Indicators

10. Does the change fit what the community needs?

• Developing a Plan for Identifying Local Needs and Resources
• Conducting Needs Assessment Surveys
• Identifying Community Assets and Resources
• Conducting Concerns Surveys
• Obtaining Feedback from Constituents: What Changes are Important and Feasible?
• Understanding Risk and Protective Factors: Their Use in Selecting Potential Targets and Promising Strategies for Interventions
• Gathering Information: Monitoring Your Progress
• Rating Community Goals

11. Have we used a reward system to assure tangible benefits for producing the outputs and intended outcomes (e.g., incentives, disincentives)?

• Toolkit: Developing a Framework or Model of Change
• Rewarding Accomplishments

12. Were identified incentives and disincentives delivered contingent upon attainment of the objectives (e.g., bonus grants for full implementation of the intervention, outcome dividends for actual improvements in outcomes)?

• Rewarding Accomplishments
• Achieving and Maintaining Quality Performance