Where can I find a coalition assessment tool that I can use to
measure various aspects of my coalition’s functioning
What
is a coalition assessment and why should my coalition do one?
The Institute has been receiving many calls regarding coalition assessment tools.
Coalitions, from time-to-time, engage in an assessment process for a variety
of reasons. Some coalitions are interested in getting feedback from their membership
on satisfaction with the coalition. Other coalitions are interested in getting
more information about their membership – such as potential untapped resources
available to the coalition and the community. Other times, coalitions would
like to get some sense of how they might be functioning as an organization,
e.g., is the coalition collaborating sufficiently, are meetings efficient, etc.
There are a wide variety of coalition assessment tools available to coalitions
to answer any number of questions your coalition may have about itself.
A coalition assessment does not have to be a complicated, long, drawn-out process
requiring a statistical consultant, complicated methods and a large budget.
This is somewhat different from a community assessment, which involves assessing
your community on its strengths, needs and resources around substance abuse
issues.
The coalition assessment is also not the formal evaluation of your coalition
and the overall success of its combined programs, policies and practices. Consider
the coalition assessment to be part of your coalition’s process evaluation.
It’s a way to capture a piece of the larger picture. It can provide a
temperature check on an aspect or aspects of a coalition’s functioning.
For example, if meeting attendance is down, it may be time to assess why this
is so. Is it due to poor meeting organization, time constraints, lack of meaningful
discussion? Are there any suggestions from your membership on how to improve
meetings so that more individuals attend and that meetings are more productive?
This type of information is what a coalition assessment can yield to help improve
certain organizational processes. A coalition assessment will allow your coalition
to get feedback from your membership and be more responsive to them. With periodic
temperature checks and subsequent tweaks, the assessment process can help your
coalition more effectively address your community’s substance abuse issues
because it can result in a more stream-lined, efficient coalition.
Where can I find a coalition
assessment?
The National Coalition Institute has collected a sample of coalition assessments
for your use. This is not an exhaustive list, by any means, but it’s a
start. Some of the assessments have been developed by other coalitions, some
have been developed by coalition evaluators for coalition use, and others have
been developed by coalition researchers for research purposes. Many of these
instruments consist of close-ended questions, asking respondents to agree or
disagree with a statement or rate the quality of a certain aspect of the coalition
using a rating scale. Other instruments ask more open-ended questions, such
as the Coalition Self-Assessment, which lays out a series of questions that
can be used as a conversation tool to help understand and clarify the coalition’s
logic model or strategic plan.
It is up to you to decide which assessment best fits your purpose. If you happen
to find an instrument that sufficiently meets your needs, use it. More likely,
you’ll find that you like different items/sections of various instruments.
That’s fine. Pick items that are of interest to your coalition and that
will answer questions specific to the reason you are initiating a coalition
assessment. Do not make this more cumbersome than it needs to be. Make this
a simple but meaningful process for your coalition. This way you answer the
question(s) you want answered in the most succinct way possible. Pick items
from various assessment instruments and adapt them to your needs. Ask yourself,
do I want responses to be in numbers that I can add up? Would it be helpful
for members to provide open-ended comments? Would a combination of the two be
best?
The following downloadable list of coalition assessments is ever growing and
changing. The list provides the name of the instrument, some background information
on the developer and the kinds of information it gathers. Some assessments are
for public use and can be acquired on the internet or by contacting CADCA for
a copy, others can be accessed by contacting the instrument’s developer.
Coalition
Assessment Tools
(Download Table Below
- MS Word Document)
| Instrument | Source | How used |
| Checklist of Policy Indicators for Alcohol, Tobacco and Other Drugs | Center
for Center for Prevention Research & Development (CPRD) |
This checklist can help coalitions assess the number and types of policies within the community and where they might best extend their efforts. |
| Coalition Member Survey | Center for Prevention Research & Development (CPRD) Institute of Government & Public Affairs University of Illinois at Champaign-Urbana 510 Devonshire Drive Champaign, IL 61820 (217) 333-3231 (office) (217) 244-0214 (fax) |
A tool to gage coalition members' opinions about their involvement with the coalition. It covers topics such as the role they play in the coalition, interaction with other partners, perceived coalition impact on ATOD issues in the community, an assessment of the coalition leadership, etc. Can be implemented yearly. |
| Coalition
Rating Scale (Coalitions: Key Feature of Success A Performance Rating Scale) |
Developed by Andy Rowe, Ph.D. Vice President, GHKINT for The Historic Triangle Substance Abuse Coalition, which serves the City of Williamsburg, and the Counties of James City and York, Virginia |
Assesses several features of successful partnerships gleaned from the research literature. Asks members to assess their impressions of the Coalition so that it can improve Coalition activities where necessary. Using a 10-point scale, members rate the degree to which the feature is present in their partnership. |
| Coalition Self Assessment | Developed as part of the Fighting Back project. |
Set of qualitative questions coalitions can use to help articulate their strategic plan/logic model. |
| Collaboration Evaluation Worksheets | Wolff, T. (2002) A practical approach to evaluating coalitions. In T. Backer (Ed.) Evaluating Community Collaborations. Springer Publishing. |
Compilation of various assessment tools: Annual Satisfaction Survey for Community Coalitions; Diagnosing Your Coalition: Risk Factors for Participation; Assessing your Collaboration’s Commitment to Agency-Based and Community-Based Approaches; Climate Diagnostic Tool: The Six R’s of Participation; Responsibility Charting; Inclusivity Checklist; Task Force Evaluation and Resource Allocation; Sustainability Benchmarks; Coalition Annual Report |
| Collaboration Progress Checklist | National Network for Collaboration Training Manual: http://crs.uvm.edu/nnco/cd/ The checklist
is at: http://crs.uvm.edu/nnco/cd/checklis.htm |
Members rate the extent to which they feel that certain factors are part of their collaboration (goals, communication, sustainability, research and evaluation, political climate, resources, etc.). Thirteen factors are rated using a 5 point scale (strongly agree to strongly disagree). |
| Community Coalition Profile Survey | Oakland County
(MI) Office of Substance Abuse Services Dr. James O’Neill (Madonna University) Download PDF Document |
Gathers information on the coalition’s structure and dynamics, stage of community readiness, strategic planning & evaluation, scope & scale of program efforts, successes & challenges, and sustainability efforts. |
| Community Ownership Scale | Armbruster,
C., Gale, B., Brady, J., & Thompson, N. (1999). Public Health Nursing,
16(1), 17-22. Based on survey in Flynn, B.S. (1995). Measuring community leaders’ perceived ownership of health education programs: Initial tests of reliability and validity. Health Education Research, 10, 27-36 |
Paper-pencil survey filled out by coalition/organization members to assess the amount of influence various stakeholders have over programmatic elements. |
| CTC Questionnaire (Pennsylvania) | Developed
by the Prevention Research Center at Penn State University in collaboration
with the PCCD and the Technical Assistance team at Shippensburg University.
Contact: Mark T. Feinberg, Ph.D. |
Web-based survey used to evaluate the Communities That Care Initiative in Pennsylvania. Instrument assesses the level of involvement with CTC: CTC board and membership, CTC process/fidelity, Barriers to implementing the CTC approach, Community support, Global assessment of the CTC process, Sustainability, TA needs, etc. Currently in the process of examining the appropriateness of the instrument for non-CTC communities. |
| Diagnosing the Health of Your Coalition | Developed by Gillian Kaye, President Community Development Consultants, Brooklyn, NY |
To help you assess, individually, what you believe to be the current reality of your collaborative partnership. This assessment tool is used most effectively when provided to multiple parties with varied perspectives on the initiative. Distribute this to all participant and communicate the results to the group. Use the assessment tool to facilitate conversation among members and to generate ideas about how to move the group forward. |
| Drug Strategies - Case Study Questions | Drug Strategies.
(2001). Assessing community coalitions. |
“In depth questionnaire designed to explore coalitions’ experiences in addressing key elements. Topics covered include: investigation into how coalitions are established and funded, how they define their objectives and if they can be translated into outcome indicators, what process data are collected, and the use of data to maintain public support, media interest and financial backing. The questions also evaluate how the coalition interacts with the community, develops a strategic plan, chooses programs, and identifies training needs” (Drug Strategies, 2001, p. 27) |
| Drug Strategies - Coalition Mail Survey | Drug Strategies.
(2001). Assessing community coalitions. |
“18-question survey mailed to coalition leaders regarding basic coalition structure and functioning, including early history, composition of membership, staffing, type of interventions, obstacles, and funding history” (Drug Strategies, 2001, p. 27). |
| Drug Strategies - Coalition Telephone Survey | Drug Strategies.
(2001). Assessing community coalitions. |
“Approximately 45-minute telephone survey with coalition leaders to further explore coalition structure and functioning, including decision-making structure, program goals and compliance to goals, purpose of coalitions’ interventions, evaluation efforts, barriers, and community readiness” (Drug Strategies, 2001, p. 27). |
| Drug Strategies - Expert Advisory Panel Questions | Drug Strategies.
(2001). Assessing community coalitions. |
“Nine questions for experts in the prevention field designed to identify various aspects of community coalitions, including: different coalition types; implementation methods; community influence; barriers to, and key elements of, success; need for training; and evaluation” (Drug Strategies, 2001, p. 27). |
| Drug Strategies - Key Informant Survey | Drug Strategies.
(2001). Assessing community coalitions. |
“20-minute telephone survey of non-coalition community leaders in business, law enforcement, education, media, faith, social services, and government, to assess their perspectives on issues of substance abuse in their community and whether or not they knew of the coalitions’ efforts” (Drug Strategies, 2001, p. 27). |
| Family Connection Partnerships FY 2002 Self Assessment | Part of Georgia’s
evaluation of the Family Connection Partnerships. Steve Erickson, State Evaluation Team member Phone (770) 394-0514 or (404) 681-9759 Fax (770) 394-1475 or (404) 681-1067 E-mail: mskahrs@worldnet.att.net |
Standardized source of information used to tell the story of collaboration throughout Georgia. Covers various topics – results areas/benchmarks, programs and activities, systems change, financing, collaborative development and evaluation. |
| Fighting Back-Community Leader Survey | Fighting Back
Lessons Learned Project |
Mail survey used in the Fighting Back Lessons Learned Project. Gathers information on the community leader’s perceptions of the local Fighting Back initiative, impact on leader’s organization, and impact on the community. |
| Fighting Back- Current Board Chair Survey | Fighting
Back Lessons Learned Project |
Mail survey used in the Fighting Back Lessons Learned Project. Gathers information on governance, resources, administration and impact on the community. |
| Fighting Back- Current Project Director Survey | Fighting
Back Lessons Learned Project |
Mail survey used in the Fighting Back Lessons Learned Project. Gathers information on governance, resources, administration and impact on the community. |
| Healthy Youth Coalition Evaluation | Used by the Alliance for Youth, Healthy Youth Coalition, Santa Clara, CA |
Checklist rating coalition characteristics to provide a general picture of the Coalition’s stage of development. It may point out areas in which technical assistance, training or other support are needed and will gauge effectiveness in meeting defined goals. |
| Join Together Survey | Join Together.
(1996). Leading from the ground up: The third national survey of the community
movement against substance abuse. www.jointogether.org |
20-minute mail survey of community leaders of organizations that fight substance abuse. Gathers information on organization description, organizational goals and activities, community report card, public policy issues, and assessment of Join Together services. |
| Key Informant Interview | Consortium
for Community Initiatives Communities Research & Services Team Department of Psychology University of Rhode Island Most recently in: Florin, P., Mitchell, R. & Stevenson, J. (2000). Predicting intermediate outcomes for prevention coalitions: A developmental perspective. Evaluation Program Planning, 23, 341-6. |
Ten minute telephone survey of community key informants (chair of city or town council, superintendent of schools, police chief for city or town). Assesses substance abuse prevention task force impact in the community, perceptions of substance abuse issues in their community, and supports and barriers in the community. |
| Ohio Statewide Prevention Coalition Association - Associate Member Survey 2002 | Ohio Parents For
Drug Free Youth Dr. Robert Seufert Evaluator Miami University Center for Applied Research |
Phone survey of state association members. Assesses satisfaction with trainings provided through the state association, use of training information, public policy issues, changes in member prevention activities, and assessment of impact of state association services. |
| Self Assessment - A Tool for Parents | For more information, please visit the Maine Parents' Kit at |
The Maine Office of Substance Abuse has created a free guide with practical tips, useful facts, and valuable statewide resources to help Maine parents monitor and prevent alcohol use by their teen. Included in this is a self-assessment for parents to help see what type of messages parents are sending to their teens about alcohol. |
| Somerville Cares About Prevention One-On-One Interview Protocol (OOO) | Used as part of the Communities Mobilizing for Change on Alcohol initiative. |
This is an interview protocol to be used with community members to gauge tolerance levels regarding underage drinking. It can also be used as a tool to assess a potential new member's interest in participating in the coalition. Includes a preparation guide, interview guide, interview summary sheet and a participant questionnaire. These were done in English, Spanish, Haitian Creole, and Portuguese. |
| Survey for Parents | Bonnie Favero via ondcp listserv bfavero@piedmontcsb.org | Created by a coalition assess parental attitudes related to ATOD issues. |
| Survey on Participation in Community- Based Substance Abuse Prevention | RAND - Survey Research
Group Contact: Dr. Abe Wandersman, University of South Carolina |
This survey has been designed to capture information about involvement with a community coalition to prevent substance abuse and about members’ prevention experience. |
| 1996 Task Force Member Survey | Communities
United for Prevention Communities Research & Services Team Department of Psychology University of Rhode Island Most recently in: Florin, P., Mitchell, R. &
Stevenson, J. (2000). Predicting intermediate outcomes for prevention
coalitions: A developmental perspective. Evaluation Program Planning,
23, 341-6. |
20-25 minute mail survey of members involved in substance abuse prevention task forces in Rhode Island. Assesses member participation in the community task force, perceptions of effects of member participation, information on the community served by the task force, and views of the community task force and its effects. |
In terms of the process of
getting the instrument filled out and the information analyzed, some coalitions
ask their membership to fill out the instrument at their regularly scheduled
meetings. Or, you can do a mail or telephone survey. If you have the technical
capabilities, you can create an online form for individuals to fill out. The
information you collect with the coalition assessment can be formally analyzed
using simple descriptive statistics. You may find the information can be more
simply summarized using a graph or chart. Or perhaps the assessment is more
qualitative---your coalition may just be interested in reviewing the responses
and getting a more informal understanding of how your membership feels about
various aspects of the coalition. You need to figure out how this information
will be used and given that, what is the best way to analyze the information
collected through the assessment.
This is also an opportunity for you to help other coalitions. If you would like
to add your coalition assessment instrument to our list, please forward a copy
(preferably electronic) to Evelyn Yang at CADCA’s National Coalition Institute.
Please provide some information on who developed the assessment, its content
and how items are used or scored.
Evelyn Yang, MA is the Evaluation and Research Manager at CADCA’s
National Coalition Institute. She can be reached at eyang@cadca.org.