Section 3. Gathering Data on Public Opinion

• What does it mean to gather data on public opinion?

• Why do you want to know what people think?

• What kind of information are you looking for?

• Whose opinions are you trying to measure?

• What are you going to do with the information?

• How do you gather data on public opinion?

What does it mean to gather data on public opinion?

Gathering data on public opinion means systematically learning what a defined group of people thinks, believes, prefers, knows, or has experienced regarding a particular issue, program, policy, organization, or community condition.

Public-opinion data can help community organizations understand:

• Whether people are aware of an issue
• What concerns or priorities they have
• How they view a proposed policy or program
• Whether opinions differ across groups or geographic areas
• What experiences may be influencing those views
• How views change over time

Public opinion can be important in democratic decision-making and community planning, but it is only one form of information.

Public opinion does not by itself determine whether a factual claim is true, whether a program is effective, whether a right should be protected, or whether a policy is ethical.

Decisions may also require research evidence, professional expertise, legal requirements, lived experience, community values, resource considerations, and attention to people who may be affected even when they are not part of the majority.

Gathering information on public opinion means learning where a defined population stands on an issue using methods appropriate to the question and population.

Before collecting information, ask:

• Why do we want to know what people think?
• What exactly do we want to learn?
• Whose opinions are relevant?
• How will we use the information?
• What method can provide useful and credible information?
• What limitations, accessibility needs, or ethical concerns should we anticipate?

Why do you want to know what people think?

Begin by defining the purpose of the research.

Community organizations may gather opinion data to:

• Understand community priorities
• Assess awareness of an issue
• Learn how people experience a program or service
• Identify concerns about a proposed policy
• Improve a program
• Assess support for a community initiative
• Understand barriers to participation
• Inform advocacy strategy
• Evaluate whether community needs or preferences are changing
• Meet evaluation or funding requirements

Public-opinion research should not be designed simply to discover which message will persuade people to support a predetermined position.

It can certainly inform communication, but it should also help the organization listen.

If community members raise concerns that challenge your assumptions or preferred strategy, take those concerns seriously.

Example: A neighborhood recreation project

Suppose a neighborhood organization believes a new soccer field or recreation space would benefit local young people.

Before asking local government for funding, the organization might want to know:

• Whether young people and families actually want a soccer field
• Whether another recreation need is considered more important
• Who currently lacks access to recreation
• What transportation or accessibility barriers exist
• Whether nearby residents have concerns about location, noise, traffic, or maintenance
• Whether similar proposals have been considered before

The goal is not simply to prove that the original idea has support. It is to determine whether it reflects community priorities and how it might be improved.

What kind of information are you looking for?

Be specific about what you want to learn.

Public-opinion research may examine:

• Awareness
• Knowledge
• Beliefs
• Attitudes
• Preferences
• Priorities
• Satisfaction
• Intentions
• Experiences
• Support or opposition

These are different questions and should not be treated as interchangeable.

For example, someone may:

• Know little about a proposed program but still express an initial opinion
• Support the goal but disagree with the strategy
• Believe an issue is important but rank another issue as a higher priority
• Support a policy in general but have concerns about how it would be implemented

Whenever possible, design questions that allow these differences to appear.

Avoid treating opinion as fact

If you are asking what people know about an issue, separate factual knowledge from attitudes.

For example, if community members express concern about HIV transmission, public-health evidence should be used to determine actual transmission risk. A survey can tell you what people believe; it cannot establish the medical facts.

Similarly, public opinion about education, environmental hazards, public health, or other technical issues should be considered alongside relevant evidence and expertise.

Whose opinions are you trying to measure?

Define the population carefully.

The relevant population might be:

• All residents of a city
• Residents of a particular neighborhood
• Young people
• Parents and caregivers
• Program participants
• Workers
• Students
• Voters
• People directly affected by a policy
• Service providers
• Decision-makers

Different populations may need to be studied separately.

For example, if a city is considering a new park, you may want information from:

• Residents who live nearby
• Families with children
• Older adults
• People with disabilities
• Young people
• Local businesses
• Parks staff
• Elected officials

Their perspectives answer different questions.

Avoid overly broad demographic categories

Do not assume that an entire racial, ethnic, cultural, religious, age, disability, gender, or socioeconomic group shares one opinion.

If demographic differences are relevant to the research question, collect and report them carefully.

Use specific and current terminology rather than categories such as minorities or the average person.

Ask the population directly when possible

Avoid relying solely on other people to tell you what a community thinks.

For example, if you are considering an English-language learning program for Spanish-speaking residents, talk directly with potential participants about:

• Whether they want the program
• Scheduling
• Location
• Childcare
• Transportation
• Program goals
• Preferred learning formats

Do not assume that community leaders or service providers can substitute for participants' own perspectives.

What are you going to do with the information?

Decide in advance how the information may influence decisions.

Public-opinion findings might be used to:

• Revise a program
• Set priorities
• Decide whether to proceed with an initiative
• Identify communication needs
• Improve accessibility
• Inform policymakers
• Identify areas requiring further research
• Evaluate change over time

Be cautious about using opinion data merely to strengthen supporters and weaken people who disagree with you.

Research should help clarify what the community thinks, not manufacture the appearance of consensus.

Decide what would cause you to change course

Before collecting data, ask:

• What would we do if support is strong?
• What would we do if opinions are divided?
• What would we do if most participants oppose the proposal?
• What would we do if people identify a different priority?

If no possible result would change your decisions, reconsider whether collecting opinion data is necessary or whether you are using research only to legitimize a decision that has already been made.

Majority opinion is not the only consideration

A majority preference may be important without being decisive.

For example, majority opinion should not determine whether a person receives legally required disability access, protection from discrimination, or another established right.

Community decisions may also need to consider:

• Effects on smaller or historically excluded populations
• Legal requirements
• Health and safety evidence
• Professional standards
• Available resources

How do you gather data on public opinion?

Begin by looking for existing information before collecting new data.

Existing sources

Useful sources may include:

• Previous community surveys
• Government datasets
• University research
• Community assessments
• Polling organizations
• Program evaluations
• Public meeting records
• Reports from community organizations

When using existing opinion data, check:

• When the data were collected
• Who was surveyed
• How participants were selected
• Sample size
• Question wording
• Survey mode
• Response rate
• Weighting or adjustments
• Who sponsored the research

Do not use media coverage as a substitute for public-opinion research

News reporting can help you understand public debate, history, and arguments being made about an issue.

However, the tone of news stories, editorials, social-media comments, letters to the editor, or people quoted in an article should not automatically be treated as representative of public opinion.

People who comment publicly are often a self-selected group.

Surveys

Surveys can estimate attitudes, awareness, preferences, or experiences when they are designed and sampled appropriately.

Surveys may be conducted through:

• Online forms
• Telephone
• Text messaging
• Mail
• Paper questionnaires
• In-person outreach

Each mode reaches people differently.

Consider:

• Internet access
• Stable phone access
• Literacy
• Language
• Disability access
• Privacy
• Trust
• Cost

Sampling matters

A large number of responses does not automatically make a survey representative.

For example, an online poll shared through your organization's social-media accounts may collect thousands of responses but still mostly reflect people who already follow or support the organization.

If you want to estimate opinion across a larger population, seek appropriate survey or statistical expertise.

When reporting results, describe:

• Who participated
• How they were recruited
• How many people responded
• Important demographic or geographic limitations
• Whether the findings can reasonably be generalized

Question wording matters

Questions can influence responses.

Avoid wording that:

• Suggests a preferred answer
• Uses emotionally loaded language unnecessarily
• Combines two questions into one
• Assumes knowledge participants may not have
• Presents incomplete information

When possible, pilot-test questions with people similar to the intended participants.

Interviews

Interviews can help explain why people hold particular views.

They can explore:

• Experiences
• Priorities
• Concerns
• Reasons for supporting or opposing a proposal
• Ideas for improvement

Interviews provide depth but generally should not be treated as statistically representative unless they are part of a sampling design intended for that purpose.

Focus groups and listening sessions

Focus groups and listening sessions can help explore the range of perspectives on an issue.

They are useful for understanding:

• How people talk about the issue
• Questions or concerns that survey designers may have overlooked
• Reasons behind different opinions
• Reactions to possible programs or policies

A focus group does not show how common a particular opinion is across the whole community.

Public meetings

Public meetings can provide opportunities for residents to express views and hear one another.

They are useful for participation but generally should not be treated as representative public-opinion polls.

People who attend may differ substantially from those who do not.

Digital and social-media information

Social media can provide information about public conversations, emerging concerns, and the language people use to discuss an issue.

It should be interpreted cautiously.

Online activity may be affected by:

• Self-selection
• Platform demographics
• Algorithmic amplification
• Organized campaigns
• Automated accounts
• Duplicate participation

A trending topic, comment section, or online poll does not necessarily represent the broader community.

What roles do community leaders and specialists play?

Community leaders and specialists can provide valuable information, but their views answer different questions from those of the general public.

Community leaders

Elected officials, organizers, faith leaders, neighborhood leaders, business leaders, youth leaders, and other community figures may understand institutions, networks, history, or emerging concerns.

Do not assume that influential leaders speak for everyone in a population.

Compare leadership perspectives with information gathered directly from community members.

Specialists

Specialists can help establish what current evidence shows about technical questions.

For example, public-health agencies, clinicians, or researchers may help explain current evidence regarding HIV prevention, infectious disease, environmental hazards, or another health issue.

Expertise should be evaluated according to relevant qualifications, evidence, and methods.

Public opinion and factual evidence are different

It can be useful to compare what people believe with what research or professional evidence shows.

Differences may indicate:

• A need for clearer public information
• Distrust of institutions
• Different experiences among populations
• Values that are not captured by technical evidence alone
• Uncertainty in the evidence itself

Avoid describing community members as uninformed simply because they disagree with experts.

At the same time, public concern should not be presented as scientific evidence.

Good community decision-making often requires both technical evidence and an understanding of what residents value and experience.

Gathering opinions from children and young people

Young people's views may be essential when programs or policies directly affect them.

Research involving minors requires additional care.

Consider:

• Age-appropriate language
• Privacy
• Consent or assent requirements
• School or organizational policies
• Whether questions involve sensitive information
• Whether participation could affect relationships with teachers, caregivers, or service providers

Do not assume that parents or caregivers can fully substitute for young people's own views when young people are capable of expressing their perspectives.

Use opinion data ethically

People who participate in opinion research should understand, as appropriate:

• Who is collecting the information
• Why it is being collected
• How it may be used
• Whether responses are anonymous or confidential
• Whether participation is voluntary

Avoid collecting sensitive demographic or personal information unless it serves a clear research purpose.

Protect identifying information and consider the risks that disclosure could create.

Anticipate common obstacles

Public-opinion research may encounter:

• Low response rates
• Difficulty reaching particular populations
• Language barriers
• Accessibility barriers
• Distrust
• Limited time or funding
• Biased or unclear questions
• Samples that do not reflect the population
• Rapidly changing opinions

Plan for these limitations and report them honestly.

A study does not need to be perfect to be useful, but readers should be able to understand what the findings do and do not support.

In Summary

Gathering data on public opinion can help organizations understand what people know, believe, prefer, experience, and prioritize.

Begin by deciding why you need the information, what exactly you want to learn, whose opinions matter, and how the findings could affect your decisions.

Public opinion is important, but it is not the same thing as factual evidence, professional expertise, legal requirements, or ethical standards.

Define the population carefully. Avoid assuming that influential leaders, people who attend a public meeting, social-media users, or members of one demographic group represent an entire community.

Use existing research when appropriate, and collect new information through surveys, interviews, focus groups, listening sessions, or other methods when needed.

Sampling and question wording matter. A large number of responses does not automatically mean that a survey represents the wider population.

Media coverage, online comments, social-media activity, and public meetings can reveal aspects of community discussion but should not automatically be treated as measures of public opinion.

Compare community views with relevant evidence while respecting the fact that residents may contribute experience, values, and priorities that technical research alone cannot provide.

Protect privacy, obtain appropriate consent, and be especially careful when research involves children, young people, or sensitive information.

Finally, use public-opinion research as a tool for listening as well as advocacy.

The goal should not simply be to learn how to persuade people. It should be to understand the community well enough to make better, more responsive decisions.