Data Collection for M&E

Reliable monitoring starts with choosing the right method and using it consistently. This guide covers primary and secondary data, quantitative and qualitative approaches, and includes a free instrument library: surveys, FGD protocols, and KII guides ready to adapt for your program.

What is data collection in M&E?

M&E data collection is the systematic process of gathering evidence about program activities, outputs, and outcomes using defined methods and instruments. The goal is not to collect as much data as possible; it is to collect exactly the data your program needs to answer the questions in your MEL plan.

Primary vs. secondary data

Primary data is collected directly from respondents or observations for your program's specific purpose: household surveys, focus groups, site visit observations. Secondary data uses existing records: health facility registers, school attendance data, government statistics. Most M&E systems use both. Primary data provides program-specific evidence; secondary data provides context and avoids duplicating what others have already collected.

Quantitative vs. qualitative methods

Quantitative methods, such as structured surveys, administrative records, and count data, tell you how many and how much. They are essential for measuring indicators and tracking progress against targets. Qualitative methods, such as focus group discussions, key informant interviews, and observations, tell you why and how. They explain patterns in quantitative data, surface implementation barriers, and capture changes that numbers miss.

The most rigorous M&E systems use both. A household survey can tell you that water access improved by 30 percentage points. A focus group can tell you which households were excluded and why, and whether the improvement will last when the project ends.

The most common data collection mistake

Most programs collect too much data, not too little. A 90-question household survey administered to 400 households produces 36,000 data points, most of which never inform a decision. A focused 20-question survey covering only the indicators in your MEL plan produces 8,000 points, takes half the time in the field, and costs significantly less to clean and analyze. Start with your indicator list, not with your curiosity.

Which Method Do You Need?

Three primary collection methods, each suited to different evidence needs. Most programs use a combination; start with your indicator list to determine which methods are required.

Household Surveys

Structured questionnaires administered to households or individuals. Produces quantitative data at scale.

Best for

  • Outcome measurement across large populations
  • Sector-specific indicators (health, WASH, food security, livelihoods)
  • Baseline and endline comparisons

Available instruments

Household Health SurveyWASH Household SurveyFood Consumption Score SurveyLivelihoods Coping Strategy Survey

Focus Group Discussions

Facilitated group discussions (6-12 participants) exploring shared experiences, perceptions, and attitudes.

Best for

  • Understanding community priorities and barriers
  • Exploring service quality from beneficiary perspectives
  • Nuanced gender and social dynamics

Available instruments

FGD: Community NeedsFGD: Service SatisfactionFGD: Women's Empowerment

Key Informant Interviews

In-depth interviews with individuals who have specialized knowledge: program staff, officials, community leaders.

Best for

  • Understanding implementation challenges and lessons learned
  • Policy alignment, coordination, and sustainability
  • Triangulating quantitative findings with expert insight

Available instruments

KII: BeneficiaryKII: Community LeaderKII: Government StakeholderKII: Program Staff
Tip

Always pilot instruments with 5-10 respondents before full deployment. Even well-tested tools need local adaptation for language and cultural context.

Free Instrument Library

Ready-to-use data collection instruments for development programs. Each is designed for field use and should be adapted to your program context before deployment.

Household Surveys4

Household Health Survey

Health outcomes, service access, morbidity, and treatment-seeking behavior.

QuantitativeHousehold

WASH Household Survey

Water access, sanitation facilities, hygiene practices, and water treatment.

QuantitativeHousehold

Food Consumption Score Survey

Dietary diversity, food consumption frequency, and food group coverage.

QuantitativeHousehold

Livelihoods Coping Strategy Survey

Asset sales, debt, migration patterns, and reduced consumption as stress indicators.

QuantitativeHousehold
FGD Protocols3

FGD: Community Needs

Community priorities, barriers to services, available resources, and gaps.

QualitativeGroup

FGD: Service Satisfaction

Service quality, access, relevance to needs, and ideas for improvement.

QualitativeGroup

FGD: Women's Empowerment

Gender dynamics, decision-making power, and economic participation.

QualitativeGroup
KII Guides4

KII: Beneficiary

Participation experience, changes observed since program start, and key challenges.

QualitativeIndividual

KII: Community Leader

Program relevance, community coordination, sustainability, and ownership.

QualitativeIndividual

KII: Government Stakeholder

Policy alignment, government capacity, coordination mechanisms, and sustainability.

QualitativeIndividual

KII: Program Staff

Implementation challenges, lessons learned, and adaptive management practices.

QualitativeIndividual

Pre-Fieldwork Readiness Checklist

Before any data collection begins, confirm these items. Missing any one costs more time in the field than the preparation would have taken.

  • 1
    Site access confirmed for all locations
  • 2
    Teams assigned with clear daily targets
  • 3
    Buffer days scheduled (minimum 20% contingency)
  • 4
    Instruments printed, devices charged, supplies packed
  • 5
    IRB or ethics approval obtained (if required)
  • 6
    Consent forms ready and translated into local language(s)
  • 7
    Enumerators trained and piloted on all instruments
Tip

Schedule buffer days. Weather, access issues, and respondent availability always cause delays. Plan for at least 20% contingency time beyond your estimated field schedule.

Free Downloads

WASH Household Survey

Multi-section household survey covering water access, sanitation infrastructure, hygiene practices, and water treatment behavior. Includes enumerator guidance notes.

Coming soon

KII Guide: Program Staff

Semi-structured interview guide for program staff. Covers implementation challenges, adaptive management, lessons learned, and recommendations for future programming.

Coming soon

Using AI in data collection

AI tools can support several stages of data collection: drafting survey questions, translating instruments into local languages, creating structured analysis frameworks for qualitative data, and cleaning raw datasets after collection. The AI for M&E guides below cover the most common use cases.

More M&E methodology guides

Practical, plain-language guides for every phase of the M&E cycle.

Browse all guides