Data Collection for M&E
Reliable monitoring starts with choosing the right method and using it consistently. This guide covers primary and secondary data, quantitative and qualitative approaches, and includes a free instrument library: surveys, FGD protocols, and KII guides ready to adapt for your program.
What is data collection in M&E?
M&E data collection is the systematic process of gathering evidence about program activities, outputs, and outcomes using defined methods and instruments. The goal is not to collect as much data as possible; it is to collect exactly the data your program needs to answer the questions in your MEL plan.
Primary vs. secondary data
Primary data is collected directly from respondents or observations for your program's specific purpose: household surveys, focus groups, site visit observations. Secondary data uses existing records: health facility registers, school attendance data, government statistics. Most M&E systems use both. Primary data provides program-specific evidence; secondary data provides context and avoids duplicating what others have already collected.
Quantitative vs. qualitative methods
Quantitative methods, such as structured surveys, administrative records, and count data, tell you how many and how much. They are essential for measuring indicators and tracking progress against targets. Qualitative methods, such as focus group discussions, key informant interviews, and observations, tell you why and how. They explain patterns in quantitative data, surface implementation barriers, and capture changes that numbers miss.
The most rigorous M&E systems use both. A household survey can tell you that water access improved by 30 percentage points. A focus group can tell you which households were excluded and why, and whether the improvement will last when the project ends.
The most common data collection mistake
Most programs collect too much data, not too little. A 90-question household survey administered to 400 households produces 36,000 data points, most of which never inform a decision. A focused 20-question survey covering only the indicators in your MEL plan produces 8,000 points, takes half the time in the field, and costs significantly less to clean and analyze. Start with your indicator list, not with your curiosity.
Which Method Do You Need?
Three primary collection methods, each suited to different evidence needs. Most programs use a combination; start with your indicator list to determine which methods are required.
Household Surveys
Structured questionnaires administered to households or individuals. Produces quantitative data at scale.
Best for
- ›Outcome measurement across large populations
- ›Sector-specific indicators (health, WASH, food security, livelihoods)
- ›Baseline and endline comparisons
Available instruments
Focus Group Discussions
Facilitated group discussions (6-12 participants) exploring shared experiences, perceptions, and attitudes.
Best for
- ›Understanding community priorities and barriers
- ›Exploring service quality from beneficiary perspectives
- ›Nuanced gender and social dynamics
Available instruments
Key Informant Interviews
In-depth interviews with individuals who have specialized knowledge: program staff, officials, community leaders.
Best for
- ›Understanding implementation challenges and lessons learned
- ›Policy alignment, coordination, and sustainability
- ›Triangulating quantitative findings with expert insight
Available instruments
Always pilot instruments with 5-10 respondents before full deployment. Even well-tested tools need local adaptation for language and cultural context.
Free Instrument Library
Ready-to-use data collection instruments for development programs. Each is designed for field use and should be adapted to your program context before deployment.
Household Health Survey
Health outcomes, service access, morbidity, and treatment-seeking behavior.
WASH Household Survey
Water access, sanitation facilities, hygiene practices, and water treatment.
Food Consumption Score Survey
Dietary diversity, food consumption frequency, and food group coverage.
Livelihoods Coping Strategy Survey
Asset sales, debt, migration patterns, and reduced consumption as stress indicators.
FGD: Community Needs
Community priorities, barriers to services, available resources, and gaps.
FGD: Service Satisfaction
Service quality, access, relevance to needs, and ideas for improvement.
FGD: Women's Empowerment
Gender dynamics, decision-making power, and economic participation.
KII: Beneficiary
Participation experience, changes observed since program start, and key challenges.
KII: Community Leader
Program relevance, community coordination, sustainability, and ownership.
KII: Government Stakeholder
Policy alignment, government capacity, coordination mechanisms, and sustainability.
KII: Program Staff
Implementation challenges, lessons learned, and adaptive management practices.
Pre-Fieldwork Readiness Checklist
Before any data collection begins, confirm these items. Missing any one costs more time in the field than the preparation would have taken.
- 1Site access confirmed for all locations
- 2Teams assigned with clear daily targets
- 3Buffer days scheduled (minimum 20% contingency)
- 4Instruments printed, devices charged, supplies packed
- 5IRB or ethics approval obtained (if required)
- 6Consent forms ready and translated into local language(s)
- 7Enumerators trained and piloted on all instruments
Schedule buffer days. Weather, access issues, and respondent availability always cause delays. Plan for at least 20% contingency time beyond your estimated field schedule.
Free Downloads
WASH Household Survey
Multi-section household survey covering water access, sanitation infrastructure, hygiene practices, and water treatment behavior. Includes enumerator guidance notes.
KII Guide: Program Staff
Semi-structured interview guide for program staff. Covers implementation challenges, adaptive management, lessons learned, and recommendations for future programming.
Using AI in data collection
AI tools can support several stages of data collection: drafting survey questions, translating instruments into local languages, creating structured analysis frameworks for qualitative data, and cleaning raw datasets after collection. The AI for M&E guides below cover the most common use cases.
More M&E methodology guides
Practical, plain-language guides for every phase of the M&E cycle.
Browse all guides