Dear Practitioners
We are planning to conduct a baseline survey which is aimed to capture information for malnutrition and IYCF but also hygiene, other micronutrient supplementation and mortality among children between 0-59 months. To undertake this survey we are not interested in carrying out standard nutrition survey but rather would like to do a kind of small scale survey. In the our initial stage of sample size calculation we found a sample of 333 children 6-59 months but thinking to add 34 children under 6 months based on Step-by-Step guide for IYCF making the total sample size 367 and 408 HHs. this seems fine in terms of our intent as are aiming small scale baseline survey.
However, when calculated sample for mortality we ended having sample size of 514 HH. Hence, was wondering if we are to consider this number of HH for collecting mortality then we will end up collecting far more children than anticipated as teams will collect data from 15 children/cluster/days.
Therefore, does anybody have an idea on how we can match this without increasing the number of children massively? Or do you think we can collect data from the 408 HHs identified by anthropometry sample size?
With above number HHs (408/15HH per day will be 28 clusters) will be also acceptable?
The other thing I would like to get some thoughts/explanation is nature of small scale survey, how small and reliable will be? If there are experiences from practitioners I would be happy to hear.
Kind Regards,
Muhiadin
This question should have been posted to the assessment forum.
You have to be very careful when investigating mortality. The main sampling issue is survivor bias (i.e. the sample tends to exclude households in which deaths have taken place and is, therefor, biased to include survivors). All of the other indicators relate to living infants and children and the sample will be of households with children. Any household that has lost all children will be excluded from the sample. It is important to realise that "all children" can mean just one child. Any survey done this way will underestimate mortality. If (e.g.) infant mortality is high in first-born children of young mothers then the magnitude of underestimation will be large.
Mortality is a difficult indicator. My recommendation is to always use a separate survey to estimate mortality. You can do the two surveys at the same time in the same villages but the sample will be different and is probably best collected by a separate enumerator. Some surveyors use a mixed sample which consists of the households with children AND the households that were "skipped" because they did not have children. I find this slow and inefficient and can lead to a tendency to rush the mortality component.
I hope this helps.
Mark Myatt
Technical Expert
Answered:
13 years agoThanks for the comments. Our intention is to collect data on mortality from all HHs regardless of presence of children under 5 years. Besides, I would like to hear your advice on the small scale survey and the sample size.
Regards,
Anonymous
Answered:
13 years agoFrom Kirk Dearden:
A couple of thoughts and questions:
1. I'm assuming you are conducting a survey that is principally designed to capture something other than IYCF and that the nutrition questions are simply being added to that questionnaire (which appears to be focused first and foremost on mortality). Knowing this helps one decide on the most appropriate sampling strategy.
2. It seems to me that there should be 37 infants 0-5.9 months of age, not 33 because 333 divided by 9 age intervals between 6 and 59.9 months = 37 per 6-month age interval.
3. I don't follow how there will be 367 respondents in 408 households. Also, if the sample size goes up from 408 to 514, I wouldn't consider this a massive increase. Perhaps I am missing something.
4. I don't know all of the logistics and costs associated with conducting the survey in this particular context; however, given that a lot of the expense associated with a survey is finding the households in the first place and that the IYCF questions take up about 2 pages of a questionnaire (i.e., it wouldn't take long to administer them), I'd recommend conducting the IYCF survey in each one of the 514 houses where there is a child 0-59.9 months of age. If that simply isn't feasible, then you can simply collect IYCF data from the 408 households. In other words, they'd collect data from 79.4% of the households involved in the mortality survey (408/514). Perhaps the easiest way to do this is to ask during the mortality survey for age-eligible children (0-59.9 months) in each household in each cluster. Once you reach the necessary 25 kids for a given cluster (370 sample size divided by 15 clusters), they stop collecting IYCF data on kids for that particular cluster.
Hopefully, this is of some help.
Kirk
Tamsin Walters
Forum Moderator
Answered:
13 years agoThank you very much Kirk for the thoughts.
Just to give you a bit more info, first of all the 37 children in the 0-5 age groups is as you said I think I divided by 10 instead of 9. As for the number of HHs it is based on the previous survey which indicated that there are 0.9 children/HH.
Regarding the survey, it is actually meant to be a kind of small scale survey and if you like a kind of survelliance which we will repeat at some point. we are looking at a sample of around 350 children, I think as for the mortality is concerned we will anyway be asking information on mortality on every house visited which will give us more information. and 408 is already including 10% non-response so even if we go for the 408 I think it will be fine.
Therefore, in this case we are thinking in doing aroun 28 clusters of 15 children.
Regards,
Anonymous
Answered:
13 years agoThanks. This all sounds reasonable.
Kirk
Answered:
13 years agoDear Muhiadin,
I've had some e-chat with Mary Lung'aho on your question, who has been very involved with developing the IYCF Step by Step Guide, especially with regard to IYCF. Just a note to emphasise, with regard to the IYCF survey. A separate survey of mothers of children 0-<6 months and of mothers of 6-<24 months is not needed. The same questions should be asked of all mothers with children 0 up to 24 months of age.
Best regards
Marie & Mary
Marie McGrath
Technical Expert
Answered:
13 years agoAddressing the sample size issue ... this is tricky with multiple indicators and these will have different expected values and need to be estimated with different levels of precision. The usual thing to do in such situations is to pick the most important indicator(s) and calculate the sample size based on expected value, desired precision, and expected design effect. If you do this for more than one indicator then you use the largest sample size.
Since you posted this in the "Infant and young child feeding interventions" forum I'd guess that some form of IYCF indicator is most important to you. The indicator is often a complex case-definition which is applied to each respondent and returns a pass / fail classification. This sort of indicator can be thought of as a coverage indicator. The most common programs for which coverage is estimate are EPI and CMAM. Both of these tend to use a precision of +/- 10% or better. A random sample of n = 96 gives this for any proportion. For a cluster-sampled survey we usually assume a design effect of 2 (unless we know better). Then gives n = 96 * 2 = 192. Cluster-sampled surveys work best with many small clusters with "many" usually defined as >= 30 clusters. Assume you need 30 clusters. The cluster sample size is then 192/30 = 6.4 which should be rounded up to 7. This is the same as the standard 30-by-7 EPI coverage survey. This is good for estimating a single proportion. For many proportions (e.g. age-specific proportion) you will need a bigger sample size. For me, n = 210 collected as 30-by-7 would be good enough for M&E / surveillance. For nutritional anthropometry you could use the PROBIT approach which works well at small sample sizes and is implemented in the SMART software. This sample size is also suited to the LQAS approach developed by FANTA for classifying the prevalence of wasting.
In summary ... your proposal for n = 333 is plenty.
To address the mortality sample size issue ... I need more information (i.e. expected rates, required precision, duration of recall period, and average household size). You may want to use the new informant method (also developed by FANTA).
I hope this helps.
Mark Myatt
Technical Expert
Answered:
13 years agoFrom Bradley Woodruff:
Dear All:
Thanks to Mark for his very clear explanation. One additional point you should remember is that the standard IYCF indicators, as recommended by WHO and UNICEF, apply to age groups of differing width, and some of these age groups are quite narrow. For example, introduction of complementary foods is calculated only in children 6-8 months of age, while ever breastfed is calculated for all children less than 24 months of age. Therefore, if you are recruiting children in different age groups from the same sample and you are calculating a sample size for more than one IYCF indicator, you must find a common unit into which the sample size for each indicator can be converted so that you can compare the various sample sizes you have calculated. For example, if you calculate that the sample sizes for introduction of complementary foods and ever breastfed are both 333, as recommended by Mark, and you are conducting a household survey, which indicator requires visiting more households? You do not know this until you convert the sample size of 333 children 6-8 months of age and the sample size of 333 children 0-23 months of age into the number of households you must visit to find the 333 children in each age group.
Let's work through an example. If we know, for example, that 18% of the population is less than 5 years of old and that the average household size is 5.5 persons, we can calculate the average number of children in each age group who will be found in each household. If we assume that infant mortality and child mortality are neglible (which may not be true in some populations), then about 40% of the under five population is under two, and 7.2% of the population is less than 24 months of age (18% x 0.4). The age group 6-8 months represents 3 months of the 59 months in the first 5 years of life; therefore, children 6-8 months make up 0.92% of the population (18% x [3/59]). Now multiply the average household size by the proportion of the total population made up of each target group to get the average number of children in each age group per household. For children less than 24 months, this would be 0.4 child per household (0.072 x 5.5 = 0.396). For children 6-8 months of age, this would be 0.05 children per household (0.0092 x 5.5 = 0.05).
Now to calculate how many households you will have to visit to find the 333 children for each indicator. For children less than 24 months of age, you will have to go to about 2.5 households to find one eligible child (1 / 0.4). To find 333 children, you will need to visit 833 households (333 / 0.4). For children 6-8 months of age, you will have to go to 20 households to find one eligible child (1 / 0.05). To find 333 children, you will need to visit 6,660 households! (333 / 0.05) Therefore, you will have to go to many more households to find children for the indicator introduction of complementary food than for the indicator ever breastfed. So even though the sample size for children may be the same, when it comes to the sampling unit (in this example, households) the sample sizes are very different. In fact, because some of the IYCF indicators, such as introduction of complementary foods, are calculated in children from such a narrow age range, it is essentially impractical to measure them in household surveys. You may need to find some other sampling frame, such as population registrations or MCH registrations, from which to sample such children.
Regards,
Woody
Tamsin Walters
Forum Moderator
Answered:
13 years agoDear Mark, Tamsin and Marie
Thank you so much for your assistance on the elaborating the sample size calculations. The explanations you gave are very useful guidance. Mark as you stated we are basically trying to gather baseline information on multiple indicators to help us monitor progress on High Impact Nutrition Interventions which on top of Anthropometry indicators is aiming to gather adequate information on IYCF indicators. Therefore, as you may have seen my communication earlier is to consolidate IYCF indicators in to the general survey but also to add enough sample size for under two years old.
Based on local level discussions we felt that we need to increase the sample size from around the 300 to around 1000 to capture both IYCF and other indicators. Hence, considering suggestions of Mark and Tamsin I think we may now recalculate the sample size for each indicator and see which sample size will be adequate enough to enable us collect data. But also we will gather information on anthropometry, mortality, hygiene and sanitation and etc.
I will come back to you for your invaluable assitance
Regards,
Anonymous
Answered:
13 years agoWoody is more familiar with the specifics of the indicator(s) than I am and what I write now may be silly.
The indicator(s) vary with age. We should expect this since we don't (e.g.) consider exclusive breastfeeding to be appropriate for the older child. My thinking is that all you really want to do is is apply a case-definition that tells you whether a given child is exposed to adequate or inadequate IYCF practices. The case-definition that is applied will have different sets of clauses for different age-groups but should still produce a binary pass / fail classification for every child regardless of their age. In this case you are estimating a single proportion and the sample size calculation is simple and the sample size required quite small.
This "common indicator" approach was developed by Arimond and Ruel (International Food Policy Research Institute) for in DHS surveys. Their indicator was call ICFI. I think the IYCF should not be much different ... if it is then I think that a simpler indicator set is required that is better suited to simple low cost surveys. In the meantime, I suggest we use the ICFI with the addition of exclusive breastfeeding for the 0-6 month age-group.
What you lose from this approach is an ability to "decompose" the indicator ... by this I mean that you might find that < 70% of children receive a "pass" classification but, with a small sample size, it may not be possible to identify the exact nature of failure.
Just my tuppence.
Mark Myatt
Technical Expert
Answered:
13 years agoDear All,
I have the same kind of question about a sample size...
The KAP will include IYCF, WASH and GBV questions in a camp context...
I calculated the sample size required for the IYCF indicators ,
So we have for Camp 1: 146 individuals
Indicators Prevalence (p1) Expected
Prevalence (p2) Sample Size
Exclusive Breastfeeding under 6 Months 55% 71% 141
Minimum dietary diversity (6 – 23 months) 73% 86% 146
For Camp 2: 233
Indicators Prevalence (p1) Expected
Prevalence (p2) Sample Size
Exclusive Breastfeeding under 6 Months 29% 43% 201
Minimum dietary diversity (6 – 23 months) 73% 86% 233
Based on the results above, the sample size is 146 for Camp 1 and 233 for Camp 2.
However, I understood that this figure has to be multiplied by four to put into consideration the four distinct age groups namely 0 – 5, 6 – 11, 12 – 17, and 18 – 23.
Therefore, the final sample size for Camp1 would be 584 and 932 for Camp 2 which is HUGE !
What am I doing wrong here?
Thanks for your help...
Alexandra Rutishauser-Perera
Answered:
12 years ago