Experienced from my current SMART survey, we faced one issues as HH from one sample cluster doesn't have enough HH to met the sample size demanded for each cluster. The target population is IDP and we have use the update population data and HH list of March 2014 for survey planning and one IDP camps which also selected as sampled cluster have faced sudden population movement as to move this camps and merge with other IDP camps. It was happen during survey team training time and what we got information from camp leader was that all HH was moved to new camps.
In reality when we administer survey for that cluster the actual HH living in that clusters had changed as decrease, only 20 HH. (What our survey sample size for one cluster demanded 21 HH)
So, in this situation which will be the best option to follow in respecting SMART methodology. For me, I'd administered survey all 20 HH from this cluster.
I am not sure if there is a specific SMART way ... there are a few things that I have seen used / used myself:
(1) Take a census sample (i.e. all HH) from this cluster and move on. This is what I have most frequently done. The PPS sample will be a bit off but it usually is in emergency situations. If you are concerned about this then SMART is probably not your best method. A method that weights after data-collection (rather than before as with PPS) might be better.
(2) Drop this PSU and replace it with a contingency PSU. Remember to take (e.g.) 33 clusters and use 11, 22, and 33 only if needed. In situations with poor security I have gone as far as taking 60 instead of 30 clusters and sampling odd numbers with the nearest accessible even numbered cluster as the contingency cluster.
(3) Do (1) above and then top up from the nearest potential PSU (e.g. a neighbouring village).
(4) Special cases ... in your case if you have two camps of about 150 HH each that became two camps of 280 and 20 HH each then you might decide to move the cluster to the 280 HH camp or to split the cluster between the two camps so that you took (e.g.) 2 HH from the small camp and 19 from the large camp.
I don't think it matters much which approach you use as long as you say what happened and what you did. If possible try to make some judgement as to what you did might effect the overall result.
I hope this is of some help.
Mark Myatt
Technical Expert
Answered:
10 years agoI would definitely recommend that you drop this cluster and use a RC (replacement cluster).
Blessing Mureverwi
Answered:
10 years agoSMART has some solutions for such case. You can combine a nearby village which was not select as cluster initially with the village with fewer households than required. The second option is that you can do the few households you are able to get in that village and move on with other clusters, the non respondent percent you added at the sample size calculation will take care of the shortcoming.
Anonymous
Answered:
10 years agoThanks for you all replies.
In this survey we took 15% NRR in Sample size calculation. So, we made decision on taking 20 HH from that issue cluster and just watch the over all coverage of HH and children involved in survey, if not reached 10% of Cluster or not got 80% of children, we will go for RC clusters.
nicky
Answered:
10 years agoYour decision is good Nicky.
Blessing Mureverwi
Answered:
10 years agoThe issue is not so much that you will fail to meet your sample size and lose a little precision but that the representativeness of the sample is jeopardised. You included the original PSU in the sample by PPS (probably) because it had a large population. Now it has a small population (c. 20 HH ... equivalent to a small village). The best approach, As Blessing indicates, is probably to drop the original PSU and replace it with a contingency PSU. That should maintain the PPS nature of the sample.
Mark Myatt
Technical Expert
Answered:
10 years agoHere are some thoughts on the issues....
If the team arrives at a cluster and there are not a sufficient number of households or individuals, one option is to assess those that are there and then use sample weights in the analysis. In the example the goal was 21 HHs and the cluster had only 20 HHs - one less HH will not make affect the estimates in any meaningful way. Therefore I would agree with Nicky on this issue to just sample the 20 HHs
What if there were even fewer HHs, say 10 or fewer? Should a replacement cluster be used or visit a neighboring cluster or other options? Some of these were discussed by others in their responses.
In general, I would not recommend having contingency clusters. When clusters are selected using PPS, they have probability of selection but if all of the clusters are not visited (i.e., the "contingency" clusters), this probability of selection is violated. My recommendation is that if it is thought that some clusters may be may not be accessible due to insecurity or other reasons, the total number of clusters should be increased - same in concept that when households are visited in a cluster, the number of households is increased to account for nonresponse. For example, if a 30 cluster survey is desired, but it seems likely that two clusters may not be accessible, then select 32 clusters. Every reasonable effort should be made to visit all 32 clusters - the teams should not stop once 30 clusters have been visited. It may be that the actual number of clusters assessed could be 32 (all accessible), 31 (one not accessible), 30 (two not accessible), or fewer. The important issue is that the results may be biased if clusters not accesible differ meaninfully in the survey indicators from those assessed. Less of an issue is that when fewer than the target number of clusters are visited, there may be a slight loss in precision.
Most surveys (e.g., DHS and MICS) generally do not recommend replacement clusters for the same reason that most household-based surveys do not recommend replacement households - the potential for introducing more bias to the survey. While not being able to assess a cluster may introduce some bias, cluster replacement has the potential to introduce even more bias. If 30 clusters are to be assessed but one is not accessible, selecting a replacement cluster violates the selection probabilities and may even introduce more bias into the survey results than the loss of one cluster.
Whatever approach is used, I agree with Mark that all procedures in the selection of clusters and households be described in detail so that the reader can make their own judgement on the quality of the methodology and potential affect on the interpretation of the results. The further the a survey drifts from acceptable survey methods, the greater the potential for biased estimates.
Given the constraints of attempting to adhere to the statistical aspects while faced with less than desirable field conditions, there is no such thing as a "perfect" survey but we should strive for a reasonable attempt to attain high quality survey results.
Kevin
Kevin Sullivan
Answered:
10 years agoBased on the information provided I don't think it is necessary to replace the cluster with 20HHs with a replacement cluster (RC) as it can't meaningfully affect your final sample size as stated by Kevin above. I would definitely proceed with surveying the cluster with 20HHs as it is. After all the target is children 6-59 months old and the number of HHs/Cluster are calculated based on the proportion of under-5 years/6-59months old children per HH. Hence as in most cases with surveys on the ground that same proportion could be less or higher per HH. So the non-response in HHs will cancel out each other by this fact and your Survey will still maintain the basic principle of probability sampling, there by avoiding more bias being introduced due to this reason.
However I prefer increasing the number of Clusters to be surveyed instead of the number of HHs (eg. instead of using 30 clusters of 20HHs it is better to use 42 clusters of 14HHs) as this will reduce the variability of responses in a clustered sample. Statistically speaking increasing the number of clusters enhances power more efficiently than does increasing the number of subjects within a cluster.
On the other hand as most of these surveys are emergency nutrition surveys time and logistics as well as financial issues are best maintained within acceptable levels.(so using contingency/replacement clusters would save the much needed time allowing us to target on meeting only our representative sample size with minimal bias being introduced). So these decisions are usually best made at the ground level taking into account the geographic/spatial population distribution/arrangements of the survey area as well as the context, while maintaining its statistical soundness in sampling.
Asfaw Addisu
Answered:
10 years ago