@ksullivanwiley @LeverhulmeTrust @ConBiology Thanks so much-sorry it is 4 papers in a 5 tweet thread. But if you are interested in the mechisms stuff read the Cons. Biology one https://t.co/KcUmnsRIX8. For more on why qualitative evaluation wld have given same answer for water quality, see https://t.co/zfHiM4OEyE
Excluding cattle improved water quality locally but there was no impact of incentives on quality of water consumed by people. Rather depressingly (given the effort) we show qualitative evaluation would have told us that with the RCT. 3/5 #FLARETC20 https://t.co/SGENlr2DiA https://t.co/roVU51xB8q
Water quality: While keeping cattle out of rivers improved water quality locally, there was no detectable impact of the intervention (offering WaterShared incentives) on water quality consumed by people. 6/14
https://t.co/JcC1pW7irY https://t.co/Feavy5Clz1
@ivanscales @EdwinPynegar We have published 2 papers on a landscape-scale RCT of PES in Bolivia. The conclusions were, we didn't need the RCT to get the answer we got about water quality https://t.co/zfHiM4OEyE but it was helpful in the deforestation analysis https://t.co/NtL8TBwFOd
In previous work we have also shown that while excluding cattle has a positive impact on water quality locally, the scheme did not measurably impact water quality at the landscape scale (see Pynegar et al for a detailed explanation of why). https://t.co/zfHiM4OEyE https://t.co/HDv0DQA91e
Take a look at it together with its ‘twin’ – https://t.co/00deAQij2L – using same #RCT to evaluate program's #waterquality impacts. Many similarities & some differences – #water analysis more complicated due to spatial effects & monitoring challenges...
https://t.co/wDSxzITQo1
@StephenWoroniec Fantastic questions. I certainly don’t think RCTs represent a gold standard for impact evaluation. We discuss a lot of limitations of RCTs in the water quality evaluation (& show the same result could have been obtained without the costly RCT) https://t.co/zfHiM4OEyE
In a previous paper we have also showed that the intervention (which also incentivized farmers to keep cattle out of waterbodies) did not have a measurable impact on water quality consumed in villages. (8/12)
https://t.co/zfHiM4OEyE https://t.co/qsfHuJtb1c