I think the problem of entities lying about what they’re doing (especially in low trust regions) is wider than just corporate campaigns. Ultimately charities have to make some sort of decision on how and if to audit whether the outcomes they’re expecting are the ones they’re getting.
Asking whether Sinergia had any way to evaluate whether companies were complying (before or after their intervention) is I think the main reason that it would have been good for VettedCauses to share their initial findings before publication. Sinergia appear to have Brazilian staff focused on this specific issue so they shouldn’t have been ignorant of the relevant law, but it’s possible they intentionally targeted companies they suspected were noncompliant (this is the whole theory of change behind Legal Impact for Chickens) and had some success. It is also possible they targeted companies they suspected were noncompliant and simply believed what the companies said in response. It is also possible there are loopholes and exemptions in the law. But I’d still have to agree that taking 70% of the credit for campaigning against something already made illegal is a bold claim, and some of the other claims Sinergia made don’t seem justifiable either.
I tend to agree, but historically EA (especially GiveWell) has been critical of the “donor illusion” involved in things like “sponsorship” of children in areas the NGO has already decided to fund by mainstream charities on a similar basis. More explicit statistical claims about future marginal outcomes based on estimates of outcomes of historic campaign spend or claims about liberating from confinement and mutilation when it’s one or the other free seem harder to justify than some of the other stuff condemned as “donor illusion”.
Even leaning towards the view it’s much better for charities to have effective marketing than statistical and semantic exactness, that debate is moot if estimates are based mainly on taking credit for decisions other parties had already made, as claimed by the VettedCauses review. If it’s true[1] that some of their figures come from commitments they should have known do not exist and laws they should have known were already changed it would be absolutely fair to characterise those claims as “false”, even if it comes from honest confusion (perhaps ACE—apparently the source of the figures—not understanding the local context of Sinergia’s campaigns?)
I would like to hear Sinergia’s response, and am happy for them to take their time if they need to do more research to clarify.