Great write-up. Thanks for doing this, and thanks for your work!
You mentioned that “Over the past year and a half, a smaller fraction of people responded to the survey,” but I don’t think you report what those percentages are? The closest I can see is “200+ clients” and all the various n values, which seem to peak around 60. But you don’t report your current number of clients, so I can’t take much from these data. Can you report approximately what fraction of people responded in 2020 vs previous years?
I just checked, and 43% of clients who started coaching in 2020 filled in the survey, compared to 81% of clients who started coaching in 2018.
I see, thanks! Any ideas why? Maybe just because you have more clients now, and larger groups tend to have lower response rates for this sort of thing?
I’m guessing it’s mostly because I put less emphasis on them filling it out. When I started coaching, I got more information from new data than I do now, so I put more effort into getting as many people as possible to fill it out. Additionally, I got feedback that it seemed strange paying clients were spending so much time giving me feedback. So now, e.g., I haven’t been following up as much if people don’t fill it out, and the ask is probably easier to ignore.
Larger groups, coaching busier clients on average, and only asking at the end (instead of also after the first four calls) might also contribute.