The example of the student is if fair, but my claim is that you can get those effects in cheaper ways than a retreat. For any given community retreat, only a couple people will attend with profiles for which it’s realistic that a retreat can help them get a role (see my point about retreats having too low of a bar). I would want to support these in other ways.
I’m worried though that the scale is too small to power an RCT. But I do like your idea on that we should try to measure the effectiveness of these interventions more rigorously!
Yep, RCT was probably the wrong word. I completely agree with the power concerns. I was more thinking that if one can get some suggestive evidence that might be better than no evidence (even if power is low and the estimated effects aren’t significant at conventional levels).
The example of the student is if fair, but my claim is that you can get those effects in cheaper ways than a retreat. For any given community retreat, only a couple people will attend with profiles for which it’s realistic that a retreat can help them get a role (see my point about retreats having too low of a bar). I would want to support these in other ways.
I’m worried though that the scale is too small to power an RCT. But I do like your idea on that we should try to measure the effectiveness of these interventions more rigorously!
Yep, RCT was probably the wrong word. I completely agree with the power concerns. I was more thinking that if one can get some suggestive evidence that might be better than no evidence (even if power is low and the estimated effects aren’t significant at conventional levels).