Yes, lots to consider. I talked to a lot of people about how to measure impact, and yes, it’s hard. This is, AFAIK, the first public attempt at cost-effectiveness for this stuff.
I disagree on things like log(minutes). Short-form content is consumed with incredibly low engagement and gets scrolled through extremely passively, for hours at a time, just like long-form content.
In terms of preaching to the converted, I think it takes a lot of engagement time to get people to take action. It seems to often take people 1-3 years of engagement with EA content to make significant career shifts, etc.
I’m measuring cost effectiveness thus far. Some people may overperform expectations, and some people may underperform.
As for measuring channel growth, I expect lots of people to make cases for why their channel will grow more compared to others and this would introduce a ton of bias. The fairest thing to do is to measure past impact. More importantly, when we compare to other places we use CEAs, we measure the impact that has happened, we don’t just speculate (even with good assumptions) the impact that will occur in the future. Small grants/​attempts are made and the ones that work, we scale up.
Yes, lots to consider. I talked to a lot of people about how to measure impact, and yes, it’s hard. This is, AFAIK, the first public attempt at cost-effectiveness for this stuff.
I disagree on things like log(minutes). Short-form content is consumed with incredibly low engagement and gets scrolled through extremely passively, for hours at a time, just like long-form content.
In terms of preaching to the converted, I think it takes a lot of engagement time to get people to take action. It seems to often take people 1-3 years of engagement with EA content to make significant career shifts, etc.
I’m measuring cost effectiveness thus far. Some people may overperform expectations, and some people may underperform.
As for measuring channel growth, I expect lots of people to make cases for why their channel will grow more compared to others and this would introduce a ton of bias. The fairest thing to do is to measure past impact. More importantly, when we compare to other places we use CEAs, we measure the impact that has happened, we don’t just speculate (even with good assumptions) the impact that will occur in the future. Small grants/​attempts are made and the ones that work, we scale up.