It’s worth clarifying that the Online team’s budget was much less than $2M budget before 2022, and a lot of the development of the Forum happened between 2018 and 2021 with one developer (JP). The budget and team grew in the last 12 months with FTX funding and significant growth in the EA movement, and now we’re evaluating what portion of the $2M budget to put towards continuing to develop the Forum versus new projects we’re exploring. It’s also worth noting that a portion of the $2M budget goes towards the content team (Lizka), and moderation and support contractors, who I think are super valuable but not the bulk of our budget, so I’ll instead focus on the product/engineering team and the platform in the next part of my response.
When I think of how the Forum compares to other platforms, I see some major tradeoffs. Compared to social media sites like reddit, twitter, and facebook groups, the EA Forum encourages long form content and high quality discussion much better, is a more focused space (with no ads or non-EA content), and indexes and organizes content better. Compared to individual or group blogs, the Forum is much more open (anyone can post), and prioritizes discussion better (commenting features are more hidden on many blogs).
Put together, I think these mean that the EA Forum is a more attractive space for EAs, and ultimately the network of users is a key factor in determining the value of the site.
This isn’t to say that the Forum can claim 100% counterfactual value for every interaction that happens in this space (compared to a world where it didn’t exist and we had a subreddit), but I do think the Forum has been valuable. I wish we could measure this value in a really clean way without too much effort (and we have near term plans to do more work here), but on the other hand I think it’s important we avoid the trap of focusing too much on measurement and evaluation for a public good that has fairly diffuse impact.
It’s worth clarifying that the Online team’s budget was much less than $2M budget before 2022, and a lot of the development of the Forum happened between 2018 and 2021 with one developer (JP). The budget and team grew in the last 12 months with FTX funding and significant growth in the EA movement, and now we’re evaluating what portion of the $2M budget to put towards continuing to develop the Forum versus new projects we’re exploring. It’s also worth noting that a portion of the $2M budget goes towards the content team (Lizka), and moderation and support contractors, who I think are super valuable but not the bulk of our budget, so I’ll instead focus on the product/engineering team and the platform in the next part of my response.
When I think of how the Forum compares to other platforms, I see some major tradeoffs. Compared to social media sites like reddit, twitter, and facebook groups, the EA Forum encourages long form content and high quality discussion much better, is a more focused space (with no ads or non-EA content), and indexes and organizes content better. Compared to individual or group blogs, the Forum is much more open (anyone can post), and prioritizes discussion better (commenting features are more hidden on many blogs).
Put together, I think these mean that the EA Forum is a more attractive space for EAs, and ultimately the network of users is a key factor in determining the value of the site.
This isn’t to say that the Forum can claim 100% counterfactual value for every interaction that happens in this space (compared to a world where it didn’t exist and we had a subreddit), but I do think the Forum has been valuable. I wish we could measure this value in a really clean way without too much effort (and we have near term plans to do more work here), but on the other hand I think it’s important we avoid the trap of focusing too much on measurement and evaluation for a public good that has fairly diffuse impact.
Hope that was helpful.
This isn’t a convincing less of analysis to me, as these two things can both be true at the same time:
The EA Forum as a whole is very valuable
The marginal $1.8M spent on it isn’t that valuable
i.e., you don’t seem to be thinking on the margin.