It seems that we’re spending 2 million a year on a glorified subreddit. What’s the donors case for this being a good use of funds? Isn’t the forum good enough as is? Some reddit mods handle ~100x the content, with 100x more traffic, for 0% of the cost.
What have you accomplished that justifies the spend on the forum to date? Couldn’t 99% of this have been accomplished by forking lesswrong and making minor tweaks?
It’s worth clarifying that the Online team’s budget was much less than $2M budget before 2022, and a lot of the development of the Forum happened between 2018 and 2021 with one developer (JP). The budget and team grew in the last 12 months with FTX funding and significant growth in the EA movement, and now we’re evaluating what portion of the $2M budget to put towards continuing to develop the Forum versus new projects we’re exploring. It’s also worth noting that a portion of the $2M budget goes towards the content team (Lizka), and moderation and support contractors, who I think are super valuable but not the bulk of our budget, so I’ll instead focus on the product/engineering team and the platform in the next part of my response.
When I think of how the Forum compares to other platforms, I see some major tradeoffs. Compared to social media sites like reddit, twitter, and facebook groups, the EA Forum encourages long form content and high quality discussion much better, is a more focused space (with no ads or non-EA content), and indexes and organizes content better. Compared to individual or group blogs, the Forum is much more open (anyone can post), and prioritizes discussion better (commenting features are more hidden on many blogs).
Put together, I think these mean that the EA Forum is a more attractive space for EAs, and ultimately the network of users is a key factor in determining the value of the site.
This isn’t to say that the Forum can claim 100% counterfactual value for every interaction that happens in this space (compared to a world where it didn’t exist and we had a subreddit), but I do think the Forum has been valuable. I wish we could measure this value in a really clean way without too much effort (and we have near term plans to do more work here), but on the other hand I think it’s important we avoid the trap of focusing too much on measurement and evaluation for a public good that has fairly diffuse impact.
While I’m sympathetic to the view that ~$2M is too much to spend, the quality of moderation here is much higher than in any open-access, high-volume space I am aware of on Reddit.[1] So I don’t think it is helpful to compare the mod workload here with what “reddit mods handle” (usually large mod teams on the major subreddits).
I think some subreddits do a good job of moderating to create a culture which is different from the default reddit culture, e.g. /r/askhistorians. See this post for an example, where there are a bunch of comments deleted, including one answer which didn’t cite enough sources. Maybe this is what you have in mind when you refer to “moderating with an iron fist” though, which you mention might be destructive!
Seems like the challenge with reddit moderation is that users are travelling between subreddits all the time, and most have low quality/effort discussion norms. Whereas on the Forum, the userbase is more siloed, which I guess would make good quality moderation easier.
I think benchmarking at reddit moderation is probably the wrong benchmark. Firstly, because the tail risk of unpaid moderation is really bad (e.g. the base rate of moderator driven meltdowns in big subreddits is really high). Secondly, I just don’t think we should underpay people in EA because (a) it creates financial barriers to entry to EA that have long-term effects (e.g. publishing unpaid internships have made the wider labour market for journalism terrible) (b) it’ll create huge amounts of more informal barriers that mean we lean on more informal relationships in EA even more.
It seems that we’re spending 2 million a year on a glorified subreddit. What’s the donors case for this being a good use of funds? Isn’t the forum good enough as is? Some reddit mods handle ~100x the content, with 100x more traffic, for 0% of the cost.
What have you accomplished that justifies the spend on the forum to date? Couldn’t 99% of this have been accomplished by forking lesswrong and making minor tweaks?
It’s worth clarifying that the Online team’s budget was much less than $2M budget before 2022, and a lot of the development of the Forum happened between 2018 and 2021 with one developer (JP). The budget and team grew in the last 12 months with FTX funding and significant growth in the EA movement, and now we’re evaluating what portion of the $2M budget to put towards continuing to develop the Forum versus new projects we’re exploring. It’s also worth noting that a portion of the $2M budget goes towards the content team (Lizka), and moderation and support contractors, who I think are super valuable but not the bulk of our budget, so I’ll instead focus on the product/engineering team and the platform in the next part of my response.
When I think of how the Forum compares to other platforms, I see some major tradeoffs. Compared to social media sites like reddit, twitter, and facebook groups, the EA Forum encourages long form content and high quality discussion much better, is a more focused space (with no ads or non-EA content), and indexes and organizes content better. Compared to individual or group blogs, the Forum is much more open (anyone can post), and prioritizes discussion better (commenting features are more hidden on many blogs).
Put together, I think these mean that the EA Forum is a more attractive space for EAs, and ultimately the network of users is a key factor in determining the value of the site.
This isn’t to say that the Forum can claim 100% counterfactual value for every interaction that happens in this space (compared to a world where it didn’t exist and we had a subreddit), but I do think the Forum has been valuable. I wish we could measure this value in a really clean way without too much effort (and we have near term plans to do more work here), but on the other hand I think it’s important we avoid the trap of focusing too much on measurement and evaluation for a public good that has fairly diffuse impact.
Hope that was helpful.
This isn’t a convincing less of analysis to me, as these two things can both be true at the same time:
The EA Forum as a whole is very valuable
The marginal $1.8M spent on it isn’t that valuable
i.e., you don’t seem to be thinking on the margin.
While I’m sympathetic to the view that ~$2M is too much to spend, the quality of moderation here is much higher than in any open-access, high-volume space I am aware of on Reddit.[1] So I don’t think it is helpful to compare the mod workload here with what “reddit mods handle” (usually large mod teams on the major subreddits).
Curating higher-quality content by moderating with an iron fist is easier, but would destroy a significant portion of the Forum’s value in my opinion.
I think some subreddits do a good job of moderating to create a culture which is different from the default reddit culture, e.g. /r/askhistorians. See this post for an example, where there are a bunch of comments deleted, including one answer which didn’t cite enough sources. Maybe this is what you have in mind when you refer to “moderating with an iron fist” though, which you mention might be destructive!
Seems like the challenge with reddit moderation is that users are travelling between subreddits all the time, and most have low quality/effort discussion norms. Whereas on the Forum, the userbase is more siloed, which I guess would make good quality moderation easier.
I think benchmarking at reddit moderation is probably the wrong benchmark. Firstly, because the tail risk of unpaid moderation is really bad (e.g. the base rate of moderator driven meltdowns in big subreddits is really high). Secondly, I just don’t think we should underpay people in EA because (a) it creates financial barriers to entry to EA that have long-term effects (e.g. publishing unpaid internships have made the wider labour market for journalism terrible) (b) it’ll create huge amounts of more informal barriers that mean we lean on more informal relationships in EA even more.
Just noting that there is already an effective altruism subreddit. I think we should post in both places and see if the difference is worth the cost