Wholly AI-generated posts should not be allowed on the EA Forum
As a daily reader of the EA Forum, I have found the experience significantly degraded recently. When I come to the /allPosts page, I am confronted with an onslaught of posts with a single upvote, mostly by brand-new users.
I want to give genuine new users a chance and read their stuff, and maybe upvote it. But when I see a pattern of “brand new user wrote long complicated post that currently has no upvotes”, most of the time it’s fully AI-generated, and it’s a waste of my time to read it.
Even just reading through the titles wears me out and makes me want to leave. There will be maybe 15–20 posts for the day, most of which have long, kind of vague titles that take me a minute to parse. (Example title from today: “From AI Tool to Being? - Memory, Time and Reflection as a Possible Architecture of Artificial Identity”)
In principle, I don’t object to using AI to clean up your prose. But as far as I can tell, these posts usually have zero human thought behind them.*
Many of these posts are already automatically flagged as AI by Pangram. Rather than flagging and leaving them, these posts should be deleted. Or at minimum, the “AI-generated” flag should be visible from the /allPosts page so I know I can skip them. But really, nobody wants to read those, so what’s the point in leaving them to clog up the Forum?
*It looks to me like there are bots roaming the web that are autonomously signing up for and writing posts on EAF.
I 100% agree with every sentiment here, I just haven’t seen this as a huge problem. I feel like the mods have done a pretty good job recently of removing AI slop. I only consider posts when they get past about 10 Karma too which might be saving me tho...
I always browse from the /allPosts page so I can see posts in chronological order. Somebody has to be the one to read and upvote a new user’s post first, or else it won’t make it to the front page. But it’s exhausting when >75% of new users are likely-bots who write long and meandering posts that look at first glance like word salad.
Could you please give examples of these posts you seem to be saying are wholly without merit? Scrolling through my feed, it isn’t evident to me to what you are referring.
From today:
Beyond Literalism: Disarming Reward Gaming Through Adversarial Variable Expansion
From AI Tool to Being? - Memory, Time and Reflection as a Possible Architecture of Artificial Identity
THE WIDOW OPPORTUNITY MAP
There are also a few posts that are either AI/human hybrids or fully human-written, from one-day-old accounts, with no summary or thesis statement so I can’t quickly tell whether they’re worth reading. I am not sure what to make of those.
Out of 14 posts today:
5 are definitely real posts from real people
3 are definitely fully AI-generated
3 are not flagged as AI-generated, but they’re written by one- or two-day-old accounts and I am struggling to extract any semantic content by skimming them
3 are written by much older accounts, but those accounts have only one or two posts ever and zero comments
That’s pretty much how it is every day lately.
Your response identifies these as AI generated, but does not explain why they lack merit. I skimmed the articles and it is not clear to me why these articles like these should be discouraged, let alone purged from the forum.
Beyond literalism explains the problem of narrow rewards and the need to design systems that internalize second order effects.
From AI Tool to Being discusses the role of memory and existing across time as something that brings about selfhood and indicates consciousness, rather than just intelligence.
The Widow Opportunity Map proposes a way to disseminate information such that resources can be directed to a vulnerable population.
With 50 karma to your post, it bothers me considerably how popular your position seems to be. I have been deterred, on the margin, from generating posts sharing my ideas. With a job at the moment that takes over 60h/week and not being a fast writer, for me it’s often between doing a series of iterations with Claude/Chatgpt on an idea, or it not being done at all. I feel increasingly alienated from this community, which I have identified with for like 6 years or more, due to this ascendant view I find rather censorious and prejudiced.
I guess I just would ask that people read stuff and evaluate it before condemning it. If something seems to be AI and you don’t want to read further, fine. But going on to condemn it simply on that basis seems very wrong to me. It seems very strange that in this community I am in a small minority thinking this.
Thank you for saying this. A newcomer here with very little karma appreciates your perspective on giving newcomers a chance.
That’s exactly why I want stricter rules: I want to read newcomers’ posts, but right now they are drowned out by AI posts.
For what it’s worth, I appreciate you reading the posts of new users.
LessWrong mods have reported that, apparently, people with AI psychosis are often told by the AI to post their crackpot ideas onto LW, and the mods have to delete a lot of AI slop posts and bad posts by humans with AI psychosis. Could be something similar is going on here, except that the posts aren’t getting deleted.
LessWrong gets a lot of these too, but they land in https://www.lesswrong.com/moderation.
I personally think rate limiting new users would be a good way to help with quality of new posts generally (e.g. maybe you can only comment, at some limited frequency, when you first create an account, and only make top-level posts either via mod approval, or if you hit some reasonable threshhold of comment karma from other people, demonstrating you write things others find valuable to read).
(this is at −1 karma when I left this comment). I’m interested in why folks downvoted this? I understand disagree voting, but was surprised by the downvote, so would be helpful to hear your perspective.
BTW, I didn’t downvote your comment and I think I understand where you’re coming from. It sounds to me like you’re remembering what the forum used to be like and are thinking of ways to preserve or perhaps even bring back that quality.
I agree that some level of moderation is necessary and of course there is already moderation on the forum. But whether a post is worth someone’s time could also be a choice left up to the reader, no?
So perhaps readers could be given more control over what they want to see rather than go the route of restricting newcomers from contributing. For instance, what if account settings allowed readers to filter their feeds by things like account age or author karma? Then that becomes a choice a reader makes, not the community as a whole. I feel that might allow people one way to manage their own attention without placing a lot of barriers on newcomers, some of whom may genuinely be interested in learning, understanding and becoming part of the community.