How much of a post are you comfortable for AI to write?
This poll is NOT about using AI for brainstorming, research or analysis. Its not about who came up with the ideas or the post quality. The question asks who writes the words of the post, who writes the final copy.[1] I think there are good arguments on both sides, with some takes in this thread here.
I’m aware the question has some ambiguity. I imagine the poll to be quantitative[2], so the midpoint might be half the words written by AI. This could be a heavy AI edit where a human writes first, then half the words were changed, or perhaps AI drafts first then half the words are then written by a human. Feel free to interpret the spectrum how you like.
- ^
Its also not asking how AI might be used to write, for example whether you’ve trained it to copy your voice and writing well. Its a quantitative question—who actually wrote the words?
- ^
This poll may not capture the most important questions about AI writing. Questions about who came up with the ideas and structure might be more important in the long run, especially after AI starts to actually write as well as very good human writers, which I believe it can’t yet.
The main benefits I have in mind from allowing an AI to write ~the whole post (over just helping in other ways):
Someone who isn’t confident in their (English) writing ability.
Saving time or reducing other opportunity costs for the author.
If for whatever reason they wouldn’t post it, or not without substantial delay. This is usually because of 1 or 2, but maybe there’d be other reasons.
These are all context- and author-specific considerations. I can imagine preferring a post be AI-written than some possible counterfactuals: not posted at all, posted at much larger opportunity cost to the author, posted but worse to read than what an AI could have done. These point me towards permissibility and letting each author decide.
I think the author or another human should generally look over the post before the author posts it. I don’t think it’s necessary for them to insert their own voice.
thanks @Michael St Jules . I agree with those benefits but there’s no mention here of potential costs? Maybe you don’t think those are significant?
Its a completely different question but are you happy to receive 100% AI written grant application as well? And would you be happy on your grantmaker end to allow your own AI to review that application or would you insist on reading the whole thing yourself?
Just trying to prod a bit and see how far it goes...
I’d prefer human-written applications, because it can be hard to distinguish ~100% AI-written but primarily using the applicants’ own ideas and reasoning from ~100% AI-generated, including writing, ideas and reasoning.[1] Grants are bets on the grantees’ abilities, not just the project idea. However, I tend to also talk to applicants over calls or in person, and see their work in other ways.
I can imagine for a project for which communication by the applicant is an important part of the project’s path to impact, if the application looks AI-written, I would ask them to resubmit or I would reject them, if and because the people the applicant would be communicating to dislike AI writing. This hasn’t come up yet, though.
At this point, I’d insist on at least personally reading parts that are enough to be decisive one way or the other.
Of course, this leaves another possibility (and others in between the different possibilities outlined so far, including no AI use): 100% of the ideas and reasoning come from AI, but the application is 100% written by the applicant. Hopefully by writing it themself, they’ve taken the time to understand what they’re submitting, but it would still be better if the ideas came from the applicant.
If we’re assuming the post would be good quality, then I don’t expect the costs (to me) to be significant, but I’m open to reasons otherwise. If the posts are sometimes low quality or repetitive, then AI could enable more of them, and that would be bad. I’d lean towards allowing 100% AI written posts and seeing what happens to the EA Forum, i.e. tracking the results and reassessing.
Maybe the voting system, minimum karma to post, and throttling based on recent net negative karma posts/comments are enough to handle this without negatively affecting engagement. Banning 100% AI-written posts is a blunt tool, and it seems worth trying other things.
Currently, when I see something that reads as AI written that’s a pretty strong signal that the nominal author doesn’t fully stand behind the post. I really hate it when I engage deeply with the arguments in a post and write a carefully reply, only to learn that the author wasn’t really trying to say that and didn’t review the output of their AI carefully enough.
Currently, I think AI writing isn’t good enough to be better than good human users of the Forum, but I think this will quickly change, and I want to prioritise ideas and impact over who wrote the final words. I expect it will be longer before AIs are at the frontier of doing EA research and cuase-prioritization, so I think posts with only AI ideas will be bad for a longer time to come. But posts with human ideas written up well by an AI I could well imagine being better quality than most Forum writer’s posts within a year or two.
I feel differently if someone is writing something to me personally, if someone writes me a poem or a birthday card or something that has sentimental value, then AI writing reduces that. But the Forum I see as primarily content-value rather than sentimental value.
I value content and human connection about equally on the EA forum. Its a “forum” after all, I think human-to-human forum discussion has far more value than just “sentimentality” We are a group of people working together to find the best ways to make the world better and put those plans into action. That needs connection and comradery, with perhaps some sentimentality too. I think if a forum is reduced to only “content value” it will cease to be a forum at all in some ways, and will lose significance.
On the content front, If forum posts with human ideas heavily written by AI were better than or as good human posts, I think your argument would be stronger but right now they are not. I challenge you to find one excellent forum post which is over 50% written by AI. It may be there but I doubt it. From a forum norms perspective, don’t think there’s a lot of value speculating about the future here, we need to adjust to AI reality as it comes.
Nuance, I’d be happy for an AI to write a draft, but (at this time) I will never publish something without a thorough review and strong work to put it in my own voice. I will never let a single AI-written word go unreviewed. (This is the same for ghostwritten posts made on my behalf, I don’t think AI changes much here).
Our authorial voice and trust that people put in our words is one of the few things we really have left that makes us human. When I catch it, I find reading AI-written (or ghostwritten) content gross and disturbing, because it signals to me that the author has no respect for my time, or their own humanity. I know that’s an extreme position but I find it hard to take any other one.
Yep that’s similar to where I am at too, although I’m a bit less extreme. Much if it for me is about respect for their and my humanity although in still confused and haven’t figured out the nuance.
This particular question is about how many words of the final product are written by a human vs. AI. I don’t think you’ve voted though?
Well, like, I don’t care who wrote the words but I do care about who took ownership of them. If an I happened to write in my style/voice and I reviewed it and posted it, would you consider that my writing or the AI’s?
By this poll’ definition the AI wrote the whole thing. This poll isn’t about style or substance, it is about who actually wrote the words. I think though (disturbingly) most people seem happy to take ownership of AI written words, I don’t think that’s a big issue.
This question though is asked in the context of AI right now and I don’t think AI can actually write nearly as good as a decent writer, even when prompted and guided to write in their voice. So I think your question might be theoretical at this point in some way?
Also you said “Our authorial voice and trust that people put in our words is one of the few things we really have left that makes us human.” If we didn’t write the words, is it actually our human voice? Even if if it sounds a lot like us?
At least until people accept that “oh the AI wrote that bit, I don’t exactly mean that” is unacceptable. If you post it, you should stand behind every word.
I would definitely want a human reviewing and possibly iterating, but if that is happening and the AI is drafting, that’s fine.
I’m comfortable with something around 30% which is aroundabout where I feel people’s distinctive voice begins to fade
I do understand the arguments of the “100%ers” AI can reduce the friction and time to post, can help English second language speakers and can help people express themselves better.
But with AI in between the writer and the reader we lose part of the soul and even beauty in communication. I want to talk with you. I want to hear your voice. Are those your words? Did they come from directly from your mind? Ideas and structure is important, but the words themselves matter at least as much to me—an expression of ourselves and the people we are. What are we without our own words?
If we’re happy with discourse without our own words, where does that leave us? Someone’s AI bot writes a post, my AI bot replies, then maybe we read it later? This kind communication is less real, and quickly fades into irrelevance.
I’m happy to pay the time and friction costs to keep our communication pretty close to human-to-human. Its already hard enough to have good discourse on the internet without speaking face-to-face.
I agree 100% that there should be places where AI written discourse is welcomed, personally I would rather that wasn’t this forum.
The only parts I’d let AI write are those where I’m unsure if my phrasing is really natural in English and I ask for a better one.
If I’m not the one writing the post, I don’t see why anyone should bother reading it.
AI sucks at writing and doesn’t get my style at all. If it did, I’d let it write the whole thing. (Yudkowsky predicts we have about 2 more years until AI learns to write.)
One day the AIs can be much better at writing but that day is not today
That is true.
Even when they do become better than us at writing, I might be keen to keep discourse spaces separate. some spaces where humans can talk just with humans and others where it’s everyone together. Obviously the AIs will be talking to each other on a scale hard to fathom.
I think if we get too used to mixing it might be difficult to separate down the line too.
This is absurdly speculative though.
I have a particular writing style that I consider my “voice”, and I fundamentally take pride in my writing skill and see writing as a craft and art form, so I refuse to use AI to write a single word of what I would publish to the world.
To me, using AI for writing is equivalent to having someone else write it for you.
I largely agree—I think its similar in many ways to having a ghostwriter
Good for brainstorming first drafts, but I’m not comfortable having it write everything, even if the content is right and coherent.
Seconding what @huw wrote: I’d be happy for an AI to write a draft, but (at this time) I will never publish something without a thorough review and strong work to put it in my own voice. I will never let a single AI-written word go unreviewed.
Also I usually also ask humans to review my drafts even after I have a first/final pass, and the ideas that I input into the prompt are mine, not just something I asked AI to create. Also, my AI tools know my voice quite well at this point and I’m constantly tweaking the instructions.
There’s some ambiguity as to whether this is a personal preference question (I.e., I would never post something drafted by an AI, but don’t have a problem if you do) or a normative question (I. E., I would never post something drafted by an AI and neither should you.
Yeah the question isn’t perfect. It’s a personal question which could apply to you or others. It’s about what you are comfortable with others and yourself doing in the forum here.
The ambiguity in this regard may give the impression that there is more hostility toward people using AI to draft things than there actually is.
I’m pretty comfortable with AI taking rough ideas / bullet points and turning them into paragraphs, from which the author can then edit and refine.
I consider myself a good writer, in the sense that I can express my thoughts clearly, but I find that’s different from being able write them down if I have a mental block.
Some people are proficient at dashing down their thoughts without resistance to getting started. I’m not one of those people and I’m sure there are many like me.