Your argument about the Doorman Fallacy seems to capture the individual layer of a broader dynamic. My question is whether these reduced cognitive costs scale in a qualitatively different way at the collective level.
If many agents begin to delegate not just generation but also evaluation to AI systems, the cost of producing plausible outputs may fall faster than the cost of verifying them. In that case, does the shared epistemic infrastructure — the common ground that makes coordination possible — begin to erode independently of any individual’s cognition?
Put differently: is there a point where individually rational cognitive offloading leads to a collective coordination failure that no single actor intends or can correct?
I think probably yes. Separate to the individual level, the erosion of the collective common ground is probable as AI costs fall and ‘human in the loop’ becomes even more of an exception than it is now. I guess the question then becomes, “In what ways is that bad?”. My first thought is then around the homogenization of human outputs, which could be referred to uncharitably as ‘Mcdonaldisation’. The rational offloading of cognitive labor leading to a dearth of diversity of thought, which no single person intended.
Is that useful? I’m aware that many people in this space have thought about this much more than I have!!!
Yes, exactly — and I think you’re pointing at something real. The homogenization concern is part of it: when AI systems optimize for statistical plausibility rather than semantic precision, the shared language we use for coordination begins to flatten.
But I’d suggest the deeper problem is downstream of that. Shared language is the infrastructure for common knowledge — the recursive structure that lets groups act collectively even under uncertainty. When that infrastructure degrades, individually rational offloading can produce a collective coordination failure that no single actor intended or can reverse.
This is what I’ve been trying to map out — not as a critique of AI tools per se, but as a structural risk that emerges from the aggregate of individually reasonable choices.
Is it fair to characterize it as a slippery slope then?
I hadn’t really considered the degradation of shared language structures due to the homogenization of outputs as a stand alone structural risk of AI use. There is something there for sure though. So in answer to the question ‘why is it bad?’ your saying that there is a degradation our ability to act collectively in conditions of uncertainty and is essentially irreversible?
Not quite a slippery slope — I’d call it a structural trap. A slippery slope implies a speculative causal chain. What I’m describing is closer to a coordination equilibrium: once enough agents rationally offload verification, the individual incentive to maintain independent epistemic standards collapses, because the social environment has already shifted. It’s less “one thing leads to another” and more “individually rational choices aggregate into a collectively irrational outcome” — which is a different kind of argument.
On irreversibility: not necessarily permanent, but the feedback loops make it self-reinforcing. The more the shared language degrades, the more expensive independent verification becomes, the more rational offloading becomes. Breaking that loop requires collective action — which is precisely what the degraded infrastructure makes harder.
So yes: the core claim is that AI-driven homogenization erodes the shared epistemic infrastructure on which collective action depends — and that this is a structural risk, not a moral panic about technology.
Your argument about the Doorman Fallacy seems to capture the individual layer of a broader dynamic. My question is whether these reduced cognitive costs scale in a qualitatively different way at the collective level. If many agents begin to delegate not just generation but also evaluation to AI systems, the cost of producing plausible outputs may fall faster than the cost of verifying them. In that case, does the shared epistemic infrastructure — the common ground that makes coordination possible — begin to erode independently of any individual’s cognition? Put differently: is there a point where individually rational cognitive offloading leads to a collective coordination failure that no single actor intends or can correct?
Thanks for the comment!
I think probably yes. Separate to the individual level, the erosion of the collective common ground is probable as AI costs fall and ‘human in the loop’ becomes even more of an exception than it is now. I guess the question then becomes, “In what ways is that bad?”.
My first thought is then around the homogenization of human outputs, which could be referred to uncharitably as ‘Mcdonaldisation’. The rational offloading of cognitive labor leading to a dearth of diversity of thought, which no single person intended.
Is that useful? I’m aware that many people in this space have thought about this much more than I have!!!
Yes, exactly — and I think you’re pointing at something real. The homogenization concern is part of it: when AI systems optimize for statistical plausibility rather than semantic precision, the shared language we use for coordination begins to flatten. But I’d suggest the deeper problem is downstream of that. Shared language is the infrastructure for common knowledge — the recursive structure that lets groups act collectively even under uncertainty. When that infrastructure degrades, individually rational offloading can produce a collective coordination failure that no single actor intended or can reverse. This is what I’ve been trying to map out — not as a critique of AI tools per se, but as a structural risk that emerges from the aggregate of individually reasonable choices.
Is it fair to characterize it as a slippery slope then?
I hadn’t really considered the degradation of shared language structures due to the homogenization of outputs as a stand alone structural risk of AI use. There is something there for sure though. So in answer to the question ‘why is it bad?’ your saying that there is a degradation our ability to act collectively in conditions of uncertainty and is essentially irreversible?
Not quite a slippery slope — I’d call it a structural trap. A slippery slope implies a speculative causal chain. What I’m describing is closer to a coordination equilibrium: once enough agents rationally offload verification, the individual incentive to maintain independent epistemic standards collapses, because the social environment has already shifted. It’s less “one thing leads to another” and more “individually rational choices aggregate into a collectively irrational outcome” — which is a different kind of argument. On irreversibility: not necessarily permanent, but the feedback loops make it self-reinforcing. The more the shared language degrades, the more expensive independent verification becomes, the more rational offloading becomes. Breaking that loop requires collective action — which is precisely what the degraded infrastructure makes harder. So yes: the core claim is that AI-driven homogenization erodes the shared epistemic infrastructure on which collective action depends — and that this is a structural risk, not a moral panic about technology.