When reporting AI timelines, be clear who you’re deferring to

It’s fashionable these days to ask people about their AI timelines. And it’s fashionable to have things to say in response.

But relative to the number of people who report their timelines, I suspect that only a small fraction have put in the effort to form independent impressions about them. And, when asked about their timelines, I don’t often hear people also reporting how they arrived at their views.

If this is true, then I suspect everyone is updating on everyone else’s views as if they were independent impressions, when in fact all our knowledge about timelines stems from the same (e.g.) ten people.

This could have several worrying effects:

  • People’s timelines being overconfident (i.e. too resilient), because they think they have more evidence than they actually do.

    • In particular, people in this community could come to believe that we have the timelines question pretty worked out (when we don’t), because they keep hearing the same views being reported.

  • Weird subgroups forming where people who talk to each other most converge to similar timelines, without good reason.[1]

  • People using faulty deference processes. Deference is hard and confusing, and if you don’t discuss how you’re deferring then you’re not forced to check if your process makes sense.

So: if (like most people) you don’t have time to form your own views about AI timelines, then I suggest being clear who you’re deferring to (and how), rather than just saying “median 2040” or something.[2]

And: if you’re asking someone about their timelines, also ask how they arrived at their views.

(Of course, the arguments here apply more widely too. Whilst I think AI timelines is a particularly worrying case, being unclear if/​how you’re deferring is a generally poor way of communicating. Discussions about p(doom) are another case where I suspect we could benefit from being clearer about deference.)

Finally: if you have 30 seconds and want to help work out who people do in fact defer to, take the timelines deference survey!

Thanks to Daniel Kokotajlo and Rose Hadshar for conversation/​feedback, and to Daniel for suggesting the survey.

  1. ^

    This sort of thing may not always be bad. There should be people doing serious work based on various different assumptions about timelines. And in practice, since people tend to work in groups, this will often mean groups doing serious work based on various different assumptions about timelines.

  2. ^

    Here are some things you might say, which exemplify clear communication about deference:

    - “I plugged my own numbers into the bio anchors framework (after 30 minutes of reflection) and my median is 2030. I haven’t engaged with the report enough to know if I buy all of its assumptions, though”
    —“I just defer to Ajeya’s timelines because she seems to have thought the most about it”
    —“I don’t have independent views and I honestly don’t know who to defer to”

Crossposted to LessWrong (38 points, 6 comments)