Iām not sure I get why āSingletons about non-life-maximizing values are also convergentā, though.
Sorry, I wrote that point lazily because that whole list was supposed to be rather speculative. It should be āSingletons about non-life-maximizing values could also be convergent.ā I think that if some technologically advanced species doesnāt go extinct, the same sorts of forces that allow some human institutions to persist for millennia (religions are the best example, I guess) combined with goal-preserving AIs would make the emergence of a singleton fairly likelyānot very confident in this, though, and I think #2 is the weakest argument. Bostromās āThe Future of Human Evolutionā touches on similar points.
Sorry, I wrote that point lazily because that whole list was supposed to be rather speculative. It should be āSingletons about non-life-maximizing values could also be convergent.ā I think that if some technologically advanced species doesnāt go extinct, the same sorts of forces that allow some human institutions to persist for millennia (religions are the best example, I guess) combined with goal-preserving AIs would make the emergence of a singleton fairly likelyānot very confident in this, though, and I think #2 is the weakest argument. Bostromās āThe Future of Human Evolutionā touches on similar points.