Thank you for this post! I will make sure to read the 5ā5 books that I havenāt read yet, especially excited about Joseph Heinrichās book from 2020, had read The Secret of Our Success before but not that one.
I actually come from an AI Safety interest when it comes to moral progress. The question is to some extent for me on how we can set up AI systems so that they continuously improve āmoral progressā as we donāt want to leave our fingerprints on the future.
In my opinion, the larger AI Safety dangers come from ābig data hellā like the ones described in Yuah Noah Harariās Homo Deus or Paul Christianoās slow take-off scenarios.
Therefore we want to figure out how to set up AIs in such a way that automatically improves moral progress in the structure of their use. Iām also a believer that AI will most likely in the future go through a similar process to the one described in The Secret of Our Success and that we should prepare appropriate optimisation functions for it.
So, if you ever feel like we might die from AI, I would love to see some work in that direction! (happy to talk more about it if youāre up for it.)
Hi Jonas! Henrichās 2020 book is very ambitious, but I thought it was really interesting. It has lots of insights from various disciplines, attempting to explain why Europe became the dominant superpower from the middle ages (starting to take off around the 13th century) to modernity.
Regarding AI, I think itās currently beyond the scope of this project. Although I mention AI at some points regarding the future of progress, I donāt develop anything in-depth. So sadly I donāt have any new insights regarding AI alignment.
I do think theories of cultural evolution and processes of mutations and selection of ideas could play a key role in predicting and shaping the long-term future, whether itās for humans or AI. So Iām excited for some social scientists or computer modellers to try to take this kind of work in a direction applied to making AI values dynamic and evolving (rather than static). But again, itās currently outside of the scope of my work and area of expertise.
Thank you for this post! I will make sure to read the 5ā5 books that I havenāt read yet, especially excited about Joseph Heinrichās book from 2020, had read The Secret of Our Success before but not that one.
I actually come from an AI Safety interest when it comes to moral progress. The question is to some extent for me on how we can set up AI systems so that they continuously improve āmoral progressā as we donāt want to leave our fingerprints on the future.
In my opinion, the larger AI Safety dangers come from ābig data hellā like the ones described in Yuah Noah Harariās Homo Deus or Paul Christianoās slow take-off scenarios.
Therefore we want to figure out how to set up AIs in such a way that automatically improves moral progress in the structure of their use. Iām also a believer that AI will most likely in the future go through a similar process to the one described in The Secret of Our Success and that we should prepare appropriate optimisation functions for it.
So, if you ever feel like we might die from AI, I would love to see some work in that direction!
(happy to talk more about it if youāre up for it.)
Hi Jonas! Henrichās 2020 book is very ambitious, but I thought it was really interesting. It has lots of insights from various disciplines, attempting to explain why Europe became the dominant superpower from the middle ages (starting to take off around the 13th century) to modernity.
Regarding AI, I think itās currently beyond the scope of this project. Although I mention AI at some points regarding the future of progress, I donāt develop anything in-depth. So sadly I donāt have any new insights regarding AI alignment.
I do think theories of cultural evolution and processes of mutations and selection of ideas could play a key role in predicting and shaping the long-term future, whether itās for humans or AI. So Iām excited for some social scientists or computer modellers to try to take this kind of work in a direction applied to making AI values dynamic and evolving (rather than static). But again, itās currently outside of the scope of my work and area of expertise.