Iām wondering about ācrazy teenager builds misaligned APS system in a basementā scenarios and to what extent you see the considerations in this report as bearing on those.
To be a bit more precise: Iām thinking about worlds where āalignment is easyā for society at large (i.e. your claim 3 is not true), but building powerful AI is feasible even for people who are not interested in taking the slightest precautions, even those that would be recommended by ordinary self-interest. I think mostly about individuals or small groups rather than organizations.
I think these scenarios are distinct from misuse scenarios (which you mention below your report is not intended to cover), though the line is blurry. If someone who wanted to see enormous damage to the world built an AI with the intent of causing such damage, and was successful, Iād call that āmisuse.ā But Iām interested more in ācrazyā than āomnicidalā here, where I donāt think itās clear whether to call this āmisuseā or not.
Maybe you see this as a pretty separate type of worry than what the report is intended to cover.
Thanks for this work!
Iām wondering about ācrazy teenager builds misaligned APS system in a basementā scenarios and to what extent you see the considerations in this report as bearing on those.
To be a bit more precise: Iām thinking about worlds where āalignment is easyā for society at large (i.e. your claim 3 is not true), but building powerful AI is feasible even for people who are not interested in taking the slightest precautions, even those that would be recommended by ordinary self-interest. I think mostly about individuals or small groups rather than organizations.
I think these scenarios are distinct from misuse scenarios (which you mention below your report is not intended to cover), though the line is blurry. If someone who wanted to see enormous damage to the world built an AI with the intent of causing such damage, and was successful, Iād call that āmisuse.ā But Iām interested more in ācrazyā than āomnicidalā here, where I donāt think itās clear whether to call this āmisuseā or not.
Maybe you see this as a pretty separate type of worry than what the report is intended to cover.