Here is an intuitive, brief answer that should provide evidence that there is risk:
In the history of life before humans, there have been 5 documented mass extinctions. Humans—the first generally intelligent agent to evolve on our planet—are not causing the 6th mass extinction.
An intelligent agent that is superior to humans, clearly has potential to be another mass extinction agent—and if it turns out humans are in conflict with that agent, the risks are real.
So it makes sense to understand that risk—and, today, we don’t, even though development of these agents is barrowing forward at an incredible pace.
Here is an intuitive, brief answer that should provide evidence that there is risk:
In the history of life before humans, there have been 5 documented mass extinctions. Humans—the first generally intelligent agent to evolve on our planet—are not causing the 6th mass extinction.
An intelligent agent that is superior to humans, clearly has potential to be another mass extinction agent—and if it turns out humans are in conflict with that agent, the risks are real.
So it makes sense to understand that risk—and, today, we don’t, even though development of these agents is barrowing forward at an incredible pace.
https://en.wikipedia.org/wiki/Holocene_extinction
https://www.cambridge.org/core/journals/oryx/article/briefly/03807C841A690A77457EECA4028A0FF9