While most of us into AI safety primarily worry about alignment, I think it’d be worth looking into Perrow’s idea of “normal accidents” applied to risks from the use of AI.
Here’s a paper tackling this issue: https://www.achan.ca/publication/iclr-rai-2021-ai-risks/iclr-rai-2021-ai-risks.pdf
A few additional papers that look into this topic, that might be of interest: https://dl.acm.org/doi/10.1145/3278721.3278766
https://www.mdpi.com/2409-9287/6/3/53
https://www.tandfonline.com/doi/abs/10.1080/13523260.2019.1576464?journalCode=fcsp20
And (more narrowly focused on NAT in LAWS) https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3161446