In case of developing technologies for general near term harm, one needs to look at the effects their technology is having on the customers and others affected. But, as with all technology, there can be good and bad uses of it. In regard to existential risk, it is hard to know ahead of time what will cause existential risk. Humans are already bad at predicting the future and we can’t expect to stop all technological progress for the sake of some microscopic existential risk not measured empirically. It would be better to have a educated society that is ready to work towards difficult problems at the drop of a hat if it poses a risk to humanity. We have done things in the past to a lesser scale such as the Manhattan project and WWII innovation more generally along with COVID vaccines coming in 1 year instead of the most optimistic prediction at the time of 4 years. Technology in general still has a very high EV in my book.
In case of developing technologies for general near term harm, one needs to look at the effects their technology is having on the customers and others affected. But, as with all technology, there can be good and bad uses of it. In regard to existential risk, it is hard to know ahead of time what will cause existential risk. Humans are already bad at predicting the future and we can’t expect to stop all technological progress for the sake of some microscopic existential risk not measured empirically. It would be better to have a educated society that is ready to work towards difficult problems at the drop of a hat if it poses a risk to humanity. We have done things in the past to a lesser scale such as the Manhattan project and WWII innovation more generally along with COVID vaccines coming in 1 year instead of the most optimistic prediction at the time of 4 years. Technology in general still has a very high EV in my book.