I’d like to point out the possibility of “dual use”:
Tech that can be used to develop a vaccine quickly might (maybe, sometimes, not always) also be used to “print” a pathogen (such as smallpox) cheaply.
Tech that advances what we know about AIs might also help creating an AGI faster, which would leave us less time to figure out how to make it safe.
I didn’t look into the company yet, this is just a response to the things you wrote. I got the sense like this company advances AI capabilities and bio capabilities, which might maybe be used for safety, but also sometimes not.
Here’s a nice post from Scott Alexander about times that good intentions went wrong in this way. It isn’t rare, unfortunately
I’d like to point out the possibility of “dual use”:
Tech that can be used to develop a vaccine quickly might (maybe, sometimes, not always) also be used to “print” a pathogen (such as smallpox) cheaply.
Tech that advances what we know about AIs might also help creating an AGI faster, which would leave us less time to figure out how to make it safe.
I didn’t look into the company yet, this is just a response to the things you wrote. I got the sense like this company advances AI capabilities and bio capabilities, which might maybe be used for safety, but also sometimes not.
Here’s a nice post from Scott Alexander about times that good intentions went wrong in this way. It isn’t rare, unfortunately