And I guess also more generally, again from a relatively outside perspective, it’s always seemed like AI folks in EA have been concerned with both gaining the benefits of AI and avoiding X risk. That kind of tension was at issue when this article blew up here a few years back and seems to be a key part of why the OpenAI thing backfired so badly. It just seems really hard to combine building the tool and making it safe into the same movement; if you do, I don’t think stuff like Mechanize coming out of it should be that surprising, because your party will have guests who only care about one thing or the other.
And I guess also more generally, again from a relatively outside perspective, it’s always seemed like AI folks in EA have been concerned with both gaining the benefits of AI and avoiding X risk. That kind of tension was at issue when this article blew up here a few years back and seems to be a key part of why the OpenAI thing backfired so badly. It just seems really hard to combine building the tool and making it safe into the same movement; if you do, I don’t think stuff like Mechanize coming out of it should be that surprising, because your party will have guests who only care about one thing or the other.