Thanks that is super helpful although some downvotes could have come from what might be perceived as a slightly infantilizing tone—haha! (no offense taken as you are right that the information is really accessible but I guess I am just a bit surprised that this is not more often mentioned on the podcasts I listen to, or perhaps I have just missed several EAF posts on this).
Ok so all major funders of AI safety are personally, and probably quite significantly going to profit from the large AI companies making AI powerful and pervasive.
I guess the good thing is then as AI grows they will have more money to put towards making it safe—it might not be all bad.
Ok so all major funders of AI safety are personally, and probably quite significantly going to profit from the large AI companies making AI powerful and pervasive.
I know of only two major funders in AI safety—Jaan Tallinn and Good Ventures—and both have investments in frontier AI companies. Do you know of any others?
No, my comments are completely novice and naïve. I think I am just baffled that all of the funding of AI Safety is done by individuals who will profit massively from accelerating AI. Or, I think what baffles me most is how little focus there is on this peculiar combination of incentives—I listen to a few AI podcasts and browse the forum now and then—why am I only hearing about it now after a couple of years? Not sure what to think of it—my main feeling is just that the relative silence about this is somehow strange, especially in an environment that places importance on epistemics and biases.
Thanks that is super helpful although some downvotes could have come from what might be perceived as a slightly infantilizing tone—haha! (no offense taken as you are right that the information is really accessible but I guess I am just a bit surprised that this is not more often mentioned on the podcasts I listen to, or perhaps I have just missed several EAF posts on this).
Ok so all major funders of AI safety are personally, and probably quite significantly going to profit from the large AI companies making AI powerful and pervasive.
I guess the good thing is then as AI grows they will have more money to put towards making it safe—it might not be all bad.
I know of only two major funders in AI safety—Jaan Tallinn and Good Ventures—and both have investments in frontier AI companies. Do you know of any others?
No, my comments are completely novice and naïve. I think I am just baffled that all of the funding of AI Safety is done by individuals who will profit massively from accelerating AI. Or, I think what baffles me most is how little focus there is on this peculiar combination of incentives—I listen to a few AI podcasts and browse the forum now and then—why am I only hearing about it now after a couple of years? Not sure what to think of it—my main feeling is just that the relative silence about this is somehow strange, especially in an environment that places importance on epistemics and biases.
I think most people don’t talk about it because they don’t think it’s a big deal. FWIW I don’t think it’s a huge deal but it’s still concerning.