What are you developing this talent for? I basically think Horizon is good, but recruiting for Anthropic is bad. So it wouldn’t surprise me if this ROI is actually negative.
Data on MATS alumni show that 80% are currently working on AI safety and 10% on capabilities. 10% is still too high but an 80⁄10 ratio still seems like positive ROI.
(It’s not entirely clear to me because 27% are working at AI companies and I’m nervous about people doing AI safety work at AI companies, although my guess is still that it’s net positive.)
What are you developing this talent for? I basically think Horizon is good, but recruiting for Anthropic is bad. So it wouldn’t surprise me if this ROI is actually negative.
I think this is a legitimate concern.
Data on MATS alumni show that 80% are currently working on AI safety and 10% on capabilities. 10% is still too high but an 80⁄10 ratio still seems like positive ROI.
(It’s not entirely clear to me because 27% are working at AI companies and I’m nervous about people doing AI safety work at AI companies, although my guess is still that it’s net positive.)
People who participate in talent development programs can go on to work in a variety of roles outside of the government and AI companies.