However, I think it misses a big contribution of HIA: demonstrating the absence of a need to risk everything on AGI.
I don’t think this is a real contribution. I don’t think people are trying to make AGI because they are concerned that there will be an insufficient number of high IQ humans alive in the next few decades. I think they’re trying to make it because they think they can.
And also because they [rightly or wrongly] believe that AGI will be more cost effective, more controllable, need less sleep and have higher problem solving potential than even the smartest possible humans. And be here a lot sooner. (And in some of the AGI fantasies, a route to making humans genetically smarter anyway!)
-
Even if one assumes near term “AGI” has a fairly low ceiling,[1] it seems like “intelligence augmentation” is unpromising as an EA intervention.[2] The necessary research is complex, expensive, long term and dependent not just on germline engineering, but on academic research to understand what intelligence is in less shallow terms than we currently do. It’s not clear that there are individual tractable interventions. The quantifiable impact—if it actually worked—would presumably be a tiny proportion of people sufficiently rich and focused on maximising their offspring’s intelligence paying to select a few genes somewhat correlated with intelligence for “designer babies”, with the possibility this might translate enough into real world outcomes to turn a handful of children with already above average prospects into particularly capable and influential individuals. It is not obvious these children will grow up to use their greater talent (real or perceived) for mitigating existential risk or any other sort of greater good[3] Humans with rich, driven parents who’ve been taught about their superiority to ordinary humans from birth don’t sound immune to “alignment problems” either....
As far as germline engineering goes, the more obviously positive quantifiable impacts would be addressing debilitating genetic conditions, where at least we can be confident that the expensive and risky process could alleviate some suffering.
Feels like tractability is the key point here. It doesn’t matter a huge amount if 7 billion is or isn’t the total amount of animals that would counterfactually be saved if all pets were fed vegan diets[1]
What matters is what change can feasibly be achieved by a marginal campaign or food innovation, given that vegan pet food is already a thing which I suspect most vegans are aware of, and most pet owners are not vegans. Also, many vegans are comfortable feeding their pets (or in the case of one person I know, an entire zoo) with omnivorous or carnivorous diets.
I suspect the returns to campaigning would look like marginal returns to vegan advocacy and meat alternatives research for humans, but it feels like this is where the evidence would be most interesting.
the order of magnitude seems plausible when considering how many more animals free ranging domestic cats alone are estimated to kill...