Post summary (feel free to suggest edits!): AI startups can be big money-makers, particularly as capabilities scale. The author argues that money is key to AI safety, because money:
Can convert into talent (eg. via funding AI safety industry labs, offering compute to safety researchers, and funding competitions, grants, and fellowships). Doubly so if the bottleneck becomes engineering talent and datasets instead of creative researchers.
Can convert into influence (eg. lobbying, buying board seats, soft power).
Is flexible and always useful.
The author thinks another $10B AI company would be unlikely to counterfactually accelerate timelines by more than a few weeks, and that money / reduced time to AGI tradeoff seems worth it. They also argue that the transformative potential of AI is becoming well-known, and now is the time to act to benefit from our foresight on it. They’re looking for a full-stack developer as a cofounder.
(If you’d like to see more summaries of top EA and LW forum posts, check out the Weekly Summaries series.)
Post summary (feel free to suggest edits!):
AI startups can be big money-makers, particularly as capabilities scale. The author argues that money is key to AI safety, because money:
Can convert into talent (eg. via funding AI safety industry labs, offering compute to safety researchers, and funding competitions, grants, and fellowships). Doubly so if the bottleneck becomes engineering talent and datasets instead of creative researchers.
Can convert into influence (eg. lobbying, buying board seats, soft power).
Is flexible and always useful.
The author thinks another $10B AI company would be unlikely to counterfactually accelerate timelines by more than a few weeks, and that money / reduced time to AGI tradeoff seems worth it. They also argue that the transformative potential of AI is becoming well-known, and now is the time to act to benefit from our foresight on it. They’re looking for a full-stack developer as a cofounder.
(If you’d like to see more summaries of top EA and LW forum posts, check out the Weekly Summaries series.)