Trying to figure out how EA can use AI better, both to uplift current orgs and to create new tools to positively reshape the world.
I’m really keen to meet people building things with AI, and people interested in making more of that happen within EA. If you’re any of those, please have a really low bar for emailing or booking a call with me.
What are some groups or communities outside mainstream EA that would be worth engaging in our efforts to reduce existential risks? What are some specific areas or projects we could work on together?
Here’s a few other questions that approach that from different angles:
* Who’s the audience for your new book? Within them, who would be most keen to help reduce x-risk, even if it’s not through EA-affiliated orgs or projects?
* What points in common does EA have with the UK Progress community? What can we do on the margin to work more closely together on our shared priorities?
Well, AI sentience probably has <100 people and I’d be joyful if that increased to 1k. I’m still interested even if the question is “How can we fail less misserably at creating a talent pipeline?”
Yep, agree that linear averages might not be the best tool for that. The product of odds sounds interesting. I might give it a read and see if it’s easy to keep track of in my mind
Oh, amazing! I didn’t knew Alex had a Substack. And indeed, it’s full of advice for using LLMs for work.
Here’s a relevant link for those interested: https://lawsen.substack.com/p/lean-into-laziness
On the same genre there’s also these posts from Shakeel Hashim and Peter Hartree on how they use LLMs:
For anyone considering working on the ORCID-TAXID mapping tool, I suspect it might be an unusually approachable project for those with some familiarity with biological publications and programming. Even without what ORCID or TAXID stood for before reading this post, I managed to construct a barebones demo in 30 minutes using ChatGPT and the Europe PMC API (which has an option to search by ORCID ID, though some quick manual searches suggest it isn’t comprehensive). I think in under 30 hours you could build a decently useful product by adding features like:
Querying PubMed too alongside Europe PMC to get better publication coverage
Searching publications by author name (since PubMed doesn’t offer filtering by ORCID ID) and filtering out clear false positives using simple heuristics like author affiliation and publication area
Creating more fine-grained criteria for identifying organisms in publication abstracts and texts
I will message the post authors and offer to do this myself, but if you already have background in biological sciences and are looking for a cool upskilling project, you would probably be a better fit than me for this.
For those wanting a quick encapsulation of Nietzsche’s morality, I recommend Arjun’s other post on the topic. It’s both unusually succinct and well-written.
Oh, sorry. I’ll expand the abbreviation in the original comment. It’s ‘Community Building resources’.
Thanks for putting numbers to my argument! I was expecting a greater proportion of left-leaning individuals among the college educated, so this was a useful update.
A reason why the political orientation gap might be less worrying than it appears at first sight is that it probably stems partly from the overwhelmingly young bent of EA. Young people from many countries (and perhaps especially in the countries where EA has greater presence) tend to be more left leaning than the general population.
This might be another reason to try onboarding older people to EA more relative to the pool of new members, but if you thought that would involve significant costs (e.g. having less young talented EAs because less community building resources were directed towards that demographic), then perhaps in equilibrium we should have a somewhat skewed distribution of political orientations.
Thanks for taking the time to respond! I find your point of view more plausible now that I understand it a little bit better (though I’m still not sure of how convincing I find it overall).
I’m not sure if I understand where you’re coming from, but I’d be curious to know: do you think similarly of EAs who are Superforecasters or have a robust forecasting record?
In my mind, updating may as well be a ritual, but if it’s a ritual that allows us to better track reality then there’s little to dislike about it. As an example of how precise numerical reasoning could help, the book Superforcasting describes how rounding Superforecasters predictions (interpreting .67 probability of X happens as .7 probability of X happening) increases the error of the prediction. The book also includes many other examples where I think numerical reasoning confers a sizable advantage to its user.
What stops AI Safety orgs from just hiring ML talent outside EA for their junior/more generic roles?
I loved how both the title of the post and the first section foreshadow the wild animal welfare turn in the middle of the post. It was truly enjoyable read!