I am a cognitive scientist who specialized in rationality under radical uncertainty.
For many years I worked full-time in effective altruism community building, communication, and outreach.
I am a cognitive scientist who specialized in rationality under radical uncertainty.
For many years I worked full-time in effective altruism community building, communication, and outreach.
Hey Jay,
Over the years, I have talked to many very successful and productive people, and most do, in fact, not work more than 20 productive hours per week. If you have a job with meetings and low-effort tasks in between, it’s easy to get to 40 hours plus. Every independent worker who measures hours of real mental effort is more in the 4-5 hours per day range. People who say otherwise tend to lie and change their numbers if you pressure them to get into the detail of what “counts as work” to them. It’s a marathon, and if you get into that range every day, you’ll do well.
Firstly, thank you in general for writing this up, this is an important piece of information and creates common knowledge and norms around how to behave related to the topic.
”You still control your own social circle—you don’t have to be friends with jerks just because they are EAs.”
Joining EA at a subjectively still young and starry-eyed age, I equated anyone associating with EA as “living up to the EA principles”. Now being older and more experienced, I see many younger people in EA making the same mistake. By now, I’m convinced that e.g. interest in ethics and actual ethical behavior and character correlate only very mildly. Similarly, there are many people in EA who are not particularly ethical either. Humans are still humans.
During EAG London 2021 @Emerson Spartz and I initiated a informal but successful “Complexity and EA” meetup.
@Michael Hinge wrote “Complexity Science, Economics and the Art of Zen” inspired by the meeting
We now have a Telegram Chat and Discord Server for people interested in the topic, please reach out if you want to get added. (Not posting the link to keep entry selective) (“ComplexitEA”)
Further resources we collected or found relevant:
Making Sense of Complexity (Introduction to Complexity) Comic by Sarah Firth
The Map of the Complexity Sciences by Brian Castellani
Seeing like a State (Slate Star Codex)
Complexity Podcast (Michael Garfield)
Jim Rutt Show Podcast (Jim Rutt)
Thinking in Systems (Donella Meadows) (start here) -- Reading Group
Applied Complexity Science (Joe Norman)
Game B Movement (e.g. Daniel Schmachtenberger)
Nassim Taleb: Fooled by Randomness, Antifragile, Skin in the Game, Black Swan
The Systems Bible (John Gall)
Origin of Wealth (complexity economics)
Physics of Life (and his second book, Freedom and Evolution)
Why Greatness Cannot Be Planned (novelty search)
Scale (by Geoffrey West)
Order Without Design
Map of Cybernetics and Systems Science (Bob Horn)
Complexity Explorer Courses by SFI
Graphic design showing difference between systems thinking/change etc.
Principles of Systems Science George E. Mobus, Michael C. Kalton
In consulting this is also referred to as the “Minto pyramid” or “pyramid principle of communication”: you put the key message and main insight concisely as the first step.
In a fast-paced environment, this means the one piece with the highest information density is ensured to be delivered before e.g. getting interrupted. It also enables the listener to decide whether this topic is relevant early on in the communication and therefore shows respect for their attention.
After delivering the key message you can elaborate on the underlying insights or what brought you to the conclusion. If further elaboration is necessary or there is time for it the receiver of the message can ask further questions.
Here is an image to visualize the principle. The related book is called: “The Pyramid Principle: Logic in Writing and Thinking” by Barbara Minto.
Thank you for reading and reviewing the book for the rest of us!
Disappointed to hear it is close minded in regards to the political framework it comes from.
I do think there are many valid arguments to be made to criticize EA on its own terms and hope this is what the book set out to do.
With my current research together with John Vervaeke and Johannes Jaeger, I’m continuing the work on the cognitive science of rationality under uncertainty, bringing together the axiomatic approach (on which Stanovich et al. build) and the ecological approach.
Here I talk about Rationality and Cognitive Science on the ClearerThinking Podcast. Here is a YouTube conversation between me and John, explaining our work and the “The paradigm shift in rationality”. Here is the preprint of the same argumentation as “Rationality and Relevance Realization”. John also mentions our research multiple times on the Jim Rutt Show.
I’ve always admired your writings on the topic and you were one of the voices that led me to my current path.
I noticed that I missed Elephant in the Brain, it’s a remarkable book and I agree with including it in the next version.
Hidden Games I had not thought of at all.
Thank you!
“utilitiarians should self-efface their utilitarianism” “Parfit suggests adopting whatever moral system seems to be most likely to produce the highest utility” “you may instead need to forget that you ever believed in utilitarianism”
This sounds plausible: you orient yourself towards the good and backpropagate over time how things play out and then learn through it which system and policies are reliable and truly produce good results (in the context and world you find yourself). This is also exactly what has played out in my own development, by orienting toward what produces good consequences and understanding how uncertain the world is (and how easily I fooled myself by saying I was doing the thing with the best consequences when I didn’t) I came out with virtue ethics myself.
”For a while, I have been thinking of writing a post with many similar themes and maybe I still will at some point.” I would read it with joy and endorse a full post being devoted to this topic (happy to read drafts and provide thoughts)
Glad you enjoy it!
Thank you to the many of you who have filled out the Google form as an alternative to writing a comment!
Here are some great points made:
the current average is at EA as a knowledge space being 75% principles/values and only 25% concrete knowledge
Introduction:
What We Owe The Future is heavily upvoted by those who already read it
Removing Factfulness from top line of books as there have been substantial critiques of New Optimism “people on both sides of the ‘is the world getting better’ debate can try to make the world better.”
HPMOR should not be included in the introductory section “it teaches a certain mindset that fits inside Effective Altruism, but fails to introduce many important parts of the community”, the style does not fit the values of a serious movement (person likes it a lot, though)
Ethics:
maybe replace ‘The Moral Landscape’ by Sam Harris with ‘Think’ by Simon Blackburn
Moral Tribes is extremely digestible for a philosophy book, much more so than Practical Ethics
Current ethics list is unfocused: “Parfit is an important ethicist and reasons and persons is important. But he isn’t really more EA than many other ethicists. On Liberty is not really that EA-relevant. Utilitarianism is good. I like Hedonic Imperative but Pearce’s writing style is a turn-off for many, I think. I’d strongly prefer collections of papers/articles than a list of full books. Reading full books is just a terrible strategy for getting a handle on important issues in ethics. If it has to be books, than I would use books that are collections of papers. Particularly: (1) The Oxford Handbook of Population Ethics. And (2) Greaves & Pummer’s Effective Altruism: Philosophical Issues. (But I think you could do even better than these collections if you handpicked papers.) To these I would add (3) Mill’s Utilitarianism (4) Singer’s Expanding Circle. Strongly prefer a small list. Apologies that these thoughts are dashed off and unorganized.”
Rationality:
redundant information, strongly prefer culling all but maybe one or two.
The Scout Mindset was fantastic, and of all the EA books I’ve read, it’s probably the one I’m most inclined to recommend to pretty much everyone I know.
Once again, I just think it’s a bad idea to include all these books that are only tangentially related to EA, but are part of niche subcultures with their own worldviews. We’re not going to get a diverse community with fresh ideas if we filter for people who have a similar culture to current EAs.
https://mitpress.mit.edu/books/handbook-rationality this collection (The Handbook of Rationality) is a more information-dense path to learning this stuff I think. There are likely equally good subs
Economics:
Add Nudge and Make It Stick
Freakonomics is not important to read. It’s just some fun cases of applied economics. It’s not an efficient learning tool and it isn’t focused on important issues. It is entertaining. I don’t think microeconomics is important because it helps with entrepreneurial decisions; these should maybe be considered separately. Quantitative economics is at least as important as micro. Prefer a culled list. Possibly culled to zero.
Black Swan contains some helpful stuff, but it is off-puttingly polemical and not focused on extinction risks. Would make sense in a very large library maybe.
Can’t really see a justification for including Anarchy, State, and Utopia. I think this list is too long. I don’t think EA has a unified or consistent political ideology for short-term nation-states; I think this is a good thing and don’t want a list that implies that EA does have one.
Add Radical Markets by Posner and Weyl and Nudge
AI:
The Alignment Problem, while I would say is overall good, does jump around quite a bit narratively. I would want to read other books in this category before recommending it too strongly.
“Artificial Intelligence: A Modern Approach” is the only book I’m familiar with on the list that I dislike. The vast majority of people need something more accessible.
Animal Liberation was a great “why” book, The End of Animal Farming was a great “how” book. They serve different purposes. Overall, I found Animal Liberation more compelling than The End of Animal Farming, though it is quite a bit denser.
Community and Soft Skill:
How to Make Friends and Influence People
Happiness:
Daniel Haybron’s work on happiness is the best I’ve come across by far: Happiness and Well-Being: Integrating Research Across the Disciplines; The Pursuit of Unhappiness: The Elusive Psychology of Well-Being (Oxford University Press, 2008); Happiness: A Very Short Introduction (Oxford University Press, 2013).
Transhumanism:
Haven’t read ending aging but this seems like a preoccupation of the rationalist community that makes little sense by EA-lights? I’d prefer to get rid of this category.
Other
Would be surprised if anything beyond what’s included in the main EA recommendations is helpful here. Cull!
Biographies of changemakers seem like not particularly important reads?
Are there categories missing?
BioSecurity/Global Catastrophic Biological risks
I think you did an extremely thorough job. Well done!
Connections to other philosophies that value EA principles; ask e.g. Buddhist, Christian, and Jewish EA groups for recommendations
Should a category be removed?
I think people will assume the importance of an issue is proportional to the number of books included in it on the diagram. As a result, I would remove all object-level categories save the most important, and I would cull within them dramatically. I also think presenting object-level books seems like an endorsement, when mostly they are probably intended as jumping-off points for future thinking.
In general, I view MBA-style business strategy books as a negative signal. Of the philosophy books, Parfit is the only positive signal for me. The others mostly scan as popular philosophy.
I get a negative impression of people who are really into rationalist books and not much else—convinced of their own superiority, narrow-minded unless the idea is from a trusted rationalist guy, etc.
anything important missing?
Strangers Drowning, by Larissa MacFarquhar
Which books if understood by others would make you more confident in collaborating with them?
The Scout Mindset, Human Compatible, The Scout Mindset, anything introductory, Waking Up
Thank you for the kind comment!
Those designs come under many different terms, from information design to data visualizations. Many different semantic pointers point in a similar direction. I love the map of philosophy, too. You might also (already know and) like Domains of Science. Very related to metascience and science of science. Here e.g. Max Noichl does a network analysis of current philosophy [More: 1, 2, 3]. More links here.
Yes, good point regarding interpersonal communication, I was also thinking about more “soft skills” to add. I did consider nonviolent communication but wasn’t sure. Btw once talking about (human) communication theory I actually prefer Watzlawick and von Thun in their content. Or at least, the are equally important work if one cares about the topic of interpersonal communication. I don’t know whether to include any of this or not, I’ll wait for more opinions to form mine in this context.
Yes, again, excellent point. I agree that Rosling and Pinker in their argumentation follow e.g. naive empiricism (the world will continue the trends from the past) and have progress as an underlying assumption. The books on Ending Poverty have similar narratives and assumptions. Reading “How the world thinks” by Julian Baggini helped me to understand how much the assumption of progress is in general a fact about Western philosophy in particular. However, I don’t think just skipping these books or this perspective is the right way either. One can’t just read “the right perspective”, one needs to triangulate insights from multiple sides and narratives. As Taleb, who also makes many arguments against Pinker, is included multiple times, I feel like the antithesis is also properly reflected. Thanks for bringing it up!
Came here to say the same. It would also help to actually print and bind it as a book to hand it to beginners. It gives a more “contained” perspective. With sequences online I always have the sense that the link tree never ends and my motivation to read it is reduced.
Focusmate has changed a lot since this post was published; maybe invite links are disabled by now.
More than ever as far as I can tell
People who like Logan’s post on EA burnout will love Tyler Alterman’s post on Effective altruism in the garden of ends. Both are close to my own experience.
First of all, thank you for speaking up about this. I know very smart people that are scared to just share their perspective on things and I do think THAT is very dumb.
Secondly, I do think donating some money regularly and cost-effectively is a safe bet, and freaking yourself out about “doing more” or even “the most” can easily be counterproductive. Just e.g. focusing on doing advocacy and explaining why evidence-based and cost-effective donations are good choices is still neglected in basically every country. There are many such relatively easy tasks that are great leverage points and in the end, it is precisely about comparative advantage. By you taking up such tasks you shoulder some burdens that are of relatively lower value to others.
Then for objectively difficult problems to solve it is, of course, reasonable to not try to make it “inclusive”, there is a reason why there is a minimum height to become a soldier because the task environment will not change to accommodate certain people. I understand that you understand this. And by understanding this and e.g. not attempting something grandiose that ends up harmful, you are counterfactually already winning.
Then I also do think that “higher” intellectual ability and related work are not necessarily higher utility. There isn’t one best or optimal thing everyone should be doing. The more one reads about complexity and systems science it is quite clear that there is no one optimal thing to do. It also shows that localism (serving one’s direct community) e.g. is better than often portrayed in EA. Creatively and pragmatically solving problems you perceive directly around you is fantastic and your interest in EA suggests that might be better suited to doing so than others around you.
In general, you can be and become a virtuous person independently of your raw processing powers or academic credentials, and action on all possible levels is needed.