I think impact-focussed funders underrate research on animal sentience, and, more broadly, on comparing welfare across species. I believe there is huge uncertainty, and ways of decreasing it. Here is some context about my uncertainty. In Bob Fischerâs book about comparing welfare across species, the tentative sentience-adjusted welfare range of shrimps is 8.0 % of that of humans. Welfare range is defined there as the difference between the maximum and minimum welfare per unit time among ârealistic biological possibilitiesâ. For sentience-adjusted welfare ranges proportional to âindividual number of neuronsâ^âexponentâ, and âexponentâ from 0 to 2, which covers the best guesses that I consider reasonable, the sentience-adjusted welfare range of shrimps is 10^-12 to 1 times that of humans.
If someone had a pattern of fabrication and very poor understanding (and apparent confidence) like LLMs often do if used uncritically, I would be annoyed with them and possibly do any of the following:
Tell them to read and review more carefully, look for opposing arguments, etc..
Downvote such comments (and I very very rarely downvote).
Stop engaging with this person, because it wastes my time and may encourage them to waste othersâ time.
Makes sense. I just think what is âpoor understandingâ is often sufficiently contentious for one to have a high bar for preferring not sharing over sharing with little verification. I also tend to default to let people decide the extent to which they want to engage with something.
My impression is that many people, including academics, use âconsciousnessâ and âphenomenal consciousnessâ interchangeably, but they do so implicitly rejecting strong illusionism, would reject strong illusionism if asked directly, and typically donât understand strong illusionism. Maybe many are open, though, Iâm not sure.
Makes sense. I was not clear. However, by âwithout wanting to take a stance on illusionism or realismâ, I meant many do not have a good picture of what strong illusionism means, and may be conflating it with eliminativism. I was doing this to some extent.
The amount of energy needed to refute bullshit is an order of magnitude bigger than that needed to produce it.
Verification is often easier than generation.
I was more referring to the diversification as implied by âdonât focus the vast majority of efforts on one causeâ, which to me meant more âif youâre a decision maker over some amount of resources, you should diversify the allocation across cause areasâ. Which I agree with, but itâs quite hard to really justify.
Yes, via nonlinearity you can get to diversification, but this means making additional assumptions beyond sampling error/âpublication bias/âoptimiser curse type effects.
The nonlinearity youâre describing matters on a movement level, but not on a individual decision makers level.
âImpact risk aversionâ is another mechanism to get diversification which I think can be reasonable in cases where eg low impact reduces the probability of future donations or similar.
One channel I think is under explored and might work well as a justification for diversification in practice is something like this (I havenât thought about this rigorously though): if I predictably optimise and my objective function is known to others, they will (in the worst case, possibly thru misaligned incentives) feed me biased information to influence my decision, and optimisation is very sensitive to noise, therefore I subject myself to adverse selection. So basically by not optimising but diversifying across good options you reduce the negative impact of this type of adverse selection. In this case, the âerrorsâ are not iid. Hard to say how much diversification that yields.
Mox Movie Nights watched Slumdog Millionaire today and it reminded me of the why behind the work. Weâre not here to EV-max, to gain impact points, to count utils. Weâre here because the world is unfair, suffering is prolific, and need to find a way through it.
very exciting!!!
We enticed a real life comedian onto our podcast:
Err on the side of applying. Donât think too much into the details of whether you will be getting selectedâitâs a conferenceâmeant to be for folks interested in the cause and donât know much about it to gain more exposure.
After reading your post I donât see the cause of doubtâto me it just seems hesitance in applying, which wonât help you in long run. Take bets and apply
Note you can also donate to Screwworm Free Future for the chance at helping to avoid extreme suffering for 30+million animals per year.
Itâs a more speculative & risky donation but if one thinks their marginal dollars have a chance to speed up elimination by even 2-3 years then it is like 100 animals avoiding extreme suffering for every $1 donated.
https://ââwww.every.org/ââscrewworm-free-future
The potential effectiveness of such donations may put you over the threshold of making the job worth it.
Some commentary. I mostly agree with the page, but I will focus on the bits where I see room for improvement:
All 8 gates look correct to me, but they donât all deserve equal emphasis.
Gate 1 says IPOs have lock-ups. Thatâs true but I basically donât think that matters because lock-ups are very predictable: they will announce how long it is, and thatâs exactly how long it will be. Thereâs no uncertainty. The main reason itâs relevant is that a lockup gives more time for AI valuations to fluctuate or collapse, but the text doesnât even mention this.
Gate 5 and Gate 7 seem like theyâre saying the same thing.
Gate 8 (âBay social incentivesâ) seems uninteresting since itâs not a claim in the same category as the others. Itâs more like a meta-level reason why people might not think about the other 7 gates.
Would be cool for the BOTEC to use distributions rather than point estimates. (Squiggle is good for this, and Squigglehub even has a built-in way to have AI generate models.) IMO distributions are a lot more informative than point estimates.
It looks like the default estimates in the BOTEC are pulled from the sources, but itâs not clear which estimates came from which sources. There should be inline citations.
âAnthropic valuationâ variable should specifically be the valuation at the end of the 6-month lockup. Doesnât matter much for a point estimate but it would increase the variance if there variable were a probability distribution.
Unclear what the âFounder pledgeâ variable refers to. Is it the % of pledgersâ wealth that theyâve pledged to donate? If so, the default of 80% seems really high?
âEmployee committed poolâ is defined in terms of dollars rather than as a % of company valuation, which seems weird. Shouldnât it depend on the value of the equity?
This model is supposed to illustrate how a lot of people are being too optimistic, but even then, I think most of the point estimates in the model are too optimistic. Consider that e.g. the median self-reported earner-to-give only donates (IIRC) 3% of their income.
IMO âDeployment by end-2026â should use a different date. IPO 3-6 months from now plus 6 months lockup means no money will be deployed in 2026, unless Anthropic does a fast IPO + early lockup release. Even by the end of 2027, youâre talking about a 3-9 month turnaround time on lockup ending â grants being disbursed. FTX Foundation donated $190 million (pre-clawbacks) in about 6 months, which was ridiculously fast compared to a typical foundation, and that was still a pretty small % of its long-term budget (or at least, what was believed to be its long-term budget before FTX collapsed).
I would delete the OpenAI Foundation bit because (1) the model has enough parameters already and (2) I doubt OpenAI Foundation will give much money to causes that look good by EA lights.
âGrantmaker capacity multiplierâ seems nonsensical as written. Shouldnât the capacity max out at 1x? If grantmakers are a complete non-bottleneck, then the other parameters will dictate the amount disbursed; if theyâre a bottleneck, then the amount disbursed will be less. Thereâs no way for grantmaker capacity to have a multiplier >1x.
Also this would make more sense as a dollar amount, not a multiplier. Like thereâs a fixed total amount that grantmakers can reasonably disburse. You could model it in a more complicated way but IMO a simple cap is the way to do it. Or maybe donât use this parameter at all. I think itâs probably worth including, but keep it simple.
âField absorption ceilingâ is structured more sensibly than âGrantmaker capacity multiplierâ, but these two seem redundant because theyâre closely related. If orgs have more capacity to expand, grantmakers can deploy money faster by giving to those orgs. If there are more grantmakers, they can create more and bigger RFPs. etc. I would include one variable or the other, but not both.
âThe steelman could be too pessimistic if founders or employees treat liquidity as an urgent moral obligationâ â TBH the BOTEC as written seems to me like itâs already pricing in that founders/âemployees will treat donations as urgent, e.g. itâs implying that Anthropic money will be disbursed faster than FTX Foundation money, which itself was disbursed at historic speed. IMO most likely reason why the model will end up underestimating is that Anthropic market cap ends up being like 10x higher than predicted.
My downward adjustments to the model arenât even the pessimistic case. The pessimistic case* is that the AI field collapses (investor funding dries up or something) and Anthropic stock is worth $0. Base rate says thereâs like a 50% chance that that will happen. Even optimistically, you should expect at least a 10â20% chance that Anthropic stockholders get nothing.
The recommendations under âHow to plan if the skeptical case is liveâ donât really make sense. AFAIK ~zero orgs are planning as if theyâre guaranteed to get a huge pile of donations 1â2 years from now. I believe nonprofits mainly plan based on the money they already have on their books + short-term (<1 year) fundraising expectations. âHow to plan if the skeptical case is liveâ is just âbusiness as usualâ.
That section says âFunders and field builders should prioritize grantmaker capacityâ, but thatâs what to do if the skeptical case is wrong, not if the skeptical case is right.
âWhat would update this memo?â â as with the gates, no sense of prioritization is given. IMO by far the biggest uncertainty, about which we will get more information in the future, is: What will Anthropicâs valuation be when the lockup ends? âConcrete donor vehiclesâ is also important evidence, but we wonât get that until probably 6-24 months later.
*this is pessimistic for donations but I would actually prefer that this happen because it would lengthen timelines. so in a way itâs the optimistic outcome
Why would they need to shut down completely? It seems like it would work just as well to say âWe wonât build any new models, but weâll keep serving the ones we already have.â Then they wouldnât be accelerating towards riskier models, it wouldnât be AS bad for them financially (so it might have a better chance of happening) and they can still do safety research on the models they already have.
Oh, wow, thatâs really interesting that you found that correlation.
One explanation of this correlation could be that the additive model focuses on the presence of different cognitive capacities, and animals may need higher neuron counts to have more cognitive capacities.
This would then center your worldview on how significant you think cognitive capacities are in determining welfare ranges.
Wonderful read, The framing point is something that was specifically compeling.
Also was very interested in the âCollaborate with Institutionsâ section. The action of incorporating animal welfare education into university curricula for further interdisciplinary involvement in animal welfare comes off as incredibly promising. I was wondering from you or anyone reading, thoughts on how this curricula could be expanded into spaces that are not, on first thought, related to animals or agriculture such as policy, journalism, business and more. In my thinking having some expectation of taking an animal welfare course throughout a students academic career could spark interest in spaces that are neglected in animal welfare. Iâd love to hear thoughts on this in terms of feasibility and effectiveness.
Definitely agree that shooting down GPS satellites (or satellites of any kind, really) is a really agressive move that would make all countries super mad at you, thus probably only happens in a pretty serious âall or nothingâ great-power conflict!
Iâll try to talk more about the military dynamics around GPS in my later post, although Iâm not an expert. My impression is that although militaries do indeed have lots of backup systems, none of them is perfect and some systems (like many existing drones and guided bombs) do rely exclusively on GPS, so losing GPS would still be a big problem even though the military has done a lot of work to try and ensure that it wouldnât be a totally overwhelming catastrophe.
I fear this is missing the main objective though. Maximising taste is solely for the purpose of maximising uptake of alternative meats. There isnât an intrinsic good in having tasty meat alternatives.
The logic is: tastier meat alternatives â> more people eat meat alternatives â> less animal suffering.
Itâs foundational argument is better tasting meat alternatives increase the number of people eating meat alternatives.There are companies that exist to sell people meat alternatives. So their incentives are aligned. Profit maximising is just an incentive to do that most efficiently, so theyâd do it if taste was the most cost effective wayâI.e. if for every $1 spent on making meat alternatives taste better it led to $2 of sales, but $1 spent on marketing led to $1.5 of sales, then itâd be better value to spend on making it taste better.
My issue with this RFP is it presumes the market is failing. My question is where is the proof? It being underfunded by public agencies and private R&D suggests to me either massive vested interest (which may be true for public agencies but less clear why Beyond Meat wouldnât want more customers if tastier meat alternatives was the best way to do that); or it suggests there is a more efficient method being employed by those with the incentives to find it. Unless you think the meat alternative providers donât want more customers, or are incompetent (in which case why hasnât a tastier competitor already appeared).
This whole RFP looks to fix a market failure, which Iâm not clear exists. It also tries to do that with $10m, which by their on linked numbers is such a tiny fraction of money spent on tasting research. Unfortunately, this RFP has the hallmarks of a fund that would have to be so amazingly well spent to make a difference that the whole thing seems destined to have little to no impact.
A few comments, some of which you may be intending to cover in updates
First of all we actually have a pretty decent idea of what happens in GNSS-denied environments because localised GNSS jamming is a thing,[1] Itâs especially a thing in combat zones, which means that people and infrastructure affected typically have other problems[2]
Because GNSS denial is a thing, militaries have alternative PNT systems to aid them in combat. So actively disabling GNSS satellites is a pretty extreme measure that mostly hurts civilians, including in about 250 countries not currently at war with you. And if it involves use of anti-satellite weapons or EMPs, probably takes out a whole bunch of other space infrastructure too[3]
As itâs a pretty extreme measure that annoys everyone worldwide without even offering you a decisive advantage in a local conflict, itâs most likely to happen during escalation of a great power conflict. Great power conflicts mean that sectors like maritime would be experiencing COVID level downturns already. The âsolar stormâ is more interesting because it might be largely unexpected (and would also likely impair a lot of non-GNSS comms stuff)
But costs of nuisance level GNSS jamming in borderlands between states not actually at war (say, the Baltic...) has a scaled down version of this impact which I guess might be underestimated...
Interested to see the followup
- ^
Similarly, people working with navigation systems prone to spoofed location results (maritime navigation) have to find workarounds
- ^
though electronic warfare can affect neutral neighbours and overflying aircraft too...
- ^
current generation GNSS satellites are in fairly empty medium earth orbits and can be disabled without kinetic weapons, but this doesnât rule out collateral damage and likely wonât be the case for future GNSS (in part because they want more redundancy even though the system(s) just work.
One simple model is:
each person can choose only one cause area
errors are iid across people
the x-risk coming from each cause decreases with each additional person working on this cause
Whether diversification is better (in expectation) depends on how a causeâs x-risk decreases as additional people work on this cause. If x-risk decreases linearly (the 1000th person makes the same marginal contribution as the 1st), then diversification is not better in expectation. But if the contribution to x-risk prevention is marginally decreasing in people, diversification is better.
(By diversification I mean each person choosing their top estimated x-risk cause individually. But it can also mean that some people deliberately do not work on the cause with the highest aggregated risk estimate.)
While some people might notice the fact the companies are making losses, others will notice the fact that they are valued in the billions! I am not sure if a shutdown would actually be the right move but it would definitely send a message.
I like diversification as a reaction to this type of uncertainty, but it does not trivially follow? I might be missing somethingâdo you have a favourite minimal set of assumptions that rigorously yield diversification as a function of this?
Above all it implies donât focus the vast majority of efforts on one cause.
That might not be practical for career choices,[1] but itâs certainly possible for a funder or movement
- ^
though a corollary of it is âdonât assume that just because youâve picked direct work that your career choice is maximally good and stuff like donations and helping others is just a distractionâ. This is arguably true for speculative career choices even if the optimal cause is the correct one (i.e. even if AI x-risk really does dominate everything, lots of the promising approaches to resolving it that people might choose will have no impact)
- ^
Relevant abstract just published in Neurology: DMT use in Cluster Headache: Interim Analysis of an International Survey (S23.003)