Vanessa

• VanessaMay 22, 2025, 4:54 PM

  3 points

  0 ∶ 0

  in reply to: Mjreard’s comment on: The Soul of EA is in Trouble

  I intentionally stayed meta because I didn’t especially want to start an argument about EA premises. Concretely, my disagreements with EA are, that I don’t believe in any of:

  • Moral realism

  • Radical impartiality

  • Utilitarianism

  • Longtermism

  I view improving the world as an enterprise of collective rationality /​ cooperation, not a moral imperative (I don’t believe in moral imperatives). I care much more about the people (and other creatures) closer to me in the social graph, but I also want to cooperate with other people for mutual gain, and in particular endorse/​promote social norms that create incentives beneficial for most of everyone (e.g. reward people for helping others /​ improving the world).

  Why I changed some of my views in this particular direction is a long story, but it involved a lot of reflection and thinking about my preferences on different levels of abstraction (from “how do I feel about such-and-such particular situation” to “what could an abstract mathematical formalization of my preferences look like”).

• VanessaMay 20, 2025, 11:38 AM

  14 points

  7 ∶ 0

  on: The Soul of EA is in Trouble

  I’m a vegan existential AI safety researcher. I once identified as EA, now as EA-adjacent. So, superficially, I’m part of the problem you describe. However, my reasons for not identifying as EA anymore have nothing to with FTX or other PR concerns. It’s not a “mask”. I just have philosophical disagreements with EA, coming out of my own personal growth, that seem sufficiently significant to be acknowledged.

  To be clear, I’m very grateful to EA donors and orgs for supporting my research. I think that both EAs in AI safety and EAs more broadly are doing tonnes of good, for which they genuinely deserve my and most of everyone’s gratitude and praise.

  At the same time, it’s a perfectly legitimate personal choice to not identify as EA. Moreover, the case for the importance of AI X-safety doesn’t rest on EA assumptions (some of which I reject), but is defensible much more broadly. And, there is no reason that every individual or organization working on AI X-safety must identify as EA or recruit only EA-aligned personnel. Even if they have history with EA or funding from EA etc.

  Let’s keep cooperating and accomplishing great things, but let’s also acknowledge each other’s right to ideological pluralism.

[Closed] Gaug­ing In­ter­est for a Learn­ing-The­o­retic Agenda Men­tor­ship Programme

• VanessaNov 1, 2024, 10:42 AM

  5 points

  1 ∶ 0

  on: Reflec­tions and les­sons from Effec­tive Ventures

  Thank you for this update.

  I’m curious what is going to happen to EA Funds specifically? Is it going to be an independent entity that continues to function more or less in the same way? Or something else entirely?

• VanessaAug 4, 2024, 12:24 PM

  1 point

  0 ∶ 0

  on: On Living

  Here’s a human translation, although ChatGPT’s is suspiciously similar.

• VanessaJul 21, 2024, 1:46 PM

  8 points

  2 ∶ 1

  on: an­i­mal welfare out­side of EA—num­bers and thoughts on UFAW 2024

  This is pretty sad and also surprising. In your opinion, why are there so many people that come to an animal welfare conference but are not really interested in helping animals (apparently)? If they don’t care about animals, what are they doing there?

• VanessaMar 26, 2024, 12:17 AM

  79 points

  29 ∶ 1

  on: An­nounce­ment on the fu­ture of Wytham Abbey

  Is there going to be a post-mortem including an explanation for the decision to sell?

  What links here?

  • Post-mortem on Wytham Abbey by WythamAbbey (Apr 1, 2024, 10:38 AM; 69 points)

• VanessaNov 28, 2023, 5:08 PM

  3 points

  1 ∶ 1

  in reply to: Tom Barnes🔸’s comment on: Tom Barnes’s Quick takes

  Yes. Moreover, GCR mitigation can appeal even to partial altruists: something that would kill most of everyone, would in particular kill most of whatever group you’re partial towards. (With the caveat that “no credence on longtermism” is underspecified, since we haven’t said what we assume instead of longtermism; but the case for e.g. AI risk is robust enough to be strong under a variety of guiding principles.)

• VanessaNov 28, 2023, 11:34 AM

  34 points

  11 ∶ 1

  in reply to: Tom Barnes🔸’s comment on: Tom Barnes’s Quick takes

  The framing “PR concerns” makes it sound like all the people doing the actual work are (and will always be) longtermists, whereas the focus on GCR is just for the benefit of the broader public. This is not the case. For example, I work on technical AI safety, and I am not a longtermist. I expect there to be more people like me either already in the GCR community, or within the pool of potential contributors we want to attract. Hence, the reason to focus on GCR is building a broader coalition in a very tangible sense, not just some vague “PR”.

[Closed] Agent Foun­da­tions track in MATS

• VanessaAug 17, 2023, 4:50 AM

  12 points

  4 ∶ 0

  in reply to: Ozzie Gooen’s comment on: Ozzie Gooen’s Shortform

  I can relate, as someone who also struggles with self-worth issues. However, my sense of self-worth is tied primarily to how many people seem to like me /​ care about me /​ want to befriend me, rather than to what “senior EAs” think about my work.

  I think that the framing “what is the objectively correct way to determine my self-worth” is counterproductive. Every person has worth by virtue of being a person. (Even if I find it much easier to apply this maxim to others than to myself.)

  IMO you should be thinking about things like, how to do better work, but in the frame of “this is something I enjoy /​ consider important” rather than in the frame of “because otherwise I’m not worthy”. It’s also legitimate to want other people to appreciate and respect you for your work (I definitely have a strong desire for that), but IMO here also the right frame is “this is something I want” rather than “this is something that’s necessary for me to be worth something”.

• VanessaJun 6, 2023, 7:08 AM

  6 points

  1 ∶ 1

  in reply to: NickLaing’s comment on: EA and Longter­mism: not a crux for sav­ing the world

  I strongly disagree that utilitarianism isn’t a sound moral philosophy, and don’t understand the black and white distinction between longtermism and us not all dying. I might be missing something there is surely at least some overlap betwen those two reasons for preventing AI risk.

  I don’t know if it’s a “black and white distinction”, but surely there’s a difference between:

  • Existential risk is bad because the future could have a zillion people, so their combined moral weight dominates all other considerations.

  • Existential risk is bad because (i) I personally am going to die (ii) my children are going to die (iii) everyone I love are going to die (iv) everyone I know are going to die, and also (v) humanity is not going to have a future (regardless of the number of people in it).

  For example, something that “only” kills 99.99% of the population would be comparably bad by my standards (because i-iv still apply), whereas it would be way less bad by longtermism standards. Even something that “only” kills (say) everyone I know and everyone they know would be comparably bad for me, whereas utilitarianism would judge it a mere blip in comparison to human extinction.

  Out of interest, if you aren’t an effective altruist, nor a longermist then what do you call yourself?

  I call myself “Vanessa” :) Keep your identity small and all that. If you mean, do I have a name for my moral philosophy then… not really. We can call it “antirealist contractarianism”, I guess? I’m not that good at academic philosophy.

• VanessaJun 3, 2023, 10:17 AM

  8 points

  3 ∶ 5

  on: EA and Longter­mism: not a crux for sav­ing the world

  Strongly agreed.

  Personally, I made the mitigation of existential risk from AI my life mission, but I’m not a longtermist and not sure I’m even an “effective altruist”. I think that utilitarianism is at best a good tool for collective decision making under some circumstances, not a sound moral philosophy. When you expand it from living people to future people, it’s not even that.

  My values prioritize me and people around me far above random strangers. I do care about strangers (including animals) and even hypothetical future people more than zero, but I would not make the radical sacrifices demanded by utilitarianism for their sake, without additional incentives. On the other hand, I am strongly committed to following a cooperative strategy, both for reputational reasons and for acausal reasons. And, I am strongly in favor of societal norms that incentivize making the world at large better (because this is in everyone’s interest). I’m even open to acausal trade with hypothetical future people, if there’s a valid case for it. But, this is not the philosophy of EA as commonly understood, certainly not longtermism.

  The main case for preventing AI risk is not longtermism. Rather, it’s just that otherwise we are all going to die (and even going by conservative-within-reason timelines, it’s at least a threat to our children or grandchildren).

  I’m certainly hoping to recruit people to work with me, and I’m not going to focus solely on EAs. I won’t necessarily even focus on people who care about AI risk: as long as they are talented, and motivated to work on the problems for one reason or the other (e.g. “it’s math and it’s interesting”), I would take them in.

[Closed] Prize and fast track to al­ign­ment re­search at ALTER

• VanessaSep 17, 2022, 1:12 PM

  10 points

  0 ∶ 0

  on: 🎨 Altru­ist Dreams—a col­lab­o­ra­tive art piece from EAG SF

  Nice work! Many good hopes in there, but, hard to compete with “make furries real”.

• VanessaAug 22, 2022, 4:33 PM

  16 points

  0 ∶ 0

  on: Feel­ing Deeply Un­safe! At the Disco: Mi­sog­yny in EA

  I’m confused. What are you trying to say here? You linked a proposal to prioritize violence against women and girls as an EA cause area (which I assume you don’t object to?) and a tweet by some person unknown to me saying that critics of EA hold it to a standard they don’t apply to feminism (which probably depends a lot on what kind of critics, and on their political background in particular). What do you expect the readers to learn from this or do about it?

• VanessaAug 21, 2022, 8:28 AM

  2 points

  0 ∶ 0

  in reply to: helmetedhornbill’s comment on: To WELLBY or not to WELLBY? Mea­sur­ing non-health, non-pe­cu­niary benefits us­ing sub­jec­tive wellbeing

  Thanks so much for replying, I learned a lot from your response and its clarity helped me update my thinking.

  You’re very welcome, I’m glad it was useful!

  I would expect these to be exceptions rather than norms (because if e.g. wanting to have a career was the norm, over enough time, that would tend to become culturally normative and even in the process of it becoming a more normative view the difference with a SWB measure should diminish).

  I’m much more pessimistic. The processes that determine what is culturally normative are complicated, there are many examples of norms that discriminate against certain groups or curtail freedoms lasting over time, and if you’re optimizing for the near future then “over enough time” is not a satisfactory solution.

  I suppose I’m also thinking about the potential difference in specific SWB scales. Something like the SWLS scale or the single item measures would not be very domain specific but scales based around the e.g. Wheel of Life tradition tell you a lot more different facets of your life (e.g. you can see high overall scale but low for job satisfaction), so it seems to me that with the right scales and enough items you can address culture or other variance even further.

  I don’t know how those scales work, but (as I wrote in my reply to Joel), I would be much more optimistic about scales that are relative i.e. ask you to compare your well-being in situation A to situation B (whether these situations are familiar or hypothetical) rather than absolute (in which case it’s not clear what’s the reference frame).

  What I was unable to articulate well is that your individual preferences are not stable (or I suppose: per person, rather than across people), i.e. Alice when she has $5 will exchange a different amount of free time for an extra $1 then when Alice has $10.

  This is considered a consistent preference in standard (VNM) decision theory. It is entirely consistent that U(6$ and X free time) > U(5$ and Y free time) but U(11$ and X free time) < U(10$ and Y free time).

• VanessaAug 21, 2022, 8:12 AM

  1 point

  0 ∶ 0

  in reply to: JoelMcGuire’s comment on: To WELLBY or not to WELLBY? Mea­sur­ing non-health, non-pe­cu­niary benefits us­ing sub­jec­tive wellbeing

  Hi Joel,

  Thank you for the informative reply!

  I think there’s a big difference between asking people to rate their present life satisfaction and asking people what would make them more satisfied with their life. The latter is a comparison: either between several options or between future and present, depending on the phrasing of the questions. In a comparison it makes sense people report their relative preferences. On the other hand, the former is in some ill-posed reference frame. So I would be much more optimistic about a variant of WELLBY based on the former than on the latter.

• VanessaAug 17, 2022, 4:18 PM

  0 points

  0 ∶ 0

  in reply to: helmetedhornbill’s comment on: To WELLBY or not to WELLBY? Mea­sur­ing non-health, non-pe­cu­niary benefits us­ing sub­jec­tive wellbeing

  I think the fact that SWB measures differs across cultures is actually a good sign that these measures capture what they are supposed to capture… In fact, I would be more concerned if different people with different views and circumstances did not, as you say, ‘differ substantially.’

  My claim is not “SWB is empirically different between cultures therefore SWB is bad”. My claim is, I suspect that cultural factors cause people to choose different numbers for reasons orthogonal to what they actually want. For example, maybe Alice wants to be a career woman instead of her current role as a housewife (and would make choices to this effect if she had an opportunity), but she reports high life satisfaction because she feels that is expected of her (and it’s not like reporting a low number would help her). Or, maybe people in Fooland consistently report higher life satisfaction than people in Baristan (because they have lower expectations of how life should be), but nobody from Baristan wants to move to Fooland and everyone from Fooland want to move to Baristan if they can (because life is actually better in Baristan).

  I think these differences, attributable to culture or individual variance, are not likely to be of concern for what I would imagine would be the more common ways WELLBYs could be used. Most cost effectiveness analyses rely on RCTs or comparable designs with pre and post measures.

  I agree that directly comparing “pre” to “post” SWB might work okay for many interventions, because the intervention doesn’t affect the confounding factors, as long as you’re comparing different interventions applied to similar populations. I would still rely more on asking people directly how much this intervention helped them /​ how much their life improved over this period (as opposed to comparing numbers reported at different points of time)^[1]. And, we should still be vigilant about situations in which the confounders cannot be ignored (e.g. interventions that cause cultural shifts). And, there might be a non-linear relationship between SWB and decision-utility which should be somehow divulged if we are averaging these numbers.

  In my reading, there’s a long body of researcher suggesting these are stable, yet in practice your ‘revealed’ preference at $5 is likely to be different than at $10.

  I’m guessing you are not talking about things like, how much free time you would exchange for an additional $1? Because that’s consistent with constant preferences? So, Alice has $5 and Bob has $10, they are asked to choose between X and Y, and they have predictably different preferences despite the fact that post-X-Alice has the same wealth (and other circumstances) and post-X-Bob and the same for Y? And this despite somehow controlling for confounders are correlated both with the causes for Alice’s and Bob’s wealth and with their preferences?

  I imagine such things can happen, in which case I would try to add hindsight judgements and judgements of people who experienced different circumstances into the mix. I expect that as people become more informed and experienced they roughly converge to some stable set of preferences, and the tradeoffs that don’t converge are not really important. If I’m wrong and they are important, then we need to use the revealed preferences of people in those particular circumstances (which, yes, might include SWB, might also include other parameters).

  1. ^

     Even under optimistic assumptions about SWB, this seems less noisy. Under pessimistic assumptions, I can imagine e.g. people implicitly interpreting the question as comparing their life to their neighbors (which were also affected by the intervention) or comparing their life now to their life in the past (which was still after the intervention), in which case SWB has no signal at all.

• VanessaAug 17, 2022, 6:37 AM

  5 points

  0 ∶ 0

  in reply to: Lorenzo Buonanno🔸’s comment on: To WELLBY or not to WELLBY? Mea­sur­ing non-health, non-pe­cu­niary benefits us­ing sub­jec­tive wellbeing

  I don’t know much about supplements/​bednets, but AFAIU there are some economy of scale issues which make it easier for e.g. AMF to supply bednets compared with individuals buying bednets for themselves.

  As to how to predict “decision utility when well informed”, one method I can think of is look at people who have been selected for being well-informed while similar to target recipients in other respects.

  But, I don’t at all claim that I know how to do it right, or even that life satisfaction polls are useless. I’m just saying that I would feel better about research grounded in (what I see as) more solid starting assumptions, which might lead to using life satisfaction polls or to something else entirely (or a combination of both).

  What links here?

  • Lorenzo Buonanno🔸's comment on Rho­dri Davies on why he’s not an EA by Sanjay (Aug 19, 2022, 8:02 PM; 2 points)