David_Moss

• David_Moss 15 Nov 2024 18:43 UTC

  2 points

  0 ∶ 1

  in reply to: NickLaing’s comment on: Re­sources Allo­ca­tion: A Re­search Agenda

  4 out of 5 of the team members worked publically (googlably) to a greater or lesser extent on animal welfare issues even before joining RP

  
  I think this risks being misleading, because the team have also worked on many non-animal related topics. And it’s not surprising that they have, because AW is one of the key cause areas of EA, just as it’s not surprising they’ve worked on other core EA areas. So pointing out that the team have worked on animal-related topics seems like cherry-picking, when you could equally well point to work in other areas as evidence of bias in those directions.

  For example, Derek has worked on animal topics, but also digital consciousness, with philosophy of mind being a unifying theme.

  I can give a more detailed response regarding my own work specifically, since I track all my projects directly. In the last 3 years, ¹¹²⁄₁₂₄ (90.3%)^[1] of the projects I’ve worked on personally have been EA Meta /​ Longtermist related, with <10% animal related. But I think it would be a mistake to conclude from this that I’m longtermist-biased, even though that constitutes a larger proportion of my work.

  Edit: I realise an alternative way to cash out your concern might not be in terms of bias towards animals relative to other cause areas, but rather than we should have people on both sides of all the key cause areas or key debates (e.g. we should have people on both extreme of being pro- and anti- animal, pro- and anti-AI, pro- and anti- GHD, and also presumably on other key questions like suffering focus etc).

  If so, then I agree this would be desirable as an ideal, but (as you suggest) impractical (and perhaps undesirable) to achieve in a small team.

  1. ^

     This is within RP projects, if we included non-RP academic projects, the proportion of animal projects would be even lower.

• David_Moss 15 Nov 2024 13:55 UTC

  6 points

  0 ∶ 0

  in reply to: NickLaing’s comment on: Re­sources Allo­ca­tion: A Re­search Agenda

  Thanks Nick!
  

  My reservation is when im the research will end up being somewhat biased towards animal welfare, considering that has been a major research focus and passion for most of these researchers for a long time.

  This seems over-stated to me.

  WIT is a cross-cause team in a cross-cause organization. The Animal Moral Weight project is one project we’ve worked on, but all our other subsequent projects (the Cross-Cause Model, the Portfolio Tool, the Moral Parliament Tool, the Digital Consciousness Model, and our OpenAI project on Risk Alignment in Agentic AI) are all not specifically animal related. We’ve also elsewhere proposed work looking at human moral weight and movement building.

  You previously suggested that the team who worked on the Moral Weight project was skewed towards people who would be friendly to animals (though the majority of the staff on the team were animal scientists of one kind or another). But all the researchers on the current WIT team (aside from Bob himself) were hired after the completion of the Moral Weight project. In addition, I personally oversee the team and have worked on a variety of cause areas.

  Also, regarding interpreting our resource allocation projects: the key animal-related input to these are the moral weight scores. And our tools purposefully give users the option to adjust these in line with their own views themselves.

• David_Moss 14 Nov 2024 18:54 UTC

  2 points

  0 ∶ 0

  in reply to: Joseph Lemien’s comment on: Joseph Lemien’s Shortform

  EA already skews somewhat young, but from the last EA community survey it looks like the average age was around 29. So I wonder why are the vast majority of people doing mentorship/​coaching/​career advising are younger than that? Maybe the older people involved in EA are disproportionality not employed for EA organizations and are thus less focused on funneling people into impactful careers?

  I checked and people who currently work in an EA org are only slightly older on average (median 29 vs median 28).

Re­sources Allo­ca­tion: A Re­search Agenda

• David_Moss 14 Nov 2024 15:30 UTC

  2 points

  1 ∶ 0

  in reply to: Tobias Häberli’s comment on: Test­ing Fram­ings of EA and Longtermism

  If true, it could mean that any theory framed in opposition, such as a critique of Shorttermism or Longtermism, might be more appealing than the time-focused theory itself. Critizising short-term thinking is an applause light in many circles.

  I agree this could well be true at the level of arguments i.e. I think there are probably longtermist (anti-shorttermist), framings which would be successful. But I suspect it would be harder to make this work at the level of framing/​branding a whole movement, i.e. I think promoting the ‘anti-shorttermist’ movement would be hard to do successfully.

• David_Moss 14 Nov 2024 15:02 UTC

  4 points

  3 ∶ 0

  in reply to: ElliotJDavies’s comment on: ElliotJDavies’s Quick takes

  It takes a significant amount of time to mark a test task. But this can be fixed by just adjusting the height of the screening bar, as opposed to using credentialist and biased methods (like looking at someone’s LinkedIn profile or CV).

  Whether or not to use “credentialist and biased methods (like looking at someone’s LinkedIn profile or CV)” seems orthogonal to the discussion at hand?

  The key issue seems to be that if you raise the screening bar, then you would be admitting fewer applicants to the task (the opposite of the original intention).

  This is an empirical question, and I suspect is not true. For example, it took me 10 minutes to mark each candidates 1 hour test task. So my salary would need to be 6* higher (per unit time) than the test task payment for this to be true.

  This will definitely vary by org and by task. But many EA orgs report valuing their staff’s time extremely highly. And my impression is that both grading longer tasks and then processing the additional applicants (many orgs will also feel compelled to offer at least some feedback if a candidate has completed a multi-hour task) will often take much longer than 10 minutes total.

• David_Moss 14 Nov 2024 14:35 UTC

  5 points

  3 ∶ 0

  in reply to: ElliotJDavies’s comment on: ElliotJDavies’s Quick takes

  Orgs can continue to pay top candidates to complete the test task, if they believe it measurably decreases the attrition rate, but give all candidates that pass an anonymised screening bar the chance to complete a test task.

  My guess is that, for many orgs, the time cost of assessing the test task is larger than the financial cost of paying candidates to complete the test task, and that significant reasons for wanting to compensate applicants are (i) a sense of justice, (ii) wanting to avoid the appearance of unreasonably demanding lots of unpaid labour from applicants, not just wanting to encourage applicants to complete the tasks^[1].

  So I agree that there are good reasons for wanting more people to be able to complete test tasks. But I think that doing so would potentially significantly increase costs to orgs, and that not compensating applicants would reduce costs to orgs by less than one might imagine.

  I also think the justice-implications of compensating applicants are unclear (offering pay for longer tasks may make them more accessible to poorer applicants)

  1. ^

     I think that many applicants are highly motivated to complete tasks, in order to have a chance of getting the job.

• David_Moss 14 Nov 2024 13:47 UTC

  0 points

  2 ∶ 2

  in reply to: Will Aldred’s comment on: Ju­lia_Wise’s Shortform

  I guess it depends on the specifics of the situation, but, to me, the case described, of a board member making one or two incorrect claims (in a comment that presumably also had a bunch of accurate and helpful content) that they needed to walk back sounds… not that bad? Like, it seems only marginally worse than their comment being fully accurate the first time round...

  I agree that it depends on the situation, but I think this would often be quite a lot worse in real, non-ideal situations. In ideal communicative situations, mistaken information can simply be corrected at minimal cost. But in non-ideal situations, I think one will often see things like:

  • Mistaken information gets shared and people spend time debating or being confused about the false information

  • Many people never notice or forget that the mistaken information got corrected and it keeps getting believed and shared

  • Some people speculate that the mistaken claims weren’t innocently shared, but that the board member was being evasive/​dishonest

  • People conclude that the organization /​ board is incompetent and chaotic because they can’t even get basic facts right

  Fwiw, I think different views about this ideal/​non-ideal distinction underlie a lot of disagreements about communicative norms in EA.

• David_Moss 11 Nov 2024 20:35 UTC

  4 points

  0 ∶ 0

  in reply to: Ben_West🔸’s comment on: Test­ing Fram­ings of EA and Longtermism

  Thanks Ben!

  I don’t think there’s a single way to interpret the magnitude of the differences or the absolute scores (e.g a single effect size), so it’s best to examine this in a number of different ways.

  One way to interpret the difference between the ratings is to look at the probability of superiority scores. For example, for Study 3 we showed that ~78% of people would be expected to rate longtermism AI safety (6.00) higher than longtermism (4.75). In contrast, for AI safety vs effective giving (5.65), it’s 61%, and for GCRR (5.95) it’s only about 51%.

  

  You can also examine the (raw and weighted) distributions of the responses. This allows one to assess directly how many people “Like a great deal”, “Dislike a great deal” and so on.

  

  You can also look at different measures, which have a more concrete interpretation than liking. We did this with one (interest in hearing more information about a topic). But in future studies we’ll include additional concrete measures, so we know e.g. how many people say they would get involved with x movement.

  

  I agree that comparing these responses to other similar things outside of EA (like “positive action” but on the negative side) would be another useful way to compare the meaning of these responses.

  One other thing to add is that the design of these studies isn’t optimised for assessing the effect of different names in absolute terms, because we every subject evaluated every item (“within-subjects”). This allows greater statistical power more cheaply, but the evaluations are also more likely to be implicitly comparative. To get an estimate of something like the difference in number of people who would be interested in x rather than y (assuming they would only encounter one or the other in the wild at a single time), we’d want to use a between-subjects design where people only evaluate one and indicate their interest in it.

The Welfare of Digi­tal Minds: A Re­search Agenda

• David_Moss 9 Nov 2024 9:41 UTC

  6 points

  0 ∶ 0

  in reply to: Ben_West🔸’s comment on: Test­ing Fram­ings of EA and Longtermism

  Thanks Ben!

  For descriptions or descriptions with terms the questions were “How much do you like or dislike each of the following?” (Study 2) and “Please indicate the extent to which you like or dislike the following” (Study 3), both asked on a 7 point scale from “Dislike a great deal”—“Like a great deal”.

  For terms only, we included some more instructions to ensure that people evaluated the terms specifically, rather than trying to evaluate the things referred to by the terms: “Based only on the terms provided below, how much do you like or dislike each of the following? (Please note that you do not have to have heard of the terms to answer. Please just answer based on the names below without looking up additional information).” This was also asked on a 7 point scale from “Dislike a great deal”—“Like a great deal”.

  For cause areas (Study 1), the question: “Based on the description of each cause area below, please indicate to what extent you like or dislike a movement that promotes giving resources to this area.” And, again, we used the scale 7 point scale from “Dislike a great deal”—“Like a great deal”.

• David_Moss 8 Nov 2024 16:04 UTC

  5 points

  0 ∶ 0

  in reply to: Deborah W.A. Foulkes’s comment on: Test­ing Fram­ings of EA and Longtermism

  Thanks Deborah!

  I’d like to see more research, however, as to why longtermism performed poorly in comparison with global catastrophic risks, because many of the latter play out on a long-term timescale.

  I think there are likely multiple different factors here:

  • As you note, the effects of global catastrophic risk reduction may play out largely in the long-term future. But they don’t play out exclusively in the long-term figure, and people may care particularly about the near-term effects of averting global catastrophic risks.

  • Considered as a term, “longtermism” may be less appealing than “global catastrophic risk reduction” for a variety of reasons. For example, it may be less clear what it means, or it may sound like an “ism” (an ideology), which people may not like. We’ll explore this more when we report on the qualitative data.

  • Considering the descriptions we tested, I also think there are multiple possible reasons for the disparity. For example, the description of global catastrophic risk reduction we tested might have fared more positively due to its focus on specific concrete risks. Conversely, our description of longtermism was more abstract. It was also explicit about effects being potentially “hundreds or thousands of years away”. As noted, I think further testing of different framings would be valuable to disentangle these possible causes.

• David_Moss 7 Nov 2024 21:40 UTC

  5 points

  0 ∶ 0

  in reply to: SummaryBot’s comment on: Test­ing Fram­ings of EA and Longtermism

  Specific cause areas like AI safety and pandemic preparedness were generally better liked than broader concepts like EA or longtermism.

  The summary was generally good, but I wouldn’t say the above exactly. In the one study where we tested specific causes against broader concepts, AI Safety and Pandemic preparedness were roughly neck and neck with the general broader concept Global catastrophic risk reduction. Those three were more popular than Climate change (specific), Effective Altruism and Effective Giving (broader), which were neck and neck with each other. And all were more effective than Longtermism. So there wasn’t a clear difference between specific cause area vs broader concept distinction.

• David_Moss 7 Nov 2024 15:30 UTC

  6 points

  0 ∶ 0

  in reply to: James Herbert’s comment on: Test­ing Fram­ings of EA and Longtermism

  Thanks! This was supported via Manifund and then topped up by Open Philanthropy after they saw it on there (so thanks to our donors on there and to Open Phil!).

Test­ing Fram­ings of EA and Longtermism

Valu­ing Im­pacts Across Species: A Re­search Agenda

• David_Moss 28 Oct 2024 9:30 UTC

  4 points

  1 ∶ 0

  in reply to: SiebeRozendal’s comment on: Bri­tish pub­lic per­cep­tion of ex­is­ten­tial risks

  Thanks Siebe!

  I think that would also be interesting, but there’s still value in replicating previous surveys which focused on extinction specifically.

  I also think that focus on extinction specifically may also be useful for tracking changes in concerns about severe risks from AI. Assessing perceptions of other severe risks from AI will be a lot more methodologically challenging (since there’s more of a continuum from very severe non-extinction threats to less severe threats (e.g. will harm autonomy in some much less severe way), so it will be difficult to ensure respondents are thinking of non-extinction threats which are of interest to us. That said, I agree that studying what non-extinction threats people perceive from AI would be independently interesting and important.

• David_Moss 26 Oct 2024 14:06 UTC

  2 points

  0 ∶ 0

  in reply to: PeterSlattery’s comment on: Bri­tish pub­lic per­cep­tion of ex­is­ten­tial risks

  Thanks Peter! We’d be happy for this to be shared more widely.

  I am also wondering if someone should do a review/​meta-analysis to aggregate public perception of AI and other risks? There are now many surveys and different results, so people would probably value a synthesis.

  Agreed. I’d also be interested to see more work systematically assessing how these responses vary across different means of posing the question.

Bri­tish pub­lic per­cep­tion of ex­is­ten­tial risks

• David_Moss 17 Oct 2024 18:18 UTC

  8 points

  3 ∶ 0

  in reply to: MichaelStJules’s comment on: Ex­plain­ing the dis­crep­an­cies in cost effec­tive­ness rat­ings: A repli­ca­tion and break­down of RP’s an­i­mal welfare cost effec­tive­ness calcu­la­tions

  Subjective well-being studies are usually not assessing hedonic well-being, but life satisfaction. People can be satisfied with their lives because they have things important to them that are going well (family, friends, other goals), or by comparing their lives to others’ around them, and these can be more important to them than their own average hedonic wellbeing when they judge their own lives.

  I agree, but I would go further and say that I don’t think we have good reason to think that people have a reliable sense of the hedonic balance of their lives, even if we suppose they have good introspective access to the valence of their discrete experiences.