EdoArad

• EdoAradMar 9, 2024, 3:34 PM

  4 points

  1 ∶ 0

  in reply to: Elizabeth’s comment on: This is why peo­ple are re­luc­tant to write on the EA Forum

  If you or someone else wants to expand on this point, I’d be interested in understanding whether that’s really the case or in which ways it got better or worse

• EdoAradFeb 10, 2024, 5:08 PM

  1 point

  0 ∶ 0

  in reply to: EdoArad’s comment on: Am­bi­tious Im­pact (AIM) - a new brand for Char­ity En­trepreneur­ship and our ex­tended ecosys­tem!

  wait, was it like that before??

• EdoAradFeb 8, 2024, 7:57 PM

  3 points

  2 ∶ 1

  on: Am­bi­tious Im­pact (AIM) - a new brand for Char­ity En­trepreneur­ship and our ex­tended ecosys­tem!

  Love the Harry Potter color theme!

• EdoAradFeb 7, 2024, 4:53 PM

  41 points

  6 ∶ 1

  on: In­tro­duc­ing the Effek­tiv Spen­den “Defend­ing Democ­racy” fund

  Is the issue highly polarized/​politicized in Germany? Say, do you expect some people to engage less with your work as a result of “choosing sides”?

  In EA Israel we tend to take more politically neutral approaches when engaging publicly, including in relation to the current war or to the large “pro-democratic” public protests (wiki). I’m curious about your attitude to reputational risks and the potential problem of “painting EA with leftist colors”.

• EdoAradFeb 4, 2024, 3:28 PM

  5 points

  0 ∶ 0

  on: A sim­ple and generic frame­work for im­pact es­ti­ma­tion and attribution

  Usually we use purchase-parity adjustments when we look at the value of money, so there might be a subtle circular reasoning problem here. One issue for example is that there is no value in innovation (say, by designing a cheaper transportation service/​product, people could end up paying less for the service so the revenue may decrease [while the profits could get higher]).

  Another issue is that I don’t think this could take into account counterfactual impact.

  Didn’t read through the whole thing yet, sorry if I missed how you addressed this issues! I love the idea of trying to find simpler ways of estimating impact!

• EdoAradJan 12, 2024, 7:28 AM

  2 points

  0 ∶ 0

  on: Prior knowl­edge elic­i­ta­tion: The past, pre­sent, and fu­ture [re­view pa­per 2023]

  Seems like this was first published in 2021 but revised in 2023

• EdoAradJan 12, 2024, 7:06 AM

  4 points

  0 ∶ 0

  in reply to: EdoArad’s comment on: Copen­hagen Con­sen­sus Cen­ter’s best in­vest­ment pa­pers for the sus­tain­able de­vel­op­ment goals

  Also, CCC are using a discount rate of 8% (compared with 4% that’s common at least for CE)

• EdoAradJan 12, 2024, 6:56 AM

  11 points

  0 ∶ 0

  on: Copen­hagen Con­sen­sus Cen­ter’s best in­vest­ment pa­pers for the sus­tain­able de­vel­op­ment goals

  How should we compare their (CCC’s) cost-benefit estimates to GiveWell’s (GW’s) results?

  I quickly spot two differences:

  1. GW’s benefit estimates are in units of doubling of consumption (interventions are compared to direct cash transfers through Give Directly, itself measured in terms of doubling of consumption), whereas CCC’s estimates are in units of value of a statistical life.

  2. CCC’s analyses are for large-scale government operations, so

     1. they don’t account for counterfactual investments,

     2. they encounter diminishing returns (compared to GW’s focus on the marginal dollar).

  Points 1. and 2.a. are both indications that CCC’s cost-benefit ratios are higher than GW-esque’s cost-effectiveness ratios, while 2.b. goes to the other direction.

  From the Tuberculosis paper, regarding value of a statistical life (VSL):

  The GDP growth in this group of countries outpaces the population growth, so that the VSL grows rapidly over time. In constant 2020 US$ values, the benefit of an averted death is US$ 98,700 (2020), US$ 149,800 (2025), US$ 212,000 (2030), US$ 276,300 (2035), US$ 338,100 (2040), US$ 396,800 (2045), and US$ 456,000 (2050).

  In comparison, GW estimates that one can save a life (or have equivalent impact) at about $5000. That’s a factor of ~20. [I think this is misleading, so I’d be interested in a more careful comparison here, directly comparing VSL to doubling of consumption].

  I’m also not sure how exactly to account for the differences in 2.

Prior knowl­edge elic­i­ta­tion: The past, pre­sent, and fu­ture [re­view pa­per 2023]

• EdoAradJan 5, 2024, 9:34 AM

  3 points

  1 ∶ 0

  in reply to: JoshuaBlake’s comment on: How We Plan to Ap­proach Uncer­tainty in Our Cost-Effec­tive­ness Models

  Totally agree with the need for a more balanced and careful analysis!

• EdoAradJan 5, 2024, 9:30 AM

  2 points

  0 ∶ 0

  in reply to: JoshuaBlake’s comment on: How We Plan to Ap­proach Uncer­tainty in Our Cost-Effec­tive­ness Models

  The main point is that access management is more natively associated with the structure of the model in software settings. Say, you are less likely to release a model without its prerequisites.

  But I agree that this could also be messed up in software environments, and that it’s mainly an issue of UI and culture. I guess I generally argue for a modeling environment that is “modeling-first” rather than something like “explainable-results-first”.

• EdoAradJan 3, 2024, 4:26 PM

  40 points

  5 ∶ 1

  on: How We Plan to Ap­proach Uncer­tainty in Our Cost-Effec­tive­ness Models

  I have a very rough draft based on work with @Michael Latowicki and Charity Entrepreneurship (@Filip_Murar and @weeatquince) where we tried various tools for modeling uncertainty for use in their CEAs. Due to personal issues, I’m not sure when I’ll finish it, so here it is (very unpolished and not finished).

  Mainly, we list various tools we found with some comments on them and discuss the pros and cons of spreadsheet vs software solutions. The latter is mostly coherent so I’ll paste it here:

  Spreadsheets vs programming languages

  The tools we found for probabilistic calculation come in two flavours: either the calculation is expressed in a spreadsheet, or it is written as text in some programming language that is customized by a dedicated interpreter or library for this purpose.

  The spreadsheet-based solutions seem to have one salient advantage: they do not scare non-programmers away. This is, we think, a barrier-to-entry advantage, rather than a long-term productivity advantage. The kind of people who build cost-effectiveness model are not incapable of being productive in a simple, probability-dedicated programming language as well as with a probabilistic library within a general purpose language.

  The error-proneness of spreadsheets

  We strongly suspect that using spreadsheets to organize formulae is more error-prone than using programming languages. We are not alone in this suspicion. Audits of spreadsheets generally find that something between a large fraction and nearly all spreadsheets contain errors.

  Some pitfalls that make spreadsheets more error-prone than programming languages:

  • In a spreadsheet, mistyping a cell address does not necessarily result in an error message. By contrast, mistyping a variable name in a programming language typically does.

  • In a spreadsheet, unintentionally leaving a cell empty is equivalent to setting it to zero, which often does not result in an error. In a programming language, using a variable without declaring it does trigger an error.

  • Since spreadsheet formulae typically reference values by cell address, erroneous references are not salient to the reader. If your formula is “power(1+interest_rate, -years_left)”, but it is encoded as “power(1+M7, $A$13)” then you may easily fail to notice that the “13” should actually be “12”.

  • Formulas are not automatically updated to account for added data, for example in sums of columns.

  • Copy-and-pasting formulae often results in erroneous cell references because the software adjusts treats cell addresses as relative by default and the spreadsheet author often fails to consider whether addresses should be relative or absolute.

  There are other causes of errors in spreadsheets, but you get the point. Errors occur in every kind of programming environment, of course, but spreadsheets sport their own additional pitfalls, on top of those that exist in every programming language.

  We are far from certain that writing cost-effectiveness analyses in an ordinary programming language would reduce the error rate compared to spreadsheets—quantitative estimates of the error rate in both spreadsheets and in non-spreadsheet programs find error rates on the same order of magnitude. The mix of problems that are typically approached using these two types of tools is different though, and we have not found an apples-to-apples study of those error rates.

  It is apparently not easy to root out spreadsheet errors. In “Spreadsheet errors: What we know. What we think we can do”, Professor of IT management Ray Panko summarizes his findings:

  Unfortunately, only one approach to error reduction has been demonstrated to be effective. This is code inspection, in which a group of spreadsheet developers checks a spreadsheet cell-by-cell to discover errors. Even this exhausting and expensive process will catch only about 80% of all errors. Other things can be done to reduce errors, but given the tenacity of spreadsheet error in the face of even cell-by-cell code inspection, we should be careful about expecting too much from most error-reducing approach.

• EdoAradJan 3, 2024, 3:39 PM

  2 points

  0 ∶ 0

  in reply to: MHR🔸’s comment on: How We Plan to Ap­proach Uncer­tainty in Our Cost-Effec­tive­ness Models

  [btw, this is a common problem when using spreadsheets rather than when modeling in a software development environment—the software space has a lot of experience in working in (partially-) open source settings]

• EdoAradJan 3, 2024, 3:09 PM

  2 points

  0 ∶ 0

  on: Help me find an­swers for the miss­ing parts in mod­ern ed­u­ca­tion.

  Relevant keyphrase: Positive Education

• EdoAradDec 26, 2023, 4:57 AM

  5 points

  1 ∶ 0

  in reply to: EdoArad’s comment on: new trol­ley problem

  Oh! I see that you’ve also posted Shrimp Neuroanatomy. Great, I’m looking forward future posts on this topic to inform the debate :)

• EdoAradDec 26, 2023, 4:54 AM

  9 points

  2 ∶ 0

  on: new trol­ley problem

  I don’t agree with your take, but many people in EA (and definitely outside it) feel similarly to you so I appreciate you writing this. It’s also a good time to criticize invertebrate welfare, as more attention and funding are directed there.

  That said, I found the tone of this post too confrontational to promote useful discussion so I’ve decided neither to upvote or downvote. I know it’s a tough ask, but it would also be very useful to directly engage with works in this space (say, recent posts on invertebrate welfare or RP’s sequence) and clearly outline the difference in views.

• EdoAradDec 25, 2023, 2:25 PM

  2 points

  1 ∶ 0

  in reply to: MichaelDickens’s comment on: BenMill­wood’s Shortform

  I like this as an example of a case where you wouldn’t want to combine these two different forms of uncertainty

• EdoAradNov 29, 2023, 7:07 AM

  2 points

  0 ∶ 0

  in reply to: Agustín Covarrubias 🔸’s comment on: Re­think Pri­ori­ties’ Cross-Cause Cost-Effec­tive­ness Model: In­tro­duc­tion and Overview

  Yeah. If I understand correctly, everything is resampled rather than cached, so comparing results between two models is only done on aggregate rather than on a sample-by-sample basis

• EdoAradNov 28, 2023, 6:10 PM

  5 points

  0 ∶ 0

  on: Re­think Pri­ori­ties’ Cross-Cause Cost-Effec­tive­ness Model: In­tro­duc­tion and Overview

  If I understand correctly, all the variables are simulated freshly for each model. In particular, that applies to some underlying assumptions that are logically shared or correlated between models (say, sentience probabilities or x-risks).

  I think this may cause some issues when comparing between different causes. At the very least, it seems likely to understate the certainty by which one intervention may be better than another. I think it may also affect the ordering, particularly if we take some kind of risk aversion or other non-linear utility into account.

  To be clear, this would be a problem in any uncertainty-based CEA modeling, and clearly the situation in non-randomized models is usually much worse. It may also be very minor, not sure.

• EdoAradNov 22, 2023, 9:14 AM

  4 points

  0 ∶ 0

  on: Vi­su­als for EA-al­igned Research

  These are beautiful! Thanks for your generous offer to the community, this seems very valuable!