Flodorner

• Flodorner 27 Jun 2020 18:16 UTC

  11 points

  in reply to: judyfletcher’s comment on: EA con­sid­er­a­tions re­gard­ing in­creas­ing poli­ti­cal polarization

  Claims that peo­ple are “un­abashed racists and sex­ists” should at least be backed up with ac­tual ex­am­ples. Like this, I can­not know whether you have good rea­sons for that be­lieve that I don’t see (to the very least not in all of the cases), or whether we have the same in­for­ma­tion but fun­da­men­tally dis­agree about what con­sti­tutes “un­abashed racism”.

  I agree with the feel­ing that the post un­der­sells con­cerns about the right wing, but I don’t think you will con­vince any­body with­out any ar­gu­ments ex­cept for a weakly sup­ported claim that the con­cern about the left is overblown. I also agree that “both sides are equal” is rarely true, but again just claiming that does not show any­one that the side you pre­fer is bet­ter (see that com­ment where some­one es­sen­tially ar­gues the same for the other side; Imag­ine I haven’t thought about this topic be­fore, how am I sup­posed to choose whom of you two to listen to?).

  “If you would like to avoid be­ing de­plat­formed or called out, per­haps the best ad­vice is to sim­ply not make bi­goted state­ments. That cer­tainly seems eas­ier than flee­ing to an­other coun­try.” The au­thor seems to be ar­gu­ing that it might make sense to be pre­pared to flee the coun­try if things be­come a lot worse than de­plat­form­ing. While I think that the like­li­hood of this hap­pen­ing is fairly small (al­though this course of ac­tion would be equally ad­vis­able if things got a lot worse on the right wing), they are clearly not ad­vo­cat­ing to leave the coun­try in or­der to avoid be­ing “called out”.

  Lastly, I sincerely hope that all of the down­votes are for failing to com­ply with the com­ment­ing guidlines of “Aim to ex­plain, not per­suade, Try to be clear, on-topic, and kind; and Ap­proach dis­agree­ments with cu­ri­os­ity” and not be­cause of your opinions.

• Flodorner 27 Jun 2020 17:32 UTC

  11 points

  on: EA con­sid­er­a­tions re­gard­ing in­creas­ing poli­ti­cal polarization

  “While Trump’s poli­cies are in some ways more mod­er­ate than the tra­di­tional Repub­li­can plat­form”. I do not find this claim self-ev­i­dent (po­ten­tially due to bi­ased me­dia re­port­ing af­fect­ing my views) and find it strange that no source or ev­i­dence for it is pro­vided, es­pe­cially given the com­mend­able gen­eral amount of links and sources in the text.

  Re­lat­edly, I no­ticed a gut feel­ing that the text seems more char­i­ta­ble to the right-wing per­spec­tive than to the left (spe­cific “ev­i­dence” in­cluded the state­ment from the pre­vi­ous para­graph, the use of the word “mob”, the use of con­crete ex­am­ples for the wrong­do­ings of the left while mostly talk­ing about hy­po­thet­i­cals for the right and the fo­cus on the cul­tural rev­olu­tion with­out pro­vid­ing ar­gu­ments why par­allels to pre­vi­ous right-wing takeovers [es­pe­cially against the back­drop of a per­ceived left-wing threat] are not ad­e­quate). The recom­men­da­tion of east­ern eu­rope as good des­ti­na­tion for mi­gra­tion seems to push in a similar vein, given re­cent drifts to­wards right wing au­thor­i­tar­i­anism in states like poland and hun­gary.

  I would be cu­ri­ous if oth­ers (es­pe­cially peo­ple whose poli­ti­cal in­stincts don’t kick in when think­ing about the dis­cus­sion around de­plat­form­ing) share this im­pres­sion to get a bet­ter sense of how much poli­tics dis­torts how I viscer­ally weigh ev­i­dence.

  I am also con­fused whether pieces that can eas­ily be read in a way that is ex­plic­itly anti-left wing (If I, who is quite scep­ti­cal of de­plat­form­ing but might not see it is as a huge threat can do this, imag­ine some­one who is fur­ther to the left) rather than mostly or­thog­o­nal to poli­tics (with the oc­ca­sional state­ment that can be mis­con­strued as right-wing) might make it even eas­ier for EA to “get la­bel­led as right-wing or counter-rev­olu­tion­ary and lose sta­tus among left-wing academia and me­dia out­lets.”. If that was the case, one would have to care­fully weigh the like­li­hood that these texts will pre­vent ex­treme poli­ti­cal out­comes and the added risk of get­ting caught in the cross­fire. (Of course, there are also sec­ond or­der like the effect of po­ten­tial self-cen­sor­ship that might very well play a rele­vant role).

  Similar con­sid­er­a­tions go for mass-down­vot­ing com­ments push­ing against texts like this [in a way that most likely vi­o­lates com­mu­nity norms but is un­likely to be trol­ling], with­out any­one ex­plain­ing why.

• Flodorner 27 Jun 2020 15:40 UTC

  4 points

  in reply to: Inda’s comment on: EA con­sid­er­a­tions re­gard­ing in­creas­ing poli­ti­cal polarization

  If you go by GDP per cap­ita, most of eu­rope is be­hind the US but ahead of most of Asia https://​​en.wikipe­dia.org/​​wiki/​​List_of_coun­tries_by_GDP_(nom­i­nal)_per_cap­ita (growth rates in Asia are higher though, so this might change at some point in the fu­ture.)

  In terms of the Hu­man Devel­omp­ment In­dex https://​​en.wikipe­dia.org/​​wiki/​​List_of_coun­tries_by_Hu­man_Devel­op­ment_In­dex (which seems like a bet­ter mea­sure of “suc­cess” than just GDP), some coun­tries (in­clud­ing large ones like Ger­many and the UK) score above the US but oth­ers score lower. Most of Asia (ex­cept for Sin­ga­pore, Hong Kong and Ja­pan) scores lower.

  For the mil­i­tary as­pect, it kind of de­pends on what you mean by “failed”? Europe is clearly not as mil­i­tar­ily ca­pa­ble as the US, but it also seems quite ques­tion­able whether spend­ing as much as the US on mil­i­tary ca­pa­bil­ities is a good choice, es­pe­cially for al­lies of the US who also pos­sess (or are strongly con­nected with) other coun­tries who pos­sess nu­clear de­ter­rence.

• Flodorner 15 May 2020 18:02 UTC

  4 points

  in reply to: avturchin’s comment on: Crit­i­cal Re­view of ‘The Precipice’: A Re­assess­ment of the Risks of AI and Pandemics

  While I am un­sure about how good of an idea it is to map out more plau­si­ble sce­nar­ios for ex­is­ten­tial risk from pathogens, I agree with the sen­ti­ment that the top level post seems seems to fo­cus too nar­rowly on a spe­cific sce­nario.

• Flodorner 27 Feb 2020 16:38 UTC

  1 point

  on: Bi­ases in our es­ti­mates of Scale, Ne­glect­ed­ness and Solv­abil­ity?

  Re bonus sec­tion: Note that we are (hope­fully) tak­ing ex­pec­ta­tions over our es­ti­mates for im­por­tance, ne­glect­ed­ness and tractabil­ity, such that gen­eral cor­re­la­tions be­tween the fac­tors be­tween causes do not nec­es­sar­ily cause a prob­lem. How­ever, it seems quite plau­si­ble that our es­ti­ma­tion er­rors are of­ten cor­re­lated be­cause of things like the halo effect.

  Edit: I do not fully en­dorse this com­ment any more, but still be­lief that the way we model the es­ti­ma­tion pro­ce­dure mat­ters here. Will edit again, once I am less con­fused.

• Flodorner 6 Sep 2019 15:06 UTC

  5 points

  on: Im­pli­ca­tions of Quan­tum Com­put­ing for Ar­tifi­cial In­tel­li­gence al­ign­ment re­search (ABRIDGED)

  Maybe hav­ing a good un­der­stand­ing of Quan­tum Com­put­ing and how it could be lev­er­aged in differ­ent paradigms of ML might help with fore­cast­ing AI-timelines as well as dom­i­nant paradigms, to some ex­tend?

  If that was true, while not nec­es­sar­ily helpful for a sin­gle agenda, knowl­edge about quan­tum com­put­ing would help with the cor­rect pri­ori­ti­za­tion of differ­ent agen­das.

• Flodorner 15 Feb 2019 17:18 UTC

  2 points

  on: Three Bi­ases That Made Me Believe in AI Risk

  “The com­bi­na­tion of these vastly differ­ent ex­pres­sions of scale to­gether with an­chor­ing makes that we should ex­pect peo­ple to over-es­ti­mate the prob­a­bil­ity of un­likely risks and hence to over-es­ti­mate the ex­pected util­ity of x-risk pre­ven­tion mea­sures. ”

  I am not en­tirely sure whether i un­der­stand this point. Is the ar­gu­ment that the an­chor­ing effect would cause an over­es­ti­ma­tion, be­cause the “per­ceived dis­tance” from an an­chor grows faster per added zero than per in­crease of one to the ex­po­nent?

• Flodorner 15 Dec 2018 20:28 UTC

  4 points

  in reply to: rohinmshah’s comment on: Cri­tique of Su­per­in­tel­li­gence Part 2

  Directly rele­vant quotes from the ar­ti­cles for eas­ier refer­ence:

  Paul Chris­ti­ano:

  “This story seems con­sis­tent with the his­tor­i­cal record. Things are usu­ally pre­ceded by worse ver­sions, even in cases where there are weak rea­sons to ex­pect a dis­con­tin­u­ous jump. The best coun­terex­am­ple is prob­a­bly nu­clear weapons. But in that case there were sev­eral very strong rea­sons for dis­con­ti­nu­ity: physics has an in­her­ent gap be­tween chem­i­cal and nu­clear en­ergy den­sity, nu­clear chain re­ac­tions re­quire a large min­i­mum scale, and the dy­nam­ics of war are very sen­si­tive to en­ergy den­sity.”

  “I’m not aware of many his­tor­i­cal ex­am­ples of this phe­nomenon (and no re­ally good ex­am­ples)—to the ex­tent that there have been “key in­sights” needed to make some­thing im­por­tant work, the first ver­sion of the in­sight has al­most always ei­ther been dis­cov­ered long be­fore it was needed, or dis­cov­ered in a pre­limi­nary and weak ver­sion which is then iter­a­tively im­proved over a long time pe­riod. ”

  “Over the course of train­ing, ML sys­tems typ­i­cally go quite quickly from “re­ally lame” to “re­ally awe­some”—over the timescale of days, not months or years.

  But the train­ing curve seems al­most ir­rele­vant to take­off speeds. The ques­tion is: how much bet­ter is your AGI then the AGI that you were able to train 6 months ago?”

  AIIm­pacts:

  “Dis­con­ti­nu­ities larger than around ten years of past progress in one ad­vance seem to be rare in tech­nolog­i­cal progress on nat­u­ral and de­sir­able met­rics. We have ver­ified around five ex­am­ples, and know of sev­eral other likely cases, though have not com­pleted this in­ves­ti­ga­tion. ”

  “Sup­pos­ing that AlphaZero did rep­re­sent dis­con­ti­nu­ity on play­ing mul­ti­ple games us­ing the same sys­tem, there re­mains a ques­tion of whether that is a met­ric of suffi­cient in­ter­est to any­one that effort has been put into it. We have not in­ves­ti­gated this.

  Whether or not this case rep­re­sents a large dis­con­ti­nu­ity, if it is the only one among re­cent progress on a large num­ber of fronts, it is not clear that this raises the ex­pec­ta­tion of dis­con­ti­nu­ities in AI very much, and in par­tic­u­lar does not seem to sug­gest dis­con­ti­nu­ity should be ex­pected in any other spe­cific place.”

  “We have not in­ves­ti­gated the claims this ar­gu­ment is premised on, or ex­am­ined other AI progress es­pe­cially closely for dis­con­ti­nu­ities.”

• Flodorner 14 Dec 2018 10:55 UTC

  3 points

  on: Cri­tique of Su­per­in­tel­li­gence Part 2

  Another point against the con­tent over­hang ar­gu­ment: While more data is definitely use­ful, it is not clear, whether raw data about a world with­out a par­tic­u­lar agent in it will be similarly use­ful to this agent as data ob­tained from its own (or that of suffi­ciently similar agents) in­ter­ac­tion with the world. Depend­ing on the ac­tual im­ple­men­ta­tion of a pos­si­ble su­per­in­tel­li­gence, this raw data might be marginally helpful but far from be­ing the most rele­vant bot­tle­neck.

  “Bostrom is sim­ply mak­ing an as­sump­tion that such rapid rates of progress could oc­cur. His in­tel­li­gence spec­trum ar­gu­ment can only ever show that the rel­a­tive dis­tance in in­tel­li­gence space is small; it is silent with re­spect to likely de­vel­op­ment times­pans. ”

  It is not com­pletely silent. I would ex­pect any mean­ingful mea­sure for dis­tance in in­tel­li­gence space to at least some­what cor­re­late with times­pans nec­es­sary to bridge that dis­tance. So while the ar­gu­ment is not a de­ci­sive one re­gard­ing time spans, it also seems far from say­ing noth­ing.

  “As such it seems patently ab­surd to ar­gue that de­vel­op­ments of this mag­ni­tude could be made on the times­pan of days or weeks. We sim­ply see no ex­am­ples of any­thing like this from his­tory, and Bostrom can­not ar­gue that the ex­is­tence of su­per­in­tel­li­gence would make his­tor­i­cal par­allels ir­rele­vant, since we are pre­cisely talk­ing about the de­vel­op­ment of su­per­in­tel­li­gence in the con­text of it not already be­ing in ex­is­tence. ”

  Note that the ar­gu­ment from his­tor­i­cal par­allels is ex­tremely sen­si­tive to refer­ence class. While it seems like there has not been “any­thing like this” in sci­ence or en­g­ineer­ing (al­though progress seems to have been quite dis­con­ti­nous (but not self-re­in­forc­ing) by some met­rics at times) or re­lated to gen­eral in­tel­li­gence (here it would be in­ter­est­ing to ex­plore, whether or not the evolu­tion of hu­man in­tel­li­gence hap­pened a lot faster than an out­side ob­server would have ex­pected from look­ing at the evolu­tion of other an­i­mals, since hours and weeks seem like a some­what An­thro­pocen­tric frame of refer­ence), nar­row AI has gone from sub- to su­per­hu­man level in quite small time spans a lot re­cently (this is once again very sen­si­tive to fram­ing, so take it more as a point for the com­plex­ity of aru­ments from his­tor­i­cal par­allels, than as a di­rect ar­gu­ment for fast take-offs be­ing likely).

  “not con­sis­tent ei­ther with the slow but steady rate of progress in ar­tifi­cial in­tel­li­gence re­search over the past 60 years”

  Could you elab­o­rate? I’m not ex­tremely fa­mil­iar with the his­tory of ar­tifi­cial in­tel­li­gence, but my im­pres­sion was, that progress was quite jumpy at times, in­stead of slow and steady.

• Flodorner 13 Dec 2018 23:50 UTC

  5 points

  on: Cri­tique of Su­per­in­tel­li­gence Part 1

  Thanks for writ­ing this!

  I think you are point­ing out some im­por­tant im­pre­ci­sions, but i think that some of your ar­gu­ments aren’t as con­clu­sive as you seem to pre­sent them to be:

  “Bostrom there­fore faces a dilemma. If in­tel­li­gence is a mix of a wide range of dis­tinct abil­ities as in In­tel­li­gence(1), there is no rea­son to think it can be ‘in­creased’ in the rapidly self-re­in­forc­ing way Bostrom speaks about (in math­e­mat­i­cal terms, there is no sin­gle vari­able which we can differ­en­ti­ate and plug into the differ­en­tial equa­tion, as Bostrom does in his ex­am­ple on pages 75-76). ”

  Those vari­ables could be re­in­forc­ing each other, as one could ar­gue they had done in the evolu­tion of hu­man in­tel­li­gence. (in math­e­mat­i­cal terms, there is a run­away dy­namic similar to the one di­men­sional case for a lin­ear vec­tor-val­ued differ­en­tial equa­tion, as long as all eigen­val­ues are pos­i­tive).

  “This should be­come clear if one con­sid­ers that ‘es­sen­tially all hu­man cog­ni­tive abil­ities’ in­cludes such ac­tivi­ties as pon­der­ing moral dilem­mas, re­flect­ing on the mean­ing of life, analysing and pro­duc­ing so­phis­ti­cated liter­a­ture, for­mu­lat­ing ar­gu­ments about what con­sti­tutes a ‘good life’, in­ter­pret­ing and writ­ing po­etry, form­ing so­cial con­nec­tions with oth­ers, and crit­i­cally in­tro­spect­ing upon one’s own goals and de­sires. To me it seems ex­traor­di­nar­ily un­likely that any agent ca­pa­ble of perform­ing all these tasks with a high de­gree of profi­ciency would si­mul­ta­neously stand firm in its con­vic­tion that the only goal it had rea­sons to pur­sue was till­ing the uni­verse with pa­per­clips. To me it seems ex­traor­di­nar­ily un­likely that any agent ca­pa­ble of perform­ing all these tasks with a high de­gree of profi­ciency would si­mul­ta­neously stand firm in its con­vic­tion that the only goal it had rea­sons to pur­sue was till­ing the uni­verse with pa­per­clips.”

  Why does it seem un­likely? Also, do you mean un­likely as in “agents emerg­ing in a world similar to ours is now­prob­a­bly won’t have this prop­erty” or as in “given that some­one figured out how to con­struct a great va­ri­ety of su­per­in­tel­li­gent agents, she would still have trou­ble con­struct­ing an agent with this prop­erty?”

• Flodorner 23 Nov 2018 18:59 UTC

  1 point

  in reply to: Max_Daniel’s comment on: When should EAs al­lo­cate fund­ing ran­domly? An in­con­clu­sive liter­a­ture re­view.

  Yes, ex­actly. When first read­ing your sum­mary i in­ter­preted it as the “for all” claim.

• Flodorner 22 Nov 2018 16:27 UTC

  2 points

  on: When should EAs al­lo­cate fund­ing ran­domly? An in­con­clu­sive liter­a­ture re­view.

  Very in­ter­est­ing!

  In the your liter­a­ture re­view you sum­ma­rize the Smith and Win­kler (2006) pa­per as “Prove that non­ran­dom, non-Bayesian de­ci­sion strate­gies sys­tem­at­i­cally over­es­ti­mate the value of the se­lected op­tion.”

  On first sight, this claim seems like it might be stronger than the claim i have taken away from the pa­per (which is similar to what you write later in the text): if your de­ci­sion strat­egy is to just choose the op­tion you (naively) ex­pect to be best, you will sys­tem­at­i­cally over­es­ti­mate the value of the se­lected op­tion.

  If you think the first claim is im­plied by the sec­ond (or some­thing in the pa­per i missed) in some sense, i’d love to learn about your ar­gu­ments!

  “In fact, I be­lieve that choos­ing the win­ning op­tion does max­i­mize ex­pected value if all mea­sure­ments are un­bi­ased and their re­li­a­bil­ity doesn’t vary too much.”

  I think you are ba­si­cally right, but the amount of available op­tions also plays a role here. If you con­sider a lot of non-op­ti­mal op­tions, for which your mea­sure­ments are only slightly nois­ier than for the best op­tion, you can still sys­tem­at­i­cally un­der­s­e­lect the best op­tion. (For ex­am­ple, simu­la­tions sug­gest that with 99 N(0,1.1) and 1 N(0.1,1) vari­ables, the last one will only be max­i­mal among the 100 only 0.7% of the time, de­spite hav­ing the high­est ex­pected value).

  In this case, ran­domly tak­ing one op­tion would in fact have a higher ex­pected value. (But it still seems very un­clear, how one would iden­tify similar situ­a­tions in re­al­ity, even if they ex­isted).

  Some com­bi­na­tion of mod­er­ately vary­ing noise and lots of op­tions seems like the most plau­si­ble con­di­tion, un­der which not tak­ing the win­ning op­tion might be bet­ter for some real world de­ci­sions.

  What links here?

  • When should EAs al­lo­cate fund­ing ran­domly? An in­con­clu­sive liter­a­ture re­view. by Max_Daniel (17 Nov 2018 14:53 UTC; 36 points)

• Flodorner 11 Nov 2018 13:11 UTC

  2 points

  on: Tiny Prob­a­bil­ities of Vast Utilities: De­fus­ing the Ini­tial Worry and Steel­man­ning the Problem

  I think that the as­sump­tion of the ex­is­tence of a Fun­nel shaped dis­tri­bu­tion with un­defined ex­pected value of things we care about is quite a bit stronger than as­sum­ing that there are in­finitely many pos­si­ble out­comes.

  But even if we re­strict our­selves to dis­tri­bu­tions with finite ex­pected value, our es­ti­mates can still fluc­tu­ate wildly un­til we have gath­ered huge amounts of ev­i­dence.

  So while i am scep­ti­cal of the as­sump­tion that there ex­ists a se­quence of world states with util­ities tend­ing to in­finity and even more scep­ti­cal of ex­tremely high/​low util­ity world states be­ing reach­able with suffi­cient prob­a­bil­ity for there to be un­defined ex­pected value (the ab­solute value of the util­ity of our ac­tion would have to have in­finite ex­pected value, and i’m scep­ti­cal of be­liev­ing this with­out some­thing at least close to “in­finite ev­i­dence”), i still think your post is quite valuable for start­ing a de­bate on how to deal with low prob­a­bil­ity events, cru­cial con­sid­er­a­tions and our de­ci­sion mak­ing when ex­pected val­ues fluc­tu­ate a lot.

  Also, even if my in­tu­ition about the im­pos­si­bil­ity of in­finite util­ities was true (I’m not ex­actly sure what that would ac­tu­ally mean, though), the prob­lems you men­tioned would still ap­ply to any­one who does not share this in­tu­ition.

• Flodorner 11 Nov 2018 12:12 UTC

  2 points

  in reply to: sbehmer’s comment on: Is Ne­glect­ed­ness a Strong Pre­dic­tor of Marginal Im­pact?

  I think the ar­gu­ment is that ad­di­tional in­for­ma­tion show­ing that a cause has high marginal im­pact might di­vert causes away to­wards it from causes with less marginal im­pact. And get­ting this kind of in­for­ma­tion does seem more likely for causes with­out a track record al­low­ing for a some­what ro­bust es­ti­ma­tion of their (marginal) im­pact.

• Flodorner 11 Nov 2018 12:10 UTC

  1 point

  on: Is Ne­glect­ed­ness a Strong Pre­dic­tor of Marginal Im­pact?

  Com­ment moved.

• Flodorner 11 Nov 2018 11:30 UTC

  1 point

  on: Is Ne­glect­ed­ness a Strong Pre­dic­tor of Marginal Im­pact?

  For clar­ifi­ca­tion: (PITi+ui) is the “real” tractabil­ity and im­por­tance?

  The text seems to make more sense that way, but read­ing “ui is the un­known (to you) im­por­tance and tractabil­ity of the cause.”, I in­ter­preted it as ui be­ing the “real” tractabil­ity and im­por­tance in­stead of just a noise term at first.

• Flodorner 11 Nov 2018 10:23 UTC

  3 points

  on: De­bate and Effec­tive Altru­ism: Friends or Foes?

  Re­lat­edly, the im­promptu na­ture of some de­bat­ing for­mats could also help with get­ting com­fortable for­mu­lat­ing an­swers to non­triv­ial ques­tions un­der (time) pres­sure. Apart from be­ing gen­er­ally helpful, this might be es­pe­cially valuable in some types of job in­ter­views.

  I’ve been con­sid­er­ing to in­vest some time into com­pet­i­tive de­bat­ing, mostly in or­der to im­prove that skill, so if some­one has data (even anec­do­tal) on that, pleases share :)

• Flodorner 9 Nov 2018 16:36 UTC

  2 points

  on: Tiny Prob­a­bil­ities of Vast Utilities: A Prob­lem for Long-Ter­mism?

  In­ter­est­ing post!

  I am quite in­ter­ested in your other ar­gu­ments for why EV calcu­la­tions won’t work for pas­cal’s mug­ging and why they might ex­tend to x-risks. I would prob­a­bly have prefered a post already in­clud­ing all the ar­gu­ments for your case.

  About the ar­gu­ment from hy­po­thet­i­cal up­dates: My in­tu­ition is, that if you as­sign a prob­a­bil­ity of a lot more than 0.1^10^10^10 to the mug­ger ac­tu­ally be­ing able to fol­low through this might cre­ate other prob­lems (like prob­a­bil­ities of dis­tinct events adding to some­thing higher than 1 or pri­ors in­con­sis­tent with oc­cams ra­zor). If that in­tu­ition (and your ar­gu­ment) was true (my in­tu­ition might very well be wrong and seems at least slightly in­fluenced by mo­ti­vated rea­son­ing), one would ba­si­cally have to con­clude that bayesian EV rea­son­ing fails as soon as it in­volves com­bi­na­tions of ex­treme util­ities and minis­cule prob­a­bil­ities.

  How­ever, i don’t think the cre­denced for be­ing able to in­fluence x-risks are so low, that up­dat­ing be­comes im­pos­si­ble and there­fore i’m not con­vinced not to use EV to eval­u­ate them by your first ar­gu­ment. I’m quite ea­ger to see the other ar­gu­ments, though.

• Flodorner 1 Nov 2018 20:19 UTC

  2 points

  on: Re­duc­ing ex­is­ten­tial risks or wild an­i­mal suffer­ing?

  What ex­actly do you mean with util­ity here? The Quasi-nega­tive util­i­tar­ian frame­work seems to cor­re­spond to a shift of ev­ery­one’s per­sonal util­ity, such that the shifted util­ity for each per­son is 0, when­ever this per­son’s live is nei­ther worth liv­ing, nor not worth liv­ing.

  It seems to me, like a rea­son­able no­tion of util­ity would have this prop­erty any­way (but i might just use the word differ­ently than other peo­ple, please tell me, if there is some widely used defi­ni­tion con­tra­dict­ing this!). This re­frames the dis­cus­sion into one about where the zero point of util­ity func­tions should lie, which seems eas­ier to grasp. In par­tic­u­lar, from this point of view Quasi-nega­tive util­i­tar­i­anism still gives rise to some for of the sadis­tic-re­pug­nant con­clus­sion.

  On a broader point, i sus­pect, that the re­pug­nance of repgug­nant con­clus­sions usu­ally stems from con­fu­sion/​dis­agree­ment about what “a life worth liv­ing” means. How­ever, as in your ar­ti­cle, en­ter­tain­ing this con­clus­sion still seems use­ful in or­der to sharpen our in­tu­ition about what lives are ac­tu­ally worth liv­ing.

• Flodorner 10 Sep 2018 8:59 UTC

  7 points

  on: Ad­di­tional plans for the new EA Forum

  Are any ways of mak­ing con­tent eas­ier to filter (like for ex­am­ple tags) planned?

  I am rather new to the com­mu­nity and there have been mul­ti­ple oc­cas­sions, where i ran­domly stum­bled upon old ar­ti­cles, i haven’t read, con­cerned with top­ics i was in­ter­ested in and had pre­vi­ously made an effort to find ar­ti­cles about. This seems rather in­effi­cient.