RSS

Ar­tifi­cial intelligence

TagLast edit: Aug 6, 2022, 11:28 AM by Pablo

Artificial intelligence (AI) is the set of intellectual capacities characteristic of human beings exhibited by machines, as well as the area of research aimed at creating machines with these capacities.

Terminology

The literature on AI risk features several commonly used expressions that refer to various types or forms of artificial intelligence. These notions are not always used consistently.

As noted, artificial intelligence is the set of intellectual capacities characteristic of human beings exhibited by machines. But some authors use the term imprecisely, to refer to human-level AI or even to strong AI (a term which itself is very imprecise).[1]

Human-level artificial intelligence (HLAI) is AI that is at least as intelligent as the average or typical human. In one sense, human-level AI requires that the AI exhibits human-level ability in each of the capacities that constitute human intelligence. In another, weaker, sense, the requirement is that these capacities, assessed in the aggregate, are at least equivalent to the aggregate of human capacities. An AI that is weaker than humans on some dimensions, but stronger than humans on others, may count as human-level in this weaker sense. (However, it is unclear how these different capacities should be traded off against one another or what would ground these tradeoffs.[2])

Artificial general intelligence (AGI) is AI that does not only exhibit high ability in a wide range of specific domains, but can also generalize across these domains and display other skills that are wide rather than narrow in scope.[3] “Artificial general intelligence” is sometimes also used as a synonym for “human-level artificial intelligence”.[4][5]

High-level machine intelligence (HLMI) is AI that can carry out most human professions at least as well as a typical human. Vincent Müller and Nick Bostrom coined the expression to overcome the perceived deficiencies of existing terminology.[6][7]

Finally, “strong artificial intelligence” (strong AI) is a multiply ambiguous expression that can mean either “artificial general intelligence”, “human-level artificial intelligence” or “superintelligence”, among other things.[8]

Discussion

Today, AI systems are better than even the smartest people at some intellectual tasks, such as chess, but much worse at others, such as writing academic papers. If AI systems eventually become as good or better than humans at many of these remaining tasks, then their impact will likely be transformative. Furthermore, in the extreme case that AI systems eventually become more capable than humans at all intellectual tasks, this would arguably be the most significant development in human history.

Possible impacts of progress in AI include accelerated scientific progress, large-scale unemployment, novel forms of warfare, and risks from unintended behavior in AI systems.

Further reading

Christiano, Paul (2014) Three impacts of machine intelligence, Rational Altruist, August 23.

Related entries

AI governance | AI alignment | AI safety | human-level artificial intelligence

  1. ^

    An example of the latter is Muehlhauser, Luke (2013) When will AI be created?, Machine Intelligence Research Institute, May 16.

  2. ^

    AI Impacts (2014) Human-level AI, AI Impacts, January 23.

  3. ^

    See Pennachin, Cassio & Ben Goertzel (2007) Contemporary approaches to artificial general intelligence, in Ben Goertzel & Cassio Pennachin (eds.) Artificial General Intelligence, Berlin: Springer, pp. 1–30. The expression was popularized, but not coined, by Cassio Pennachin and Ben Goertzel. See Goertzel, Ben (2011) Who coined the term “AGI”?, Ben Goertzel’s Blog, August 28.

  4. ^

    Muehlhauser, Luke (2013) What is intelligence?, Machine Intelligence Research Institute, June 19.

  5. ^

    Baum, Seth D., Ben Goertzel & Ted G. Goertzel (2011) How long until human-level AI? Results from an expert assessment, Technological Forecasting and Social Change, vol. 78, pp. 185–195.

  6. ^

    Müller, Vincent C. & Nick Bostrom (2016) Future progress in artificial intelligence: a survey of expert opinion, in Vincent C. Müller (ed.) Fundamental Issues of Artificial Intelligence, Cham: Springer International Publishing, pp. 555–572.

  7. ^

    In their influential survey of machine learning researchers, Katja Grace and her collaborators define “high-level machine intelligence” as follows: “we have ‘high-level machine intelligence’ when unaided machines can accomplish every task better and more cheaply than human workers.” (Grace, Katja et al. (2017) When will AI exceed human performance? Evidence from AI experts, ArXiv, 1705.08807.) The expression is operationalized further in Muehlhauser, Luke (2015) What do we know about AI timelines?, Open Philanthropy, October (updated July 2016), section 1.

  8. ^

    Wikipedia (2021) Strong AI, Wikipedia, October 18.

Prevent­ing an AI-re­lated catas­tro­phe—Prob­lem profile

Benjamin HiltonAug 29, 2022, 6:49 PM
138 points
18 comments4 min readEA link
(80000hours.org)

Two con­trast­ing mod­els of “in­tel­li­gence” and fu­ture growth

Magnus VindingNov 24, 2022, 11:54 AM
74 points
32 comments22 min readEA link

Why AI al­ign­ment could be hard with mod­ern deep learning

AjeyaSep 21, 2021, 3:35 PM
153 points
17 comments14 min readEA link
(www.cold-takes.com)

Deep­Mind: Gen­er­ally ca­pa­ble agents emerge from open-ended play

kokotajlodJul 27, 2021, 7:35 PM
56 points
10 comments2 min readEA link
(deepmind.com)

Why AI is Harder Than We Think—Me­lanie Mitchell

Eevee🔹Apr 28, 2021, 8:19 AM
45 points
7 comments2 min readEA link
(arxiv.org)

Pro­ject ideas: Sen­tience and rights of digi­tal minds

Lukas FinnvedenJan 4, 2024, 7:26 AM
33 points
1 comment20 min readEA link
(lukasfinnveden.substack.com)

[Question] Train­ing a GPT model on EA texts: what data?

JoyOptimizerJun 4, 2022, 5:59 AM
23 points
17 comments1 min readEA link

What AI com­pa­nies can do to­day to help with the most im­por­tant century

Holden KarnofskyFeb 20, 2023, 5:40 PM
104 points
8 comments11 min readEA link
(www.cold-takes.com)

Sen­tience in Machines—How Do We Test for This Ob­jec­tively?

Mayowa OsiboduMar 20, 2023, 5:20 AM
10 points
0 comments2 min readEA link
(www.researchgate.net)

Con­nor Leahy on Con­jec­ture and Dy­ing with Dignity

Michaël TrazziJul 22, 2022, 7:30 PM
34 points
0 comments10 min readEA link
(theinsideview.ai)

Can AI power the Global Map­ping and Quan­tifi­ca­tion of An­i­mal Suffer­ing? The Pain At­las Project

Wladimir J. AlonsoJun 25, 2024, 9:48 PM
33 points
0 comments1 min readEA link
(welfarefootprint.org)

Ques­tions about AI that bother me

Eleni_AJan 31, 2023, 6:50 AM
33 points
6 comments2 min readEA link

In­tro­duc­ing the new Ries­gos Catas­trófi­cos Globales team

Jaime SevillaMar 3, 2023, 11:04 PM
74 points
3 comments5 min readEA link
(riesgoscatastroficosglobales.com)

AI timelines and the­o­ret­i­cal un­der­stand­ing of deep learn­ing

Venky1024Sep 12, 2021, 4:26 PM
4 points
8 comments2 min readEA link

Are you pas­sion­ate about AI and An­i­mal Welfare? Do you have an idea that could rev­olu­tionize the food in­dus­try? We want to hear from you!

David van BeverenMay 6, 2024, 11:42 PM
12 points
0 comments1 min readEA link

Planes are still decades away from dis­plac­ing most bird jobs

guzeyNov 25, 2022, 4:49 PM
27 points
2 comments1 min readEA link

AGI mis­al­ign­ment x-risk may be lower due to an over­looked goal speci­fi­ca­tion technology

johnjnayOct 21, 2022, 2:03 AM
20 points
1 comment1 min readEA link

Liter­a­ture re­view of Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence timelines

Jaime SevillaJan 27, 2023, 8:36 PM
148 points
10 comments1 min readEA link

FLI launches Wor­ld­build­ing Con­test with $100,000 in prizes

ggilgallonJan 17, 2022, 1:54 PM
87 points
55 comments6 min readEA link

Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey: 2021

Janet PauketatJul 1, 2022, 7:47 AM
36 points
0 comments2 min readEA link
(www.sentienceinstitute.org)

Clar­ify­ing and pre­dict­ing AGI

richard_ngoMay 4, 2023, 3:56 PM
69 points
2 comments1 min readEA link

Linkpost: Dwarkesh Pa­tel in­ter­view­ing Carl Shulman

Stefan_SchubertJun 14, 2023, 3:30 PM
110 points
5 comments1 min readEA link
(podcastaddict.com)

On the Dwarkesh/​Chol­let Pod­cast, and the cruxes of scal­ing to AGI

JWS 🔸Jun 15, 2024, 8:24 PM
72 points
49 comments17 min readEA link

What skills, ca­reers, and ex­pe­riences should young EAs pur­sue as the AI rev­olu­tion looms?

Dan BradyFeb 19, 2024, 9:40 AM
32 points
3 comments1 min readEA link

“Tech­nolog­i­cal un­em­ploy­ment” AI vs. “most im­por­tant cen­tury” AI: how far apart?

Holden KarnofskyOct 11, 2022, 4:50 AM
17 points
1 comment3 min readEA link
(www.cold-takes.com)

AI al­ign­ment re­search links

Holden KarnofskyJan 6, 2022, 5:52 AM
16 points
0 comments6 min readEA link
(www.cold-takes.com)

[Link post] AI could fuel fac­tory farm­ing—or end it

BrianKOct 18, 2022, 11:16 AM
39 points
0 comments1 min readEA link
(www.fastcompany.com)

Large Lan­guage Models as Cor­po­rate Lob­by­ists, and Im­pli­ca­tions for So­cietal-AI Alignment

johnjnayJan 4, 2023, 10:22 PM
10 points
6 comments8 min readEA link

On the fu­ture of lan­guage models

Owen Cotton-BarrattDec 20, 2023, 4:58 PM
125 points
3 comments36 min readEA link

Trans­for­ma­tive AI is­sues (not just mis­al­ign­ment): an overview

Holden KarnofskyJan 6, 2023, 2:19 AM
36 points
0 comments22 min readEA link
(www.cold-takes.com)

Pro­ject ideas: Epistemics

Lukas FinnvedenJan 4, 2024, 7:26 AM
43 points
1 comment17 min readEA link
(lukasfinnveden.substack.com)

Pro­ject ideas: Gover­nance dur­ing ex­plo­sive tech­nolog­i­cal growth

Lukas FinnvedenJan 4, 2024, 7:25 AM
33 points
1 comment16 min readEA link
(lukasfinnveden.substack.com)

Pro­ject ideas: Backup plans & Co­op­er­a­tive AI

Lukas FinnvedenJan 4, 2024, 7:26 AM
25 points
2 comments13 min readEA link
(lukasfinnveden.substack.com)

Non-al­ign­ment pro­ject ideas for mak­ing trans­for­ma­tive AI go well

Lukas FinnvedenJan 4, 2024, 7:23 AM
66 points
1 comment3 min readEA link
(lukasfinnveden.substack.com)

Misha Yagudin and Ozzie Gooen Dis­cuss LLMs and Effec­tive Altruism

Ozzie GooenJan 6, 2023, 10:59 PM
47 points
3 comments14 min readEA link
(quri.substack.com)

[Question] Suggested read­ings & videos for a new col­lege course on ‘Psy­chol­ogy and AI’?

Geoffrey MillerJan 11, 2024, 10:26 PM
12 points
3 comments1 min readEA link

14 Ways ML Could Im­prove In­for­ma­tive Video

Ozzie GooenJan 10, 2023, 1:53 PM
8 points
0 comments2 min readEA link
(quri.substack.com)

Sleeper Agents: Train­ing De­cep­tive LLMs that Per­sist Through Safety Training

evhubJan 12, 2024, 7:51 PM
65 points
0 comments1 min readEA link
(arxiv.org)

Gentle­ness and the ar­tifi­cial Other

Joe_CarlsmithJan 2, 2024, 6:21 PM
90 points
2 comments1 min readEA link

Aspira­tion-based, non-max­i­miz­ing AI agent designs

Bob Jacobs 🔸May 7, 2024, 4:13 PM
12 points
1 comment38 min readEA link

How “AGI” could end up be­ing many differ­ent spe­cial­ized AI’s stitched together

titotalMay 8, 2023, 12:32 PM
31 points
2 comments9 min readEA link

tito­tal on AI risk scepticism

Vasco Grilo🔸May 30, 2024, 5:03 PM
76 points
3 comments6 min readEA link
(forum.effectivealtruism.org)

Make a neu­ral net­work in ~10 minutes

Arjun YadavApr 25, 2022, 6:36 PM
3 points
0 comments4 min readEA link
(arjunyadav.net)

Will scal­ing work?

Vasco Grilo🔸Feb 4, 2024, 9:29 AM
19 points
1 comment12 min readEA link
(www.dwarkeshpatel.com)

I bet Greg Colbourn 10 k€ that AI will not kill us all by the end of 2027

Vasco Grilo🔸Jun 4, 2024, 4:37 PM
195 points
57 comments2 min readEA link

Seek­ing Sur­vey Re­sponses—At­ti­tudes Towards AI risks

ansonMar 28, 2022, 5:47 PM
23 points
2 comments1 min readEA link
(forms.gle)

[Linkpost] Si­tu­a­tional Aware­ness—The Decade Ahead

MathiasKB🔸Jun 4, 2024, 10:58 PM
87 points
7 comments2 min readEA link
(situational-awareness.ai)

How AI Takeover Might Hap­pen in Two Years

JoshcFeb 7, 2025, 11:51 PM
20 points
6 comments29 min readEA link
(x.com)

A Bird’s Eye View of the ML Field [Prag­matic AI Safety #2]

TW123May 9, 2022, 5:15 PM
97 points
2 comments35 min readEA link

Ex­perts’ AI timelines are longer than you have been told?

Vasco Grilo🔸Jan 9, 2025, 5:30 PM
30 points
11 comments3 min readEA link
(bayes.net)

In­tro­duc­ing the ML Safety Schol­ars Program

TW123May 4, 2022, 1:14 PM
157 points
42 comments3 min readEA link

Oper­a­tional­iz­ing timelines

Zach Stein-PerlmanMar 10, 2023, 5:30 PM
30 points
2 comments1 min readEA link

GPT-4 is out: thread (& links)

LizkaMar 14, 2023, 8:02 PM
84 points
18 comments1 min readEA link

EA AI/​Emerg­ing Tech Orgs Should Be In­volved with Pa­tent Office Partnership

BridgesJun 12, 2022, 10:32 PM
10 points
0 comments1 min readEA link

[Question] I have re­cently been in­ter­ested in robotics, par­tic­u­larly in for-profit star­tups. I think they can help in­crease food pro­duc­tion and help re­duce im­prove health­care. Would this fall un­der AI for so­cial good? How im­pact­ful will robotics be to so­ciety? How large is the coun­ter­fac­tual?

Isaac BensonJan 2, 2022, 5:38 AM
4 points
3 comments1 min readEA link

[Question] What’s the best ma­chine learn­ing newslet­ter? How do you keep up to date?

Matt PutzMar 25, 2022, 2:36 PM
13 points
12 comments1 min readEA link

Fa­nat­i­cism in AI: SERI Project

Jake Arft-GuatelliSep 24, 2021, 4:39 AM
7 points
2 comments5 min readEA link

[Question] Will the vast ma­jor­ity of tech­nolog­i­cal progress hap­pen in the longterm fu­ture?

Vasco Grilo🔸Jul 8, 2023, 8:40 AM
8 points
0 comments2 min readEA link

AGI x An­i­mal Welfare: A High-EV Outreach Op­por­tu­nity?

simeon_cJun 28, 2023, 8:44 PM
71 points
16 comments1 min readEA link

[Question] Is Deep­Seek-R1 already bet­ter than o3 when in­fer­ence costs are held con­stant?

Magnus VindingJan 24, 2025, 3:29 PM
33 points
2 comments1 min readEA link

Le­gal As­sis­tance for Vic­tims of AI

bobMar 17, 2023, 11:42 AM
52 points
19 comments1 min readEA link

An­nounc­ing Epoch: A re­search or­ga­ni­za­tion in­ves­ti­gat­ing the road to Trans­for­ma­tive AI

Jaime SevillaJun 27, 2022, 1:39 PM
183 points
11 comments2 min readEA link
(epochai.org)

[Question] What will be some of the most im­pact­ful ap­pli­ca­tions of ad­vanced AI in the near term?

IanDavidMossMar 3, 2022, 3:26 PM
16 points
7 comments1 min readEA link

Ex­plor­ing Me­tac­u­lus’ com­mu­nity predictions

Vasco Grilo🔸Mar 24, 2023, 7:59 AM
95 points
17 comments10 min readEA link

Paul Chris­ti­ano – Ma­chine in­tel­li­gence and cap­i­tal accumulation

Tessa A 🔸May 15, 2014, 12:10 AM
21 points
0 comments6 min readEA link
(rationalaltruist.com)

Prior prob­a­bil­ity of this be­ing the most im­por­tant century

Vasco Grilo🔸Jul 15, 2023, 7:18 AM
8 points
2 comments2 min readEA link

Cos­mic AI safety

Magnus VindingDec 6, 2024, 10:32 PM
22 points
5 comments6 min readEA link

There’s No Fire Alarm for Ar­tifi­cial Gen­eral Intelligence

EA Forum ArchivesOct 14, 2017, 2:41 AM
30 points
1 comment25 min readEA link
(www.lesswrong.com)

Cru­cial con­sid­er­a­tions in the field of Wild An­i­mal Welfare (WAW)

Holly Elmore ⏸️ 🔸Apr 10, 2022, 7:43 PM
63 points
10 comments3 min readEA link

Mea­sur­ing AI-Driven Risk with Stock Prices (Su­sana Cam­pos-Mart­ins)

Global Priorities InstituteDec 12, 2024, 2:22 PM
10 points
1 comment4 min readEA link
(globalprioritiesinstitute.org)

[Question] What are some re­sources (ar­ti­cles, videos) that show off what the cur­rent state of the art in AI is? (for a layper­son who doesn’t know much about AI)

jamesDec 6, 2021, 9:06 PM
10 points
6 comments1 min readEA link

Semi-con­duc­tor /​ AI stocks dis­cus­sion.

sapphireNov 25, 2022, 11:35 PM
10 points
3 comments1 min readEA link

The Ri­val AI De­ploy­ment Prob­lem: a Pre-de­ploy­ment Agree­ment as the least-bad response

HaydnBelfieldSep 23, 2022, 9:28 AM
44 points
1 comment12 min readEA link

Oth­er­ness and con­trol in the age of AGI

Joe_CarlsmithJan 2, 2024, 6:15 PM
37 points
1 comment1 min readEA link

Me­tac­u­lus’ pre­dic­tions are much bet­ter than low-in­for­ma­tion priors

Vasco Grilo🔸Apr 11, 2023, 8:36 AM
53 points
0 comments6 min readEA link

An­nounc­ing Epoch’s dash­board of key trends and figures in Ma­chine Learning

Jaime SevillaApr 13, 2023, 7:33 AM
127 points
4 comments1 min readEA link

Mud­dling Along Is More Likely Than Dystopia

Jeffrey HeningerOct 21, 2023, 9:30 AM
87 points
3 comments8 min readEA link
(blog.aiimpacts.org)

[Cross-post] Change my mind: we should define and mea­sure the effec­tive­ness of ad­vanced AI

David JohnstonApr 6, 2022, 12:20 AM
4 points
0 comments7 min readEA link

Bio-risk and AI: AI progress might soon lead to much faster re­search and engineering

JanBApr 20, 2023, 7:48 PM
20 points
5 comments1 min readEA link

“Who Will You Be After ChatGPT Takes Your Job?”

Stephen ThomasApr 21, 2023, 9:31 PM
23 points
4 comments2 min readEA link
(www.wired.com)

[Link] New data poi­son­ing tool lets artists fight back against gen­er­a­tive AI

rileyharrisNov 20, 2023, 1:35 AM
10 points
0 comments1 min readEA link
(www-technologyreview-com.cdn.ampproject.org)

[Question] Will AI Wor­ld­view Prize Fund­ing Be Re­placed?

Jordan ArelNov 13, 2022, 5:10 PM
26 points
4 comments1 min readEA link

Long list of AI ques­tions

NunoSempereDec 6, 2023, 11:12 AM
124 points
14 comments86 min readEA link

Red-team­ing ex­is­ten­tial risk from AI

Zed TararNov 30, 2023, 2:35 PM
30 points
16 comments6 min readEA link

[Question] How does AI progress af­fect other EA cause ar­eas?

Luis Mota FreitasJun 9, 2023, 12:43 PM
95 points
13 comments1 min readEA link

[Ru­mour] Microsoft to in­vest $10B in OpenAI, will re­ceive 75% of prof­its un­til they re­coup in­vest­ment: GPT would be in­te­grated with Office

𝕮𝖎𝖓𝖊𝖗𝖆Jan 10, 2023, 11:43 PM
25 points
2 comments1 min readEA link

How we could stum­ble into AI catastrophe

Holden KarnofskyJan 16, 2023, 2:52 PM
83 points
0 comments31 min readEA link
(www.cold-takes.com)

How to use AI speech tran­scrip­tion and anal­y­sis to ac­cel­er­ate so­cial sci­ence research

Alexander SaeriJan 31, 2023, 4:01 AM
39 points
6 comments11 min readEA link

[Question] How good/​bad is the new Bing AI for the world?

Nathan YoungFeb 17, 2023, 4:31 PM
21 points
14 comments1 min readEA link

Should ChatGPT make us down­weight our be­lief in the con­scious­ness of non-hu­man an­i­mals?

splinterFeb 18, 2023, 11:29 PM
11 points
15 comments2 min readEA link

How ma­jor gov­ern­ments can help with the most im­por­tant century

Holden KarnofskyFeb 24, 2023, 7:37 PM
56 points
4 comments4 min readEA link
(www.cold-takes.com)

Joscha Bach on Syn­thetic In­tel­li­gence [an­no­tated]

Roman LeventovMar 2, 2023, 11:21 AM
8 points
0 comments9 min readEA link
(www.jimruttshow.com)

5th IEEE In­ter­na­tional Con­fer­ence on Ar­tifi­cial In­tel­li­gence Test­ing (AITEST 2023)

surabhi guptaMar 12, 2023, 9:06 AM
−5 points
0 comments1 min readEA link

2023 Open Philan­thropy AI Wor­ld­views Con­test: Odds of Ar­tifi­cial Gen­eral In­tel­li­gence by 2043

srhoades10Mar 14, 2023, 8:32 PM
19 points
0 comments46 min readEA link

AI safety and con­scious­ness re­search: A brainstorm

Daniel_FriedrichMar 15, 2023, 2:33 PM
11 points
1 comment9 min readEA link

AI Safety − 7 months of dis­cus­sion in 17 minutes

Zoe WilliamsMar 15, 2023, 11:41 PM
89 points
2 comments17 min readEA link

Dou­glas Hoft­stadter con­cerned about AI xrisk

Eli RoseJul 3, 2023, 3:30 AM
64 points
0 comments1 min readEA link
(www.youtube.com)

Would you pur­sue soft­ware en­g­ineer­ing as a ca­reer to­day?

justapersonMar 18, 2023, 3:33 AM
8 points
15 comments3 min readEA link

Public Opinion on AI Safety: AIMS 2023 and 2021 Summary

Janet PauketatSep 25, 2023, 6:09 PM
19 points
0 comments3 min readEA link
(www.sentienceinstitute.org)

An­nounc­ing AI Align­ment work­shop at the ALIFE 2023 conference

Rory GreigJul 8, 2023, 1:49 PM
9 points
0 comments1 min readEA link
(humanvaluesandartificialagency.com)

Em­brac­ing the au­to­mated future

Arjun KhemaniJul 16, 2023, 8:47 AM
2 points
1 comment1 min readEA link
(arjunkhemani.substack.com)

Ar­tifi­cially sen­tient be­ings: Mo­ral, poli­ti­cal, and le­gal issues

Fırat AkovaAug 1, 2023, 5:48 PM
20 points
2 comments1 min readEA link
(doi.org)

A se­lec­tion of some writ­ings and con­sid­er­a­tions on the cause of ar­tifi­cial sentience

Raphaël_PesahAug 10, 2023, 6:23 PM
48 points
1 comment10 min readEA link

Miti­gat­ing ex­is­ten­tial risks as­so­ci­ated with hu­man na­ture and AI: Thoughts on se­ri­ous mea­sures.

LinyphiaMar 25, 2023, 7:10 PM
2 points
2 comments3 min readEA link

[Question] Is Bill Gates overly op­tomistic about AI?

DovMar 22, 2023, 12:29 PM
11 points
0 comments1 min readEA link

Ex­plor­ers in a vir­tual coun­try: Nav­i­gat­ing the knowl­edge land­scape of large lan­guage models

Alexander SaeriMar 28, 2023, 9:32 PM
17 points
1 comment6 min readEA link

Pes­simism about AI Safety

Max_He-HoApr 2, 2023, 7:57 AM
5 points
0 comments25 min readEA link
(www.lesswrong.com)

No, the EMH does not im­ply that mar­kets have long AGI timelines

JakobApr 24, 2023, 8:27 AM
83 points
21 comments8 min readEA link

Perché il deep learn­ing mod­erno potrebbe ren­dere diffi­cile l’al­linea­mento delle IA

EA ItalyJan 17, 2023, 11:29 PM
1 point
0 comments16 min readEA link

Prevenire una catas­trofe legata all’in­tel­li­genza artificiale

EA ItalyJan 17, 2023, 11:07 AM
1 point
0 comments3 min readEA link

OPEC for a slow AGI takeoff

vyraxApr 21, 2023, 10:53 AM
4 points
0 comments3 min readEA link

Mo­ral Spillover in Hu­man-AI Interaction

Katerina ManoliJun 5, 2023, 3:20 PM
17 points
1 comment13 min readEA link

If AGI is im­mi­nent, why can’t I hail a rob­o­taxi?

YarrowDec 9, 2023, 8:50 PM
26 points
4 comments1 min readEA link

Prin­ci­ples for AI Welfare Research

jeffseboJun 19, 2023, 11:30 AM
138 points
16 comments13 min readEA link

AI Policy In­sights from the AIMS Survey

Janet PauketatFeb 22, 2024, 7:17 PM
10 points
1 comment18 min readEA link
(www.sentienceinstitute.org)

AI-based dis­in­for­ma­tion is prob­a­bly not a ma­jor threat to democracy

Dan WilliamsFeb 24, 2024, 8:01 PM
63 points
8 comments10 min readEA link

IV. Par­allels and Review

Maynk02Feb 27, 2024, 11:10 PM
7 points
1 comment8 min readEA link
(open.substack.com)

AGI will be made of het­ero­ge­neous com­po­nents, Trans­former and Selec­tive SSM blocks will be among them

Roman LeventovDec 27, 2023, 2:51 PM
5 points
0 comments1 min readEA link

Dario Amodei — Machines of Lov­ing Grace

Matrice JacobineOct 11, 2024, 9:39 PM
66 points
0 comments1 min readEA link
(darioamodei.com)

Book Re­view (mini): Co-In­tel­li­gence by Ethan Mollick

Darren McKeeApr 3, 2024, 5:33 PM
5 points
1 comment1 min readEA link

Ge­offrey Hin­ton on the Past, Pre­sent, and Fu­ture of AI

Stephen McAleeseOct 12, 2024, 4:41 PM
5 points
1 comment1 min readEA link

The ne­ces­sity of “Guardian AI” and two con­di­tions for its achievement

ProicaMay 28, 2024, 11:42 AM
1 point
1 comment15 min readEA link

Is un­der­stand­ing the moral sta­tus of digi­tal minds a press­ing world prob­lem?

Cody_FenwickSep 30, 2024, 8:50 AM
42 points
0 comments34 min readEA link
(80000hours.org)

My The­ory of Con­scious­ness: The Ex­pe­riencer and the Indicator

David HammerleDec 23, 2024, 4:07 AM
1 point
1 comment7 min readEA link

When do ex­perts think hu­man-level AI will be cre­ated?

Vishakha AgrawalJan 2, 2025, 11:17 PM
36 points
4 comments2 min readEA link
(aisafety.info)

[Question] Why are bond yields anoma­lously ris­ing fol­low­ing the Septem­ber rate cut?

incredibleutilityJan 7, 2025, 3:49 PM
2 points
2 comments1 min readEA link

Descartes’ 17th cen­tury Tur­ing Test

James-Hartree-LawJan 16, 2025, 8:18 PM
3 points
0 comments7 min readEA link

[Question] What do you mean with ‘al­ign­ment is solv­able in prin­ci­ple’?

RemmeltJan 17, 2025, 3:03 PM
10 points
1 comment1 min readEA link

AI Safety Protest, Melbourne, Aus­tralia

Mark BrownJan 17, 2025, 2:55 PM
2 points
0 comments1 min readEA link

AI for Re­solv­ing Fore­cast­ing Ques­tions: An Early Exploration

Ozzie GooenJan 16, 2025, 9:40 PM
21 points
0 comments9 min readEA link

Fact Check: 57% of the in­ter­net is NOT AI-gen­er­ated

James-Hartree-LawJan 17, 2025, 9:26 PM
1 point
0 comments1 min readEA link

Ex­plain­ing all the US semi­con­duc­tor ex­port controls

ZacRichardsonJan 17, 2025, 6:00 PM
16 points
1 comment9 min readEA link

We don’t want to post again “This might be the last AI Safety Camp”

RemmeltJan 21, 2025, 12:03 PM
38 points
2 comments1 min readEA link
(manifund.org)

Wor­ries about la­tent rea­son­ing in LLMs

CBiddulphJan 20, 2025, 9:09 AM
20 points
1 comment1 min readEA link

The sec­ond bit­ter les­son — there’s a fun­da­men­tal prob­lem with al­ign­ing AI

aelwoodJan 19, 2025, 6:48 PM
4 points
1 comment5 min readEA link
(pursuingreality.substack.com)

[Question] Look­ing for Quick, Col­lab­o­ra­tive Sys­tems for Truth-Seek­ing in Group Disagreements

EffectiveAdvocate🔸Jan 21, 2025, 6:32 AM
10 points
1 comment1 min readEA link

14+ AI Safety Ad­vi­sors You Can Speak to – New AISafety.com Resource

Bryce RobertsonJan 21, 2025, 5:34 PM
18 points
2 comments1 min readEA link

An­nounc­ing the Com­pas­sion­ate Fu­ture Sum­mit 2025

Ruth_SeleoJan 21, 2025, 7:15 AM
30 points
0 comments1 min readEA link

Google AI Ac­cel­er­a­tor Open Call

Rochelle HarrisJan 22, 2025, 4:50 PM
10 points
1 comment1 min readEA link

Ti­maeus is hiring re­searchers & engineers

Tatiana K. Nesic SkuratovaJan 27, 2025, 2:35 PM
19 points
0 comments4 min readEA link

Could ASI Have Ex­isted Since the Big Bang?

Aaron LiJan 31, 2025, 1:20 PM
−13 points
0 comments1 min readEA link

US gov­ern­ment com­mis­sion pushes Man­hat­tan Pro­ject-style AI initiative

LarksNov 19, 2024, 4:22 PM
83 points
15 comments1 min readEA link
(www.reuters.com)

[Question] Launch­ing Ap­pli­ca­tions for the Global AI Safety Fel­low­ship 2025!

Impact AcademyNov 27, 2024, 3:33 PM
9 points
1 comment1 min readEA link

INTELLECT-1 Re­lease: The First Globally Trained 10B Pa­ram­e­ter Model

Matrice JacobineNov 29, 2024, 11:03 PM
2 points
1 comment1 min readEA link
(www.primeintellect.ai)

An­nounc­ing In­sights for Impact

Christian PearsonJan 4, 2023, 7:00 AM
80 points
6 comments1 min readEA link

[Question] What work has been done on the post-AGI dis­tri­bu­tion of wealth?

tlevinJul 6, 2022, 6:59 PM
16 points
3 comments1 min readEA link

Philan­thropists Prob­a­bly Shouldn’t Mis­sion-Hedge AI Progress

MichaelDickensAug 23, 2022, 11:03 PM
28 points
9 comments36 min readEA link

New Work­ing Paper Series of the Le­gal Pri­ori­ties Project

Legal Priorities ProjectOct 18, 2021, 10:30 AM
60 points
0 comments9 min readEA link

Us­ing ar­tifi­cial in­tel­li­gence (ma­chine vi­sion) to in­crease the effec­tive­ness of hu­man-wildlife con­flict miti­ga­tions could benefit WAW

Rethink PrioritiesOct 28, 2022, 4:23 PM
53 points
7 comments32 min readEA link

[Question] How might a herd of in­terns help with AI or biose­cu­rity re­search tasks/​ques­tions?

Marcel DMar 20, 2022, 10:49 PM
30 points
8 comments2 min readEA link

New GPT3 Im­pres­sive Ca­pa­bil­ities—In­struc­tGPT3 [1/​2]

simeon_cMar 13, 2022, 10:45 AM
49 points
4 comments7 min readEA link

AGI Safety Com­mu­ni­ca­tions Initiative

InesJun 11, 2022, 4:30 PM
35 points
6 comments1 min readEA link

Si­mu­la­tors and Mindcrime

𝕮𝖎𝖓𝖊𝖗𝖆Dec 9, 2022, 3:20 PM
1 point
0 comments1 min readEA link

The Ter­minol­ogy of Ar­tifi­cial Sentience

Janet PauketatNov 28, 2021, 7:52 AM
29 points
0 comments1 min readEA link
(www.sentienceinstitute.org)

Data Publi­ca­tion for the 2021 Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey

Janet PauketatMar 24, 2022, 3:43 PM
21 points
0 comments3 min readEA link
(www.sentienceinstitute.org)

The prob­a­bil­ity that Ar­tifi­cial Gen­eral In­tel­li­gence will be de­vel­oped by 2043 is ex­tremely low.

cveresOct 6, 2022, 11:26 AM
2 points
12 comments13 min readEA link

[Question] What EAG ses­sions would you like on AI?

Nathan YoungMar 20, 2022, 5:05 PM
7 points
10 comments1 min readEA link

Pri­ori­tiz­ing the Arts in re­sponse to AI automation

CaseySep 25, 2022, 7:49 AM
6 points
1 comment1 min readEA link

Chris Olah on what the hell is go­ing on in­side neu­ral networks

80000_HoursAug 4, 2021, 3:13 PM
5 points
0 comments133 min readEA link

Su­per­in­tel­li­gent AI is nec­es­sary for an amaz­ing fu­ture, but far from sufficient

So8resOct 31, 2022, 9:16 PM
35 points
5 comments1 min readEA link

AI Alter­na­tive Fu­tures: Ex­plo­ra­tory Sce­nario Map­ping for Ar­tifi­cial In­tel­li­gence Risk—Re­quest for Par­ti­ci­pa­tion [Linkpost]

KiliankMay 9, 2022, 7:53 PM
17 points
2 comments8 min readEA link

Why some peo­ple be­lieve in AGI, but I don’t.

cveresOct 26, 2022, 3:09 AM
13 points
2 comments4 min readEA link

On Scal­ing Academia

kirchner.janSep 20, 2021, 2:54 PM
18 points
3 comments13 min readEA link
(universalprior.substack.com)

Free Guy, a rom-com on the moral pa­tient­hood of digi­tal sentience

micDec 23, 2021, 7:47 AM
26 points
2 comments2 min readEA link

We Can’t Do Long Term Utili­tar­ian Calcu­la­tions Un­til We Know if AIs Can Be Con­scious or Not

Mike20731Sep 2, 2022, 8:37 AM
4 points
0 comments11 min readEA link

“The Physi­cists”: A play about ex­tinc­tion and the re­spon­si­bil­ity of scientists

Lara_THNov 29, 2022, 4:53 PM
28 points
1 comment8 min readEA link

When 2/​3rds of the world goes against you

Jeffrey KursonisJul 2, 2022, 8:34 PM
2 points
2 comments9 min readEA link

Ap­ply to be a Stan­ford HAI Ju­nior Fel­low (As­sis­tant Pro­fes­sor- Re­search) by Nov. 15, 2021

Vael GatesOct 31, 2021, 2:21 AM
15 points
0 comments1 min readEA link

Stack­elberg Games and Co­op­er­a­tive Com­mit­ment: My Thoughts and Reflec­tions on a 2-Month Re­search Project

Ben BucknallDec 13, 2021, 10:49 AM
18 points
1 comment9 min readEA link

Strong AI. From the­ory to prac­tice.

GaHHuKoBAug 19, 2022, 11:33 AM
−2 points
0 comments10 min readEA link
(www.reddit.com)

Pro­ject Idea: The cost of Coc­ci­dio­sis on Chicken farm­ing and if AI can help

Max HarrisSep 26, 2022, 4:30 PM
25 points
8 comments2 min readEA link

An Ex­er­cise in Speed-Read­ing: The Na­tional Se­cu­rity Com­mis­sion on AI (NSCAI) Fi­nal Report

abiolveraAug 17, 2022, 4:55 PM
47 points
4 comments12 min readEA link

[Question] Please Share Your Per­spec­tives on the De­gree of So­cietal Im­pact from Trans­for­ma­tive AI Outcomes

KiliankApr 15, 2022, 1:23 AM
3 points
3 comments1 min readEA link

Sixty years af­ter the Cuban Mis­sile Cri­sis, a new era of global catas­trophic risks

christian.rOct 13, 2022, 11:25 AM
31 points
0 comments1 min readEA link
(thebulletin.org)

GPT-2 as step to­ward gen­eral in­tel­li­gence (Alexan­der, 2019)

Will AldredJul 18, 2022, 4:14 PM
42 points
0 comments2 min readEA link
(slatestarcodex.com)

13 Very Differ­ent Stances on AGI

Ozzie GooenDec 27, 2021, 11:30 PM
84 points
23 comments3 min readEA link

Can we simu­late hu­man evolu­tion to cre­ate a some­what al­igned AGI?

Thomas KwaMar 29, 2022, 1:23 AM
19 points
0 comments7 min readEA link

[Question] Re­quest for As­sis­tance—Re­search on Sce­nario Devel­op­ment for Ad­vanced AI Risk

KiliankMar 30, 2022, 3:01 AM
2 points
1 comment1 min readEA link

Slides: Po­ten­tial Risks From Ad­vanced AI

Aryeh EnglanderApr 28, 2022, 2:18 AM
9 points
0 comments1 min readEA link

“AGI timelines: ig­nore the so­cial fac­tor at their peril” (Fu­ture Fund AI Wor­ld­view Prize sub­mis­sion)

ketanramaNov 5, 2022, 5:45 PM
10 points
0 comments12 min readEA link
(trevorklee.substack.com)

FYI: I’m work­ing on a book about the threat of AGI/​ASI for a gen­eral au­di­ence. I hope it will be of value to the cause and the community

Darren McKeeJun 17, 2022, 11:52 AM
32 points
1 comment2 min readEA link

Love and AI: Re­la­tional Brain/​Mind Dy­nam­ics in AI Development

Jeffrey KursonisJun 21, 2022, 7:09 AM
2 points
2 comments3 min readEA link

Rab­bits, robots and resurrection

Patrick WilsonMay 10, 2022, 3:00 PM
9 points
0 comments15 min readEA link

Sce­nario Map­ping Ad­vanced AI Risk: Re­quest for Par­ti­ci­pa­tion with Data Collection

KiliankMar 27, 2022, 11:44 AM
14 points
0 comments5 min readEA link

Align­ing AI with Hu­mans by Lev­er­ag­ing Le­gal Informatics

johnjnaySep 18, 2022, 7:43 AM
20 points
11 comments3 min readEA link

In­tent al­ign­ment should not be the goal for AGI x-risk reduction

johnjnayOct 26, 2022, 1:24 AM
7 points
1 comment1 min readEA link

On Generality

Oren MontanoSep 26, 2022, 8:59 AM
2 points
0 comments1 min readEA link

A strange twist on the road to AGI

cveresOct 12, 2022, 11:27 PM
3 points
0 comments1 min readEA link

‘Ar­tifi­cial In­tel­li­gence Gover­nance un­der Change’ (PhD dis­ser­ta­tion)

MMMaasSep 15, 2022, 12:10 PM
54 points
1 comment2 min readEA link
(drive.google.com)

AGI Timelines in Gover­nance: Differ­ent Strate­gies for Differ­ent Timeframes

simeon_cDec 19, 2022, 9:31 PM
110 points
19 comments1 min readEA link

“In­tro to brain-like-AGI safety” se­ries—just finished!

Steven ByrnesMay 17, 2022, 3:35 PM
15 points
0 comments1 min readEA link

Without spe­cific coun­ter­mea­sures, the eas­iest path to trans­for­ma­tive AI likely leads to AI takeover

AjeyaJul 18, 2022, 7:07 PM
217 points
12 comments84 min readEA link
(www.lesswrong.com)

England & Wales & Windfalls

John Bridge 🔸Jun 3, 2022, 10:26 AM
13 points
1 comment24 min readEA link

Why I’m Scep­ti­cal of Foom

𝕮𝖎𝖓𝖊𝖗𝖆Dec 8, 2022, 10:01 AM
22 points
7 comments1 min readEA link

My ar­gu­ment against AGI

cveresOct 12, 2022, 6:32 AM
2 points
29 comments3 min readEA link

Chris Olah on work­ing at top AI labs with­out an un­der­grad degree

80000_HoursSep 10, 2021, 8:46 PM
15 points
0 comments73 min readEA link

6 Year De­crease of Me­tac­u­lus AGI Prediction

Chris LeongApr 12, 2022, 5:36 AM
40 points
6 comments1 min readEA link

How to be­come more agen­tic, by GPT-EA-Fo­rum-v1

JoyOptimizerJun 20, 2022, 6:50 AM
24 points
8 comments4 min readEA link

Why I think strong gen­eral AI is com­ing soon

porbySep 28, 2022, 6:55 AM
14 points
1 comment1 min readEA link

Ex­plo­ra­tory sur­vey on psy­chol­ogy of AI risk perception

Daniel_FriedrichAug 2, 2022, 8:34 PM
1 point
0 comments1 min readEA link
(forms.gle)

First call for EA Data Science/​ML/​AI

astrastefaniaAug 23, 2022, 7:37 PM
29 points
0 comments1 min readEA link

Catholic the­olo­gians and priests on ar­tifi­cial intelligence

anonymous6Jun 14, 2022, 6:53 PM
21 points
2 comments1 min readEA link

Carnegie Coun­cil MisUn­der­stands Longtermism

Jeff ASep 30, 2022, 2:57 AM
6 points
8 comments1 min readEA link
(www.carnegiecouncil.org)

Re­sults from the lan­guage model hackathon

Esben KranOct 10, 2022, 8:29 AM
23 points
2 comments1 min readEA link

The Limit of Lan­guage Models

𝕮𝖎𝖓𝖊𝖗𝖆Dec 26, 2022, 11:17 AM
10 points
0 comments1 min readEA link

“Origi­nal­ity is noth­ing but ju­di­cious imi­ta­tion”—Voltaire

Damien LasseurOct 23, 2022, 7:00 PM
1 point
0 comments1 min readEA link

Google could build a con­scious AI in three months

Derek ShillerOct 1, 2022, 1:24 PM
16 points
22 comments7 min readEA link

The Me­taethics and Nor­ma­tive Ethics of AGI Value Align­ment: Many Ques­tions, Some Implications

Eleos Arete CitriniSep 15, 2021, 7:05 PM
25 points
0 comments8 min readEA link

Gen­eral vs spe­cific ar­gu­ments for the longter­mist im­por­tance of shap­ing AI development

Sam ClarkeOct 15, 2021, 2:43 PM
44 points
7 comments2 min readEA link

PIBBSS Fel­low­ship: Bounty for Refer­rals & Dead­line Extension

Anna_GajdovaJan 17, 2022, 4:23 PM
17 points
7 comments1 min readEA link

Don’t ex­pect AGI any­time soon

cveresOct 10, 2022, 10:38 PM
0 points
19 comments1 min readEA link

An­nual AGI Bench­mark­ing Event

MetaculusAug 26, 2022, 9:31 PM
20 points
2 comments2 min readEA link
(www.metaculus.com)

EA for dumb peo­ple?

Olivia AddyJul 11, 2022, 10:46 AM
493 points
160 comments2 min readEA link

It takes 5 lay­ers and 1000 ar­tifi­cial neu­rons to simu­late a sin­gle biolog­i­cal neu­ron [Link]

MichaelStJulesSep 7, 2021, 9:53 PM
44 points
17 comments2 min readEA link

What if we don’t need a “Hard Left Turn” to reach AGI?

EigengenderJul 15, 2022, 9:49 AM
39 points
7 comments4 min readEA link

Why don’t gov­ern­ments seem to mind that com­pa­nies are ex­plic­itly try­ing to make AGIs?

Ozzie GooenDec 23, 2021, 7:08 AM
82 points
49 comments2 min readEA link

The His­tory of AI Rights Research

Jamie_HarrisAug 27, 2022, 8:14 AM
48 points
1 comment14 min readEA link
(www.sentienceinstitute.org)

High Im­pact Ca­reers in For­mal Ver­ifi­ca­tion: Ar­tifi­cial Intelligence

quinnJun 5, 2021, 2:45 PM
28 points
7 comments16 min readEA link

A Sur­vey of the Po­ten­tial Long-term Im­pacts of AI

Sam ClarkeJul 18, 2022, 9:48 AM
63 points
2 comments27 min readEA link

What’s so dan­ger­ous about AI any­way? – Or: What it means to be a superintelligence

Thomas KehrenbergJul 18, 2022, 4:14 PM
9 points
2 comments11 min readEA link

How Open Source Ma­chine Learn­ing Soft­ware Shapes AI

Max LSep 28, 2022, 5:49 PM
11 points
3 comments15 min readEA link
(maxlangenkamp.me)
No comments.