RSS

Anthropic

TagLast edit: Jul 22, 2022, 7:13 PM by Leo

Anthropic is an AI safety and research company. It was founded in May 2021 by siblings Dario Amodei and Daniela Amodei, who serve as CEO and President, respectively.[1][2]

Anthropic raised $124 million in a series A founding round. The round was led by Jaan Tallinn, and included participation from James McClave, Dustin Moskovitz, the Center for Emerging Risk Research (now Polaris Ventures), Eric Schmidt, and others.[3][4][5]

Anthropic raised a further $580 million in a series B founding round. The round was led by Sam Bankman-Fried, and included participation from Caroline Ellison, Jim McClave, Nishad Singh, as well as Tallinn and CERR.[6]

Further reading

Perry, Lucas (2022) Daniela and Dario Amodei on Anthropic, Future of Life Institute, March 4.

External links

Anthropic. Official website.

Apply for a job.

Related entries

AI safety | OpenAI

  1. ^
  2. ^

    Waters, Richard & Miles Kruppa (2021) Rebel AI group raises record cash after machine learning schism, Financial Times, May 28.

  3. ^
  4. ^

    Piper, Kelsey (2021) Future Perfect Newsletter, Vox, May 28.

  5. ^
  6. ^

    Coldewey, Devin (2022) Anthropic’s quest for better, more explainable AI attracts $580M, TechCrunch, April 29.

Chris Olah on what the hell is go­ing on in­side neu­ral networks

80000_HoursAug 4, 2021, 3:13 PM
5 points
0 comments133 min readEA link

[Question] Would an An­thropic/​OpenAI merger be good for AI safety?

MNov 22, 2023, 8:21 PM
6 points
1 comment1 min readEA link

In­tro­duc­ing Align­ment Stress-Test­ing at Anthropic

evhubJan 12, 2024, 11:51 PM
80 points
0 comments1 min readEA link

Dario Amodei — Machines of Lov­ing Grace

Matrice JacobineOct 11, 2024, 9:39 PM
66 points
0 comments1 min readEA link
(darioamodei.com)

Claude 3.5 Sonnet

Zach Stein-PerlmanJun 20, 2024, 6:00 PM
31 points
0 comments1 min readEA link
(www.anthropic.com)

Dear An­thropic peo­ple, please don’t re­lease Claude

Joseph MillerFeb 8, 2023, 2:44 AM
27 points
5 comments1 min readEA link

Spicy takes about AI policy (Clark, 2022)

Will AldredAug 9, 2022, 1:49 PM
44 points
0 comments3 min readEA link
(twitter.com)

We are fight­ing a shared bat­tle (a call for a differ­ent ap­proach to AI Strat­egy)

Gideon FutermanMar 16, 2023, 2:37 PM
59 points
11 comments15 min readEA link

Jan Leike: “I’m ex­cited to join @An­throp­icAI to con­tinue the su­per­al­ign­ment mis­sion!”

defun 🔸May 28, 2024, 6:08 PM
35 points
11 comments1 min readEA link
(x.com)

Fron­tier Model Forum

Zach Stein-PerlmanJul 26, 2023, 2:30 PM
40 points
7 comments1 min readEA link
(blog.google)

2021 AI Align­ment Liter­a­ture Re­view and Char­ity Comparison

LarksDec 23, 2021, 2:06 PM
176 points
18 comments73 min readEA link

Google in­vests $300mn in ar­tifi­cial in­tel­li­gence start-up An­thropic | FT

𝕮𝖎𝖓𝖊𝖗𝖆Feb 3, 2023, 7:43 PM
155 points
5 comments1 min readEA link
(www.ft.com)

[Question] I’m in­ter­view­ing Nova Das Sarma about AI safety and in­for­ma­tion se­cu­rity. What shouId I ask her?

Robert_WiblinMar 25, 2022, 3:38 PM
17 points
13 comments1 min readEA link

[Question] Is it pos­si­ble that SBF-linked funds haven’t yet been trans­ferred to An­thropic or that An­thropic would have to re­turn these funds?

donegalNov 16, 2022, 9:33 AM
5 points
0 comments1 min readEA link

An­thropic’s sub­mis­sion to the White House’s RFI on AI policy

Agustín Covarrubias 🔸Mar 6, 2025, 10:47 PM
47 points
7 comments1 min readEA link
(www.anthropic.com)

An­thropic: Core Views on AI Safety: When, Why, What, and How

jonmenasterMar 9, 2023, 5:30 PM
107 points
6 comments22 min readEA link
(www.anthropic.com)

The cur­rent state of RSPs

Zach Stein-PerlmanNov 4, 2024, 4:00 PM
19 points
1 comment1 min readEA link

An­thropic teams up with Palan­tir and AWS to sell AI to defense customers

Matrice JacobineNov 9, 2024, 11:47 AM
28 points
1 comment2 min readEA link
(techcrunch.com)

Con­sider keep­ing your threat mod­els pri­vate.

Miles KodamaFeb 1, 2025, 12:29 AM
18 points
2 comments4 min readEA link

[Question] If FTX is liqui­dated, who ends up con­trol­ling An­thropic?

OferNov 15, 2022, 3:04 PM
63 points
8 comments1 min readEA link

Pod­cast: Tam­era Lan­ham on AI risk, threat mod­els, al­ign­ment pro­pos­als, ex­ter­nal­ized rea­son­ing over­sight, and work­ing at Anthropic

AkashDec 20, 2022, 9:39 PM
14 points
1 comment1 min readEA link

Thoughts on re­spon­si­ble scal­ing poli­cies and regulation

Paul_ChristianoOct 24, 2023, 10:25 PM
191 points
5 comments6 min readEA link

Re­spon­si­ble Scal­ing Poli­cies Are Risk Man­age­ment Done Wrong

simeon_cOct 25, 2023, 11:46 PM
42 points
1 comment1 min readEA link
(www.navigatingrisks.ai)

Scal­able And Trans­fer­able Black-Box Jailbreaks For Lan­guage Models Via Per­sona Modulation

soroushjpNov 7, 2023, 6:00 PM
10 points
0 comments2 min readEA link
(arxiv.org)

AI Safety Newslet­ter #37: US Launches An­titrust In­ves­ti­ga­tions Plus, re­cent crit­i­cisms of OpenAI and An­thropic, and a sum­mary of Si­tu­a­tional Awareness

Center for AI SafetyJun 18, 2024, 6:08 PM
15 points
0 comments5 min readEA link
(newsletter.safe.ai)

OMMC An­nounces RIP

Adam_SchollApr 1, 2024, 11:38 PM
7 points
0 comments2 min readEA link

An­thropic rewrote its RSP

Zach Stein-PerlmanOct 15, 2024, 2:30 PM
32 points
1 comment1 min readEA link

#197 – On whether An­thropic’s AI safety policy is up to the task (Nick Joseph on The 80,000 Hours Pod­cast)

80000_HoursAug 22, 2024, 3:34 PM
9 points
0 comments18 min readEA link

In­tro­duc­ing Senti—An­i­mal Ethics AI Assistant

Animal_EthicsMay 9, 2024, 7:33 AM
40 points
2 comments2 min readEA link

I read ev­ery ma­jor AI lab’s safety plan so you don’t have to

sarahhwDec 16, 2024, 2:12 PM
67 points
2 comments11 min readEA link
(longerramblings.substack.com)

OpenAI and An­thropic Donate Cred­its for AI Fore­cast­ing Bench­mark Tournament

christianJul 17, 2024, 9:50 PM
2 points
0 comments1 min readEA link

Align­ment Fak­ing in Large Lan­guage Models

Ryan GreenblattDec 18, 2024, 5:19 PM
142 points
9 comments1 min readEA link

Takes on “Align­ment Fak­ing in Large Lan­guage Models”

Joe_CarlsmithDec 18, 2024, 6:22 PM
72 points
1 comment1 min readEA link
No comments.