METR

TagLast edit: Oct 10, 2024, 7:18 PM by Sarah Cheng

METR (Model Evaluation and Threat Research), formerly known as ARC Evals, is a research nonprofit that works on assessing whether cutting-edge AI systems could pose catastrophic risks to society. Their work focuses on AI evals.

External links

METR. Official website.

METR: Measuring AI Ability to Complete Long Tasks

Ben_West🔸Mar 19, 2025, 4:49 PM

122 points

16 comments1 min readEA link

(metr.org)

METR is hiring!

ElizabethBarnesDec 26, 2023, 9:03 PM

50 points

0 comments1 min readEA link

(www.lesswrong.com)

Clarifying METR’s Auditing Role [linkpost]

ChanaMessingerJun 4, 2024, 3:34 PM

47 points

1 comment1 min readEA link

(www.alignmentforum.org)

Introducing METR’s Autonomy Evaluation Resources

Megan KinnimentMar 15, 2024, 11:19 PM

28 points

0 comments1 min readEA link

(metr.github.io)

METR is hiring ML Research Engineers and Scientists

Ben_West🔸Jun 5, 2024, 9:25 PM

18 points

2 comments1 min readEA link

(metr.org)

No comments.

Keyboard shortcuts

Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).

Keys shown in grey (e.g., ?) do not require any modifier keys.

General
? Show keyboard shortcuts
Esc Hide keyboard shortcuts

Site navigation
h Go to Home (a.k.a. “Frontpage”) view
f Go to Featured (a.k.a. “Curated”) view
a Go to All (a.k.a. “Community”) view
m Go to Meta view
v Go to Tags view
c Go to Recent Comments view
r Go to Archive view
q Go to Sequences view
t Go to About page
u Go to User or Login page
o Go to Inbox page

Page navigation
, Jump up to top of page
. Jump down to bottom of page
/ Jump to top of comments section
s Search

Page actions
n New post or comment
e Edit current post

Post/comment list views
. Focus next entry in list
, Focus previous entry in list
; Cycle between links in focused entry
Enter Go to currently focused entry
Esc Unfocus currently focused entry
] Go to next page
[ Go to previous page
\ Go to first page
e Edit currently focused post

Editor
k Bold text
i Italic text
l Insert hyperlink
q Blockquote text

Appearance
= Increase text size
- Decrease text size
0 Reset to default text size
′ Cycle through content width settings
1 Switch to default theme [A]
2 Switch to dark theme [B]
3 Switch to grey theme [C]
4 Switch to ultramodern theme [D]
5 Switch to simple theme [E]
6 Switch to brutalist theme [F]
7 Switch to ReadTheSequences theme [G]
8 Switch to classic Less Wrong theme [H]
9 Switch to modern Less Wrong theme [I]
; Open theme tweaker
Enter Save changes and close theme tweaker
Esc Close theme tweaker (without saving)

Slide shows
l Start/resume slideshow
Esc Exit slideshow
→↓ Next slide
←↑ Previous slide
Space Reset slide zoom

Miscellaneous
x Switch to next view on user page
z Switch to previous view on user page
` Toggle compact comment list view
g Toggle anti-kibitzer

METR

External links

METR: Mea­sur­ing AI Abil­ity to Com­plete Long Tasks

METR is hiring!

Clar­ify­ing METR’s Au­dit­ing Role [linkpost]

In­tro­duc­ing METR’s Au­ton­omy Eval­u­a­tion Resources

METR is hiring ML Re­search Eng­ineers and Scientists

METR: Measuring AI Ability to Complete Long Tasks

Clarifying METR’s Auditing Role [linkpost]

Introducing METR’s Autonomy Evaluation Resources

METR is hiring ML Research Engineers and Scientists