Vael Gates

Karma: 1,150

Vael Gates 7 Mar 2024 17:38 UTC
7 points
0 ∶ 0
on: Who’s hiring? (Feb-May 2024)
Arkose is seeking an AI Safety Call Specialist who will be speaking with and supporting professors, PhD students, and industry professionals who are interested in AI safety research or engineering.
Salary: $75,000 - $95,000, depending on prior experience and location. This is currently a 9-month-long fixed contract.
Location: Remote (but we highly prefer candidates to be able to work in roughly US time zones).
Deadline: 30 March 2024, with rolling admission (early applications encouraged).
Learn more on our website, and apply here if you’re interested!

Vael Gates 15 Feb 2024 23:56 UTC
8 points
0 ∶ 1
on: Offering AI safety support calls for ML professionals
FAQ
This is cool! Why haven’t I heard of this?
Arkose has been in soft-launch for a while, and we’ve been focused on email outreach more than public comms. But we’re increasingly public, and are in communication with other AI safety fieldbuilding organizations!

How big is the team? 
3 people: Zach Thomas and Audra Zook are doing an excellent job in operations, and I’m the founder.
How do you pronounce “Arkose”? Where did the name come from?
 I think whatever pronunciation is fine, and it’s the name of a rock. We have an SEO goal for arkose.org to surpass the rock’s Wikipedia page.

Where does your funding come from?
The Survival and Flourishing Fund.

 Are you kind of like the 80,000 Hours 1-1 team?
Yes, in that we also do 1-1 support calls, and that there are many people for whom it’d make sense to do a call with both 80,000 Hours and Arkose! One key difference is that Arkose is aiming to specifically support mid-career people interested in getting more involved in technical AI safety.

I’m not a mid-career person, but I’d still be interested in a call with you. Should I request a call?
Regretfully no, since we’re currently focusing on professors, PhD students, or industry researcher or engineers who have AI / ML experience. This may expand in the future, but we’ll probably still be pretty focused on mid-career folks.

Is Arkose’s Resource page special in any way?
Generally, our resources are selected to be most helpful to professors, PhD students, and industry professionals, which is a different focus than most other resource lists. We also think arkose.org/papers is pretty cool: it’s a list of AI safety papers that you can filter by topic area. It’s still in development and we’ll be updating it over time (and if you’d like to help, please contact Vael!)

How can I help?
• If you know someone who might be a good fit for a call with Arkose, please pass along arkose.org to them! Or fill out our referral form.
• If you have machine learning expertise and would like to help us review our resources (for free or for pay), please contact vael@arkose.org.

Thanks everyone!

Vael Gates 11 Jan 2024 19:34 UTC
2 points
0 ∶ 0
in reply to: Joe Hardie’s comment on: Announcing Arcadia Impact
Thanks!

Vael Gates 10 Jan 2024 18:30 UTC
3 points
0 ∶ 0
on: Announcing Arcadia Impact
Neat! As someone who’s not on the ground and doesn’t know much about either initiative, I’m curious what Arcadia’s relationship is London Initiative for Safe AI (LISA)? Mostly in the spirit of “if I know someone in AI safety in London, in what cases should I recommend them to each?”

Vael Gates 4 Sep 2023 21:46 UTC
27 points
6 ∶ 1
on: How much do EAGs cost (and why)?
This is sideways to the main point in the post, but I’m interested in a ticket type that’s just “Swapcard / unsupported virtual attendee” where accepted people just get access to Swapcard, which lets them schedule 1-1 online videoconferencing, and that’s it.

I find a lot of the value of EAG is in 1-1s, and I’d hope that this would be an option where virtual attendees can get potentially lots of networking value for very little cost.

(Asking because I don’t want to pay a lot of money to attend an EAG where I’d mostly be taking on a mentor role, but I would potentially be happy to do some online 1-1s with people during a Schelling time.)

Update: Just learned about EAGxVirtual, which seems very relevant!

Vael Gates 10 Aug 2023 16:17 UTC
4 points
2 ∶ 0
on: Alignment Grantmaking is Funding-Limited Right Now [crosspost]
“For those applying for grants, asking for less money might make you more likely to be funded”

My guess is that it’s good to still apply for lots of money, and then you just may not be funded the full amount? And one can say what one would do with more or less money granted, so that the grantmakers can take that into account in their decision.

Vael Gates 6 Apr 2023 18:26 UTC
6 points
2 ∶ 0
in reply to: Linda Linsefors’s comment on: Vael Gates: Risks from Highly-Capable AI (March 2023)
I didn’t give a disagreement vote, but I do disagree on aisafety.training being the “single most useful link to give anyone who wants to join the effort of AI Safety research”, just because there’s a lot of different resources out there and I think “most useful” depends on the audience. I do think it’s a useful link, but most useful is a hard bar to meet!

Vael Gates 6 Apr 2023 0:48 UTC
5 points
0 ∶ 0
in reply to: Mau’s comment on: Deliberate practice for research?
Not directly relevant to the OP, but another post covering research taste: An Opinionated Guide to ML Research (also see Rohin Shah’s advice about PhD programs (search “Q. What skills will I learn from a PhD?”) for some commentary.

Vael Gates 15 Mar 2023 0:06 UTC
8 points
1 ∶ 0
on: “AI Risk Discussions” website: Exploring interviews from 97 AI Researchers
Small update: Two authors gave me permission to publish their transcripts non-anonymously!
Interview with Michael L. Littman
Interview with David Duvenaud

Vael Gates 15 Mar 2023 0:03 UTC
5 points
0 ∶ 0
on: Transcripts of interviews with AI researchers
Two authors gave me permission to publish their transcripts non-anonymously! Thus:
- Interview with Michael L. Littman
- Interview with David Duvenaud

Vael Gates 22 Feb 2023 22:21 UTC
1 point
0 ∶ 0
in reply to: Austin Witte’s comment on: A Brief Overview of AI Safety/Alignment Orgs, Fields, Researchers, and Resources for ML Researchers
Whoops, forgot I was the owner. I tried moving those files to the drive folder, but also had trouble with it? So I’m happy to have them copied instead.

Thanks plex, this sounds great!

Vael Gates 14 Feb 2023 10:27 UTC
2 points
0 ∶ 0
in reply to: Dan H’s comment on: Interviews with 97 AI Researchers: Quantitative Analysis
You can read more here!

Vael Gates 3 Feb 2023 8:01 UTC
2 points
0 ∶ 0
in reply to: PeterSlattery’s comment on: Retrospective on the AI Safety Field Building Hub
Thanks Peter!

Vael Gates 2 Feb 2023 2:23 UTC
1 point
0 ∶ 0
in reply to: Vael Gates’s comment on: AI Safety Arguments: An Interactive Guide
Update: Michael Keenan reports it is now fixed!

Vael Gates 2 Feb 2023 0:08 UTC
2 points
1 ∶ 0
in reply to: Tsunayoshi’s comment on: AI Safety Arguments: An Interactive Guide
Thanks for the bug report, checking into it now.

Vael Gates 4 Jan 2023 23:07 UTC
1 point
0 ∶ 0
in reply to: wANIEL’s comment on: What AI Safety Materials Do ML Researchers Find Compelling?
No, the same set of ~28 authors read all of the readings.

The order of the readings was indeed specified:
1. Concise overview (Stuart Russell, Sam Bowman; 30 minutes)
2. Different styles of thinking about future AI systems (Jacob Steinhardt; 30 minutes)
3. A more in-depth argument for highly advanced AI being a serious risk (Joe Carlsmith; 30 minutes)
4. A more detailed description of how deep learning models could become dangerously “misaligned” and why this might be difficult to solve with current ML techniques (Ajeya Cotra; 30 minutes)
5. An overview of different research directions (Paul Christiano; 30 minutes)
6. A study of what ML researchers think about these issues (Vael Gates; 45 minutes)
7. Some common misconceptions (John Schulman; 15 minutes)
Researchers had the option to read the transcripts where transcripts were available; we said that consuming the content in either form (video or transcript) was fine.

Vael Gates 30 Dec 2022 3:50 UTC
16 points
3 ∶ 0
on: EA Global 2023 applications are now open!
I would love a way to interface with EAGs where (I pay no money, but) I have access to the Swapcard interface and I talk only with people who request meetings with me. I often want to “attend” EAGs in this way, where I don’t interface with the conference but I’m available as a resource if people want to talk to me, for which I will schedule remote 1:1s over Zoom. It’d be nice to be helpful to people at a time where they’re available and can see I’m available on Swapcard. Are there any kind of “virtual, restricted” options like this?

Vael Gates 29 Dec 2022 22:41 UTC
7 points
0 ∶ 0
in reply to: Vasco Grilo’s comment on: What AI Safety Materials Do ML Researchers Find Compelling?
Nice, yeah! I wouldn’t have expected a statistically significant difference between a mean of 5.7 and 5.4 with those standard errors, but it’s nice to see it here.

I considered doing a statistical test, and then spent some time googling how to do something like a “3-paired” ANOVA on data that looks like (“s” is subject, “r” is reading):

[s1 r1 “like”] [s1 r1 “agreement”] [s1 r1 “informative”]
[s2 r1 “like”] [s2 r1 “agreement”] [s2 r1 “informative”]
… [s28 r1 “like”] [s28 r1 “agreement”] [s28 r1 “informative”]
[s1 r2 “like”] [s1 r2″agreement”] [s1 r2 “informative”]
[s2 r2 “like”] [s2 r2 “agreement”] [s2 r2 “informative”]
...
because I’d like to do an ANOVA on the raw scores, rather than the means. I did not resolve my confusion about about what to do about the 3-paired data (I guess you could lump each subject’s data in one column, or do it separately by “like”, “agreement”, and “informative”, but I’m interested in how good each of the readings are summed across the three metrics). I then gave up and just presented the summary statistics. (You can extract the raw scores from the Appendix if you put some work into it though, or I could pass along the raw scores, or you could tell me how to do this sort of analysis in Python if you wanted me to do it!)

When I look at these tables, I’m also usually squinting at the median rather than mean, though I look at both. You can see the distributions in the Appendix, which I like even better. But point taken about how it’d be nice to have stats.

Vael Gates 29 Dec 2022 22:25 UTC
1 point
0 ∶ 0
in reply to: Gavin’s comment on: What AI Safety Materials Do ML Researchers Find Compelling?
The authors were not anonymized, no.

Vael Gates 29 Dec 2022 7:19 UTC
7 points
4 ∶ 0
on: EAGx application community norms we’d like to see
This is not directly related, but I would love a way to interface with EAGs where (I pay no money, but) I have access to the Swapcard interface and I talk only with people who request meetings with me. I often want to “attend” EAGs in this way, where I don’t interface with the conference (physically or virtually) but I’m available as a resource if people want to talk to me, for which I will schedule remote 1:1s over Zoom. It’d be nice to be helpful to people at a time where they’re available and can see I’m available on Swapcard, but I don’t want to pay to do this (nor make the event organizers pay for my non-physical presence if I do end up applying—I usually want a “virtual only” ticket).
What links here?
- Proposed improvements to EAG(x) admissions process by Elika (30 Jan 2023 6:10 UTC; 62 points)

Vael Gates

FAQ