Jay Luong

Karma: 138

Fellowships Lead @ Sentient Futures

Building better AI futures for all sentient beings.

Apply now for our AI×Animals & Prioritizing Neglected Animals courses.

I do research on nonhuman sentience & welfare. My recent work includes:

AI Consciousness & Public Perceptions: Four Futures (coauthored preprint)
2024 AI Consciousness & Moral Status (AI CoMS) survey (principal investigator)

Other stuff I’ve done:

Former Cofounder & CTO of Electric Sheep (incubated by ProVeg’s Kickstarting for Good programme)
S-risk Fellow at the Center for Reducing Suffering
Research Fellow at Future Impact Group (Oxford Philosophy for Safe AI)
AI sentience researcher at the Center for Enabling Effective Altruism Learning & Research

Book a 1:1:

Want to make the future go well for animals? Apply to a Sentient Futures fellowship!

Damin Curtis🔹30 Aug 2025 18:52 UTC

55 points

0 comments2 min readEA link

Code4Compassion London 2025

Jay Luong6 May 2025 1:50 UTC

7 points

0 comments1 min readEA link

Last week to apply for the Futurekind AI Fellowship! (deadline: April 1)

Jay Luong23 Mar 2025 23:16 UTC

24 points

0 comments1 min readEA link

Apply to become a Futurekind AI Facilitator or Mentor (deadline: April 10)

Jay Luong21 Mar 2025 20:28 UTC

3 points

0 comments1 min readEA link

Jay Luong 28 Jan 2025 2:15 UTC
2 points
0 ∶ 0
on: Code4Compassion: a hackathon transforming animal advocacy through technology
Last chance to apply for this AI×animals hackathon!
Applications close Friday, 31 January.
- Limited support for travel+accommodation available!
- Remote participants also welcome– we may set up hubs at London Initiative for Safe AI &/or the EA Hotel in Blackpool!
- All participants get 50% off tickets for AI for Animals 2025 conference

Code4Compassion: a hackathon transforming animal advocacy through technology

Jay Luong14 Jan 2025 21:58 UTC

47 points

1 comment1 min readEA link

Jay Luong 16 Jul 2024 10:16 UTC
1 point
0 ∶ 0
in reply to: rileyharris’s comment on: The case for conscious AI: Clearing the record [AI Consciousness & Public Perception]
Do you think that consciousness will come for free? I think that it seems like a very complex phenomenon that would be hard to accidentally engineer. On top of this, the more permissive your view of consciousness (veering towards panpsychism), the less ethically important consciousness becomes (since rocks & electrons would then have moral standing too). So if consciousness is to be a ground of moral status, it needs to be somewhat rare.

Jay Luong 10 Jul 2024 8:34 UTC
2 points
0 ∶ 0
in reply to: rileyharris’s comment on: The case for conscious AI: Clearing the record [AI Consciousness & Public Perception]
Ah, I think I see where you’re coming from. Of your points I find #4 to be the most crucial. Would it be too egregious to summarise this notion as: (i) all of these capabilities are super useful & (ii) consciousness will [almost if not actually] “come for free” once these capabilities are sufficiently implemented in machines?

Jay Luong 8 Jul 2024 17:49 UTC
1 point
0 ∶ 0
in reply to: eg’s comment on: AI consciousness & moral status: What do the experts think?
What claim is being made here?

Re: track record, I’m a coauthor on a position paper that we’ve been gradually rolling out to reviewers who are well-established in this topic.

Finally, please find information about the aims of the survey in the below comment & at this webpage.

Jay Luong 6 Jul 2024 15:31 UTC
1 point
0 ∶ 0
on: AI consciousness & moral status: What do the experts think?
What?
Inspired by the Philpapers survey, we are conducting a survey on experts’ beliefs about key topics pertaining to AI consciousness & moral status. These include:
🧠 Consciousness/sentience
⚖️ Moral status/moral agency
💥 Suffering risk (”S-risk”) related AI consciousness (e.g. AI suffering)
⚠️ Existential risk (”X-risk”) related to AI consciousness (e.g. resource competition with conscious AI)
Why?
Such a survey promises to enrich our understanding of key safety risks related to conscious AI in several ways.
📊 Most importantly, the results of this survey provide a general picture of experts’ views about the probability, promises, & perils of AI consciousness.
- This summary can be used to gauge expert opinion, & make it easier for policymakers, journalists, & lay people to see where the experts stand, where they disagree, & where there is uncertainty.
- Furthermore, the survey results can also be of use to experts themselves, who may harbour misconceptions about what most other experts believe, or, owing to their specialisation, may not be abreast of advances in other areas of AI research.
- Overall, the survey enhances the accessibility of AI research, ultimately contributing to a more AI-literate (& hence, better prepared) populace.
⚔️ Analysing the types of answers given by respondents might help to identify fault lines between industry, academia, & policy.
📈 Repeating the survey on an annual basis can assist in monitoring trends (e.g. updates in belief in response to technological advances/breakthroughs, differences in attitudes between industry & academia, emergent policy levers, etc.).

[Question] AI consciousness & moral status: What do the experts think?

Jay Luong6 Jul 2024 15:27 UTC

0 points

3 comments1 min readEA link

Jay Luong 6 Jul 2024 15:08 UTC
1 point
0 ∶ 0
in reply to: rileyharris’s comment on: The case for conscious AI: Clearing the record [AI Consciousness & Public Perception]
Hey! I’m not sure I see the prima facie case for #1. What makes you think that building non-conscious AI would be more resource-intensive/expensive than building conscious AI? Current AIs are most likely non-conscious.
As for #2, I have heard such arguments before in other contexts (relating to meat industry) but I found them to be preposterous on the face of it.