JamesN

Karma: 375

Executive Director of the Swift Centre for Applied Forecasting (led projects with U.K. Gov., Google DeepMind, and on AI security and capability risks).

Co-founder of ‘Looking for Growth’ - a political movement for growth in the U.K.

CTO of Praxis—a AI led assessment platform for schools

Former Head of Policy at ControlAI (co-authored ‘A Narrow Path’)

Former Director of Impactful Government Careers

Former Head of Development Policy at HM Treasury

Former Head of Strategy at the Centre for Data Ethics and Innovation

Former Senior Policy Advisor at HM Treasury, leading on the economic and financial response to the war in Ukraine, and the modelling and allocation of the UK’s ‘Official Development Assistance’ budget.

MSc in Cognitive and Decision Sciences from UCL, my dissertation was an experimental study using Bayesian reasoning to improve predictive reasoning and forecasting in U.K. public policy officials and analysts

JamesN 3 May 2026 12:03 UTC
1 point
0 ∶ 0
in reply to: Danila Medvedev’s comment on: Forecasting is Way Overrated, and We Should Stop Funding It
This obviously assumes Marcus has a sufficient level of experience to justify the claims. Which I think, given other comments, can be adequately challenged.

It would be good to know what metric/threshold/examples would be taken as forecasting delivering adequate impact to justify funding. From examples in this thread alone, we can see senior government decision makers in both the U.K. (including Ministerial teams and critical committees) and US, frontier labs safety teams, and philanthropic funds moving tens of millions of dollars a year) have utilised forecasting (either the process or the outputs) to inform their decisions.

The argument of it only shifting a decision 1-2% is totally fair. But to keep consistent I’d expect the same people who make that argument to also be highly sceptical of the vast majority of research funding.

JamesN 30 Apr 2026 8:14 UTC
1 point
1 ∶ 0
on: Technical AI Safety Research Plausibly Increases P(doom) Absent Vastly More Advocacy
(Caveat—I read the premises and skimmed the rest)
Yes—AI research is useful and does help highlight specific advancements or potential risks. However, I fear it is being focused on by many because of personal interest in the topic, rather than the best route to reduce catastrophic and existential risks.

For better or worse, advocacy, policy, and communications are the most likely routes to reduce p(doom) - unless you believe alignment is a plausible and concrete thing.

JamesN 29 Apr 2026 15:59 UTC
4 points
0 ∶ 0
in reply to: Vasco Grilo🔸’s comment on: Why Forecasting Fails Decision Makers
Yeah 40pp, though 40% difference may also be informative depending on the question and distribution.

Regardless, “40” was just a random number. Basically the interesting thing are the areas of greatest difference, not the probability itself.

Bridging the Gap on AI Safety Policy

JamesN29 Apr 2026 14:48 UTC

8 points

0 comments4 min readEA link

JamesN 27 Apr 2026 7:30 UTC
9 points
2 ∶ 0
in reply to: NickLaing’s comment on: Forecasting is Way Overrated, and We Should Stop Funding It
We could “forecast” the likelihood of that haha.
I can’t get into specifics. But if you believe activities like evaluations of models to test for dangerous behaviour etc. is net negative, then that may give credence to your assumption. As an extra data point of whether we’d do work we thought was net negative, I was Head of Policy at ControlAI and co-authored narrowpath.co, and our forecasters have done numerous AI safety focused projects (with and outside of the Swift Centre, including AI 2027).

JamesN 26 Apr 2026 8:28 UTC
4 points
1 ∶ 0
in reply to: Chris Leong’s comment on: Forecasting is Way Overrated, and We Should Stop Funding It
Sort of, but that also doesn’t capture the significant accuracy and efficiency benefits the process of structured reasoning and communication that forecasting enables. There’s substantial risks and issues of “just looking into an issue yourself”—especially when you are more confident in your judgement (because that’s a clear risk of confirmation bias/overconfidence).
The main use of forecasting is in utilising the core scientific benefits it can bring as above into, to help real world decision makers. But fundamentally, that hasn’t been funded—instead we’ve funded tournaments and research.

JamesN 26 Apr 2026 8:10 UTC
58 points
9 ∶ 0
on: Forecasting is Way Overrated, and We Should Stop Funding It
I don’t disagree with some of the fundamentals of this post. Before diving into that, I want to correct a factual error:
“the Swift Centre have received millions of dollars for doing research and studies on forecasting and teaching others about forecasting”
The Swift Centre for Applied Forecasting has not received millions in funding. The majority of our earnings have been through direct projects with organisations who want to use forecasting to inform their decisions.

On your wider argument. I think forecasting has probably received too much funding and the vast majority of that has misallocated on platforms and research. I believe some funding (hundreds of thousands) to maintain core platforms like Metaculus as a public good of information. Though, services like Polymarket can probably fill most of this need in the future (but many useful, informative markets would never reach the necessary volume to be reliable).
Where I think we disagree most is in the application of forecasting and some of the achievements. We’ve worked with frontier AI labs to inform their decisions, are currently advising a U.K. Minister’s team on a central piece of their policy, and are about to start a secondment where I will be advising one of the most influential decision making committees in the country to help improve their scenario analysis and forecasting. Forecasting, and specifically, the science of decision making that it is built on, has the ability to structurally improve decisions in institutions. Significantly better than asking two or three of your smartest friends. That was just never funded, so instead we conclude forecasting is not useful.
What links here?
- Winners of the Manifund Essay Prize by Austin (1 May 2026 2:21 UTC; 28 points)
- Winners of the Manifund Essay Prize by Austin Chen (LessWrong; 1 May 2026 2:21 UTC; 6 points)

JamesN 25 Apr 2026 10:38 UTC
6 points
3 ∶ 0
in reply to: CB🔸’s comment on: Why Forecasting Fails Decision Makers
I think this is a clear sign the community hasn’t been able to communicate its use case well at all. This is one reason I often use “predictive reasoning” as a more general concept when talking to people, interestingly especially if they are already aware of forecasting (as they’ve been conditioned to think it means prediction markets, tournaments, and resolution criteria).

Take your example of animal welfare, I don’t know the exact use case best aligned to you, but fundamentally i’m confident 95%+ of the decisions an animal nonprofit will make are based on two predictions:

1) What will the world be like in the future (insert timeline)?
2) What interventions will most impact/change that future closer to what you’d like it to be?
Forecasting, or more specifically, the processes that underpins the science of forecasting, can be used to increase the accuracy and efficiency of those two predictions.

Once you do that, a better estimation of the future world + a better estimation of the efficacy of your actions, will occur.

Why Forecasting Fails Decision Makers

JamesN24 Apr 2026 19:39 UTC

71 points

10 comments4 min readEA link

JamesN 6 Apr 2026 16:53 UTC
11 points
0 ∶ 0
on: What Questions Do Policymakers Ask About Foreign Aid?
Some excellent reflections here. Across all advocacy, aid, animal welfare and especially AI, I often see errors in understanding the actual incentives and interests of those with power in Government.

A lot of time is also spent advocating to people who have little to no tangible influence. Which leads to organisations claiming they’ve delivered a lot of “direct advocacy” but actually they’ve just spoken to a lot of people, very few of which have the autonomy or power to enact any change.

As someone who worked at the very centre of the U.K. government for c.5 years on international development and finance policy, and time on AI policy (including roles as Head of Development Policy and Senior Policy Advisor for ODA Strategy and Spending at HM Treasury, and Head of Strategy at the CDEI), I’m always happy to share my thoughts directly if ever helpful.

JamesN 8 Mar 2026 18:56 UTC
3 points
1 ∶ 0
on: Feelings about the end of the world
Great post. This is why I’ve mentioned before that there should be dedicated therapy or counselling support org./network funded for those working in AI x-risk.

Considering many large organisations in the space specifically have a very generous “wellbeing” budget for each role, this feels quite easily fundable? Right now it doesn’t seem an issue of money but of directing it in a more efficient and effective way.

JamesN 17 Feb 2026 12:07 UTC
1 point
0 ∶ 0
in reply to: Alex Parry’s comment on: The Swift Centre AI Policy Challenge: Bridge the Gap Between Prediction and Action
Thanks!

The Swift Centre AI Policy Challenge: Bridge the Gap Between Prediction and Action

JamesN16 Feb 2026 13:29 UTC

16 points

2 comments2 min readEA link

JamesN 9 Feb 2026 16:27 UTC
8 points
1 ∶ 0
on: Some angel-on-the-shoulder AI tools
Very cool. I’m a forever optimist when it comes to the potential of AI tools to improve decision making and how people reason about the world or interact with the world.

There is such a huge risk with any such tools of incentive misalignment (I.e. quality of reasoning and error reduction often isn’t well rewarded in most professional contexts).

For these to work, I strongly believe the integration method is absolutely critical. A stand alone platform or app, or something that needs to be proactively engaged is going to struggle I fear.

Something that works with organisations and groups to build the better incentives would be high impact I feel.

JamesN 6 Feb 2026 10:33 UTC
5 points
2 ∶ 0
on: JamesN’s Quick takes
Mental health support for those working on AI risks and policy?
During the numerous projects I work on relating to AI risks, policies, and future threats/scenarios, I speak to a lot of people who bring exposed to issues of catastrophic and existential nature for the first time (or grappling with them for the first time in detail). This combined with the likelihood that things will get worse before they better, makes me frequently wonder: are we doing enough around mental health support?
Things that I don’t know exist but feel they should. Some may sound OTT but I expect you could fund all of these for c.$300k, which relative to the amount being spent in the sector as a whole, is tiny in exchange for resilience of the talent we’re building.
- Structured proactive therapy or mental health resilience sessions tied into Fellowship programs.
- Regular in-built mental health support within organisations dealing with AI risks etc., particularly around helping to anti-catastrophise (there are several threat models which are only catastrophically bad if many, many, many things go down and happen counter to regular incentives—but are very worrying to people (especially new entrants to the field) - it feels support to help prioritise the risks would help both outcomes and mental health.
- Free to use services for mental health support for those in the field.

JamesN 28 Jan 2026 10:29 UTC
1 point
0 ∶ 0
on: JamesN’s Quick takes
I’ll be in D.C. on the 12th February and morning of the 13th, before heading to EAG. If people are around and want to meet, feel free to drop me a DM!

JamesN 27 Dec 2025 17:05 UTC
3 points
0 ∶ 0
in reply to: WillPearson’s comment on: WillPearson’s Quick takes
I think that’s quite a broad remit. What’s the focus of improving the decisions? Better problem identification/specification? Better data analysis and evidence base? Better predictive accuracy? Better efficiency/Adaptiveness/robustness?

JamesN 27 Dec 2025 8:12 UTC
3 points
1 ∶ 0
on: JamesN’s Quick takes
Much of the community’s focus is rightly on technical alignment and governance. However, there seems to be a significant blind spot regarding societal adaptation, specifically, how we raise and educate the next generation.
Our current education model is predicated on a learn skills to provide economic value loop. When transformative AI disrupts this model, we risk creating a generation that is not only economically displaced but fundamentally disenfranchised and without a clear sense of purpose. Historically, large populations of disenfranchised young people have been a primary driver of societal collapse and political volatility.
If the transition to a post-AGI world is chaotic due to human unrest, our ability to manage technical safety drops significantly. Is anyone seriously funding or working on how education/raising children needs to change to fit with an AGI era? It seems like ensuring the next generation is psychologically and philosophically prepared for a world of transformative AI is a necessary prerequisite for a stable transition.

JamesN 20 Jan 2025 11:25 UTC
5 points
1 ∶ 0
on: JamesN’s Quick takes
I’m interesting in chatting to any civil servants, ideally in the UK, who are keen on improving decision making in their teams/area—potentially through forecasting techniques and similar methods. If you’d be interested in chatting, please DM me!

JamesN 25 Nov 2024 22:46 UTC
1 point
1 ∶ 0
in reply to: Joseph Lemien’s comment on: Joseph Lemien’s Shortform
Is this just a combination of anchoring with confirmation bias? Or have I misunderstood.

JamesN

Bridg­ing the Gap on AI Safety Policy

Why Fore­cast­ing Fails De­ci­sion Makers

The Swift Cen­tre AI Policy Challenge: Bridge the Gap Between Pre­dic­tion and Action

Bridging the Gap on AI Safety Policy

Why Forecasting Fails Decision Makers

The Swift Centre AI Policy Challenge: Bridge the Gap Between Prediction and Action