David T

Karma: 1,404

David T 1 Feb 2026 20:33 UTC
9 points
2 ∶ 1
in reply to: MikhailSamin’s comment on: Unfalsifiable stories of doom
Meta is paying billions of dollars to recruit people with proven experience at developing relevant AI models.
Does the set of “people with proven experience in building AI models” overlap with “people who defer to Eliezer on whether AI is safe” at all? I doubt it.
Indeed given that Yudkowsky’s arguments on AI are not universally admired and people who have chosen building the thing he says will make everybody die as their career are particularly likely to be sceptical about his convictions on that issue, an endorsement might even be net negative.

David T 1 Feb 2026 20:15 UTC
0 points
3 ∶ 2
in reply to: Nick K.’s comment on: Unfalsifiable stories of doom
The opportunity cost only exists for those with a high chance of securing comparable level roles in AI companies, or very senior roles at non-AI companies in the near future. Clearly this applies to some people working in AI capabilities research,^[1] but if you wish to imply this applies to everyone working at MIRI and similar AI research organizations, I think the burden of proof actually rests on you. As for Eliezer, I don’t think his motivation for dooming is profit, but it’s beyond dispute that dooming is profitable for him. Could he earn orders of magnitude more money from building benevolent superintelligence based on his decision theory as he once hoped to? Well yes, but it’d have to actually work.^[2]
Anyway, my point was less to question MIRI’s motivations or Thomas’ observation Nate could earn at least as much if he decided to work for a pro-AI organization and more to point out that (i) no, really, those industry norm salaries are very high compared with pretty much any quasi-academic research job not related to treating superintelligence as imminent and especially to roles typically considered “altruistic” and (ii) if we’re worried that money gives AI company founders the wrong incentives, we should worry about the whole EA-AI ecosystem and talent pipeline EA is backing. Especially since that pipeline incubated those founders.
1. ^
  including Nate
2. ^
  and work in a way that didn’t kill everyone, I guess...

David T 30 Jan 2026 21:18 UTC
24 points
9 ∶ 2
in reply to: Thomas Kwa🔹’s comment on: Unfalsifiable stories of doom
$235K is not very much money. I made close to Nate’s salary as basically an unproductive intern at MIRI.
I understand the point being made (Nate plausibly could get a pay rise from an accelerationist AI company in Silicon Valley, even if the work involved was pure safetywashing, because those companies have even deeper pockets), but I would stress that these two sentences underline just how lucrative peddling doom has become for MIRI^[1] as well as how uniquely positioned all sides of the AI safety movement are.
There are not many organizations whose messaging has resonated with deep pocketed donors to the extent that they can afford to pay their [unproductive] interns north of $200k pro rata to brainstorm with them.^[2] Or indeed up to $450k to someone with interesting ideas for experiments to test AI threats, communication skills and at least enough knowledge of software to write basic Python data processing scripts. So the financial motivations to believe that AI is really important are there on either side of the debate; the real asymmetry is between the earning potential of having really strong views on AI vs really strong views on the need to eliminate malaria or factory farming.
1. ^
  tbf to Eliezer, he appears to have been prophesizing imminent tech-enabled doom/salvation since he was a teenager on quirky extropian mailing lists, so one thing he cannot be accused of is bandwagon jumping.
2. ^
  Outside the Valley bubble, plenty of people at profitable or well-backed companies with specialist STEM skillsets or leadership roles are not earning that for shipping product under pressure, never mind junior research hires for nonprofits with nominally altruistic missions

David T 21 Jan 2026 19:57 UTC
6 points
1 ∶ 0
in reply to: huw’s comment on: Why Isn’t EA at the Table When $121 Billion Gets Allocated to Biodiversity Every Year?
Easier to persuade commercial entities of the merits of making more money (by incidentally doing the right thing) than persuade a reviewer of multiple competitive funding bids scoped for habitat preservation to fund a study into lab grown meat. At the end of the day, the proposals written by biodiversity enthusiasts with biodiversity rationales and very specific biodiversity metrics are just going to be more plausible,^[1] even if they turn out to be ineffective.
For similar reasons, I don’t expect EA animal welfare funds to award funding to an economic think tank proposing to research how to grow the economy, even if the economic think tank insists its true goal is animal welfare and provides a lot of evidence that investment in meat alternatives and enforcement of animal welfare legislation is linked to overall economic growth.
1. ^
  Biobanks and biodiversity charity effectiveness research might stand a chance, obviously

David T 19 Jan 2026 23:14 UTC
6 points
1 ∶ 0
in reply to: titotal’s comment on: Has EA given up on politics?
Also failures trying to do really outlandish things like bribing Congresspeople to endorse Jim Mattis as a centrist candidate in the 2024 US Presidential Election are likely to backfire in more spectacular ways than (say) providing malaria nets for a region with falling malaria or losing a court case against a factory farming conglomerate. That said, this criticism does apply to some other things EAs are interested in, particularly actions purportedly addressing x-risks.

David T 18 Jan 2026 15:39 UTC
3 points
0 ∶ 0
on: Everything is neglected
Feels like in the real world you describe in which few/no cause areas are actually satiated for funding, neglectedness is of interest mainly in how it interacts with tractability.
If your small amount of effort kickstarts an area of research rather than merely adds some marginal quantity of additional research or funding, you might get some sort of multiplier on your efforts, assuming others find your case persuasive. And certain problems that have being neglected due to the relative obscurity/rarity of who/what they affect might be an indication that more tractable interventions exist (if there is a simple cure for common cancers it is remarkable we have not found it yet; conversely certain obscure diseases have been the subject of comparatively little research). On the other hand, the relationship doesn’t always run that way: some causes like world peace are neglected precisely because however important they might be, there doesn’t appear to be an efficacious solution.

David T 18 Jan 2026 15:22 UTC
2 points
0 ∶ 0
on: Ancient precedents of longtermist thinking
This stands in notable contrast to most other religious and philosophical traditions, which tend to focus on timescales of centuries or millennia at most, or alternatively posit an imminent end-times scenario.
Feels like the time of perils hypothesis (and associated imperatives to act and magnitude of reward scenario) popular with longtermists maps rather more closely to the imminent end times scenario common to many eras and cultures than Buddhist views of short and long cycles and an eventual^[1] Maitreya Buddha...
1. ^
  there have also been Buddhists acting on the belief that the Maitreya was imminent or the claim that they were the Maitreya...

David T 16 Jan 2026 16:17 UTC
4 points
0 ∶ 0
on: Is rushing friendly AI our best hope of preventing “grey goo” nanotech doom?
I thought Altman and the Amodeis had already altruistically devoted their lives to saving us from grey goo. Since they’re going to do this before 2027 you may already be too late
Peter Thiel wants to know if your AI can be unfriendly enough to make a weapon out of it.

David T 9 Jan 2026 0:25 UTC
4 points
1 ∶ 0
in reply to: Lydia Nottingham’s comment on: Vitae per person (VPP): a new metric of civilizational resource
It’s a little different, but I’m not sure indexing to the consumption preferences of a certain class of US citizen in 2025 represents a better index, or one particularly close to Rawls concept of primary goods. The “climate controlled space” in particular feels particularly oddly specific (both because much of the world doesn’t need full climate control, and because 35m^2 is not a particularly “elite” apportionment of space )
To the extent the VPP concept is useful I’d say it’s mostly in indicating that no matter how much it bumps GDP per capita, AI isn’t going to automagically reduce costs of land and buildings, and is currently driving the amount of compute+bandwidth an “US coastal elite” person directly or indirectly consumes up very rapidly...

David T 8 Jan 2026 22:28 UTC
40 points
10 ∶ 2
on: Public intellectuals need to say what they actually believe
I don’t have a global audience, but if I did I wouldn’t have share this view I expressed to individuals back when COVID was first reported:
probably this isn’t going to become a global pandemic or affect us at all; but the WHO overreacting to unknown new diseases is what prevents pandemics from happening
That take illustrates two things: firstly that there are actual lifesaving reasons for communicating messages slightly differently to your personal level of concern about an issue, and secondly hunches about what is going to happen next can be very wrong.
In fact, semi-informed contrarian hunches were shared frequently and often by public intellectuals throughout the pandemic, often with [sincere] high confidence. They predicted it would cease to be a thing as soon as the weather got warmer, were far too clever to wear masks because they knew that protective effects which might be statistically significant at population level had negligible impact upon them, they didn’t have to worry about infection any more because they were using Invermectin as a prophylactic and they were keen to express their concern about vaccines^[1] Piper’s hunch is probably unusual in being directionally correct. Of all the possible cases for public intellectuals sharing everything they think about an issue, COVID is probably the worst example. Many did, and many readers and listeners died.
Being a domain expert relative to ones audience doesn’t seem nearly enough to be contradicting actual experts with speculation on health in other contexts either.^[2]
Similarly, I’m unfamiliar with Ball, but if he is “probably way above replacement level for “Trump admin-approved intellectual” he should probably try to stay in post. There are many principled reasons to cease to become a White House adviser, but to pursue a particular cause by placing less emphasis on arguments they’re might be receptive to and more on others isn’t really one of them. It’s not like theories that Open Source AI might be valuable as an alternative to an oligarchy dominated by US Americans who orbit the White House struggle to get aired in other environments. Political lobbying is the ur-case for emphasizing the bits the audience cares about, and I’m really struggling to imagine any benefit to Ball giving the same message to 80k Hours and the Trump administration, unless the intention is for both audiences to ignore him.
I haven’t read either of MacAskill’s full length books so I’m less sure on this one, but my understanding is that one focuses on various approaches to addressing poverty and one focuses on the long term, in much the same way as Famine, Affluence and Morality has nothing to say on liberating animals and Animal Liberation having little to say on duties to save human lives.^[3] I don’t think there’s anything deceptive in editorial focus, and I think if readers are concluding from reading one of those texts that Singer doesn’t care about animals or that MacAskill doesn’t care about the future, the problem with jumping to inaccurate conclusions is all theirs. MacAskill has written about other priorities since; I don’t think he owes his audience apologies for not covering everything he cares about in the same book.
I do have an issue with “bait and switch” like using events nominally about the best way to address global poverty to segueing into “actually all these calculations to save children’s lives we agonised earlier are moot; turns out the most important thing is to support these AI research organizations we’re affiliated with”^[4] but I consider that fundamentally different to focusing
1. ^
  These are just the good-faith beliefs held by intellectuals with more than a passing interest in the subject. Needless to say not all the people amplifying them had such good intentions or any relevant knowledge at all...
2. ^
  At least with COVID, public health authorities were also acting on low information. The same is not true in other cases, where on the one hand there is a mountain of evidence-based medicine and on the other, a smart more influential person idly speculating otherwise.
3. ^
  Even though Singer has had absolutely no issue with writing about some seriously unpopular positions he holds, he still doesn’t emphasize everything important in everything he writes…
4. ^
  Apart from the general ickiness, I’m not even convinced it’s a particularly good way to recruit the most promising AI researchers...

David T 28 Dec 2025 13:14 UTC
25 points
3 ∶ 0
in reply to: Richard Y Chappell🔸’s comment on: Epistemics (Part 10: The nontrivial probability gambit) | Reflective Altruism
Seems like you and the other David T are talking past each other tbh.
Above you reasonably argue the [facetious] “time of carols” hypothesis is not remotely as credible as the time of perils hypothesis. But you also don’t assign a specific credence to it, or provide an argument that the “time of carols” is impossible or even <1%^[1]
I don’t think it would be fair to conclude from this that you don’t understand how probability works, and I also don’t think that it is reasonable to assume that the probability of the ‘time of carols’ should be assumed sufficiently nontrivial to warrant action in the absence of any specific credence attached to it. Indeed if someone responded to you indirectly with an example which assigned a prior of “just 1%”, to the “time of carols”, you might feel justified in assuming it was them misunderstanding probability...
The rest of Thorstad’s post which doesn’t seem to be specifically targeted at you explicitly argues that in practice, specific claims involving navigating a ‘time of perils’ also fall into the “trivial” category,^[2] in the absence of robust argument as to why of all the possible futures this one is less trivial than others. He’s not arguing for “many gods” which invert the stakes so much as “many gods/pantheons means the possibility of any specific god is trivial, in the absence of compelling evidence of said god’s relative likelihood”. He also doesn’t bring any evidence to the table (other than arguing that time of perils hypothesis involves claims about x-risk in different centuries which might be best understood as independent claims ^[3]) but his position is that this shouldn’t be the sceptic’s job...
(Personally I’m not sure what said evidence would even look like, but for related reasons I’m not writing papers on longtermism and am happy applying a very high discount rate to the far future)
1. ^
  I think everyone would agree that it is absurd (that’s a problem with facetious examples)^[4] but if the default is that logical possibilities are considered nontrivial until proven otherwise...
2. ^
  he doesn’t state a personal threshold, but does imply many longtermist propositions dip below Monton’s 5 * 10^-16 once you start adding up the claims....
3. ^
  a more significant claim he fails to emphasize is that the relevant criteria for longtermist interventions isn’t so much that the baseline hypothesis about peril distribution is [incidentally] true but the impact of a specific intervention at the margin has a sustained positive influence on it.
4. ^
  I tend to dislike facetious examples, but hey, this is a literature in which people talk about paperclip maximisers and try to understand AI moral reasoning capacity by asking LLMs variations on trolley problems...

David T 23 Dec 2025 20:13 UTC
6 points
2 ∶ 0
on: Offering higher salaries than social-sector peers
I think this is generally true, but not sure that GiveWell is the best example of competition in social sector peers, since they seem mainly focused on hiring Western-based number crunchers who might otherwise be at a university or analysing financial data in the commercial sector, rather than poaching a small pool of educated staff from local NGOs or the best-networked, highest-performing grant fundraisers in the West.

David T 18 Dec 2025 13:50 UTC
20 points
3 ∶ 0
on: Why haven’t we seen a promising longtermist intervention yet?
I don’t think longtermism necessarily needs new priorities to be valuable if it offers a better perspective on existing ones (although I don’t think it does this well either).
Understanding what the far future might need is very difficult. If you’d asked someone 1000 years what they should focus on to benefit us, you’d get answers largely irrelevant to our needs today.^[1] If you asked someone a little over 100 years ago their ideas might seem more intelligible and one guy was even perceptive enough to imagine nuclear weapons, although his optimism about what became known as mutually assured destruction setting the world free looks very wrong now, and people 100 years ago that did boring things focused on the current world did more for us than people dreaming of post-work utopias.
To that extent, the focus on x-risk seems quite reasonable: still existing is something we actually can reasonably believe will be valued by humans in a million years time^[2] Of course, there are also over 8 billion reasons to try to avoid human extinction alive today (and most non-longtermists consider at least as far as their children) but longtermism makes arguments for it being more important than we think. This logically leads to willingness to allocate more money to x-risk causes, and consider more unconventional and highly unlikely approaches x-risk. This is a consideration, but in practice I’m not sure that it leads to better outcomes: some of the approaches to x-risk seeking funding make directionally different assumptions about whether more or less AGI is crucial to survival: they can’t both be right and the ‘very long shot’ proposals that only start to make sense if we introduce fantastically large numbers of humans to the benefit side of the equation look suspiciously like Pascal’s muggings.^[3]
Plus people making longtermist arguments typically seem to attach fairly high probabilities to stuff like AGI that they’re working on in their own estimations, which if true would make their work entirely justifiable even focusing only on humans living today.
(A moot point but I’d have also thought that although the word ‘longtermist’ wasn’t coined until much later, Bostrom and to a lesser extent Parfit fit in with the description of longtermist philosophy. Of course they also weren’t the first people to write about x-risk)
1. ^
  I suspect the main answers would be to do with religious prophecies or strengthening their no-longer-extant empire/state
2. ^
  Notwithstanding fringe possibilities like the possibility humans in a million years might be better off not existing, or for impartial total utilitarians humanity might be displacing something capable of experiencing much higher aggregate welfare.
3. ^
  Not just superficially in that someone is asking to suspend scepticism by invoking huge reward, but also that the huge rewards themselves make sense only if you believe in very specific claims about x-risk over the long term future being highly concentrated in the present (very large numbers of future humans in expectation or x-risk being nontrivial for any extended period of time might seem superficially uncontroversial possibilities but they’re actually strongly in conflict with each other).

David T 17 Dec 2025 19:26 UTC
4 points
1 ∶ 0
in reply to: Jason’s comment on: EA orgs overhire comms and underhire growth
I think it’s also more fundamental in the sense a number of EA orgs are inherently “comms-focused” because they’re lobbying for some sort of cause to some sort of decision maker (convince politicians to endorse challenge trials or ban datacentres and lead paint,, or maybe persuade fish farmers or maternal care workers in LEDCs to adopt a different approach). Or if they’re not directly lobbying they might be trying to communicate research to a relatively small group of people like computer scientists or people who want to do inter-species utility loss comparisons.
Also, with some notable exceptions I think a lot of EA is quite insular: orgs want to convey that they’re doing important work to OpenPhil funders, a pipeline of talent coming from EA groups, “aligned” organizations to collaborate with or the sort of small donor that’s already thinking about long shot solutions to x-risks or making donations to improve the welfare of unfashionable creatures. That’s a short list to a/b test, a hard group to target with paid media, and also an audience which has exacting expectations about how things are communicated, so the digital marketing to wider audience approach may not work so well. The down side is that competing for the same attention is going to usually be net less impactful than finding interest from the wider public...

David T 13 Dec 2025 22:52 UTC
2 points
0 ∶ 0
in reply to: groundsloth’s comment on: Two arguments against patient philanthropy
Sure, your example showed that if one irrationally disregards earlier generations and focuses purely on the needs of cohort P, Option B is a clear winner. If one doesn’t, we agree that it’s actually pretty darn complicated to estimate the total welfare impact of donating now versus donating a larger nominal sum on equivalent problems (assuming they still exist) in future, which requires a lot of contestable counterfactual assumptions $,$ ^[1] as well as choice of discount rates, PPP and money nonlinearity assumptions and decisions about whether any value is attached to economic stimulus to non-recipients in developing countries and keeping marginal NGOs alive. (Donations to things other than poverty relief have their own idiosyncracies: hopefully the number of ITNs needed to prevent malaria deaths by ~2050 will be zero.)
The intergenerational elasticity point is an interesting one, but intergenerational income elasticities are higher in less developed countries (and the higher incomes are partially inherited by more people in later generations, assuming they continue to reproduce above replacement rate). And under normal assumptions we care about the earlier generations helped at least as much as the later ones, so you’ve already helped many more people than the direct recipients by the time the patient philanthropy fund is investigating how many more people accrued compound interest will let them help. Plus in the specific example of the roof we’re talking about wealth, and you’d have to invest very well in stocks and shares to beat the imputed 20% annual returns on a tin roof, even over time spans that extend beyond its serviceability.
Catchup growth definitely exists, the only question is whether more marginal economies will be excluded from it.^[2] There are many reasons for economic stagnation in poorer regions (most obviously terrible governance), but it’s certainly not independent from whether philanthropic funds for economic growth and poverty alleviation decide that in the near term they should shift towards promoting the economic development of the stock market in their own country instead.^[3] Too much patience is probably worse for developing countries than the opposite extreme of too much philanthropic cash chasing too few viable opportunities.
1. ^
  You also have to make assumptions about the philanthropists of the future as well: I’m not as rosy on near future technology-enabled post scarcity societies as some people on here, but if we trend in that direction maybe your nominally larger funds are a lot less relevant in future than that now
2. ^
  Never mind the Asian Tiger economies, even some conflict-ridden impoverished backwaters like Burkina Faso have seen average growth rates comparable to US stocks over extended periods of time, and even without wild technological optimism it’ll probably be fairly hard to find people living under the new $3 per day (2025 PPP) poverty threshold in 2075
3. ^
  Makes wayyy more sense for funds to keep most of the funds invested in domestic stocks when they’re endowments ring fenced for specific things like selective scholarships or maintenance of a facility than funds for promoting economic growth and poverty alleviation

David T 13 Dec 2025 19:46 UTC
4 points
0 ∶ 0
in reply to: groundsloth’s comment on: Two arguments against patient philanthropy
I follow the logic, but I think the logic of the contrived example actually exposes general weaknesses in patient philanthropy (i.e. for example B to be clearly better we have to assume that for some arbitrary reason we do not care about the first three generations of poor people at all, only about the poor people in 100 years’ time, who are sufficiently far removed for us not to even know how poor they will be)
Once we relax that assumption and assume that poor people today are at least equally deserving as hypothetical poor people in the future, Option B starts looking rather good. ^[1]The first generation get helped to the extent they need, their descendants may benefit directly to some extent but also may be better able to help themselves, and for big enough donations there is some sort of compounding return in the wider poor country. In some plausible circumstances even the return to the grandchildren is greater than the sum of money you donated (ceteris paribus being born poor but obtaining a scholarship paid for by a foreign foundation isn’t a better situation than being born into the middle class and having education paid for by the grandparent who received the foreign-funded scholarship and was able to earn much better for fifty years as a result)
It then becomes a debate on whether poor people can achieve better returns than index investments in Western stocks, and whilst poor people aren’t sophisticated investors and are often subject to all sorts of negative economic shocks, they are often in a position to dramatically improve their livelihood (RCTs on cash transfers suggested the annual return on a long lived tin roof that didn’t need replacing every two years was at least 19%, for example) and then there’s whether to take into account the nonlinearity of money returns to the poorest people living on $2 per day (2025 USD PPP) now and the poorest people [most likely, based on current trends] earning >$2 per day (2025 USD PPP) 50 years in the future.
1. ^
  The exception might be in cases where your target population has very little capacity to improve their own situation right now, relative to those in future and so most of your money just gets wasted or stolen. I’m unconvinced this applies to people in poverty in general, but it might if you wanted to maximise the positive impact on a population of Palestinians in Gaza specifically, for example.

David T 13 Dec 2025 18:59 UTC
6 points
0 ∶ 0
in reply to: AgentMa🔸’s comment on: Two arguments against patient philanthropy
On the other hand, there is also no guarantee that the global poor in 50 years will (i) be as poor as some people from Ghana you might be able to help today and (ii) have as many low hanging fruit interventions that can help them.
Give What We Can currently assumes that the cost of saving a life today is ~$4k. It’s not obvious that the cost of saving a life will be as low as ($4k x compound interest on index fund) in 50 years’ time.
(Also, if the philanthropist’s timelines are as long as 50 years it may not be them doing the cause selection, which may or may not be a consideration)

David T 9 Dec 2025 23:00 UTC
11 points
0 ∶ 0
in reply to: Yarrow Bouchard 🔸’s comment on: How I hope the EA community will respond to the AI bubble popping
I think it’s also disanalogous in the sense that the EA community’s belief in imminent AGI isn’t predicated on the commercial success of various VC-funded companies in the same way as the EA community’s belief in the inherent goodness and amazing epistemics of its community did kind of assume that half its money wasn’t coming from an EA-leadership endorsed criminal who rationalized his gambling of other people’s money in EA terms...
The AI bubble popping (which many EAs actually want to happen) is somewhat orthogonal to the imminent AGI hypothesis;^[1] the internet carried on growing after a bunch of overpromisers who misspent their capital fell by the wayside.^[2] I expect that (whilst not converging on superintelligence) the same will happen with chatbots and diffusion models, and there will be plenty of scope for models to be better fit to benchmarks or for researchers to talk bots into creepier responses over the coming years.
The Singularity not happening by 2027 might be a bit of a blow for people that attached great weight to that timeline, but a lot are cautious to do that or have already given themselves probabilistic getouts. I don’t think its going to happen in 2027 or ever, but if I thought differently I’m not sure 2027 actually being the year some companies failed to convince sovereign wealth funds they were close enough to AGI to deserve a trillion would or even should have that much impact.
I do agree with the wider point that it would be nice if EAs realized that many of their own donation preferences might be shaped at least as much by personal interests and vulnerable to rhetorical tricks as normies’; but I’m not sure that was the main takeaway from FTX
1. ^
  FWIW I hold similar views about it not being about to happen and about undue weight being placed on certain quasi-religious prophecies...
2. ^
  there’s perhaps also a lesson that the internet isn’t that different from circa 2000, but certain aspects of it did keep getting better...

David T 9 Dec 2025 21:50 UTC
6 points
1 ∶ 0
in reply to: Arepo’s comment on: How I hope the EA community will respond to the AI bubble popping
I would add that it’s not just extreme proposals to make “AI go well” like Yudkowsky’s airstrike that potentially have negative consequences beyond the counterfactual costs of not spending the money on other causes. Even ‘pausing AI’ through democratically elected legislation enacted as a result of smart and well-reasoned lobbying might be significantly negative in its direct impact, if the sort of ‘AI’ restricted would have failed to become a malign superintelligence but would have been very helpful to economic growth generally and perhaps medical researchers specifically.
This applies if the imminent AGI hypothesis is false, and probably to an even greater extent it if it is true.
(The simplest argument for why it’s hard to justify all EA efforts to make AI go well based purely on its neglectedness as a cause is that some EA theories about what is needed for AI to go well directly conflict with others; to justify the course of action one needs to have some confidence not only that AGI is possibly a threat but that the proposed approach to it at least doesn’t increase the threat. It is possible that both donations to a “charity” that became a commercial AI accelerationist and donations to lobbyists attempting to pause AI altogether were both mistakes, but it seems implausible that they were both good causes)

David T 7 Dec 2025 19:55 UTC
4 points
0 ∶ 0
in reply to: kokotajlod’s comment on: 3 Stages of Competition for the Long-Term Future
I’m more confused by how this apparent near future, current world resource base timeline interacts with the idea that this Dyson swarm is achieved clandestinely (I agree with your sentiment the “disassemble Mercury within 31 years” scenario is even more unlikely, though close to Mercury is a much better location for a Dyson swarm). Most of the stuff in the tech tree doesn’t exist yet and the entities working on it are separate and funding-starved: the relationship between entities writing papers about ISRU or designing rectenna for power transmission and an autonomous self-replicating deep space construction facility capable of acquiring unassailable dominance of the asteroid belt within a year is akin to the relationship between a medieval blacksmith and a gigafactory. You could close that gap more quickly with an larger-than-Apollo-scale joined up research endeavour, but that’s the opposite of discreet.
Stuff like the challenges of transmitting power/data over planetary distances and the constant battle against natural factors like ionizing radiation don’t exactly point towards permanent dominance by a single actor either.