If accurate, that ratio of grantmakers to employed specialists looks rather low compared with what I understand it to be in many other fields, and I’m thinking of fields like space technology which have 75 page grant applications requiring specialist knowledge to evaluate and monitor, and government subsidy programmes whose application volume is sufficiently high to have <5% funding rates and which have painful audit requirements.
Also wonder how much EA organizations use part time external reviewers to evaluate grants, which is the standard way of broadening evaluations and removing bottlenecks? (although I can see getting AI specialists who both work in industry/research and are truly independent might be more challenging)
The full report is definitely one of the better treatments I’ve seen of the subject (and I’ve read quite a few recently as they’re loosely related to my work). A few comments though...
Feels like an unduly favourable assumption to ODCs to amortise hardware over exactly the same schedule as terrestrial ones. Any situation in which inference compute hardware doesn’t become obsolete at exactly the point the ODC reaches end of design life favours terrestrial datacentres.[1] Also feels generous to assume bleed rates in space are no worse than terrestrial bleed[2]
I’m not sure what model you’ve determined your satellite hardware costs on and I know you’ve itemised solar and radiator panels else where, but taking the most feasible approach of thousands of smallsats for your 1GW datacentre, the $4b is buying a lot of propulsion systems, GNC subsystems, intersatellite links, space rated batteries and MAIT work as well as aluminium frames[3]. The article doesn’t really discuss how much more complex satellite buses are than modular buildings...
I think the regulatory arguments actually mostly stack in favour of terrestrial datacentres, because you get to jurisdiction shop. Whilst space isn’t effectively regulated, spectrum and launch licensing is and you basically only have one choice.[4] There’s growing concern over orbital congestion and even the effects of deorbiting on the mesosphere to deal with, and plenty of parts of the world where NIMBYs either don’t live or are less relevant to local regulators than your money.
The cooling estimate for earth may or may not be representative of what people are paying for climate control for racks of servers in a building, but feels a lot easier to improve that than max out the specific power of satellite radiators, especially since for ODCs we’ve already relaxed design principles like “chips should be less than 1km away from each other!”.
So I agree with the overall point it’s going to depend a lot on launch costs but I think there’s still some way to go. And even if the unit economics do work, your “fast takeoff” approach with Starship launches scaling to 10k by 2028 feels very fast assuming no obstacles at all to development, scaling capacity or even launches scrubbed by weather. c.f. industry expectations that Blue Origin losing their only launchpad recently will set them back a full year. SpaceX’s launch cadence being exceptional feels like reason to doubt they’ll 50x it in the next 2 years with an experimental platform...
A couple of further points slightly more favourable to ODCs in the longer run
costs look different if one assumes a architecture where much of the mass doesn’t get deorbited every five years (especially stuff which suffers minimal degradation like radiators) [5] which probably looks a bit more like Starcloud plus orbital refuelling and servicer vehicles to upgrade chips. That sort of modular architecture is still a work in progress and obviously has its own tradeoffs with more expensive components.
the other use case for orbital datacentres is edge compute for military uses, which isn’t fully defined yet and isn’t nearly as price sensitive
Your terrestrial datacentre can keep on running if its 5 year old chips are still useful, or conversely be replaced much earlier if the economics favours keeping the building/microgrid but replacing the chips with much better ones. Obsolete chips potentially have some resale market too. Your ODC needs deorbiting after 5 years regardless; propellant refuelling and in space chip replacement are theoretically possible but orders of magnitude more expensive than keeping a building powered on.
we have some evidence of COTS inference chips surviving 5yr LEO radiation doses without issue, but might be a different matter for the marginal chip whilst running hot over a 5 year duration in that environment. If needed, radiation hardened variants could be delivered… for a price
if I understand correctly that’s supposed to be just $4 per watt bus/subsystem/MAIT costs excluding solar panels, radiators and inference chips which would be two orders of magnitude cheaper than competitive providers in today’s market. Even with the benefits of vertical integration and automation that seems ambitious for the near term...
I suppose you could pin your hopes on Europe or India improving launch cadence and offering less restrictive licensing regimes but that sounds unlikely...
one reason why some people manage to be both sceptical of ODCs and bullish on SBSP (which has similar pros and cons) is that the latter is supposed to amortise its build costs over decades rather than be replaced every 5 years, which offsets transmission efficiency loss. Though yeah, that does mean more expensive solar panels etc...
I don’t know how much very slight latency between different nodes or sporadic disruption affects inference compute, but feels like something that could be more of a problem than precision pointing and tracking (these are solved problems, albeit problems solved with more expensive hardware and mission ops and regulators might not like dense formations)