Re: cooling skepticism, actually this has been helpful. On review I think the net rejection will be greater than 633 W/m2. You’re right, we get absorption = ε for longwave radiation from Earth (Kirchhoff would not be pleased).
On view factor, hmm I think this will just vary over the orbital band. Computing the analytic per-face as F = (1/π)[θE − ½sin(2θE)] with sin(θE) = R⊕/(R⊕+h) I get:
Altitude
F per face
F total
550 km
0.258
0.515
1000 km
0.194
0.388
2000 km
0.118
0.236
Maybe we should go worst case and also initial ODCs would prefer to be on the low end of altitude for as long as slots are available (lower cost to orbit, less radiation) You do I think want to go high enough to avoid occasional shading in dawn-dusk-SSO so perhaps ~675km and up. If we correct the absorptivity for Earth IR and take the low end view factor, I get your 522 W/m2. That looks like a ~1% increase in total cost for ODCs if you’re right.
While checking this though it occurs to me you should be able to be have the radiators edge on to the sun while still radiating from both sides, something like this:
Basically a Starlink v3 with panels at 90 degree pivots. Then with shading from direct sunlight I think I get 650 W/m2 for 675 km altitude, F = 0.473, so an improvement on radiator performance overall. I’ll have to think about this a bit more and potentially update the appendix. Certainly we can fix the erroneous use of α in the 3rd term.
Agree loss from averaging over radiator temp looks modest.
Also agree that scaling the plumbing to a massive modular station architecture looks rough. Also there are issues with stresses/strains due to maneuvers for larger orbital platforms and some structural scaling that has to happen to avoid e.g. floppiness. My guess is that the architecture isn’t viable at least near-term.
Re: inference, not my area of expertise and I don’t think the computer architecture totally decided but from looking into it I think it looks like you’d only be handing off the query and response. The routing should be the same as for traditional satellites so this problem is already ~solved (though you may need to scale the satellite mesh as demand/traffic increase). The orbital compute is in a polar orbit so typically not overhead. The trip in a kind of worst case scenario might look something like this:
User → ground station (let’s say 100 Gbps uplink from ground station)
Ground station → uplink satellite(s) (whichever is in view at the moment, can stream seamlessly as multiple pass overhead)
Intersatellite link hop, routing toward wherever the GPUs are, let’s say there is as yet only one cluster in orbit and it takes 15 hops to reach it, each at ~100 Gbps (Starlink v2)
Arrive at cluster → run inference → return output (this is where the KV cache, session memory etc. stays, in the compute cluster)
ISL hops routing back to ground station (say 15 hops at 100 Gbps again, each is maybe 5.5 ms)
Downlink to ground station → serve output to user
For example I think for a 100 GB workload through a 100 Gbps optical ground station, total time is ~8 seconds serialization/transfer, essentially the same ~8 seconds as terrestrial on 100 Gbps direct connect, plus something like 175 ms of constellation overhead.
Re: terrestrial solar and battery. Good points: these make terrestrial microgrids look a good bit worse. For solar on Earth in addition to the seasonality we’re also assuming some of the best solar sites in the world so this should be fairly bullish for terrestrial data centers. We didn’t spot any fundamental blockers to scaling microgrids through some combo of solar overbuy + battery and gas but prices may be at a premium either for turbines or for batteries as you say. In some sense it seems like the data center buildout may have hyperscalers acting like water flowing down hill, pivoting into whichever buildout channel offers least resistance at the moment. Similarly if ODCs start going up en masse there could be lower lying supply chain issues that emerge. The most biting constraint of all is probably chips and memory.
I dug in a little more, and I think your Earth cooling estimate is high at $2.5–3.0B/GW with water chillers. An NREL study was more like $0.7B/GW with water chillers. Also, we may be able to dispense with the water chiller (as you have assumed in space), and then it could be even cheaper. So I doubt it’s actually going to be cheaper to cool in space. However, your point that cooling in space doesn’t wreck the economics still stands.
If we correct the absorptivity for Earth IR and take the low end view factor, I get your 522 W/m2. That looks like a ~1% increase in total cost for ODCs if you’re right.
I was using 550 km, so I agree that higher up, you would have more net radiation leaving the radiator.
As for your bent configuration, that is creative to avoid the sun incidence. However, then you would have radiation from the solar panels to the radiator, and since the solar panels will be warmer than the Earth, I think it will work out worse overall.
Agree loss from averaging over radiator temp looks.
Hey David, thanks for this excellent comment.
Re: cooling skepticism, actually this has been helpful. On review I think the net rejection will be greater than 633 W/m2. You’re right, we get absorption = ε for longwave radiation from Earth (Kirchhoff would not be pleased).
On view factor, hmm I think this will just vary over the orbital band. Computing the analytic per-face as F = (1/π)[θE − ½sin(2θE)] with sin(θE) = R⊕/(R⊕+h) I get:
Altitude
F per face
F total
550 km
0.258
0.515
1000 km
0.194
0.388
2000 km
0.118
0.236
Maybe we should go worst case and also initial ODCs would prefer to be on the low end of altitude for as long as slots are available (lower cost to orbit, less radiation) You do I think want to go high enough to avoid occasional shading in dawn-dusk-SSO so perhaps ~675km and up. If we correct the absorptivity for Earth IR and take the low end view factor, I get your 522 W/m2. That looks like a ~1% increase in total cost for ODCs if you’re right.
While checking this though it occurs to me you should be able to be have the radiators edge on to the sun while still radiating from both sides, something like this:
Basically a Starlink v3 with panels at 90 degree pivots. Then with shading from direct sunlight I think I get 650 W/m2 for 675 km altitude, F = 0.473, so an improvement on radiator performance overall. I’ll have to think about this a bit more and potentially update the appendix. Certainly we can fix the erroneous use of α in the 3rd term.
Agree loss from averaging over radiator temp looks modest.
Also agree that scaling the plumbing to a massive modular station architecture looks rough. Also there are issues with stresses/strains due to maneuvers for larger orbital platforms and some structural scaling that has to happen to avoid e.g. floppiness. My guess is that the architecture isn’t viable at least near-term.
Re: inference, not my area of expertise and I don’t think the computer architecture totally decided but from looking into it I think it looks like you’d only be handing off the query and response. The routing should be the same as for traditional satellites so this problem is already ~solved (though you may need to scale the satellite mesh as demand/traffic increase). The orbital compute is in a polar orbit so typically not overhead. The trip in a kind of worst case scenario might look something like this:
User → ground station (let’s say 100 Gbps uplink from ground station)
Ground station → uplink satellite(s) (whichever is in view at the moment, can stream seamlessly as multiple pass overhead)
Intersatellite link hop, routing toward wherever the GPUs are, let’s say there is as yet only one cluster in orbit and it takes 15 hops to reach it, each at ~100 Gbps (Starlink v2)
Arrive at cluster → run inference → return output (this is where the KV cache, session memory etc. stays, in the compute cluster)
ISL hops routing back to ground station (say 15 hops at 100 Gbps again, each is maybe 5.5 ms)
Downlink to ground station → serve output to user
For example I think for a 100 GB workload through a 100 Gbps optical ground station, total time is ~8 seconds serialization/transfer, essentially the same ~8 seconds as terrestrial on 100 Gbps direct connect, plus something like 175 ms of constellation overhead.
Re: terrestrial solar and battery. Good points: these make terrestrial microgrids look a good bit worse. For solar on Earth in addition to the seasonality we’re also assuming some of the best solar sites in the world so this should be fairly bullish for terrestrial data centers. We didn’t spot any fundamental blockers to scaling microgrids through some combo of solar overbuy + battery and gas but prices may be at a premium either for turbines or for batteries as you say. In some sense it seems like the data center buildout may have hyperscalers acting like water flowing down hill, pivoting into whichever buildout channel offers least resistance at the moment. Similarly if ODCs start going up en masse there could be lower lying supply chain issues that emerge. The most biting constraint of all is probably chips and memory.
I dug in a little more, and I think your Earth cooling estimate is high at $2.5–3.0B/GW with water chillers. An NREL study was more like $0.7B/GW with water chillers. Also, we may be able to dispense with the water chiller (as you have assumed in space), and then it could be even cheaper. So I doubt it’s actually going to be cheaper to cool in space. However, your point that cooling in space doesn’t wreck the economics still stands.
I’m glad it was helpful!
I was using 550 km, so I agree that higher up, you would have more net radiation leaving the radiator.
As for your bent configuration, that is creative to avoid the sun incidence. However, then you would have radiation from the solar panels to the radiator, and since the solar panels will be warmer than the Earth, I think it will work out worse overall.
Incomplete?
Your other points make sense.