Thanks! Interested in getting more stats on global GPU/TPU capacity (there seems to be a dearth of good stats available). In your AI Impacts report, you mention paywalled reports. How much are they to access? (DM me and I can pay).
Epoch AI estimate that GPT-4 costs only $40M (not sure if that is today’s price, with cost improvements since last year?)
100x the compute used for it might be the equivalent of more than 1% of the world’s existing GPU/TPU computing capacity for 2 months.
1% seems well within reach for the biggest players :(
Thanks! Interested in getting more stats on global GPU/TPU capacity (there seems to be a dearth of good stats available). In your AI Impacts report, you mention paywalled reports. How much are they to access? (DM me and I can pay).
Epoch AI estimate that GPT-4 costs only $40M (not sure if that is today’s price, with cost improvements since last year?)
1% seems well within reach for the biggest players :(