MaxRa comments on Compute Research Questions and Metrics—Transformative AI and Compute [4/4]

MaxRa 9 May 2023 12:57 UTC
2 points
0 ∶ 0
For an NVIDIA A100, the on-board memory bandwidth is around 2GB/s
I think this should be 2TB/s?

And ping!
We are working on a piece with more insights on the utilizations and some advice on how to estimate training compute and the connected utilization of the system (link to be added by the end of 2021; ping me if not).