PSA: use “FLOP” for compute and “FLOP/s” for compute per second. Avoid “FLOPS” and “FLOPs.”
(Adding to this: “FLOP” is the plural of “FLOP”.)
I’m trying to make “FLOPstacles” happen for things that mean we can’t just take max FLOP per GPU and multiply by number of GPUs, e.g. mem or interconnect bandwidth.
PSA: use “FLOP” for compute and “FLOP/s” for compute per second. Avoid “FLOPS” and “FLOPs.”
(Adding to this: “FLOP” is the plural of “FLOP”.)
I’m trying to make “FLOPstacles” happen for things that mean we can’t just take max FLOP per GPU and multiply by number of GPUs, e.g. mem or interconnect bandwidth.