This is why I sigh really hard when people talk about some measurement of FLOPS per second, as if it's the only thing that matters.

It matters. Perhaps it matters a lot for specific workloads. But most general workloads are integer-based.