> FP16 is faster (units are images per second)

But does model get quality hit: need to train for more steps before converging to the similar performance and have more parameters?

FM16 obviously contains less information than FP32.