It doesn’t add value for most applications for service providers.

TOTP for GMail assures Google that the same person who enrolled the account was given custody of a key.

The physical token only adds value in scenarios where phones aren’t available or you need to assure the identity of the individual.