What happens when your first and only Yubikey gets dropped in a puddle? You're also back to paper and backup codes.
It's not magic, there isn't any other way.