In one of my previous lives I built an encoding platform for all the major record labels. Part of this involved listening to hundreds of tracks to try and optimize the encoder settings. It's not necessarily the quality of the original recording, but simply the type of audio. For instance, the absolute hardest, IMO, were "unplugged" albums, e.g. solo singer, acoustic guitar. Lossy compression would shit itself on those.