Wasn't this rule made up by someone in the 18th century because he thought it sounded better [1]? Therefore, it's not even more correct to say fewer rather than less. The only reason to care about it is to stop people trying to correct your language usage.

[1] e.g. https://english.stackexchange.com/questions/495/less-vs-fewe...