I’ll point out the obvious that this is entirely based on perspective. An individual whose dominant mode of transportation is not driving would probably disagree.
Edinburgh doesn't enforce its 20mph zones, I follow them anyway. And I don't believe I actually make progress through the city any less quickly than drivers who speed, because it's rare that I'm not in any case sitting behind the speeders at the next red light.
Arterial roads are normally still 30mph, and it's not a huge city so it doesn't take that long to get from the outskirts to the centre. Or when it does, it's not because of low speed limits.
I'd love for my city to just focus on making other forms of transportation more appealing. More bus lanes, more (properly designed) bike lanes, etc.