Of course you could afford an apartment, or even a house! You just don't want to move there.

I don't judge you - I also live in a VHCOL area and my wife wouldn't even want to move 30km where the housing prices are half of where we are now. Such is live.

But saying you couldn't afford it is false - you can't afford it where you'd want to live, is more accurate.