I used to feel this way, too - and I live in Belltown - but over the years the random stabbings have added up, like the couple killed after a Sounder's game a while back, of the 3 random people stabbed a few days ago outside Nordstrom... it's scary, but not in the "late night walking alone" way.
Agree it's a relatively safe place for sure.