You don't need to have a lawyer on retainer, but you should probably at least have the name and phone number of one you could call in a pinch. Most law-abiding folks aren't going to see that moment coming, so having a phone number handy could make it a lot less stressful. And in a case like this, it will show the apparatchik at your door that you're not going to be an easy pushover.