"Sorry, {excuse}" seems to work best for me. Not all cultures are good with a straight no. Sometimes the excuse is just "I had a long day."