I agree with you. The way things are setup now, religion gets all sorts of special dispensations. To do this, government has to determine what is a real religion and what is not, which sounds to me like it goes directly against the separation between church and state. Religion should be treated the same as any other belief structure.
I realize this doesn’t apply directly to taxation but we defer to religion in multiple ways in the law.