If I used your software, I would totally fork your project and have a less totalitarian view of the project's leadership. You're free to think you "own" your community, but as Oracle and many other examples have told us, that's not the case and the community will make sure you learn your lesson.
I'm not advocating for anything other than community ownership of projects, only a few formalities. Thinking that everything has to be absolute anarchy in order to be "free" (even that open source's goal has to be to maximise "freedom" over any other kinds of social utility) is a kind of absolutism/idealism that I wish open source communities could leave in high-school where it belongs.
