Well, I have to keep my company there, which makes it pretty hard for me...
But you are right that it doesn't seem to hard, so I looked into it some more. I think the main problem would be to prove that you are not living in Sweden (the burden of proof is on you for the first 5 years). It seems that the requirement for not permanently living in Sweden is to permanently live somewhere else - perpetually traveling the world doesn't seem to be enough, you have to prove that you are a resident somewhere else, usually by applying for residence and paying taxes there...
But you are right that it doesn't seem to hard, so I looked into it some more. I think the main problem would be to prove that you are not living in Sweden (the burden of proof is on you for the first 5 years). It seems that the requirement for not permanently living in Sweden is to permanently live somewhere else - perpetually traveling the world doesn't seem to be enough, you have to prove that you are a resident somewhere else, usually by applying for residence and paying taxes there...