Not closely guarding the only means to destroy his source of power was such an obvious plot hole and oversight. ;)