I'm not OP but maybe it's the same: attraction to men gets developed before sexual differentiation then gets (inaccurately) overwritten later?