Because humans can only observe the universe from Earth's point of view, our perception is that we are in the middle of the cosmos. Yet we are only in the middle of what we can observe from our point of view at any angle. As you said, we can only observe so far in either direction or any direction as it were.