Is this kind of like the fact that there really is no “present”.

You are either anticipating it(future) or looking back on it (past).