We don't know how technological acceleration will continue into the future. We may start hitting very hard physical/chemical/material limits that make further progress hard, resulting in progress becoming more logarithmic in growth.

Or, there's always the potential for war and decline. Advanced civilizations have risen before, then crumbled and lost a lot of their technology. The same could happen on a larger scale.