Even further, the big names in software engineering will likely figure out how to use these models far more effectively than any old engineer.

Fabrice Bellard is utilizing transformer models for lossless compression, for example: https://bellard.org/nncp/