I look at LLMs with an engineering mindset. It is an intelligence black box that goes in a tool box with the old classical algorithms and frameworks. In order to use it in a solution I need to figure out:

1) Whether I can give it information in a compatible and cost effective way

2) Whether the model is likely to to produce useful output

I have use language models for years before LLMs such as part of speech classifiers in the Python NLTK framework.