If Transformers were able to learn in such a trivial fashion, we would already have AGI.

There is at least one missing piece to the puzzle, and some say 5-6 more breakthrough are necessary.