then Facebook's roberta came out which beat xlnet and is essentially a more intelligently trained. I included XLNet as being a bc descendant of BERT, but I guess they are all descendants of GPT1