Speaking of GPT2, I remember that nobody gave a shit what it was trained on, because it sucked then.