The model was trained on a dataset more than 100 times larger than the already record-breaking amount of text that informed the previous version, gpt-2. The results of experiments outlined in the study show big improvements to the ai’s algorithm.
Read more…