“Training Efficiency With Structured Data”

Apparently, with comparatively smaller training data compared to the likes of ChatGPT, we can obtain good models using textbook-like training data. The key is that textbooks are structured and using such data to train makes it easier for the model to learn.