Research: predict embeddings of next paragraphs to speed up LLMs

Steal this research idea. Hypothesis: it'll speed up *both* training and inference. - Modify next-token prediction task to predicting embeddings of several next paragraphs - This is a harder task, so loss will drop faster - At inference, decode embeddings in parallel