https://arxiv.org/pdf/2303.08774v3.pdf#page=64 This is a technical report about GPT-4, on page 64 it details a process they use for self improvement in training. It generates training data by itself super cool. Credit to Vladimir_Nesov from LessWrong who linked and mentioned this in a discussion, interesting stuff.
https://arxiv.org/pdf/2303.08774v3.pdf#page=64
This is a technical report about GPT-4, on page 64 it details a process they use for self improvement in training. It generates training data by itself super cool.
Credit to Vladimir_Nesov from LessWrong who linked and mentioned this in a discussion, interesting stuff.