Looks like after the OpenAI deal went south, Microsoft wants to "train" their own LLM by distilling the interactions with the other models. This may be a genuine desire for RL maybe but definitely not applicable for individual developers or even small shops. "Learning" can definitely happen in token space.
Looks like after the OpenAI deal went south, Microsoft wants to "train" their own LLM by distilling the interactions with the other models. This may be a genuine desire for RL maybe but definitely not applicable for individual developers or even small shops. "Learning" can definitely happen in token space.
https://xcancel.com/i/article/2076323181154230284
[dead]