Patel explains agentic training only needs to sync tokens every few minutes versus weights every seconds in pre-training.
“When you're doing these rollouts and especially as things get more and more agentic and training, you might not only need to send not the entire weights but just the tokens that are relevant.”
Patel says the model was released before pre-training was finished and needs more RL.
“for everything new, more, more continued pre training because the spud, they kind of like didn't finish the pre training and just released it. So finished the pre training, do more RL drop model.”