Sebastian Buck on Training

“They used O3 to craft high quality synthetic curriculum and synthetic data to teach GPT five very complex topics… converting into something that was more effective at training in a way that human generated data wouldn’t be able to teach it effectively.”