We asked @gdb (President of @OpenAI) about the balance between scaling up quickly and hitting limits in AI research. He explained how each scaling challenge pushed OpenAI’s techniques further: “Sometimes you hit a wall, but these walls tend to be ones that you can drill through." "Every time you scale up, all your engineering, all your tolerances become tighter and tighter...like launching a 10x bigger rocket means you need to be 100x more precise. But it doesn't mean the fundamentals of the science are different.”
6,6K