Honestly I think I can do a decent postmortem of everything which went wrong with 5: 1. Two and a half years ago, long before they had any idea what it would look like, they were hyping 5. 2. They trained Orion as 5, expecting big benefits from scaling pretraining, but (1/x)
733,27K