I cannot judge his research output at Meta but he failed pretty bad at the LLM race. Since so many other organizations succeeded at creating open source models of far higher quality at much lower cost, it would be instructive to understand what exactly went wrong there.
Kind of hilarious to me to consider him "failing" with LLMs. Given his remit was a research time horizon of 8-10 years, and the fact that he's gone on record saying that he expects the technology will stall out in the time horizon, it seems he can only take Ws and ties. Indirect influence on open-sourcing the models to propel research forward (which is pretty important for a chief scientist) which added benefit for Meta's other products.
What? Until the Chinese jumped in Llama was the premium open source model. The reason that the Chinese were successful at MOE was just that they were limited with chips and had to think outside the box. US labs are operating on the power law. They also, arguably, distilled from western models (llama).
Was he even involved in this?
(I forgot sims).
Besides I wonder what does a company, whose entire product lineup revolves around looking cool and successful and admired in front of strangers with a product whose main mode of usage involves blindly flailing around in a room with a plastic box stripped to your face.
Was this written in earnest or as an ironic/facetious joke?
