They (Meta) literally did do it. They open sourced a GPT-3 clone called OPT. It’s 175-B parameter version is the most powerful LM whose weights are publicly available. I have no idea why they released a system as bad as Blenderbot, but don’t let their worst projects distort your impression of their best projects. They’re 6 months behind Deepmind, not 6 years.
GPT-3 was released June 2020. Meta didn’t release their OPT until May 2022. They did this after open source replications by EleutherAI and others, and after more impressive language models had been released by DeepMind (Gopher, Chinchilla) and Google (PaLM). According to Meta’s own evaluation in Figure 4 of the OPT paper, their model still fails to perform as well as GPT-3.
Meta also recently lost many of their top AI scientists [1]. They disbanded FAIR, their dedicated AI research group, and instead have put all ML and AI researchers on product-focused teams [2].
Meta seems ~2 years behind OpenAI and DeepMind in the AI race. They are prioritizing video games, not AI, as their central focus in the next 5-10 years. Zuckerberg must have longer timelines than many other people, or else he’d be jumping on this economic opportunity. As best I can tell, OpenAI, DeepMind, and Google Brain are head and shoulders above any other non-Chinese competition and are therefore responsible for the ongoing race to AGI.
They (Meta) literally did do it. They open sourced a GPT-3 clone called OPT. It’s 175-B parameter version is the most powerful LM whose weights are publicly available. I have no idea why they released a system as bad as Blenderbot, but don’t let their worst projects distort your impression of their best projects. They’re 6 months behind Deepmind, not 6 years.
GPT-3 was released June 2020. Meta didn’t release their OPT until May 2022. They did this after open source replications by EleutherAI and others, and after more impressive language models had been released by DeepMind (Gopher, Chinchilla) and Google (PaLM). According to Meta’s own evaluation in Figure 4 of the OPT paper, their model still fails to perform as well as GPT-3.
Meta also recently lost many of their top AI scientists [1]. They disbanded FAIR, their dedicated AI research group, and instead have put all ML and AI researchers on product-focused teams [2].
Meta seems ~2 years behind OpenAI and DeepMind in the AI race. They are prioritizing video games, not AI, as their central focus in the next 5-10 years. Zuckerberg must have longer timelines than many other people, or else he’d be jumping on this economic opportunity. As best I can tell, OpenAI, DeepMind, and Google Brain are head and shoulders above any other non-Chinese competition and are therefore responsible for the ongoing race to AGI.
[1] https://www.cnbc.com/amp/2022/04/01/metas-ai-lab-loses-some-key-people.html
[2] https://aibusiness.com/document.asp?doc_id=778013