Anthropic has the same people who originally made GPT3, so them replicating gpt3 is a different sort of diffusion than others. I’d guess they internally matched gpt3 when they’d existed for ~6 months, so mid 2021. Claude, their public beta model, has similar performance to chatgpt in conversation but is not benchmarked.
Redwood Research has not attempted to train any large language models from scratch, and hasn’t even reproduced gpt-2. Redwood does have employees who’ve worked at OpenAI, and likely could reproduce gpt3 if needed.
Anthropic has the same people who originally made GPT3, so them replicating gpt3 is a different sort of diffusion than others. I’d guess they internally matched gpt3 when they’d existed for ~6 months, so mid 2021. Claude, their public beta model, has similar performance to chatgpt in conversation but is not benchmarked.
Redwood Research has not attempted to train any large language models from scratch, and hasn’t even reproduced gpt-2. Redwood does have employees who’ve worked at OpenAI, and likely could reproduce gpt3 if needed.