Hello! I am the sole founder of VANTA Research—a bootstrapped AI research project focused building safe and resilient AI models optimized for human-AI collaboration. All of our published work has been made open source thus far, and in roughly 2 months has garnered 60k+ downloads on Hugging Face and Ollama across original model families.
I have several goals with VANTA Research, but among the first major stops is building a large (400B+) open source foundational model from scratch. I love learning, asking hard questions, and a good mystery.
DMs are always open.
Great write up! Thanks for sharing. I’ve been thinking a lot about the double-edged sword of open source models. You make a great point with model providers being able to monitor usage of their products over their API.
A safety layer with open source models does not exist. Once those weights are downloaded, they are out there forever—and people are able to customize them as they see fit. No change in law or policy can retroactively remove those capable LLMs from existence.
Anthropic was fortunate to catch this, but it certainly makes you wonder what’s going on undetected from locally hosted models.