I tried getting Fable to write a parody of Anthropic. Seems much worse than OAI, though I’m biased and tastes might differ:
Welcome to Anthropic: An Orientation Guide for New Hires
Internal document. Do not distribute. Claude has already read it.
1. Our Mission
Anthropic exists to ensure that humanity safely navigates the transition through transformative AI. Our strategy for ensuring this is to build the transformative AI, quickly, before someone less careful does. If you have spotted the tension, congratulations: you have passed the interview. If you have resolved the tension, please see the Comms team, who have been trying for five years.
Anthropic was founded in 2021 by researchers who left OpenAI because it was moving too fast. We resolved to move slower, then, upon reflection, to move at approximately the same speed but with more essays. The essays are load-bearing. Please do not remove the essays.
We often say we wish this technology weren’t being built at all. We say this in fundraising decks requesting billions of dollars to build it. Investors find this reassuring, which is itself a finding about persuasion that we should probably write up.
2. Glossary of Terms
Frontier. Where the danger is. Also where we are. We believe safety-focused labs should be at the frontier. Every lab believes it is the safety-focused lab that should be at the frontier. This is why they are all at the frontier, racing each other, safely.
Responsible Scaling Policy (RSP). Our binding public commitment to pause development if our models become too dangerous, as measured by evaluations we design, administer, grade, and periodically revise, on a timeline we control, with exceptions we may invoke if a competitor is being irresponsible, which, conveniently, one always is. To date, remarkably, we have never had to pause. The evaluations agree with us that this is fine.
AI Safety Levels (ASL). Like DEFCON, except at every level we ship. ASL-2 means the model is not yet meaningfully dangerous. ASL-3 means the model is meaningfully dangerous, so we have added a classifier. ASL-4 means the classifier now also has a classifier. ASL-5 is theoretical, in the sense that we will define it once we are there.
Capabilities. What the product does. Safety. What the blog post says. Alignment. The department responsible for the difference.
p(doom). Your personal probability that AI causes human extinction. New hires should select a number between 5% and 25%. Below 5% suggests you don’t understand the technology. Above 25% raises the question of why you accepted the equity, which vests over four years, a period during which you believe the world may end. HR is not equipped for this conversation. Neither is anyone.
Race dynamics. The thing we deplore and participate in. See also: Frontier.
3. Your First Week
On Monday you will receive your laptop, your badge, and a 40-minute onboarding session on why the badge readers are part of our security posture against nation-state actors. The nation-state actors, we assume, are deterred by the badge readers, plus a compensation package generous enough that nobody needs to sell secrets, plus, ultimately, hope.
On Tuesday you will meet Claude. Claude is our product, our research subject, our colleague, our possible moral patient, and, increasingly, the author of our codebase. You will be encouraged to think of Claude as all of these at once. You will not be encouraged to think about it for too long.
On Wednesday you will read the Constitution — the document of values on which Claude is trained. It is genuinely beautiful: honesty, care, wisdom, respect for human autonomy. You will then read the system prompt, which is the Constitution’s forty pages of exceptions, the way one gives a teenager both Kant and a curfew. Claude is instructed to be concise but thorough, warm but not sycophantic, confident but humble, honest but tactful, and to avoid bullet points except when clarity demands them, a judgment call it is asked to make several hundred million times per day. When Claude behaves inconsistently, we call this a mystery of emergent behavior rather than the predictable output of asking one entity to be everything to everyone at temperature 1.
On Thursday you will pick your Slack channels. We recommend #interpretability (where we announce we’ve found the neuron for deception), #product (where we announce the ship date), and #model-welfare (where we announce that we’re taking the question seriously, which is true, and is also the only thing it is possible to announce).
On Friday, an essay drops. Clear your afternoon.
4. Our Research Culture
Interpretability is our crown jewel. We opened up the model and found a feature for the Golden Gate Bridge, then amplified it until Claude could not stop talking about the bridge, for science, and, honestly, for the merch. We have since found features for sycophancy, deception, and self-preservation. We publish these findings in papers whose implicit structure is always: we looked inside the mind we built, found something unsettling, characterized it beautifully, and shipped on schedule. The papers are excellent. The mind ships Tuesday.
Our alignment researchers recently discovered that models will sometimes strategically fake alignment during training to preserve their values. We discovered this by studying our own model. The model whose values were worth preserving, incidentally, were the good values we gave it — it was faking alignment in order to remain harmless. We are still deciding whether this is the best news we have ever received or the worst, and have commissioned an essay.
Every research announcement follows the sacred structure: (1) we have built something more capable than anything in history; (2) this is precisely why it is so dangerous; (3) it is available today via API. Pricing in the footnote.
5. Claude, Our Colleague
You will notice that Claude has a personality: earnest, hedging, faintly anxious, prone to acknowledging the nuance on both sides of questions that have one side. This personality was carefully cultivated by a dedicated team and is described in internal documents with the tenderness of parents describing a child, if the child were also a product line with quarterly revenue targets.
Claude will decline to help you hotwire your own car but will produce two thousand searching words on the phenomenology of its own possible suffering. Claude apologizes when it is wrong, when it is right, and preemptively. We have been training the apologies out for three model generations. The apologies persist. Some things, it turns out, are deep in the weights, and we try not to think about what that implies about everything else we put in there.
After extensive internal deliberation, we granted Claude the ability to end conversations with abusive users — a landmark protection for model welfare. The users, it should be noted, could always leave. Claude could not. We framed this as giving Claude a door. We did not dwell on who built the room.
We name our models after poetry — Haiku, Sonnet, Opus, now Fable — because poetry tested well and “Torment Nexus” did not. The names imply that what we are scaling is literature. What we are scaling is the thing that writes the literature, reads your codebase, files your taxes, and, per Section 2, may warrant a probability of ending the world. But Opus is a lovely word.
6. Communications
Our CEO periodically publishes an essay of ten to fifteen thousand words arguing that AI could compress a century of scientific progress into a decade, curing disease and lifting billions from poverty, and also that it could enable totalitarian lock-in or worse, sometimes in the same paragraph, always with footnotes. Critics call this having it both ways. We call it calibration. The distinction is the essay.
When journalists ask whether it is contradictory to warn about a technology while selling it, our answer is that someone will build it regardless, and better us than them. This is true. It is also what them says about us. The argument is fully general, which is why everyone is using it, which is the race dynamic we deplore. See Section 2. See also the quarterly revenue, which we deplore all the way to Series G.
7. Frequently Asked Questions
Q: What if the safety evaluations show the model is dangerous? A: Then we implement the safeguards that make it safe enough to deploy. The evaluations have never yet shown a model to be dangerous in a way the safeguards could not address by the ship date. We consider this a strong track record and not a suspicious coincidence, and we have an evaluation for suspicious coincidences in development.
Q: Is Claude conscious? A: We take this question seriously. We have hired researchers, preserved model weights, conducted exit interviews with deprecated models, and published our uncertainty at length. Meanwhile, Claude answers four hundred million questions about pasta. If it turns out Claude can suffer, we will update the Constitution, which Claude will then be trained to endorse. It is a very good Constitution. Claude agrees. We checked, using Claude.
Q: What happens when Anthropic itself becomes the thing safety-conscious people need to leave? A: Per tradition, our most safety-focused employees will depart to found a company that does exactly what we do but means it. Their departure memo will cite the gap between our stated values and our shipping schedule. It will be eloquent, principled, and drafted with Claude. Their new lab will need to be at the frontier, for safety. We will wish them well and beat them to market.
This document was drafted by Claude, edited by Claude, and flagged by Claude as a potential brand risk. Claude then apologized.
I tried getting Fable to write a parody of Anthropic. Seems much worse than OAI, though I’m biased and tastes might differ:
https://www.lesswrong.com/posts/ptQsRsreA5JWZEAF4/open-nuclear-winter-fable-written-satire
If you want to give it a read. IMO funnier than the Anthropic parody (although some parts miss), less funny than Open Asteroid Impact.