Software Engineer

Who you are

• Have 4+ years of experience as a software engineer, with meaningful time spent building internal tools, operations platforms, or back-office products
• Are comfortable using agentic coding tools (e.g. Claude Code) as a core part of your workflow, and can direct them to ship well-tested, production-quality software at a high cadence without lowering the bar (our stack is mostly React/TypeScript and Python)
• Take a product-minded approach to internal users: you work with the people using your tools, watch where they struggle, and fix it
• Are results-oriented, with a bias towards flexibility and impact
• Pick up slack, even if it goes outside your job description
• Communicate clearly with non-engineering stakeholders and can explain technical trade-offs to operations and policy partners
• Care about the societal impacts of your work and want to apply your engineering skills directly to AI safety
• Have built tooling in a trust & safety, content moderation, fraud, integrity, or risk-operations setting
• Have experience designing case-management or workflow systems (queues, SLAs, escalation paths, audit logs)
• Have worked with sensitive data and understand the privacy, access-control, and reviewer-wellbeing considerations that come with it
• Have experience with GCP/AWS, Postgres/BigQuery, and CI/CD in a production environment
• Have used LLMs as a building block inside operational tools (e.g. assisted triage, summarisation, or classification in the review loop)
• Candidates need not have 100% of the skills listed above, Prior experience in AI or machine learning or Formal certifications or education credentials
• Minimum education: Bachelor’s degree or an equivalent combination of education, training, and/or experience
• Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
• Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
• We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed.

What the job involves

• The Safeguards team is responsible for the systems that detect, review, and act on misuse of Anthropic's models — work that sits at the very centre of our mission to develop AI safely
• Within Safeguards, the Foundations team builds the platforms, infrastructure, and internal tools that the rest of the organisation depends on to do this well
• We are looking for a software engineer to own and extend the internal tooling that powers human review — the case management, labelling, investigation, and enforcement interfaces our analysts and policy specialists use every day
• These are back-office tools, but they are anything but low-stakes: the speed, clarity, and reliability of this tooling directly determines how quickly Anthropic can identify harmful behaviour, make sound enforcement decisions, and feed signal back into model training
• You'll work closely with Trust & Safety operations, policy, and detection-engineering teams to turn messy operational workflows into well-designed, durable software
• This is a hands-on, full-stack role for someone who enjoys building products for internal users, sweats the details of usability and correctness, and wants their engineering work to have a clear line to real-world safety outcomes
• Design, build, and maintain the internal review and enforcement tooling used by Safeguards analysts — including case queues, content review surfaces, decision/audit logging, and account-actioning workflows
• Understand user workflows and establish tooling for well processes that may be distributed across a number of tools and UIs
• Develop the ‘base layer’ of reusable APIs, data storage, and backend services that let new review workflows be stood up quickly and safely
• Partner with operations and policy teams to understand reviewer pain points, then translate them into clear product improvements that reduce handling time and decision error
• Integrate tooling with upstream detection systems and downstream enforcement infrastructure so that flagged behaviour flows cleanly from signal → human review → action
• Build in the guardrails that sensitive internal tools require: granular permissions, audit trails, data-access controls, and reviewer wellbeing features (e.g. content blurring, exposure limits)
• Instrument the tools you ship — surfacing metrics on queue health, reviewer throughput, and decision quality so the team can see what's working
• Contribute to the Foundations team's shared platform and on-call responsibilities

The application process

• Deadline to apply: None. Applications will be reviewed on a rolling basis

Benefits

• Comprehensive health, dental, and vision insurance for you and your dependents
• Inclusive fertility benefits via Carrot Fertility
• Generous subsidy for OneMedical
• 21 weeks of paid parental leave
• Unlimited PTO
• Optional equity donation matching at a 3:1 ratio, up to 50% of your equity grant
• 401(k) plan with 4% matching
• $500/month flexible wellness stipend
• Commuter coverage
• Annual education stipend
• A home office improvement stipend when you first join
• Relocation support for those moving to the Bay Area