All roles

Open role

Prompt Engineer, Agent Prompts & Evals

Remote · Finland Full-time

About the position About Anthropic Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the Role

We’re looking for prompt and context engineers to join our product engineering team to help build AI-first products, features, and evaluations. Your mission will be to bridge the gap between model capabilities and real product experience, working with product teams to build consistent, safe, and beneficial user experiences across all product surfaces. You will be deeply involved in new product feature and model releases at Anthropic, combining engineering expertise with an understanding of frontier AI applications and model quality. You’ll become an expert on Claude’s behavioral quirks and capabilities and apply that knowledge to deliver the best possible user experience across models and domains. You’ll be the first resource for product teams working on Claude’s AI infrastructure: system prompts, tool prompts, skills, and evaluations. This role requires someone who can effectively balance caring deeply about making Claude the best it can be while also supporting a wide variety of concurrent projects and efforts across many product teams.

Responsibilities

  • Prompt Engineering Excellence: Design, test, and optimize system prompts and feature-specific prompts that shape Claude’s behavior across consumer and API products.
  • Evaluation Development: Build and maintain comprehensive evaluation suites that ensure model quality and consistency across product launches and updates.
  • Cross-functional Collaboration: Partner closely with product teams, research teams, and safeguards to ensure new features meet quality and safety standards.
  • Model Launch Support: Play a critical role in model releases, ensuring smooth rollouts and catching regressions before they impact users.
  • Infrastructure Contribution: Help build and improve the frameworks and tools that allow teams to develop and test prompts and features with confidence.
  • Knowledge Transfer: Mentor product engineers on prompt engineering best practices and help teams build their first evaluations.
  • Rapid Iteration: Work in a fast-paced environment where model capabilities advance daily, requiring quick adaptation and creative problem-solving.

Requirements

  • 5+ years of software engineering experience with Python or similar languages.
  • Demonstrated experience with LLMs and prompt engineering (through work, research, or significant personal projects).
  • Strong understanding of evaluation methodologies and metrics for AI systems.
  • Excellent written and verbal communication skills – you’ll need to explain complex model behaviors to diverse stakeholders.
  • Ability to manage multiple concurrent projects and prioritize effectively.
  • Experience with version control, CI/CD, and modern software development practices.
  • We require at least a Bachelor's degree in a related field or equivalent experience.

Nice-to-haves

  • Experience with Claude or other frontier AI models in production settings.
  • Background in machine learning, NLP, or related fields.
  • Experience with A/B testing and experimentation frameworks (e.g. Statsig).
  • Familiarity with AI safety and alignment considerations.
  • Experience building tools and infrastructure for ML/AI workflows.
  • Track record of improving AI system performance through systematic evaluation and iteration.

Benefits

  • We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.

Apply To this Job

More open positions

Computer Vision Engineer | $90/hr Remote

Work from home Full-time role

Computer Vision Engineer (R&D) - Remote

Work from home Full-time role

Need for a Real-time Computer Vision Engineer | reputed company

Work from home Full-time role

Computer Vision Research Scientist - Remote/Hybrid - 127814

Work from home Full-time role

Software Engineer (Computer Vision) TS/SCI with Poly)

Work from home Full-time role

Strategist & Early Education Specialist

Work from home Full-time role

Waygate Visual Key Account Manager

Work from home Full-time role

Senior Procurement Manager - Spanish Speaking

Work from home Full-time role

Registered Nurse, Clinical Delivery – Remote, US

Work from home Full-time role

[Remote] Digital Marketing Manager

Work from home Full-time role

Entry-Level Remote Website Chat Support Agent – $25-$35/hr Flexible Hours & Full Training Provided

Work from home Full-time role

Experienced Patient Records Data Entry Specialist – Remote Opportunity with careerzynith

Work from home Full-time role

Join Our Massive Hiring Initiative: 2,000 Virtual Customer Service Professionals Wanted — Work From Home, Set Your Own Schedule at careerzynith

Work from home Full-time role

Senior AWS Cloud Engineer

Work from home Full-time role

Pharmacy Tech Support / Call Center Rep (Work from Home)

Work from home Full-time role

Recruiting Coordinator (Temp/Part-time) – Remote, United States

Work from home Full-time role

Entry-Level Remote Customer Support Associate – Client Success & Issue Resolution at careerzynith

Work from home Full-time role

Staff Software Engineer - Databases SRE | Ireland | Remote

Work from home Full-time role

Remote Customer Support & Sales Specialist – Entry-Level Opportunity with Comprehensive Training, Flexible Schedule, and Union Benefits

Work from home Full-time role

[Remote] Principal Software Engineer (Nashville, TN)

Work from home Full-time role

Senior Full-Stack Software Engineer — Solar Design Tools

Work from home Full-time role