[Remote] Staff AI Operations Engineer / Builder

Note: The job is a remote job and is open to candidates in USA. Yahoo is a leading consumer email platform with over 200 million monthly users, currently undergoing a transformation to become AI-native. They are seeking a Staff AI Operations Engineer to architect and implement AI-driven operational systems that enhance productivity and streamline workflows across the organization.

Responsibilities

• Architect and deploy full-stack internal AI products, from secure backend LLM integrations and agentic workflow orchestration to responsive frontend operating interfaces
• Define the foundational engineering patterns, guardrails, and platform architectures for reliability, data permissions, enterprise privacy, and observability across all internal AI systems
• Establish automated LLM evaluation (Evals), output validation frameworks, and human-in-the-loop validation flows to proactively mitigate inaccuracies or hallucinations in operational systems
• Incorporate state-of-the-art developer frameworks—including AWS Bedrock, Vertex AI, and advanced orchestration patterns—to abstract operational workflows into reusable API layers
• Design, deploy, and continuously optimize multi-agent orchestrations and retrieval-augmented generation (RAG) pipelines that ingest contextual product metadata to synthesize real-time business context
• Collaborate horizontally with Product, Engineering, Design, and Executive leadership to map physical organizational processes into autonomous workflows, serving as the technical authority on internal AI capabilities
• Mentor and uplevel adjacent engineering, product, and operational squads on prompt engineering, structured LLM interactions, and automated workflow adoption
• Turn highly ambiguous, fragmented data sources (e.g., Jira trackers, Google Workspace documents, analytics dashboards) into structured, queryable knowledge networks

Skills

• 8+ years of software engineering, product management, technical systems-building, or platform architecture experience with a focus on full-stack application development
• Professional experience designing, implementing, and evaluating LLM-backed applications, multi-agent frameworks, RAG architectures, or automated internal operations systems
• Deep familiarity with production-grade AI development platforms (e.g., AWS Bedrock, Vertex AI) and modern coding assistants (e.g., Cursor, Claude Code) to accelerate software delivery cycles
• Demonstrated experience building custom API integrations with enterprise platforms (such as Jira, Confluence, and Google Workspace) to automate manual processes
• High-agency ownership with a proven track record of delivering architectural strategy and shipping complex, operational platforms in highly ambiguous environments
• Strong proficiency in modern software engineering stacks, including Python, TypeScript, React, Node.js, and relational/non-relational data systems
• Excellent written and verbal communication skills, with experience presenting complex technical architectures directly to senior stakeholders
• Experience deploying and tuning open-source agentic frameworks or managing large-scale internal copilot environments
• Experience in Product Operations, Business Operations, Strategy, or Technical Program Management within high-scale consumer tech organizations
• Strong background in cloud infrastructure, data pipelining (SQL, ETL processes), and secure enterprise access control management
• Commitment to continuous learning, technological experimentation, and optimizing organizational systems through automation

Benefits

• Incentive compensation opportunities in the form of discretionary annual bonus or commissions
• Healthcare
• A great 401k
• Backup childcare
• Education stipends
• Flexible hybrid work options that our employees love
• 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome

Company Overview

Company H1B Sponsorship