
Sr. Software Engineer II - AI
iHerbJob Summary:
The Sr. Software Engineer II - AI will lead the build of GenAI-powered product experiences and the shared AI platform infrastructure that powers them. This includes RAG pipelines over the iHerb catalog and customer reviews, LLM-driven personalization, a conversational Wellness Agent, agentic workflow systems, and the evals and MLOps layer that makes AI features production-grade and repeatable. Specializations within this track include: RAG and personalization, agent framework and tool use, evals and guardrails, and LLM application development for internal business functions such as marketing automation and BI agents.
Job Expectations:
-
Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation.
-
Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability.
-
Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces.
-
Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data.
-
Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code.
-
Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals.
-
Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base.
-
Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents.
The duties and responsibilities described above may provide only a partial description of this position. This is not an exhaustive list of all aspects of the job. Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice.
Knowledge, Skills and Abilities:
Required:
-
AI-driven SDLC : hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor. The bar is not awareness; it is daily use in delivering real software.
-
Full-stack awareness: comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profile.
-
Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff.
-
Code quality fundamentals: strong grasp of soft
Opens the company's application page
Listed via
Jobicy
jobicy.com
Similar roles
Design & Tech
Related reads from TCHNX

The Quiet Revolution in Local-First Software
As major platforms face outages and data breaches, a new generation of developers is building applications that prioritise local data storage and peer-to-peer sync, challenging the cloud-first orthodoxy that's dominated tech for two decades.

The Quiet Revolution in Edge AI: Why Your Next Computer Might Not Need the Cloud
As neural processing units become standard in consumer devices, we're witnessing a fundamental shift in how AI applications work. Local processing is no longer a fallback; it's becoming the preferred architecture.

The Rise of AI-Assisted Code Generation 2: Are Developers Becoming Prompt Engineers?
As AI coding assistants reshape software development, the industry grapples with a fundamental question: is writing code giving way to writing prompts? We examine how London's tech scene is adapting to this seismic shift.
