Senior Software Engineer Ii 3085523 I.Html

Owning agent quality end-to-end, the remote Senior Software Engineer II will diagnose, improve, and validate SmartAssist's orchestrator and subagents while driving quality enhancements through prompt and context engineering.

##### Key responsibilities

Identify and prioritize failure modes across various quality dimensions, including factual accuracy and latency

Drive quality improvements through the development of evaluation frameworks and methodologies

Collaborate with cross-functional teams to ensure measurable quality signals for every change implemented

##### Required qualifications

8+ years of software engineering experience, with at least 2 years working directly with LLMs in production

Deep experience with prompt and context engineering, understanding model behavior changes

Strong knowledge of RAG architectures and experience building LLM evaluation frameworks

Fluency in agent system design and strong Python skills in data-heavy environments

BS or MS in Computer Science, a related field, or equivalent industry experience