AI Engineer

AI Engineer – TestSprite (Hybrid, Seattle)

TestSprite is an AI-powered software testing platform that helps teams plan, generate, run, and debug tests automatically — speeding up releases and improving reliability. Our AI engine is the core of everything we do, and we're looking for an AI engineer to push it further: smarter test generation, better debugging, and more reliable automation.

What You'll Do Design and build AI-powered services for test generation, execution, and intelligent debugging. Develop and refine LLM-based pipelines including prompt engineering, agent orchestration, tool use, and evaluation. Build context systems, vector search, and retrieval pipelines that power TestSprite's understanding of user applications. Own projects end-to-end from research and prototyping through implementation and iteration. Optimize AI pipeline performance, latency, cost, and reliability at scale.

What We're Looking For 3+ years of software engineering experience with a strong AI/ML focus. Hands-on experience building LLM-based applications (prompt engineering, agent frameworks, model evaluation). Proficiency in Python; familiarity with TypeScript/Node. Cloud experience required, AWS preferred. Solid understanding of RAG, vector search, tool use, and evaluation frameworks. Experience with embedding models and vector databases (Pinecone, Weaviate, pgvector, etc.).

Nice to Have Experience with agent orchestration frameworks (LangChain, LlamaIndex, CrewAI). Background in developer tools or testing frameworks. Open-source AI/ML contributions. Familiarity with fine-tuning or RLHF.

Why TestSprite Work at the intersection of AI and developer tools. Meaningful ownership, high-agency culture, competitive compensation with equity, benefits, hardware support, and a hybrid schedule in Seattle.

To apply, send your resume and a short intro to hiring@testsprite.com.