Senior Software Development Engineer In Test, ML/AI
United States, San Mateo, CA Hybrid
Salary not listedJobFig found this opening at its original source and checks that it remains available.
About the role
We are hiring a Sr Software Engineer in Test specializing in ML/AI quality, including automation for model evaluation, LLM-assisted test generation, and validation of AI-powered workflows. The role includes guiding quality strategy and developing automation frameworks. You will also manage implementation for complex, cross-functional, machine learning-powered products and services. This role involves more than test development. You will lead quality initiatives from start to finish, ensuring teams stay synchronized, dependencies are managed, and releases are delivered confidently. You will work closely with ML, engineering, product, and infrastructure teams. You will shape how quality is built, monitored, and expanded while leading embedded QE efforts within projects. This role also may be eligible for a bonus package. Click here to learn more. The estimated base pay range for this role is listed below. We are hiring a Sr Software Engineer in Test specializing in ML/AI quality, including automation for model evaluation, LLM-assisted test generation, and validation of AI-powered workflows. You will also manage implementation for complex, cross-functional, machine learning-powered products and services. This role involves more than test development. You will lead quality initiatives from start to finish, ensuring teams stay synchronized, dependencies are managed, and releases are delivered confidently.
What you'll bring
- Bachelor’s degree in Computer Science or equivalent
- 5+ years of experience as an SDET or QE engineer focused on backend and distributed systems.
- Experience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences.
- Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows.
- Strong experience testing RESTful APIs, microservices, and distributed architectures.
- Proficiency in Python, Java, JS or similar languages for automation development.
- Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium.
- Experience with CI/CD systems and test pipelines (Jenkins, GitHub Actions, etc.).
- Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker).
- Familiarity with databases, monitoring, and observability tools.
- Strong understanding of SDLC, Agile methodologies, and release processes.
- Excellent problem-solving, debugging, and communication skills.