AI Solutions Architect

Testlio · AI/ML

Apply
Full TimePosted Aug 30, 2026

Source: Jobicy

AT A GLANCE
Eligibility
Not available
Category
AI/ML
Salary
Not disclosed
Employment
Full Time
Experience
Director
Posted
Aug 30, 2026

This role’s source listing does not include Hungary as an eligible location.

Testlio is hiring a senior AI Solutions Architect to design and deliver AI testing services for enterprise customers, specifically for LLMs and agentic systems. This is a fully remote role open exclusively to U.S. residents.

The AI Solutions Architect will own the definition, packaging, and technical delivery methodology for Testlio's AI testing offerings. The role involves designing evaluation strategies that combine automated frameworks with human-in-the-loop oversight, while collaborating with sales and delivery teams to guide technical strategy and business value for enterprise clients.

Why You’ll Love This Role

100% Remote from USA
Director level seniority
AI testing and LLM evaluation focus
Full-time employment
High-impact consultative role

What You’ll Bring

Deep expertise in AI/ML architectures and software engineering
Proven experience in designing testing strategies for LLMs and RAG systems
Ability to translate complex AI models into measurable quality criteria
Experience in enterprise consulting and client-facing delivery
Strong understanding of autonomous agent workflows and evaluation methodologies

What You’ll Get

Benefits not specified in the listing

About the Company

Testlio is a software testing platform that integrates crowdsourced testers with proprietary technology. Founded by women, the company focuses on delivering quality assurance services for global brands across a wide range of devices and languages.

Listing checked for remote eligibility · Posted Aug 30, 2026 · JobicyApply
EXPLORE MORE
Apply