Staff AI Product Analyst

About the role

The Staff AI Product Analyst will define AI-native product analytics for Angi, turning visionary technology into prioritized use cases, robust evaluation disciplines, and a trusted data ecosystem. This role is central to building Angi’s agentic product analytics capability by designing evaluation frameworks and establishing system standards. As a senior individual contributor, you will influence the product analytics function to ensure human teams and AI agents remain aligned on quality and usefulness.

Responsibilities

• Partner with AI product, engineering, and domain experts to define north-star and guardrail metrics for flagship AI journeys.
• Align with data science partners on test design, interpretation, and causal framing for new AI products.
• Map agent interactions with metrics, tables, and APIs to ensure data requirements are structured and testable.
• Design and maintain formal evaluation sets, golden datasets, rubrics, and regression checks for agent outputs.
• Systematically categorize failure modes and feed insights back into prompts, retrieval, and data modeling pipelines.
• Monitor live usage of agentic AI analytics workflows to maintain a prioritized engineering improvement backlog.
• Own internal documentation and playbooks defining agent usage and human checkpoints.

Required skills

• Python
• ML frameworks
• Product analytics
• Data science
• Technical product management
• AI/LLM systems
• Data governance
• Data visualization

Nice to have

• Agentic analytics workflows
• Orchestration frameworks
• Multi-agent systems

Qualifications

• Bachelor's degree in Computer Science, Statistics, Mathematics, or a related quantitative field
• 10+ years of experience in product analytics, data science, or technical product management
• 1+ years of direct experience working with AI/LLM systems in an applied context

Benefits

• Performance bonus
• Equity package
• Medical insurance
• Dental insurance
• Vision insurance
• Flexible vacation policy
• Pet discount plans
• 401K with company match

About the Company

Angi has powered the home services industry for over 30 years, creating a platform that connects homeowners with skilled pros. Founded in 1995 as Angie’s List, the company operates 9 brands in 8 countries with employees worldwide.