Business Data Analyst - AI, Redmond, WA

Kforce has a client that is seeking a Business Data Analyst - AI in Redmond, WA. Overview: We are seeking a Senior Business Data Analyst/Product Owner with product experience to support and optimize an AI-powered Brand Agent, a conversational experience designed to deliver accurate, up-to-date brand guidance to users. The ideal candidate is comfortable working in ambiguity, analyzing AI/chatbot behavior, identifying gaps or inaccuracies, and translating insights into actionable product improvements. This person will act as the day-to-day steward for the agent, helping monitor performance, validate updates, refine prompts/guardrails, and support ongoing AI optimization efforts. Key Responsibilities:

• Analyze chatbot analytics, conversation logs, usage patterns, and behavioral trends to identify issues related to response quality, escalation, hallucination risk, or content drift
• Investigate AI agent behavior and translate findings into recommendations, backlog items, and user stories
• Support UAT and release validation for prompt updates, indexed content changes, ingestion rule updates, and response logic enhancements
• Partner closely with AI engineers, product teams, and stakeholders to refine prompts, instructions, and agent behavior
• Build/report on analytics and dashboards (Power BI or similar) to communicate insights, trends, risks, and improvement opportunities
• Help define and monitor success metrics such as response accuracy, deflection, satisfaction, trust signals, and coverage
• Support cross-functional communication between product, engineering, brand, and platform teams
• Strong experience in Business Analysis, Product Analytics, Product Operations, or AI/Chatbot-focused roles
• Experience working with conversational AI, chatbots, AI agents, Copilot/GenAI tools, or prompt-based systems
• Strong analytical mindset with experience using SQL, Power BI/Tableau, dashboards, or manual data analysis to surface insights
• Experience with Agile tools/processes including Azure DevOps, Jira, user stories, backlog management, and UAT

• Strong experience as a Business/Data Analyst, Product Owner, or Product Manager in digital or platform-based products
• Comfort operating in ambiguous environments and wearing multiple hats across analysis, validation, and execution
• Experience working with analytics, dashboards, and usage data to inform product decisions (ideally with PBI and/or Adobe Analytics)
• Ability to define success metrics and evaluate product performance over time

• Experience working with chatbots, conversational interfaces, or AI assisted products (LLM experience a strong plus)
• Understanding of prompt-based systems, guardrails, and content governance concepts
• Familiarity with retrieval-based systems and indexed content is preferred

• Strong stakeholder management and communication skills
• Ability to translate data and technical behavior into clear business and brand implications
• Comfortable partnering closely with engineers, designers, and brand teams
• Strong ownership mindset with attention to detail and brand risk
• Analytical and curious - driven to understand why the agent behaves the way it does
• Pragmatic and execution-oriented, balancing insight with action
• Comfortable operating in a live, evolving production environment

• Power BI, Adobe Analytics or similar analytics and reporting tools
• Experienced with querying, using SQL, Kusto, etc.