Delivery Hero
Staff Product Analyst - Agentic AI Tracking
Delivery HeroGermany19 hours ago
Full-timeRemote FriendlyInformation Technology
As the world’s pioneering local delivery platform, our mission is to deliver an amazing experience, fast, easy, and to your door. We operate in over 70+ countries worldwide, powered by tech, designed by people. As one of Europe’s largest tech platforms, headquartered in Berlin, Germany. Delivery Hero has been listed on the Frankfurt Stock Exchange since 2017 and is part of the MDAX stock market index. We enable creative minds to deliver solutions that create impact within our ecosystem. We move fast, take action and adapt. No matter where you're from or what you believe in, we build, we deliver, we lead. We are Delivery Hero.

Job Description

We are seeking a dedicated and detail-oriented Staff Product Analyst to join our Vendor Team on our journey to always deliver amazing experiences.

As part of our Vendor Team, you’ll be the driving force behind the success of thousands of restaurants, shops, and local businesses. Your contributions will empower vendors with advanced tools to manage their operations, boosting their visibility and reach. Every feature you help build will create growth opportunities for businesses of all sizes, strengthening Delivery Hero’s ecosystem and impact.

As a Staff Product Analyst, you will collaborate closely with AI Research, Data Science, Product Analytics, and Engineering teams to ensure our tracking infrastructure captures the right signals and produces high-quality, actionable insights. Your work will empower stakeholders to analyze agent behavior, measure the impact of new agentic features, and support the development of scalable evaluation pipelines.

What you need to be successful:

  • Collaborate with Product and Engineering to define, implement, and document tracking requirements for agent actions, state transitions, and user-agent interactions.
  • Develop and maintain monitoring systems, dashboards, and alerts to ensure correctness and completeness of agentic interaction data.
  • Investigate anomalies in agent event logs, trace data discrepancies, and drive timely resolutions.
  • Partner with AI Research and Data Science teams to ensure tracking aligns with evaluation metrics, model training needs, and simulation goals.
  • Collaborate with Product Analytics to validate interaction data for user behavior analysis, feature assessment, and agent success metrics.
  • Create and maintain comprehensive documentation for agent tracking specifications, data validation procedures, and QA frameworks.
  • Identify and implement process improvements to enhance the robustness, reliability, and scalability of agent data collection pipelines.

Qualifications

  • Proven experience in a similar role (e.g., Product Analyst, Data Analyst, or related position).
  • Familiarity with agentic AI systems, LLM orchestration, or AI evaluation frameworks.
  • Strong understanding of event tracking tools, logging frameworks, and observability practices (experience with structured event tracking, OpenTelemetry, or custom agent logging preferred).
  • Proficiency in SQL and data visualization platforms (e.g., Looker, Tableau, Power BI).
  • Knowledge of data validation, debugging, and monitoring techniques.
  • Excellent communication and collaboration skills, with the ability to translate technical concepts for non-technical stakeholders.

Preferred

  • Experience with Python for data analysis, scripting, and log parsing.
  • Background in data pipelines, ETL processes, or real-time event streaming (Kafka, Pub/Sub, etc.).
  • Prior experience working closely with AI or ML teams to validate data for model training or evaluation.

What's in it for you?

Ensuring you and all our Heroes are looked after, happy, and healthy is always on the menu. Because if you’re in good shape, then we’re in good shape.

  • Make the most of our hybrid working model and join the team for face-to-face connection and collaboration in our beautiful Berlin campus 2 days a week
  • We offer 27 days holiday with an extra day on 2nd and 3rd year of service
  • We will support you in developing yourself and your career growth opportunities: 1.000 € Educational Budget, Language Courses, Parental Support and access to the Udemy Business platform to explore a variety of online courses.
  • Get moving and release those wonderful, mind-boosting endorphins: Health Checkups, Meditation, Gym & Bicycle Subsidy
  • Cash. Dough. Cheddar. Whatever you call it, we’ll help you with it: Employee Share Purchase Plan, Sabbatical Bank, Public Transportation Ticket Discount, Life & Accident Insurance, Corporate Pension Plan
  • The power of getting together over some food is unrivaled. Here are a few ways to help you do that. All the yum: Digital Meal Vouchers, Food Vouchers, Corporate Discounts. Courses.

Ready to join our team? If you’re excited to grow, collaborate and be part of the world’s leading delivery platform, we’d love to hear from you. Apply today!

Additional Information

We believe diversity and inclusion are key to creating not only an exciting product, but also an amazing customer and employee experience. Fostering this starts with hiring - therefore we do not discriminate on the basis of racial identities, religious beliefs, color, national origin, gender identities or expressions, sexual orientations, age, marital or disability statuses, or any other aspect that makes you, you. We encourage you to let us know if you need any accommodations or specific accessibility support to ensure a smooth interview experience—just include it in your application. You're welcome to share your pronouns (he/she/they) right from the start so we can address you respectfully from our first contact.

Key Skills

Ranked by relevance
Apply