AI Data Engineer

Company Description: At Xerxes Global and EBM Software, we believe in bold. We get excited about the big ideas — the ones that disrupt an industry and change everything. Our focus is on developing data analysis tools so powerful that they allow our clients to transform complex data into game-changing insights. As part of our growing data science and artificial intelligence initiatives headquartered in Dublin, Ireland, you will be part of an elite group of bright, strategic thinkers working to build the future of advanced analytics.

Job Summary: We are seeking a skilled AI Data Engineer to join our Dublin office. In this role, you will be a key player in designing, building, and maintaining our modern data architecture and scalable pipelines. You will work extensively within the Microsoft data stack, particularly with Microsoft Fabric and Azure Data Factory, while supporting our advanced machine learning and generative AI workflows. This is a hands-on role that bridges the gap between traditional data engineering, MLOps, and essential daily operational support.

Key Responsibilities

• Advanced Programming: Develop and maintain scalable data processing scripts and automation applications using Python.
• AI & Machine Learning Integration: Collaborate with data scientists to operationalize machine learning models (MLOps) from development into production environments.
• Generative AI Support: Utilize Prompt Engineering techniques to integrate, optimize, and manage Large Language Models (LLMs) and AI solutions within our broader data ecosystem.
• Data Pipeline Architecture: Design, build, and deploy robust ETL/ELT pipelines and data integration solutions using Microsoft Fabric and Azure Data Factory (ADF).
• Database Management: Architect and maintain efficient database solutions using SQL Server. Write, optimize, and troubleshoot complex T-SQL queries, stored procedures, and scripts.
• Cross-Functional Collaboration: Work closely with distributed teams to gather requirements, resolve data pipeline issues, and translate business needs into technical solutions.
• Nightly Load Support: Monitor, troubleshoot, and actively support our nightly data loads. This is a critical operational component of the daily job and will require up to 25% of your time to ensure seamless data availability and system reliability.

Qualifications

• Proven experience as a Data Engineer or AI Data Engineer in a fast-paced or enterprise environment.
• Demonstrated experience and proficiency working with Microsoft Fabric.
• Experience with Prompt Engineering and an understanding of how to interact with and optimize generative AI models.
• Programming proficiency in Python for data manipulation, automation, and AI integration.
• Technical expertise in Microsoft SQL Server and advanced proficiency in T-SQL.
• Hands-on experience building data pipelines using Azure Data Factory (ADF).
• Familiarity with Machine Learning lifecycles and MLOps practices (e.g., deploying models, monitoring drift, managing compute resources).
• Excellent communication and problem-solving skills.

Nice to Have

• Experience with data quality, testing, and observability frameworks (e.g., Great Expectations).