An exciting opportunity to join our client's team at a fast-growing digital product engineering company with a global presence in 33 countries and over 19,000 experts. The company builds products, services, and experiences that inspire, excite, and delight. We are looking for a Technical Lead Data Engineer (Databricks) to join this global organization.

Objectives

Responsible for technical leadership of Agile Team(s) within the Business Analytics & Insights (BAI) team of our client, delivering high-quality solutions in domains such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.

Responsibilities

• Develop a comprehensive technical plan for migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lake.
• Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks.
• Developing scalable and re-usable frameworks for ingesting data sets.
• Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms.
• Working with event based / streaming technologies to ingest and process data.
• Provide technical guidance and support to the team, resolving any technical challenges or issues that may arise during the migration and post-migration phases.
• Stay up to date with the latest advancements in cloud computing, data engineering, and analytics technologies, and recommend best practices and industry standards for implementing the data lake solution.

Qualifications

Technical skills:

• 8+ years of Data Engineering experience.
• Minimum 4 years of experience working with Azure Databricks.
• Experience in Data Modelling & Source System Analysis.
• Familiarity with PySpark.
• Mastery of SQL.
• Knowledge of components: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL
• Experience with Python programming language used for data engineering purpose.
• Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
• Experience in data visualization/exploration tools.

Soft skills:

• Providing technical leadership and guidance to teams.
• Strong problem-solving skills and the ability to translate business requirements into actionable data science solutions.
• Excellent communication skills, with the ability to effectively convey complex ideas to technical and non-technical stakeholders.
• Strong team player with excellent interpersonal and collaboration skills.
• Ability to manage multiple projects simultaneously and deliver high-quality results within specified timelines.

Nice-to-have skills/certifications:

• Microsoft Certified: Azure Data Engineer Associate.
• Experience preparing data for Data Science and Machine Learning.
• Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development.
• Power BI Dataset Development and Dax.
• Power BI Report development.

What our client is offering

• Our client is committed to workplace diversity and provides an inclusive environment with equal opportunities for all employees.
• They partner with world class experts to bring you the latest in learning and development with training in leadership, technical and personal development.
• Our client believes you should be able to enjoy a healthy work-life balance, which is why we actively encourage flexible working arrangements and work from home.
• Multicultural environment with multiple nationalities.
• Health insurance
• Pension scheme
• Access to highly skilled experts to bring you the latest in learning and development with training in leadership, technical and personal development
• A flexible working environment
• A competitive remuneration and attractive benefits
• Opportunity to work with Top Clients on important projects
• Continuous learning and improvement activities
• Dynamic, international working environment

Equal Opportunity Employer

RSight® is an equal opportunity employer and values diversity in the workplace. We encourage all qualified individuals, including those from diverse backgrounds and people with disabilities, to apply.

Application Instructions

Please submit your resume (mandatory) outlining your qualifications and interest in the position. Only candidates selected for interviews will be contacted.