Lead Data Software Engineer

We are looking for a highly skilled Lead Data Software Engineer to join our remote team, working with a multinational e-commerce company specializing in shoes and fashion. As a Lead Data Software Engineer, you will be responsible for designing, developing, and maintaining data pipelines and data infrastructure using Apache Spark, Databricks, and other data engineering tools. You will work closely with the Data Science team to provide high-quality data solutions that support business decisions and drive growth.

Responsibilities

Design, develop, and maintain data pipelines and data infrastructure using Apache Spark, Databricks, and other data engineering tools
Collaborate with the Data Science team to provide high-quality data solutions that support business decisions and drive growth
Optimize and tune data pipelines for performance, scalability, and reliability
Ensure data quality and integrity throughout the data pipeline, from data ingestion to data consumption
Implement and maintain CI/CD pipelines for data engineering workflows
Develop and maintain documentation for data engineering processes and data infrastructure
Provide technical leadership and mentorship to junior data engineers

Requirements

5+ years of experience in Data Software Engineering, showcasing your expertise in designing and developing complex data solutions
1+ years of experience in a leadership role, demonstrating your ability to lead a team of engineers
Expertise in Apache Spark along with Spark streaming & Spark SQL, showcasing your ability to design and develop complex data pipelines
Fluency working with AWS landscape, including EC2, S3, and EMR, among others
Good hands-on experience with Databricks and delta-lake, enabling you to manage large-scale data infrastructures
Good understanding & hands-on experience with CI/CD, enabling you to automate software development processes
Rich working experience with Github, demonstrating your proficiency in version control and collaboration tools

Nice to have

Familiarity with Presto, Superset, Starburst, or Exasol, demonstrating your broader knowledge of data engineering tools and technologies

We offer

International projects with top brands
Work with global teams of highly skilled, diverse peers
Healthcare benefits
Employee financial programs
Paid time off and sick leave
Upskilling, reskilling and certification courses
Unlimited access to the LinkedIn Learning library and 22,000+ courses
Global career opportunities
Volunteer and community involvement opportunities
EPAM Employee Groups
Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn

Lead Data Software Engineer

Key Skills

Related Jobs

Senior Software Engineer (Node.js)

DevOps Engineer (AWS)

Chief Software Engineer (AdTech)

Related Jobs

Senior Software Engineer (Node.js)

DevOps Engineer (AWS)

Chief Software Engineer (AdTech)

Cookie Settings