Lead Data Software Engineer
We are looking for a highly skilled Lead Data Software Engineer to join our remote team, working with a multinational e-commerce company specializing in shoes and fashion. As a Lead Data Software Engineer, you will be responsible for designing, developing, and maintaining data pipelines and data infrastructure using Apache Spark, Databricks, and other data engineering tools. You will work closely with the Data Science team to provide high-quality data solutions that support business decisions and drive growth.

Responsibilities


  • Design, develop, and maintain data pipelines and data infrastructure using Apache Spark, Databricks, and other data engineering tools
  • Collaborate with the Data Science team to provide high-quality data solutions that support business decisions and drive growth
  • Optimize and tune data pipelines for performance, scalability, and reliability
  • Ensure data quality and integrity throughout the data pipeline, from data ingestion to data consumption
  • Implement and maintain CI/CD pipelines for data engineering workflows
  • Develop and maintain documentation for data engineering processes and data infrastructure
  • Provide technical leadership and mentorship to junior data engineers


Requirements


  • 5+ years of experience in Data Software Engineering, showcasing your expertise in designing and developing complex data solutions
  • 1+ years of experience in a leadership role, demonstrating your ability to lead a team of engineers
  • Expertise in Apache Spark along with Spark streaming & Spark SQL, showcasing your ability to design and develop complex data pipelines
  • Fluency working with AWS landscape, including EC2, S3, and EMR, among others
  • Good hands-on experience with Databricks and delta-lake, enabling you to manage large-scale data infrastructures
  • Good understanding & hands-on experience with CI/CD, enabling you to automate software development processes
  • Rich working experience with Github, demonstrating your proficiency in version control and collaboration tools


Nice to have


  • Familiarity with Presto, Superset, Starburst, or Exasol, demonstrating your broader knowledge of data engineering tools and technologies


We offer


  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn




Post Date
2025-05-08
Job Type
REMOTE
Employment type
Full-time
Category
Information Technology, Engineering, , Business Development
Level
Mid-Senior
Country
Argentina
Industry
Software Development , IT Services , IT Consulting , , Retail ,
EPAM Systems*******