IBM
Lead Data Engineer Python and AWS
IBMRomania2 days ago
Full-timeInformation Technology
Introduction

At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.

Your Role And Responsibilities

Your Role and Responsibilities

As a Lead Data Engineer, you will design, develop, and maintain large-scale data pipelines and architectures, leveraging AWS data integration and processing technologies. You will collaborate with cross-functional teams to analyze and optimize data workflows, ensuring high-performance and scalability. Your expertise in data analysis, pipeline development, and testing will enable the delivery of high-quality data products.

Required Technical And Professional Expertise

  • Strong knowledge of SQL and data modeling
  • Proficiency in Spark and Python for data processing and analysis
  • Experience with AWS data integration and processing technologies (Glue, Athena, Redshift)
  • Data pipeline development and deployment expertise
  • Functional and automated testing of data pipelines

Preferred Technical And Professional Experience

  • Experience with Lakehouse development and architecture
  • Knowledge of performance tuning and debugging techniques for data pipelines
  • Familiarity with cloud-based data warehousing and analytics platforms
  • Understanding of data governance and security best practices
  • Experience with DevOps tools and agile development methodologies

Key Skills

Ranked by relevance