Data Engineer

Role Summary

We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures. The role focuses on ensuring data quality, performance, and reliability while supporting analytics, reporting, and business intelligence initiatives.

The ideal candidate will have strong expertise in SQL, ETL processes, and big data technologies, along with experience in cloud-based data platforms.

Key Responsibilities

1. Data Pipeline Development

• Design, build, and maintain scalable data pipelines
• Develop and optimize ETL/ELT processes for data ingestion and transformation
• Ensure efficient data flow across systems and platforms

2. Data Management & Quality

• Ensure data accuracy, consistency, and integrity
• Implement data validation and quality checks
• Monitor and troubleshoot data pipeline issues

3. Data Architecture & Performance

• Design and maintain data models and data warehouse structures
• Optimize database performance and query efficiency
• Handle large-scale datasets using big data technologies

4. Integration & Collaboration

• Integrate data from multiple sources (APIs, databases, cloud platforms)
• Collaborate with data analysts, data scientists, and business teams
• Support reporting and analytics use cases

5. Cloud & Platform Management

• Work with cloud platforms such as:
• AWS
• Azure
• Google Cloud
• Implement and manage cloud-based data solutions

6. Monitoring & Optimization

• Monitor data pipelines for performance and reliability
• Troubleshoot and resolve data-related issues
• Continuously improve system efficiency and scalability

Required Skills & Experience

• 4+ years of experience as a Data Engineer
• Strong proficiency in:
• SQL
• Python
• ETL/ELT tools and frameworks
• Experience with big data technologies (e.g., Spark, Hadoop)
• Knowledge of data warehousing concepts and data modeling
• Experience with cloud data platforms (AWS / Azure / GCP)

Key Competencies

• Strong analytical and problem-solving skills
• Attention to detail
• Performance optimization mindset
• Collaboration and communication skills