Data Engineer

Our trusted high-growth healthcare technology partner is seeking a talented Data Engineer to join their dynamic team. This innovative company is dedicated to revolutionizing the healthcare industry through cutting-edge technology solutions.

Position Overview:

As a Data Engineer you will play a vital role in building and maintaining the data infrastructure that powers our products and decision-making processes. You will work closely with cross-functional teams to design, develop, and optimize scalable data pipelines, ensuring reliable data flow across systems.

Key Responsibilities:

• Pipeline Development: Design and implement end-to-end data pipelines from scratch, integrating various data sources into a unified system.
• Data Integration: Develop ETL/ELT processes to ingest, transform, and load structured and unstructured data.
• Performance Optimization: Optimize data pipelines for low latency, high throughput, and fault tolerance.
• Monitoring & Reliability: Implement monitoring, logging, and alerting to ensure pipeline reliability and quick issue resolution.
• Collaboration: Work closely with data scientists, analysts, and software engineers to understand data needs and deliver solutions.
• Best Practices: Establish and enforce data engineering best practices, including data quality, security, and governance.

Required Qualifications:

• 5+ years of professional experience in data engineering or a related role.
• Strong hands-on experience with Apache Kafka for building real-time streaming pipelines.
• Proficiency with ClickHouse for large-scale data storage and analytics.
• Basic knowledge of containerization tools like Docker or Kubernetes.
• Basic knowledge of AWS.
• Proficiency in any programming language like Python, Java, etc. for scripting and pipeline development.
• Familiarity with SQL and NoSQL databases; experience with data modeling and schema design.
• Knowledge of CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform, Helm) is a plus.

Benefits:

• Competitive salary to recognise and reward your achievements.
• Flexible work environment.
• Opportunities for professional and personal growth.