Big Data Engineer (Data&AI, Data Platform Team)

We’re always looking for the ones truly passionate about their work. If you are amongst them, you can rest assured there is a place for you in eMAG. We’ve grown very fast and we are determined to keep doing so. What brought us here is our desire for continuous evolution and practical results.

More than 6000 colleagues are part of eMAG Teams. We strongly believe in people development and therefore every year we invest more and more energy and resources to remain an organization that is constantly learning. We want to make sure that you’ll have the most talented colleagues, as well as the proper environment to grow and achieve great results, to become what you desire on a personal and professional level. Join us, grow faster!

What you’ll have to do:

• Performance Tuning and Optimization: Deeply analyze and optimize the performance of the Cloudera onpremises platform and AWS cloud services used for big data processing. This includes tuning Hadoop/Spark configurations, database performance (Impala, Hive, etc.), query optimization as well as resource contention analysis and resolution;
• Platform Reliability and Stability: Ensure the high availability and stability of the big data platform. Implement proactive monitoring, alerting, and incident response procedures;
• Capacity Planning and Management: Forecast future platform capacity needs based on data growth and usage patterns. Plan and implement capacity upgrades, ensuring scalability and cost-effectiveness. Manage resource allocation across the platform;
• Cloud Migration and Integration: Contribute to the gradual migration of the big data platform to AWS. Evaluate and select appropriate AWS services (e.g., EMR, Glue, Athena, Redshift) and design hybrid cloud solutions. Ensure seamless integration between the on-premise Cloudera platform and AWS cloud services;
• Technology Evaluation and Research: Stay up-to-date with the latest big data technologies and trends. Evaluate new tools and techniques for improving platform performance, reliability, and scalability. Conduct proof-of-concept projects to assess the feasibility of new technologies;
• Collaboration and Knowledge Sharing: Work closely with data engineers, data scientists, and other stakeholders to understand their platform requirements and provide technical guidance. Share knowledge and best practices with the team;
• Documentation: Create and maintain comprehensive documentation for the big data platform, including architecture diagrams, configuration settings, and operational procedures.

How we’d like you to be:

• Have 5+ years of full-time, relevant industry experience;
• Working experience with data at the petabyte scale;
• Design and operation of large-scale data ingestion or any other distributed systems;
• Have experience with open-source technologies like Kafka, Hadoop, Hive, Airflow and Spark;
• Have experience with AWS big data services (EMR, Glue, Athena, Redshift, S3);
• Have experience with column-oriented data files like Parquet or high-performance formats like Iceberg;
• Have experience with Java, Scala and/or Python is preferred;
• Familiar with profiling tools, performance testing frameworks, and query optimization techniques;
• Have bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Will be a plus:

• Experience with relational databases, such as SQL Server, Oracle or MySQL;
• DevOps skills: Kubernetes;
• Monitoring/Logging/Operations: Prometheus, Grafana.

What we’ve prepared for you:

• Medical subscription: Medicover, MedLife or Regina Maria.
• A flexible budget that you can invest in yourself as you wish: meal tickets, holiday tickets, cultural vouchers, private pension, foreign language classes, eMAG, Fashion Days, Tazz, Therme & Genius, membership to different gyms or even professional development classes.
• Different discounts from our partners: banking, mobile, dental medicine or wellness.
• Access to the Bookster library and free credits on the Atlas psycho-emotional health platform.
• An accelerated learning environment, with access to over 100.000 curated online resources and platforms, learning academies and development programs.
• New headquarters, where sleek design, natural light, and versatile spaces create an energizing and comfortable environment for hybrid work.

Curious to find out more about the next step in your career? Apply now and if your experience is relevant for the role you wish, we will give you a call for more details!