Data Engineer-Big Data

About TCS:

Join Tata Consultancy Services, Asia Pacific and be part of an organization committed to sustainable development for our future. TCS follows the Tata group philosophy of building sustainable businesses that are rooted in the community and demonstrate care for the environment. Our unique values position us to combine a purpose-driven worldview with digital innovation, collaborating with customers, communities and governments to lead and shape innovative solutions for a sustainable future. TCS has been carbon neutral in its operations across 11 countries, 12 delivery centers and 18 offices in Asia Pacific since 2022. This is only the initial stage in TCS’ journey as we strive to achieve long-term net zero emissions by 2030.

Corporate sustainability is embedded in our triple-bottom-line, focusing on people, the planet, and our purpose. Our offices are designed with eco-friendly features that significantly reduce our carbon footprint and enhance energy efficiency. We actively champion green initiatives, such as promoting paperless operations, implementing energy-efficient practices, and fostering employee engagement in sustainability efforts. When you become part of the TCS family, you will play an essential role dedicated to innovation, excellence, and crafting a brighter, greener future together. Join us and be a part of our mission to drive sustainability through technology and talent at Tata Consultancy Services, APAC today.

Job title: Senior Data Engineer-Big Data

Location: Sydney

Experience: 4+ Years

Roles and responsibilities:

• Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using common programming language (Scala, Java, or Python) in a Big Data and Data Warehouse platform. Preferably with at least 5+ years of hands-on experience in a Data Engineering role.
• Experience in building data solution in Hadoop platform, using Spark, MapReduce, Sqoop, Kafka and various ETL frameworks for distributed data storage and processing. Preferably with at least 5+ years of hands-on experience.
• Strong Unix/Linux Shell scripting and programming skills in Scala, Java, or Python.
• Proficient in SQL scripting, writing complex SQLs for building data pipelines.
• Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
• Experience in working in Agile teams, including working closely with internal business stakeholders.
• Familiarity with data warehousing and/or data mart build experience in Teradata, Oracle or RDBMS system is a plus.
• Certification on Cloudera CDP, Hadoop, Spark, Teradata, AWS, Ab Initio is a plus.
• Experience in Ab Initio software products (GDE, Co>Operating System, Express>It, etc.) is a plus.
• Experience in AWS technology (EMR, Redshift, DocumentDB, S3, etc.) is a plus.

Thank you for your interest in applying for this position with TCS. All applicants who meet the requirements will be considered equally and fairly for employment. We will review your application and will get back to you if we are considering your interest in this opportunity