Kaliba
Senior Software Engineer
KalibaAustralia19 hours ago
Full-timeInformation Technology, Engineering

Mid-Senior Software Developer - Melbourne Based


I am currently working with a fast-growing startup that is looking for a Mid to Senior Java/Scala Developer with a strong foundation in computer science and hands-on experience with distributed systems, particularly Apache Spark.


What You’ll Do:

  • Software Development: Design, develop, and optimise distributed applications using Java and Scala for large-scale data processing.
  • Apache Spark Expertise: Build and optimise efficient, high-performance data pipelines leveraging deep knowledge of Spark internals.
  • Table Formats: Work with open-source table formats such as Apache Iceberg, Delta Lake, Apache Hudi, and manage large datasets effectively.
  • Lakehouse Architecture: Implement open Lakehouse solutions including Unity Catalog, Polaris Catalog, and manage ML workflows with MLflow.
  • Collaboration: Partner with data engineers, ML engineers, and stakeholders to deliver solutions that meet business requirements.
  • Problem Solving: Identify and resolve complex issues in large-scale distributed systems.


What We’re Looking For:

  • Experience: 3+ years in Java or Scala development (Mid–Senior level). Fresh graduates with a Master’s in Computer Science or related fields are encouraged to apply.
  • Computer Science Fundamentals: Strong knowledge of data structures, caching, networking, and database systems.
  • Apache Spark: In-depth understanding of Spark internals, job execution, query optimisation, and distributed data processing.
  • Open-Source Table Formats: Hands-on experience with Apache Iceberg, Delta Lake, Apache Hudi, or similar.
  • Open Lakehouse & MLflow: Familiarity with Lakehouse architecture and ML workflow management.


Preferred:

  • Experience with cloud platforms (AWS, GCP, Azure) and distributed systems.
  • Familiarity with CI/CD pipelines and Git.
  • Understanding of ML workflows integrated into data pipelines.


Why Join?

  • Work on cutting-edge data technologies in a collaborative environment.
  • Build large-scale, real-world systems with the latest open-source tools.
  • Growth opportunities including career development and professional learning.


Location:

Melbourne - 4 days a week in office


Salary:

$150k-$160k + Super


Interested?

If you’re a passionate developer with strong Scala and Apache Spark skills looking for your next challenge in the data and analytics space, we’d love to hear from you. Apply now for a confidential conversation.

Key Skills

Ranked by relevance