Senior Software Engineer

Mid-Senior Software Developer - Melbourne Based

I am currently working with a fast-growing startup that is looking for a Mid to Senior Java/Scala Developer with a strong foundation in computer science and hands-on experience with distributed systems, particularly Apache Spark.

What You’ll Do:

• Software Development: Design, develop, and optimise distributed applications using Java and Scala for large-scale data processing.
• Apache Spark Expertise: Build and optimise efficient, high-performance data pipelines leveraging deep knowledge of Spark internals.
• Table Formats: Work with open-source table formats such as Apache Iceberg, Delta Lake, Apache Hudi, and manage large datasets effectively.
• Lakehouse Architecture: Implement open Lakehouse solutions including Unity Catalog, Polaris Catalog, and manage ML workflows with MLflow.
• Collaboration: Partner with data engineers, ML engineers, and stakeholders to deliver solutions that meet business requirements.
• Problem Solving: Identify and resolve complex issues in large-scale distributed systems.

What We’re Looking For:

• Experience: 3+ years in Java or Scala development (Mid–Senior level). Fresh graduates with a Master’s in Computer Science or related fields are encouraged to apply.
• Computer Science Fundamentals: Strong knowledge of data structures, caching, networking, and database systems.
• Apache Spark: In-depth understanding of Spark internals, job execution, query optimisation, and distributed data processing.
• Open-Source Table Formats: Hands-on experience with Apache Iceberg, Delta Lake, Apache Hudi, or similar.
• Open Lakehouse & MLflow: Familiarity with Lakehouse architecture and ML workflow management.

Preferred:

• Experience with cloud platforms (AWS, GCP, Azure) and distributed systems.
• Familiarity with CI/CD pipelines and Git.
• Understanding of ML workflows integrated into data pipelines.

Why Join?

• Work on cutting-edge data technologies in a collaborative environment.
• Build large-scale, real-world systems with the latest open-source tools.
• Growth opportunities including career development and professional learning.

Location:

Melbourne - 4 days a week in office

Salary:

$150k-$160k + Super

Interested?

If you’re a passionate developer with strong Scala and Apache Spark skills looking for your next challenge in the data and analytics space, we’d love to hear from you. Apply now for a confidential conversation.