Senior Java Developer (Spark, Hadoop)

Project Description:

A next-generation cross-asset data management platform to provide globally consistent data and innovative tools to support business strategy for trade/sales clients that is built on big data architecture, highly scalable, and cloud-ready. The platform enables industry-leading analytics, client reporting, regulatory compliance, surveillance, supervisory reporting, and data science solutions (data flame). The project tech stack: Apache Spark, Hive, Java, Scala, Spring, SQL, Kafka, Hadoop.

We are looking for a strong Senior Java Developer with Big Data experience (Hadoop, Spark) capable of build the design and establish the framework in order to expose and distribute the Risk data to wide variety of consumers including Finance, Front office Risk Systems, Trading Systems, Back office and Account systems. This should cover low latency access and Streaming, Push / Pull mechanisms depending on the type of consumers.

The role of the Senior Java Developer involves working with strong development teams (3 Senior Java Developers), the opportunity to work with big data improving knowledge in this domain utilizing the resources of an international bank.

Responsibilities:

• Design and build frameworks for ingesting/modeling the complex Risk data

• Develop Low latency caching to service Front office risk systems

Mandatory Skills Description:

• At least 5 years of experience in software development, including professional backend software development experience;

• Strong Knowledge of Java programming languages

• 1+ year of Big data development with extensive hands-on experience with Spark programming

• Strong knowledge of big data technologies like Hadoop (Hive) and Spark

• Should be familiar with algorithms and design patterns

• Understanding of distributed systems.

• Understanding of CI/CD workflow.

• Familiarity with Linux environment including scripting skills

Nice-to-Have Skills Description:

• Experience In-memory databases and caching

• Job Orchestration tools like Autosys or Airflow

• Financial background (where possible)

Languages:

English: B2 Upper Intermediate