Data Engineer

Job Description:

Design & build systems to process and analyze tens of millions of daily events

Real-time data processing using stream technologies (Kafka streaming or similar)

Work with big data technologies

Write efficient and scalable code

Develop on a public cloud infrastructure

The Stack

AWS (RDS, S3, EMR, ...)

Google Cloud (BigQuery, GDS)

Kafka

Java (somePython)

Docker, Kubernetes

Anything needed to achieve our goals

Must have:

Strong software engineering skills with interest in data.

Java

SQL / NoSQL

Experience dealing with event-driven pipeline (Kafka or other).

Willingness to learn and use new technology/programming language.

Min 7 yrs relevant experience for the position described at a senior level.

Willingness to play on-call role when required ( typically on a rotational basis - 7 days/1 week of on-call every 4 weeks. This will be 24 hrs on-call per day).

Nice to have:

Experience with streaming framework

Experience with open source OLAP system (Druid, Pinot…)

Telecommunication knowledge

Docker and Kubernetes exposure

Experience with public cloud

Python