Backend Developer (PySpark)

Role Overview

We are looking for an experienced Backend Developer (PySpark) with strong hands-on expertise in Microsoft Azure and Microsoft Fabric. The role involves building and optimizing Spark-based data processing solutions, including batch and streaming workloads, within an Agile delivery environment.

Mandatory Skills & Experience

• Minimum 5+years of overall IT experience

Strong hands-on experience with:

• PySpark
• Spark Streaming & Batch Processing
• Microsoft Azure Cloud Platform
• Microsoft Fabric Platform

Experience with:

• Delta Lake / Delta Table optimization
• Fabric Spark jobs
• Python notebook development