-
View all jobs
We are looking for a Python Developer (Data Engineering) to design, build, and support scalable data pipelines and analytics platforms within a large enterprise banking environment. The role involves end-to-end data engineering across batch and near-real-time processing, strong collaboration with business and IT stakeholders, and adherence to high standards of quality, governance, and security.
Key Responsibilities
Key Responsibilities
- Develop robust data ingestion, transformation, and loading (ETL/ELT) processes across batch and near-real-time workflows
- Implement distributed data processing using Apache Spark (PySpark / Scala) for large-scale transformations and analytics
- Design and maintain logical and physical data models (dimensional/star schemas, data vault, wide tables) optimized for reporting and analytics
- Write and optimize SQL and HiveQL queries; manage tables, partitions, and storage formats
- Schedule, monitor, and support data pipelines using Control-M, ensuring SLA adherence and timely delivery
- Perform performance tuning of Spark jobs, SQL/Hive queries, and storage strategies for scalability and cost efficiency
- Implement data validation, reconciliation, and lineage using checks, unit tests, and metadata frameworks
- Build operational dashboards and alerts, investigate failures, and drive root-cause analysis and remediation
- Maintain comprehensive runbooks, architecture diagrams, data dictionaries, and coding standards
- Apply data privacy, access control, and security best practices in line with enterprise and regulatory requirements
- Drive continuous service and process improvements
- Prepare unit test cases and work closely with Testing teams during SIT and UAT
- Package and migrate code across environments (DEV → QA → PROD) with proper audit trails and governance
Key Skills
Ranked by relevance
storage
spark
apache
scala
vault
sql
sla
Related Jobs
3 roles aligned with this opportunity
View Job Details
Related
DATA SCIENTIST
2026-05-19
Full-time
Not Applicable
Singapore
Computer Hardware Manufacturing
Other
View Job Details
Related
Materials Engineer & Python Expert - Freelance AI Trainer
2026-05-26
Part-time
Not Applicable
Singapore
IT Services
Other
View Job Details
Related
Fullstack Developer – NodeJS / Python / Express.js
2026-05-26
Contract
Mid-Senior
Canada
IT Services
Other
Login to Apply
- Posted
- Jan 16, 2026
- Type
- Full-time
- Level
- Entry
- Location
- Singapore
- Company
- Unison Group
Industries
IT Services
IT Consulting
Categories
Other
Related Jobs
3 roles aligned with this opportunity
View Job Details
Related
DATA SCIENTIST
2026-05-19
Full-time
Not Applicable
Singapore
Computer Hardware Manufacturing
Other
View Job Details
Related
Materials Engineer & Python Expert - Freelance AI Trainer
2026-05-26
Part-time
Not Applicable
Singapore
IT Services
Other
View Job Details
Related
Fullstack Developer – NodeJS / Python / Express.js
2026-05-26
Contract
Mid-Senior
Canada
IT Services
Other