Track This Job
Add this job to your tracking list to:
- Monitor application status and updates
- Change status (Applied, Interview, Offer, etc.)
- Add personal notes and comments
- Set reminders for follow-ups
- Track your entire application journey
Save This Job
Add this job to your saved collection to:
- Access easily from your saved jobs dashboard
- Review job details later without searching again
- Compare with other saved opportunities
- Keep a collection of interesting positions
- Receive notifications about saved jobs before they expire
AI-Powered Job Summary
Get a concise overview of key job requirements, responsibilities, and qualifications in seconds.
Pro Tip: Use this feature to quickly decide if a job matches your skills before reading the full description.
Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.
We are looking for a Staff Data Platform Engineer (Python, Spark, Databricks) to join our team.
Project Description
The project consists of building a scalable backend platform that runs data-driven analytical models in a controlled, automated, and auditable way. The backend must orchestrate model execution, enforce data validation, manage metadata and artefacts, and ensure full traceability of every processing step. The architecture is modular and cloud-oriented, with a strong focus on automation, versioning, and operational reliability.
What You'll Do
- Build, maintain, and optimize data ingestion pipelines using Python, pandas, Spark, and Databricks
- Parse and transform complex Excel-based financial models into structured Delta Lake tables
- Implement data processing workflows and calculation logic in Python
- Develop and manage pipelines using Databricks Jobs, clusters, and SQL Warehouse
- Improve performance, scalability, and reliability of existing data pipelines
- Write clean, maintainable, and production-quality Python code
- Use SQL for data validation, transformation, and pipeline integration
- Senior-level engineer with 5–8+ years of experience
- Strong Python skills, with proven experience building production data pipelines
- Hands-on experience with pandas for data transformation and ingestion
- Experience working with Spark (PySpark or Scala) and Databricks
- Solid SQL skills and experience writing complex queries
- Experience designing, implementing, and maintaining data processing pipelines
- Experience working with medium to large datasets
- Strong ownership and ability to work hands-on in a data platform environment
- English fluency for daily communication with actuarial and engineering teams.
- Experience optimizing Python or Spark workloads for performance and scalability
- Experience working with Delta Lake
- Experience ingesting and transforming large Excel-based datasets
- Experience working with financial or structured modeling data
- Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.
- Be part of a global team with equal opportunities for collaboration across continents and cultures.
- Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.
If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.
Key Skills
Ranked by relevanceReady to apply?
Join Solvd, Inc. and take your career to the next level!
Application takes less than 5 minutes

