AI focused DataBricks Developer (Digital Engineering)

Coherent Solutions is a digital product engineering company focused on empowering business success. Our global team of 1700+ talented professionals collaborate seamlessly to deliver innovative solutions that drive measurable business impact. Headquartered in Minneapolis, USA, the company’s core competencies across 10 locations worldwide include product software development, IT consulting, data and analytics, machine learning, mobile app development, DevOps, Salesforce, and more.

We grow a team of advisors, not just order takers, and strive to make the company a place for career growth and opportunities. If you want to grow your core competencies, share your passion and be sure that every contribution is evaluated, we are on the same page.

Company Background

Our client is a leading life insurance company, part of a global financial services group. The company offers a wide range of products, including annuities and life insurance, delivered through a large nationwide network of agents.

Project Description

The project focuses on a production system managing clients and life insurance programs. The role involves both support and new feature development, with a strong emphasis on building and optimizing data pipelines and working within a modern Azure-based data platform.

Technologies

• Azure
• Databricks (Architecture, Unity Catalog, Delta, Lineage, Permissions, Databricks Genie, Notebooks)
• Agentic AI (Mosaic AI)
• Python
• SQL

What You'll Do

• Develop and maintain data pipelines within the Azure-based data platform;
• Work with the Databricks ecosystem (Delta Tables, Unity Catalog, notebooks) to process and manage data;
• Build and optimize data transformations using Python and SQL;
• Develop and support AI-driven data pipelines and automation using Databricks (Mosaic AI or similar tools);
• Support and enhance existing production data systems;
• Collaborate with a team of engineers on Databricks-based solutions;
• Ensure data quality, consistency, and reliability across data pipelines;

Job Requirements

• 3+ years of experience as a Data Engineer;
• Strong experience with Databricks ecosystem (Architecture, Unity Catalog, Delta tables, lineage, permissions, Databricks Genie, notebooks);
• Strong experience with Python;
• Solid proficiency in SQL;
• Experience working in Azure cloud environment;
• Experience with Databricks pipelines AI automation (Mosaic AI or AWS Agentcore);

Nice To Have

• Experience with Azure data integration tools (Synapse Pipelines, Azure Data Factory);
• Experience with Azure SQL pools;
• Understanding of performance tuning for data workloads;
• Experience with CI/CD, DevOps practices, Infrastructure as Code (IaC);

What Do We Offer

• You will receive a salary starting from 4,700 EUR gross per month.
• Remote work. We respect each employee’s chosen way to work remotely anywhere.
• "Launch for success" package: premium health insurance, monthly lunch vouchers, telecom services for employees and their family members, and more.
• Global teams. The working model in the company is based on working in global multicultural departments and gaining experience from the highest-level professionals.
• International Clients. It is on us to ensure the wide range of Clients you will work with – Innovative start-ups and Fortune 1000 companies in the U.S. and Europe.
• Professional growth opportunity. We created a professional training center including educational programs for developers of any level and live training sessions.
• Unique ideas development. Our internal start up incubator, Innovation Sandbox, helps to materialize ideas, receive support on their realization, and win cash prizes.
• Team spirit. Work in the company is not just about work – team building, celebrations, corporate events, family events and other traditions are an essential part of our culture.

Please take you time to see Coherent Solutions Privacy Policy for Job Applicants for details on how we process your personal data: https://www.coherentsolutions.com/privacy-policy-for-job-applicants