DevOps Engineer / Platform Engineer (Databricks)

Role: DevOps Engineer / Platform Engineer (Databricks)

Location: Sydney/ Melbourne

Permanent (Fulltime)

Job Description:

• Platform Management: Design, implement, and manage cloud-based platforms using Databricks to ensure efficient, scalable, and secure data engineering operations.
• Infrastructure Automation: Automate the provisioning, configuration, and management of Databricks environments using tools like Terraform, Kubernetes, or CloudFormation.
• Data Integration: Build and optimize data pipelines in Databricks, integrating diverse data sources to enable efficient processing and analysis.
• Performance Optimization: Continuously monitor and optimize the performance of Databricks clusters and jobs, ensuring fast and cost-effective execution.
• Security & Compliance: Implement security best practices, including data encryption, access controls, and compliance policies, in Databricks environments.
• Collaboration with Data Science Teams: Work closely with data scientists and engineers to implement end-to-end data workflows, ensuring smooth integration of Databricks with other tools.
• Troubleshooting & Support: Provide ongoing technical support for Databricks platform environments, resolving issues related to infrastructure, performance, and data pipeline failures.
• Cloud Infrastructure Management: Manage cloud resources, such as AWS or Azure, to provide optimal resources for Databricks workloads.
• CI/CD Implementation: Implement continuous integration/continuous deployment pipelines for Databricks notebooks and data workflows to streamline code deployment.
• Documentation & Training: Create comprehensive documentation and provide training to development teams on Databricks platform best practices and features.

Interested Candidates can share their updated resumes on [email protected] or can reach me on +61 290 559 949.