Databricks Developer

London, Greater London, South East, England

Posted:10d ago
Location:London, Greater London, South East, England
Job Ref:BH-50602
Expiry date:12/20/2024

Job Title: Databricks dev
Location: Windsor, UK (Hybrid – Minimum 3 days in-office per week)
Duration: Minimum 6 months
Rate: Up to £500/day
About the Company:
Join a leading consultancy working on behalf of a prominent energy and utilities organization. This organization is at the forefront of driving sustainability, delivering energy solutions to millions of customers, and spearheading the transition to a low-carbon future. You'll have the opportunity to work on impactful projects in a collaborative and innovative environment.
Job Description:
We are seeking a highly skilled Azure and Databricks Administrator with a strong background in Linux to join our team. The successful candidate will bring hands-on expertise in managing and deploying Databricks clusters on the Azure platform and possess excellent troubleshooting, scripting, and automation skills.
Key Responsibilities:

  • Deploy and manage Databricks clusters on the Azure platform (both Interactive and Job Clusters).
  • Troubleshoot cluster issues, manage user access, and perform cluster health checks and monitoring.
  • Set up Azure Active Directory (AD) groups and configure Azure securities.
  • Create ARM templates and PowerShell scripts to automate deployment processes.
  • Perform housekeeping activities for the Azure platform and Databricks administration.
  • Consult with the Platform Engineering team on cluster sizing and lead deployment efforts for new data platforms.
  • Support Big Data technologies such as Hadoop or HDInsight (experience with these platforms is a plus).
  • Ensure the smooth operation and optimization of the data platform environment.

Required Skills and Experience:

  • Strong administrative skills in Azure and Databricks.
  • Solid Linux background.
  • Proven experience in deploying, managing, and troubleshooting Databricks clusters.
  • Hands-on experience with Azure security configurations and AD group setups.
  • Proficiency in writing and managing ARM templates and PowerShell scripts.
  • Familiarity with Big Data platforms (Hadoop/HDInsight administration is advantageous).
  • Excellent communication skills to collaborate with cross-functional teams and provide technical consultation.

Why Join Us?

  • Opportunity to work with a leading energy provider driving global change.
  • A chance to enhance your skill set in an advanced, collaborative environment.
  • Hybrid work model for a balanced work-life experience.

How to Apply:
If you're passionate about cloud technologies, data platforms, and driving impactful projects, apply today! Please submit your CV and a brief cover letter outlining your relevant experience.

Apply now

Related jobs.