Databricks Developer
London, Greater London, South East, England
Posted: | 10d ago |
Location: | London, Greater London, South East, England |
Job Ref: | BH-50602 |
Expiry date: | 12/20/2024 |
Job Title: Databricks dev
Location: Windsor, UK (Hybrid – Minimum 3 days in-office per week)
Duration: Minimum 6 months
Rate: Up to £500/day
About the Company:
Join a leading consultancy working on behalf of a prominent energy and utilities organization. This organization is at the forefront of driving sustainability, delivering energy solutions to millions of customers, and spearheading the transition to a low-carbon future. You'll have the opportunity to work on impactful projects in a collaborative and innovative environment.
Job Description:
We are seeking a highly skilled Azure and Databricks Administrator with a strong background in Linux to join our team. The successful candidate will bring hands-on expertise in managing and deploying Databricks clusters on the Azure platform and possess excellent troubleshooting, scripting, and automation skills.
Key Responsibilities:
- Deploy and manage Databricks clusters on the Azure platform (both Interactive and Job Clusters).
- Troubleshoot cluster issues, manage user access, and perform cluster health checks and monitoring.
- Set up Azure Active Directory (AD) groups and configure Azure securities.
- Create ARM templates and PowerShell scripts to automate deployment processes.
- Perform housekeeping activities for the Azure platform and Databricks administration.
- Consult with the Platform Engineering team on cluster sizing and lead deployment efforts for new data platforms.
- Support Big Data technologies such as Hadoop or HDInsight (experience with these platforms is a plus).
- Ensure the smooth operation and optimization of the data platform environment.
Required Skills and Experience:
- Strong administrative skills in Azure and Databricks.
- Solid Linux background.
- Proven experience in deploying, managing, and troubleshooting Databricks clusters.
- Hands-on experience with Azure security configurations and AD group setups.
- Proficiency in writing and managing ARM templates and PowerShell scripts.
- Familiarity with Big Data platforms (Hadoop/HDInsight administration is advantageous).
- Excellent communication skills to collaborate with cross-functional teams and provide technical consultation.
Why Join Us?
- Opportunity to work with a leading energy provider driving global change.
- A chance to enhance your skill set in an advanced, collaborative environment.
- Hybrid work model for a balanced work-life experience.
How to Apply:
If you're passionate about cloud technologies, data platforms, and driving impactful projects, apply today! Please submit your CV and a brief cover letter outlining your relevant experience.
Apply now
Contact:
Position:
Associate Consultant
Contact Email:
Telephone: