Data Engineer

London, Greater London, South East, England

Posted:4d ago
Location:London, Greater London, South East, England
Job Ref:BH-49574
Expiry date:10/21/2024
6 month contract
Rate DOE
London based, hybrid

Data Engineer

Our client is a leading technology solutions provider, committed to delivering innovative and high-quality services to their clients. We are looking for a talented Full Stack Data Engineer with expertise in AWS to join our dynamic team.

Job Description

Responsibilities

Design, develop, and maintain scalable data pipelines and systems.
Implement and manage data storage solutions using AWS services such as S3, Redshift, and RDS.
Develop and deploy ETL processes to ingest and transform data from various sources.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Optimize data processing workflows for performance and cost-efficiency.
Ensure data quality, integrity, and security across all data systems.
Develop and maintain APIs for data access and integration.
Monitor and troubleshoot data pipelines and systems to ensure reliability and performance.
Required Skills:

Requirements

Strong experience with AWS services (S3, Redshift, RDS, Lambda, etc.).
Proficiency in programming languages such as Python, Java, or Scala.
Experience with SQL and NoSQL databases.
Knowledge of data warehousing concepts and technologies.
Familiarity with ETL tools and processes.
Experience with containerization and orchestration tools (Docker, Kubernetes).
Strong problem-solving and analytical skills.
Excellent communication and collaboration skills.
Supplementary Skills:

Experience with big data technologies such as Hadoop, Spark, or Kafka.
Knowledge of machine learning and data science concepts.
Familiarity with DevOps practices and tools (CI/CD, Jenkins, Git).
Experience with front-end technologies (React, Angular, or Vue.js).
Ancillary Skills:

Understanding of data governance and compliance.
Experience with data visualization tools (Tableau, Power BI).
Knowledge of cloud cost management and optimization.
Familiarity with Agile methodologies and project management tools.

Qualifications

Bachelor's degree in Computer Science, Engineering, or a related field.
3+ years of experience in data engineering or a related role.
AWS certification is a plus

What is in it for you ?

Opportunity to work with cutting-edge technologies.
Collaborative and inclusive work environment.
Professional development and growth opportunities.

Apply now