Data Engineer
London, Greater London, South East, England
Posted: | 4d ago |
Location: | London, Greater London, South East, England |
Job Ref: | BH-49574 |
Expiry date: | 10/21/2024 |
6 month contract
Rate DOE
London based, hybrid
Data Engineer
Our client is a leading technology solutions provider, committed to delivering innovative and high-quality services to their clients. We are looking for a talented Full Stack Data Engineer with expertise in AWS to join our dynamic team.
Job Description
Responsibilities
Design, develop, and maintain scalable data pipelines and systems.
Implement and manage data storage solutions using AWS services such as S3, Redshift, and RDS.
Develop and deploy ETL processes to ingest and transform data from various sources.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Optimize data processing workflows for performance and cost-efficiency.
Ensure data quality, integrity, and security across all data systems.
Develop and maintain APIs for data access and integration.
Monitor and troubleshoot data pipelines and systems to ensure reliability and performance.
Required Skills:
Requirements
Strong experience with AWS services (S3, Redshift, RDS, Lambda, etc.).
Proficiency in programming languages such as Python, Java, or Scala.
Experience with SQL and NoSQL databases.
Knowledge of data warehousing concepts and technologies.
Familiarity with ETL tools and processes.
Experience with containerization and orchestration tools (Docker, Kubernetes).
Strong problem-solving and analytical skills.
Excellent communication and collaboration skills.
Supplementary Skills:
Experience with big data technologies such as Hadoop, Spark, or Kafka.
Knowledge of machine learning and data science concepts.
Familiarity with DevOps practices and tools (CI/CD, Jenkins, Git).
Experience with front-end technologies (React, Angular, or Vue.js).
Ancillary Skills:
Understanding of data governance and compliance.
Experience with data visualization tools (Tableau, Power BI).
Knowledge of cloud cost management and optimization.
Familiarity with Agile methodologies and project management tools.
Qualifications
Bachelor's degree in Computer Science, Engineering, or a related field.
3+ years of experience in data engineering or a related role.
AWS certification is a plus
What is in it for you ?
Opportunity to work with cutting-edge technologies.
Collaborative and inclusive work environment.
Professional development and growth opportunities.
Rate DOE
London based, hybrid
Data Engineer
Our client is a leading technology solutions provider, committed to delivering innovative and high-quality services to their clients. We are looking for a talented Full Stack Data Engineer with expertise in AWS to join our dynamic team.
Job Description
Responsibilities
Design, develop, and maintain scalable data pipelines and systems.
Implement and manage data storage solutions using AWS services such as S3, Redshift, and RDS.
Develop and deploy ETL processes to ingest and transform data from various sources.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Optimize data processing workflows for performance and cost-efficiency.
Ensure data quality, integrity, and security across all data systems.
Develop and maintain APIs for data access and integration.
Monitor and troubleshoot data pipelines and systems to ensure reliability and performance.
Required Skills:
Requirements
Strong experience with AWS services (S3, Redshift, RDS, Lambda, etc.).
Proficiency in programming languages such as Python, Java, or Scala.
Experience with SQL and NoSQL databases.
Knowledge of data warehousing concepts and technologies.
Familiarity with ETL tools and processes.
Experience with containerization and orchestration tools (Docker, Kubernetes).
Strong problem-solving and analytical skills.
Excellent communication and collaboration skills.
Supplementary Skills:
Experience with big data technologies such as Hadoop, Spark, or Kafka.
Knowledge of machine learning and data science concepts.
Familiarity with DevOps practices and tools (CI/CD, Jenkins, Git).
Experience with front-end technologies (React, Angular, or Vue.js).
Ancillary Skills:
Understanding of data governance and compliance.
Experience with data visualization tools (Tableau, Power BI).
Knowledge of cloud cost management and optimization.
Familiarity with Agile methodologies and project management tools.
Qualifications
Bachelor's degree in Computer Science, Engineering, or a related field.
3+ years of experience in data engineering or a related role.
AWS certification is a plus
What is in it for you ?
Opportunity to work with cutting-edge technologies.
Collaborative and inclusive work environment.
Professional development and growth opportunities.
Apply now
Contact:
Position:
Consultant
Sector:
Software Engineering & Development
Contact Email: