Data Engineer - Big Data

Data Engineer
Hybrid working (2-3 days per week in Gloucester)
£450-£550 per day (inside IR35)
 
We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically within the AWS ecosystem. You will be responsible for designing and implementing data pipelines that support large-scale data processing and analytics.
 
Key Responsibilities:

• Develop, construct, test, and maintain data architectures and data processing systems.
  
• Collaborate with data scientists and analysts to understand data requirements and ensure data availability.
  
• Design and optimise data models to support business intelligence and reporting needs.
  
• Monitor and troubleshoot data systems to ensure high availability and performance.
  
• Implement best practises for data management, security, and compliance.
   
  Required Skills:
  
• Active Security Clearance
  
• Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR.
  
• Strong experience with big data technologies and frameworks.
  
• Solid understanding of data modelling, ETL processes, and database management.
  
• Ability to work effectively in a team environment and communicate technical concepts clearly to non-technical stakeholders