Data Engineer - SC Cleared

Data Engineer - SC Cleared

Location - Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.

Contract - 6 Months

Day rate - £500 (Inside IR35)

Your responsibilities in the role

Design and implement efficient data ingestion pipelines to and from databases and file storage services.
Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
Monitor data quality and implement measures to ensure data accuracy and completeness.
Manage and maintain databases to ensure optimal performance and security.
Deploy and manage data infrastructure on cloud platforms - primarily AWS
Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.

Skills and Experience

AWS focused, Ideally a AWS Certified Data Engineer.
SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
Version Control (Gitlab), CI/CD and IaC.
Familiar with security and networking principles, especially in AWS deployment.
Experience and understanding of handling both structured and unstructured data.
Complex data migrations.
Strong problem-solving analytical skills.
Excellent communication and collaboration skills.
Understanding of GIS data models.

Further information is required upon application

ECS Recruitment Group Ltd is acting as an Employment Business in relation to this vacancy