AWS Cloud Data Engineer

Overview We are seeking a motivated AWS Cloud Data Engineer to join a growing consultancy. You will design, build, and maintain cloud-based data infrastructure and pipelines for efficient data ingestion, storage, and analysis. Collaborating with data architects, analysts, and engineers, you will optimize workflows and deliver data solutions for continuous infrastructure compliance. Key Responsibilities Apply data fabric principles to enhance data ingestion and processing. Develop scalable cloud-based data architectures, data lakes, and pipelines for structured/unstructured data. Ensure data availability, consistency, and optimization across ingestion-to-consumption stages using ETL/ELT processes. Deploy data solutions on AWS using native services like S3, Lambda, Redshift, Glue, and third-party tools like Snowflake. Monitor and optimize the performance, cost, and scalability of data infrastructure. Implement best practices for data security and compliance (e.g., encryption, data masking). Collaborate with analysts and software teams to ensure high-quality data for insights and machine learning models. Automate workflows with tools and scripts to minimize manual effort. Maintain clear documentation of data architectures and processes. Ensure security compliance by integrating AWS scanning capabilities with internal standards. Design and manage data pipelines using cloud-native or third-party services. Qualifications Strong experience in data engineering or related fields within financial services. Deep understanding of data lakes, governance, and data security best practices. Proven expertise with AWS data services (S3, Glue, Redshift, DynamoDB, Lambda, Athena). Experience with ETL tools, orchestration platforms (e.g., Airflow, AWS Step Functions), and data pipeline tools (Airflow, Databricks). Strong knowledge of relational and NoSQL databases and data warehousing. Expertise in SQL, Python, and distributed data systems. Proficiency in Infrastructure as Code (IaC) and automation tools (e.g., Chef, Ansible, SNOW, JIRA). Experience designing and managing CI/CD pipelines. Disclaimer: This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited ("ARM"). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission.