AWS Data Engineer

London
1 week ago
Create job alert

AWS Data Engineer
Salary: Negotiable to £80,000 Dependent on Experience
London: Hybrid working 3 days per week in the office 2 days home-based
Job Ref: J12931

A leader in consumer behaviour analytics, seeks a driven AWS Data Engineer to guide data infrastructure architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you'll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs).
This is an exciting opportunity for someone looking to challenge themselves in a collaborative environment, working with a breadth of diverse data and cutting edge technologies. You'll have proven experience developing AWS Cloud platforms end to end, orchestrating data using Dagster or similar as well as coding in Python and SQL.

Key Responsibilities
·Develop and optimize ETL/ELT processes to support data transformation and integrity for analytics.
·Explore and evaluate new data warehousing solutions, including Snowflake, to improve data accessibility and scalability.
·Partner with product and engineering teams to define data architecture and best practices for reporting.
·Ensure data security, compliance, and governance across data systems.
·Implement and maintain CI/CD pipelines to automate data workflows and enhance system reliability.
·Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance.

Essential Skills and Experience:
·Hands-on experience with AWS services, including Lambda, Glue, Athena, RDS, and S3.
·Strong SQL skills for data transformation, cleaning, and loading.
·Strong coding experience with Python and Pandas.
·Experience with any flavour of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc.
·Build processes supporting data transformation, data structures, metadata, dependency and workload management.
·Experience supporting and working with cross-functional teams in a dynamic environment.
·Strong communication skills to collaborate with remote teams (US, Canada)

Nice to Have
·Familiarity with LLMs including fine-tuning and RAG.
·Knowledge of Statistics
·Knowledge of DataOps best practices, including CI/CD for data workflows.

Additional Requirements
Candidates must have an existing and future right to live and work in the UK. Sponsorship at any point is not available.

If this sounds like the role for you then please apply today!

Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.
Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: (url removed) <(url removed)

Related Jobs

View all jobs

Data Engineer - SC Cleared

Senior Data Engineer - Snowflake & AWS

Lead Data Engineer

Senior Data Engineer

Lead Data Engineer

Global Data Engineering Lead, Data Engineer

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Programming Languages for Job Seekers: Which Should You Learn First to Launch Your AI Career?

Artificial Intelligence (AI) is no longer confined to academic research; it now sits at the core of countless modern industries. From healthcare diagnostics powered by machine learning to autonomous driving and natural language processing, organisations are investing heavily in AI capabilities. This surge in AI adoption has created a thriving job market for talented professionals—data scientists, machine learning engineers, AI researchers, and more. Yet if you’re aiming to break into this fast-growing field, one of the first questions you’ll ask is, “Which AI programming language should I learn first?” Given the array of options available—Python, R, Java, C++, Julia, among others—understanding the strengths, community support, and industry relevance of each is crucial. In this extensive guide, tailored for www.artificialintelligencejobs.co.uk, we’ll explore the top AI programming languages that can help you stand out to employers, accelerate your learning curve, and equip you with the skills to succeed in a competitive job market. By addressing both beginners and experienced programmers, we aim to provide actionable insights to help you choose the right language, master essential tools, and build a compelling career in AI.

UK Visa & Work Permits Explained: Your Essential Guide for International AI Talent

The United Kingdom has long been a hub of innovation, drawing some of the world’s brightest minds to its shores. In recent years, the country’s thriving technology ecosystem has been propelled by advances in Artificial Intelligence (AI), Machine Learning (ML), Robotics, Data Science, and related fields. From deep-tech start-ups in Silicon Roundabout to established global powerhouses, the UK remains at the forefront of AI research and development. Yet, for international AI professionals hoping to contribute to the UK’s tech growth, one of the most challenging hurdles can be understanding the visa and work permit landscape. The UK immigration system has its unique nuances, and it can be overwhelming to decide which route is best suited for your career aspirations. This comprehensive guide will help you navigate the main visa and work permit options for AI professionals, provide insight into the eligibility criteria, and offer practical tips on securing your dream role in the British AI sector.

Top UK AI Research Labs & Institutes: Best Places for AI Jobs

In recent years, the United Kingdom has emerged as one of the leading global hubs for artificial intelligence (AI) innovation. With a strong academic tradition, active technology communities, and robust government support, the UK has seen the rise of numerous world-class AI research labs and institutes. Many of these organisations not only drive significant academic breakthroughs but also foster powerful industry collaborations, creating thriving ecosystems where talent, investment, and creativity converge. If you are keen on pursuing an AI career—be it in academia or industry—understanding where these AI powerhouses are located, what they specialise in, and how they collaborate can help you map a clear route to success. In this blog post, written specifically for ArtificialIntelligenceJobs.co.uk, we delve into the top UK AI research labs and institutes, outline the career paths available, and highlight how you can be at the heart of Britain’s AI innovation.