Senior Data Engineer

London
4 weeks ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer - Databricks

Senior Data Engineer_London_Hybrid

Senior Data Engineer - Snowflake - £100,000

Senior Data Scientist

Senior Data Scientist

Senior Data Engineer
Hybrid working (3 days per week onsite in London)
6 Month contract initially, good scope for extension
Market rates (Umbrella-PAYE)

One of our blue chip clients are looking for a number Senior Data Engineer to join the team on a long term programme of work.

Key Responsibilities:

  • ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data quality.
  • Monitor and troubleshoot production data pipelines, ensuring their performance and reliability.
  • Mentor junior engineers and lead technical discussions to drive best practices and innovation within the team.
  • Stay up to date with the latest trends and technologies in data engineering and recommend solutions to improve data processing capabilities.
  • Query Optimization & Data Transformation: Write and optimize SQL queries, ensuring data integrity, performance, and scalability, using best practices and techniques
  • Data vault Model implementation: Implement flexible Data vault model in Snowflake to support large-scale analytics and business intelligence.
  • Cross-Team Collaboration: Collaborate with Data Engineers, Product Managers, and Data Scientists to deliver solutions that support data-driven insights and innovation.
  • Stakeholder Engagement: Engage with business stakeholders to understand requirements and translate them into technical solutions that add value.
  • Data Quality & Governance: Implement and enforce data governance and quality processes, ensuring accurate and consistent data flows across all systems.
  • Cloud & Infrastructure Support: Work with cloud platforms such as AWS/Azure and DBT with Snowflake to build and maintain scalable data solutions.
  • Continuous Improvement: Proactively look for ways to improve data systems, processes, and tools, ensuring efficiency and scalability.

    Key Skills / Experience:
  • ETL/ELT & Data Pipelines: Solid understanding of ETL/ELT processes, along with hands-on experience building and maintaining data pipelines using DBT, Snowflake, Python, SQL, Terraform and Airflow
  • Experience in designing and implementing data products and solutions on cloud-based architectures.
  • Cloud Platforms: Experience working with cloud data warehouses and analytics platforms, such as Snowflake, and AWS/Azure
  • GitHub Skills and Experience: Proficiency in using GitHub for version control, code collaboration and managing data engineering projects
  • Data Governance and Compliance: Expertise in implementing data governance frameworks in Alation, including data quality management and compliance with industry regulations.
  • Effective Communication and Collaboration: Excellent communication skills for interacting with stakeholders, presenting technical concepts, and collaborating with cross-functional teams.
  • Collaboration & Communication: Strong interpersonal skills with the ability to work cross-functionally with stakeholders, engineers, and analysts.
  • SQL Proficiency: Expertise in writing complex SQL queries, query optimization, and database design for analytics.
  • Problem-Solving & Analytical Thinking: Ability to think critically and solve complex problems, translating business requirements into actionable insights.
    Desirable skills/knowledge/experience:
  • Knowledge of Data Visualization Tools: Experience with tools such as MicroStrategy / Power BI
  • Terraform: Experience with Terraform and Terragrunt for infrastructure as code
  • GenAI: Experience with Generative AI technologies

    This is a great opportunity on a long running programme of work.
    Apply now for your CV to reach me directly and we will reply as soon as possible.

    LA International is a HMG approved ICT Recruitment and Project Solutions Consultancy, operating globally from the largest single site in the UK as an IT Consultancy or as an Employment Business & Agency depending upon the precise nature of the work, for security cleared jobs or non-clearance vacancies, LA International welcome applications from all sections of the community and from people with diverse experience and backgrounds.

    Award Winning LA International, winner of the Recruiter Awards for Excellence, Best IT Recruitment Company, Best Public Sector Recruitment Company and overall Gold Award winner, has now secured the most prestigious business award that any business can receive, The Queens Award for Enterprise: International Trade, for the second consecutive period

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Portfolio Projects That Get You Hired for AI Jobs (With Real GitHub Examples)

In the fast-evolving world of artificial intelligence (AI), an impressive portfolio of projects can act as your passport to landing a sought-after role. Even if you’ve aced interviews in the past, employers in AI and machine learning (ML) are increasingly asking candidates to demonstrate hands-on experience through the projects they’ve built and shared online. This is because practical ability often speaks volumes about your suitability for a role—far more than any exam or certification alone could. In this article, we’ll explore how to build an outstanding AI portfolio that catches the eye of recruiters and hiring managers, including: Why an AI portfolio is crucial for job seekers. How to choose AI projects that align with your target roles. Specific project ideas and real GitHub examples to help you stand out. Best practices for showcasing your work, from writing clear READMEs to using Jupyter notebooks effectively. Tips on structuring your GitHub so that employers can instantly see your value. Moreover, we’ll discuss how you can use your portfolio to connect with top employers in AI, with a handy link to our CV-upload page on Artificial Intelligence Jobs for when you’re ready to apply. By the end, you’ll have a clear roadmap to building a portfolio that will help secure interviews—and the AI job—of your dreams.

AI Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

In today's competitive AI job market, nailing a technical interview can be the difference between landing your dream role and getting lost in the crowd. Whether you're looking to break into machine learning, deep learning, NLP (Natural Language Processing), or data science, your problem-solving skills and system design expertise are certain to be put to the test. AI‑related job interviews typically involve a range of coding challenges, algorithmic puzzles, and system design questions. You’ll often be asked to delve into the principles of machine learning pipelines, discuss how to optimise large-scale systems, and demonstrate your coding proficiency in languages like Python, C++, or Java. Adequate preparation not only boosts your confidence but also reduces the likelihood of fumbling through unfamiliar territory. If you’re actively seeking positions at major tech companies or innovative AI start-ups, then check out www.artificialintelligencejobs.co.uk for some of the latest vacancies in the UK. Meanwhile, this blog post will guide you through 30 real coding & system-design questions you’re likely to encounter during your AI job interview. This list is designed to help you practise, anticipate typical question patterns, and stay ahead of the competition. By reading through each question and thinking about the possible approaches, you’ll sharpen your problem-solving skills, time management, and critical thinking. Each question covers fundamental concepts that employers regularly test, ensuring you’re well-equipped for success. Let’s dive right in.

Negotiating Your AI Job Offer: Equity, Bonuses & Perks Explained

Artificial intelligence (AI) has proven itself to be one of the most transformative forces in today’s business world. From smart chatbots in customer service to predictive analytics in finance, AI technologies are reshaping how organisations operate and innovate. As the demand for AI professionals grows, so does the complexity of compensation packages. If you’re a mid‑senior AI professional, you’ve likely seen job offers that include far more than just a base salary—think equity, bonuses, and a range of perks designed to entice you into joining or staying with a company. For many, the focus remains squarely on salary. While that’s understandable—after all, your monthly take‑home pay is what covers day-to-day expenses—limiting your negotiations to salary alone can leave considerable value on the table. From stock options in ambitious startups to sign‑on bonuses that ‘buy you out’ of your current contract, modern AI job offers often include elements that can significantly boost your long-term wealth and job satisfaction. This article aims to shed light on the full scope of AI compensation—specifically focusing on how equity, bonuses, and perks can enhance (or sometimes detract from) the overall value of your package. We’ll delve into how these elements work in practice, what to watch out for, and how to navigate the negotiation process effectively. Our goal is to provide mid‑senior AI professionals with the insights and tools to land a holistic compensation deal that accurately reflects their technical expertise, leadership potential, and strategic importance in this fast-moving field. Whether you’re eyeing a leadership role in machine learning at an established tech giant, or you’re considering a pioneering position at a disruptive AI startup, the knowledge in this guide will help you weigh the merits of base salary alongside the potential riches—and risks—of equity, bonuses, and other benefits. By the end, you’ll have a clearer sense of how to align your compensation with both your immediate lifestyle needs and long-term career aspirations.