Azure Databricks Data Engineer

London
7 months ago
Applications closed

Related Jobs

View all jobs

Data Engineer - Python & Azure

Senior Data Scientist (Hiring Immediately)

Senior Data Engineer - Databricks

AI Data Scientist (Hiring Immediately)

Sr. Data Scientist / Machine Learning Engineer - GenAI & LLM (Hiring Immediately)

Data Engineer - Python / Data Science - London(Hybrid)

Azure Databricks Data Engineer - UK Wide - Hybrid

Salary: £85,000 - £95,000 - Bonus + Pension + Private Healthcare

Location: London / UK Wide Location - Hybrid working

To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance.
Unfortunately, our client is unable to progress applicants on a VISA

The Role:

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.

Your Role

Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.
Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data.
Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive models and drive business insights.
Monitor and optimize data pipelines and infrastructure: Analyse performance metrics, identify bottlenecks, and implement optimizations for efficiency and scalability.

Key Skills and Experience

Minimum 3+ years of experience as a Data Engineer or similar role.
Proven expertise in Databricks, Apache Spark, and data pipeline development.
Strong understanding of data warehousing concepts and practices.
Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory.
Knowledge of SQL and scripting languages like Python or Scala.
Hands-on experience with AI/ML concepts and tools.

Desirable:

Experience with cloud data warehousing solutions like Azure Synapse Analytics.
Expertise in specific data visualization tools.
Proven ability to build and deploy production-ready AI/ML models.

To apply please click the "Apply" button and follow the instructions.

83DATA is a boutique Tech & Data Recruitment Consultancy based in the UK. We provide high-quality interim and permanent Tech & Data professionals

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Jobs

AI Jobs at Newly Funded UK Start-ups: Q3 2025 Investment Tracker

Over the last decade, the United Kingdom has firmly established itself as one of Europe’s most significant technology hubs. Thanks to a vibrant ecosystem of venture capital, government-backed initiatives, and a wealth of academic talent, the UK has become especially fertile ground for artificial intelligence (AI) innovation. This growth is not just evident in established tech giants—new start-ups are emerging every quarter with fresh ideas, ground-breaking technologies, and a drive to solve real-world problems. In this Q3 2025 Investment Tracker, we take a comprehensive look at the latest AI start-ups in the UK that have successfully secured funding. Beyond celebrating these companies’ milestones, we’ll explore how these recent investments translate into exciting new job opportunities for AI professionals. Whether you’re an experienced machine learning engineer, a data scientist, or simply hoping to break into the AI sector, this roundup will give you insights into the most in-demand roles, the skills you need to stand out, and how you can capitalise on the current AI hiring boom.

Jobs

Portfolio Projects That Get You Hired for AI Jobs (With Real GitHub Examples)

In the fast-evolving world of artificial intelligence (AI), an impressive portfolio of projects can act as your passport to landing a sought-after role. Even if you’ve aced interviews in the past, employers in AI and machine learning (ML) are increasingly asking candidates to demonstrate hands-on experience through the projects they’ve built and shared online. This is because practical ability often speaks volumes about your suitability for a role—far more than any exam or certification alone could. In this article, we’ll explore how to build an outstanding AI portfolio that catches the eye of recruiters and hiring managers, including: Why an AI portfolio is crucial for job seekers. How to choose AI projects that align with your target roles. Specific project ideas and real GitHub examples to help you stand out. Best practices for showcasing your work, from writing clear READMEs to using Jupyter notebooks effectively. Tips on structuring your GitHub so that employers can instantly see your value. Moreover, we’ll discuss how you can use your portfolio to connect with top employers in AI, with a handy link to our CV-upload page on Artificial Intelligence Jobs for when you’re ready to apply. By the end, you’ll have a clear roadmap to building a portfolio that will help secure interviews—and the AI job—of your dreams.

Jobs Careers

AI Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

In today's competitive AI job market, nailing a technical interview can be the difference between landing your dream role and getting lost in the crowd. Whether you're looking to break into machine learning, deep learning, NLP (Natural Language Processing), or data science, your problem-solving skills and system design expertise are certain to be put to the test. AI‑related job interviews typically involve a range of coding challenges, algorithmic puzzles, and system design questions. You’ll often be asked to delve into the principles of machine learning pipelines, discuss how to optimise large-scale systems, and demonstrate your coding proficiency in languages like Python, C++, or Java. Adequate preparation not only boosts your confidence but also reduces the likelihood of fumbling through unfamiliar territory. If you’re actively seeking positions at major tech companies or innovative AI start-ups, then check out www.artificialintelligencejobs.co.uk for some of the latest vacancies in the UK. Meanwhile, this blog post will guide you through 30 real coding & system-design questions you’re likely to encounter during your AI job interview. This list is designed to help you practise, anticipate typical question patterns, and stay ahead of the competition. By reading through each question and thinking about the possible approaches, you’ll sharpen your problem-solving skills, time management, and critical thinking. Each question covers fundamental concepts that employers regularly test, ensuring you’re well-equipped for success. Let’s dive right in.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.