National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Azure Databricks Data Engineer

83zero
London
8 months ago
Applications closed

Related Jobs

View all jobs

Design Technology Data Scientist

Machine Learning Consultant

Machine Learning Consultant

Machine Learning Operations Engineer

Senior Machine Learning Engineer

Senior Machine Learning Engineer

Job Title: Azure Databricks Data Engineer



Making sure you fit the guidelines as an applicant for this role is essential, please read the below carefully.

Location: UK Wide Offices – Hybrid Role (predominantly remote working)

Salary: £75,000 to £95,000, , Pension and Benefits & Bonus!


About The Job Your Considering:

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.


Your Role:

• Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.

• Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data.

• Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive models and drive business insights.

• Monitor and optimize data pipelines and infrastructure: Analyse performance metrics, identify bottlenecks, and implement optimizations for efficiency and scalability.

• Collaborate with cross-functional teams: Work closely with business analysts, data scientists, and DevOps engineers to ensure successful data platform implementations.

• Stay ahead of the curve: Continuously learn and adapt to the evolving landscape of big data technologies and best practices.


Required Skills and Qualifications:

• Minimum 3+ years of experience as a Data Engineer or similar role.

• Proven expertise in Databricks, Apache Spark, and data pipeline development.

• Strong understanding of data warehousing concepts and practices.

• Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory.

• Knowledge of SQL and scripting languages like Python or Scala.

• Hands-on experience with AI/ML concepts and tools.

• Excellent problem-solving and analytical skills.

• Strong communication and teamwork skills.

• Passion for data and a thirst for learning.


Your Security Clearance

To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. To obtain SC clearance, the successful applicant must have resided continuously within the United Kingdom for the last 5 years, along with other criteria and requirements.


For more information please email or call

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs UK 2025: 50 Companies Hiring Now

Bookmark this guide – we refresh it every quarter so you always know who’s really scaling their artificial‑intelligence teams. Artificial intelligence hiring has roared back in 2025. The UK’s boosted National AI Strategy funding, record‑breaking private investment (£18.1 billion so far) & a fresh wave of generative‑AI product launches mean employers are jockeying for data scientists, ML engineers, MLOps specialists, AI product managers, prompt engineers & applied researchers. Below are 50 organisations that have advertised UK‑based AI vacancies in the past eight weeks or formally announced growth plans. They’re grouped into five easy‑scan categories so you can jump straight to the kind of employer – & culture – that suits you. For each company you’ll find: Main UK hub Example live or recent vacancy Why it’s worth a look (tech stack, culture, mission) Use the internal links to browse current vacancies on ArtificialIntelligenceJobs.co.uk – or set up a free job alert so fresh roles land in your inbox.

Return-to-Work Pathways: Relaunch Your AI Career with Returnships, Flexible & Hybrid Roles

Stepping back into the workplace after a career break can feel like embarking on a whole new journey—especially in a cutting-edge field such as artificial intelligence (AI). For parents and carers, the challenge isn’t just refreshing your technical know-how but also securing a role that respects your family commitments. Fortunately, the UK’s tech sector now boasts a wealth of return-to-work programmes—from formal returnships to flexible and hybrid opportunities. These pathways are designed to bridge the gap, equipping you with refreshed skills, confidence and a supportive network. In this comprehensive guide, you’ll discover how to: Understand the booming demand for AI talent in the UK Leverage transferable skills honed during your break Overcome common re-entry challenges Build your AI skillset with targeted training Tap into returnship and re-entry programmes Find flexible, hybrid and full-time AI roles that suit your lifestyle Balance professional growth with caring responsibilities Master applications, interviews and networking Whether you’re returning after maternity leave, eldercare duties or another life chapter, this article will equip you with practical steps, resources and insider tips.

LinkedIn Profile Checklist for AI Jobs: 10 Tweaks That Triple Recruiter Views

In today’s fiercely competitive AI job market, simply having a LinkedIn profile isn’t enough. Recruiters and hiring managers routinely scout for top talent in machine learning, data science, natural language processing, computer vision and beyond—sometimes before roles are even posted. With hundreds of applicants vying for each role, you need a profile that’s optimised for search, speaks directly to AI-specific skills, and showcases measurable impact. By following this step-by-step LinkedIn for AI jobs checklist, you’ll make ten strategic tweaks that can triple recruiter views and position you as a leading AI professional. Whether you’re a fresh graduate aiming for your first AI position or a seasoned expert targeting a senior role, these actionable changes will ensure your profile stands out in feeds, search results and recruiter queues. Let’s dive in.