Azure Databricks Data Engineer

83zero
London
7 months ago
Applications closed

Related Jobs

View all jobs

Senior DataOps Engineer

Senior DataOps Engineer

Senior DevOps Engineer

Machine Learning Engineer

Machine Learning Engineer

Data Engineer

Job Title: Azure Databricks Data Engineer



Making sure you fit the guidelines as an applicant for this role is essential, please read the below carefully.

Location: UK Wide Offices – Hybrid Role (predominantly remote working)

Salary: £75,000 to £95,000, , Pension and Benefits & Bonus!


About The Job Your Considering:

As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.


Your Role:

• Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.

• Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data.

• Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive models and drive business insights.

• Monitor and optimize data pipelines and infrastructure: Analyse performance metrics, identify bottlenecks, and implement optimizations for efficiency and scalability.

• Collaborate with cross-functional teams: Work closely with business analysts, data scientists, and DevOps engineers to ensure successful data platform implementations.

• Stay ahead of the curve: Continuously learn and adapt to the evolving landscape of big data technologies and best practices.


Required Skills and Qualifications:

• Minimum 3+ years of experience as a Data Engineer or similar role.

• Proven expertise in Databricks, Apache Spark, and data pipeline development.

• Strong understanding of data warehousing concepts and practices.

• Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory.

• Knowledge of SQL and scripting languages like Python or Scala.

• Hands-on experience with AI/ML concepts and tools.

• Excellent problem-solving and analytical skills.

• Strong communication and teamwork skills.

• Passion for data and a thirst for learning.


Your Security Clearance

To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance. To obtain SC clearance, the successful applicant must have resided continuously within the United Kingdom for the last 5 years, along with other criteria and requirements.


For more information please email or call

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Top 10 Best UK Universities for AI Degrees (2025 Guide)

Discover the ten best UK universities for Artificial Intelligence degrees in 2025. Compare entry requirements, course content, research strength and industry links to choose the right AI programme for you. Artificial Intelligence continues to transform industries—from healthcare to finance to transportation. The UK leads the way in AI research and education, with several universities consistently ranked among the world’s best for Computer Science. Below, we spotlight ten UK institutions offering strong AI-focused programmes at undergraduate or postgraduate level. While league tables shift year to year, these universities have a track record of excellence in teaching, research, and industry collaboration.

How to Write a Winning Cover Letter for AI Jobs: Proven 4-Paragraph Structure

Learn how to craft the perfect cover letter for AI jobs with this proven 4-paragraph structure. Perfect for junior developers and career switchers. When applying for an AI job, your cover letter can make all the difference. For many, the process of writing a cover letter for an AI position can be daunting, especially when there are so few specific guides for tailoring it to the industry. However, a clear, effective structure combined with AI-specific language and examples can help you stand out from the competition. Whether you're a junior entering the field or a mid-career professional switching to AI, the following framework will make it easier for you to craft a compelling cover letter. In this article, we’ll take you through a proven four-paragraph structure that works and provide sample lines that you can adapt to your personal experience.

Veterans in Tech: A Military‑to‑Civilian Pathway into AI Jobs

Published on ArtificialIntelligenceJobs.co.uk – empowering the UK talent pipeline for artificial intelligence, data, and robotics. Introduction Leaving the Armed Forces is both a proud milestone and a daunting leap into the unknown. Whether you served with the Royal Navy, British Army, Royal Air Force or Royal Marines, one thing is certain: the skills you forged under pressure are in high demand—especially in the booming field of artificial intelligence (AI).  The UK’s AI market is expected to contribute £400 billion to the economy by 2030, with defence and security applications at its core. Employers from start‑ups to FTSE‑100 giants are crying out for disciplined professionals who understand mission‑critical environments. Ex‑service personnel fit the bill perfectly. This guide maps the military‑to‑civilian journey, signposts Ministry of Defence (MoD) transition programmes, and shows you exactly how to land your first AI role. Quick Win: Bookmark our live listings for Machine Learning Engineer roles to see which employers are hiring right now.