National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Databricks Solutions Architect

Data Intellect
Belfast
4 months ago
Applications closed

Related Jobs

View all jobs

Enterprise Data Architect

Enterprise Data Architect

Lead Data Engineer

Sr. Data Scientist / Machine Learning Engineer - GenAI

AI Developer

Data Scientist Senior Consultant

Job Description

As a Databricks Solutions Architect at [DI] you will work on a variety of impactful customer technical projects, including designing and building scalable reference architectures and productionalising customer use cases within Capital Markets.

What you will be doing:

  • Define end-to-end data architectures, ensuring best practices for data governance, access control, and cost optimisation using Unity Catalog and Delta Lake 
  • Optimise query performance, storage and compute efficiency for various workloads
  • Develop and deploy ETL/ELT pipelines, enabling real-time and batch data processing
  • Implement best practices for data ingestion and transformation in financial market data environments
  • Guide strategic customers in adopting Databricks Lakehouse as a unified data platform for structured and unstructured market data
  • Enhance and grow your knowledge among subject matter experts in our learning and development ecosystem


Qualifications

  • Proficient in data engineering, data platforms and analytics
  • Deep experience with Python, SQL and/or Scala
  • Knowledge of two or more common Cloud ecosystems (Azure, AWS, GCP) with expertise in at least one.
  • Deep experience with distributed computing with Apache Spark
  • Working knowledge CI/CD for production deployments
  • Working knowledge of MLOps
  • Familiarity with designing and deploying performant end-to-end data architectures
  • Experience with technical project delivery, managing scope and timelines
  • Able to communicate complex technical concepts to business stakeholders
  • Adaptable to evolving technologies and projects
  • At least one Databricks Certification, Data or ML Engineering.



Additional Information

What we offer: 

  • Flexible working – we offer hybrid working so our people can achieve that elusive work/life balance.
  • Professional development – we offer extensive training, ranging from leadership to specific technical skills.
  • Progression opportunities - we run a biannual promotion process. Monthly 121s with your People Leader provides support to guide you and your career in the right direction.
  • International travel opportunities – we offer the opportunity to work internationally, with teams in Belfast, London, New York, Hong Kong & Singapore
  • Healthcare cover – provider is dependent on region, UK is provided by Benenden Health, including 24/7 GP Service & Mental Health Helpline to give you peace of mind when it comes to your health
  • Generous referral scheme – we love to see referrals and referring a friend means cash for you!
  • Regular social events, prizes and giveaways – our talented social committee work hard all year round to provide exciting events across all regions to promote our value of togetherness

Who We Are:

Simply put – we turn big data problems into smart data solutions.

Data Intellect is a leading data and technology consultancy specializing in creating cutting-edge financial and capital markets technology solutions. Our expertise extends to diverse industries, including smart energy and healthcare.

Fair employment and equal opportunities

Data Intellect is an equal opportunity employer, committed to inclusion and diversity.

If you have a disability, accommodations are available on request throughout the assessment and selection processes.

Ready to accept the challenge?

Apply now.

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs Skills Radar 2026: Emerging Frameworks, Languages & Tools to Learn Now

As the UK’s AI sector accelerates towards a £1 trillion tech economy, the job landscape is rapidly evolving. Whether you’re an aspiring AI engineer, a machine learning specialist, or a data-driven software developer, staying ahead of the curve means more than just brushing up on Python. You’ll need to master a new generation of frameworks, languages, and tools shaping the future of artificial intelligence. Welcome to the AI Jobs Skills Radar 2026—your definitive guide to the emerging AI tech stack that employers will be looking for in the next 12–24 months. Updated annually for accuracy and relevance, this guide breaks down the top tools, frameworks, platforms, and programming languages powering the UK’s most in-demand AI careers.

How to Find Hidden AI Jobs in the UK Using Professional Bodies like BCS, IET & the Turing Society

When it comes to job hunting in artificial intelligence (AI), most candidates head straight to traditional job boards, LinkedIn, or recruitment agencies. But what if there was a better way to find roles that aren’t advertised publicly? What if you could access hidden job leads, gain inside knowledge, or get referred by people already in the field? That’s where professional bodies and specialist AI communities come in. In this article, we’ll explore how UK-based organisations like BCS (The Chartered Institute for IT), IET (The Institution of Engineering and Technology), and the Turing Society can help you uncover AI job opportunities you won’t find elsewhere. We'll show you how to strategically use their directories, special-interest groups (SIGs), and CPD (Continuing Professional Development) events to elevate your career and expand your AI job search in ways most job seekers overlook.

How to Get a Better AI Job After a Lay-Off or Redundancy

Being made redundant or laid off can feel like the rug has been pulled from under you. Whether part of a wider company restructuring, budget cuts, or market shifts in tech, many skilled professionals in the AI industry have recently found themselves unexpectedly jobless. But while redundancy brings immediate financial and emotional stress, it can also be a powerful catalyst for career growth. In the fast-evolving field of artificial intelligence, where new roles and specialisms emerge constantly, bouncing back stronger is not only possible—it’s likely. In this guide, we’ll walk you through a step-by-step action plan for turning redundancy into your next big opportunity. From managing the shock to targeting better AI jobs, updating your CV, and approaching recruiters the smart way, we’ll help you move from setback to comeback.