National AI Awards 2025Discover AI's trailblazers! Join us to celebrate innovation and nominate industry leaders.

Nominate & Attend

Big Data Lead

Hirewand
London
3 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Scientist

Research Engineer, Data (Foundational Research, Machine Learning)...

Research Engineer, Data (Foundational Research, Machine Learning)

Data Science Lead

[Only 24h Left] Lead Data Scientist...

Lead Data Scientist - Model Risk Management

Job Type:

Contract

Considering making an application for this job Check all the details in this job description, and then click on Apply.Job Location:

Wimbledon , UKJob Description :For this role, senior experience of Data Engineering and building automated data pipelines on IBM Datastage & DB2, AWS and Databricks from source to operational databases through to curation layer is expected using the latest cloud modern technologies where experience of delivering complex pipelines will be significantly valuable to how to maintain and deliver world class data pipelines.Knowledge in the following areas essential:Databricks:

Expertise in managing and scaling Databricks environments for ETL, data science, and analytics use cases.AWS Cloud:

Extensive experience with AWS services such as S3, Glue, Lambda, RDS, and IAM.IBM Skills:

DB2, Datastage, Tivoli Workload Scheduler, Urban CodeProgramming Languages:

Proficiency in Python, SQL.Data Warehousing & ETL:

Experience with modern ETL frameworks and data warehousing techniques.DevOps & CI/CD:

Familiarity with DevOps practices for data engineering, including infrastructure-as-code (e.g., Terraform, CloudFormation), CI/CD pipelines, and monitoring (e.g., CloudWatch, Datadog).Familiarity with big data technologies like Apache Spark, Hadoop, or similar.ETL/ELT tools and creating common data sets across on-prem (IBMDatastage ETL) and cloud data storesLeadership & Strategy:

Lead Data Engineering team(s) in designing, developing, and maintaining highly scalable and performant data infrastructures.Customer Data Platform Development:

Architect and manage our data platforms using IBM (legacy platform) & Databricks on AWS technologies (e.g., S3, Lambda, Glacier, Glue, EventBridge, RDS) to support real-time and batch data processing needs.Data Governance & Best Practices:

Implement best practices for data governance, security, and data quality across our data platform. Ensure data is well-documented, accessible, and meets compliance standards.Pipeline Automation & Optimisation:

Drive the automation of data pipelines and workflows to improve efficiency and reliability.Team Management:

Mentor and grow a team of data engineers, ensuring alignment with business goals, delivery timelines, and technical standards.Cross Company Collaboration:

Work closely with all levels of business stakeholder including data scientists, finance analysts, MI and cross-functional teams to ensure seamless data access and integration with various tools and systems.Cloud Management:

Lead efforts to integrate and scale cloud data services on AWS, optimising costs and ensuring the resilience of the platform.Performance Monitoring: Establish monitoring and alerting solutions to ensure the high performance and availability of data pipelines and systems to ensure no impact to downstream consumers.

#J-18808-Ljbffr

National AI Awards 2025

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

AI Jobs Salary Calculator 2025: Work Out Your Market Value in Seconds

Why your 2024 salary data is already outdated “Am I being paid what I’m worth?” It is the question that creeps in whenever you update your CV, see a former colleague announce a punchy pay rise on LinkedIn, or notice a recruiter slide into your inbox with a role that looks eerily similar to your current one—only advertised at £20k more. Artificial intelligence moves faster than any other hiring market. New frameworks are open‑sourced overnight, venture capital floods specific niches without warning, & entire job titles—Prompt Engineer, LLM Ops Specialist—appear in the time it takes most industries to schedule a meeting. In that environment, salary guides published only a year ago already look like historical curiosities. To give AI professionals an up‑to‑the‑minute benchmark, ArtificialIntelligenceJobs.co.uk has built a simple yet powerful salary‑calculation formula. By combining three variables—role, UK region, & seniority—you can estimate a realistic 2025 salary band in less than a minute. This article explains that formula, unpacks the latest trends driving pay, & offers concrete steps to boost your personal market value over the next 90 days.

How to Present AI Models to Non-Technical Audiences: A Public Speaking Guide for Job Seekers

In today’s competitive job market, AI professionals are expected to do more than just build brilliant algorithms—they must also explain them clearly to stakeholders who may have no technical background. Whether you're applying for a role as a machine learning engineer, data scientist, or AI consultant, your ability to articulate complex models in simple terms is fast becoming one of the most valued soft skills in interviews and on the job. This guide will help you master the art of public speaking for AI roles, offering tips on structuring presentations, designing effective slides, and using storytelling to make your work resonate with any audience.

AI Jobs UK 2025: 50 Companies Hiring Now

Bookmark this guide – we refresh it every quarter so you always know who’s really scaling their artificial‑intelligence teams. Artificial intelligence hiring has roared back in 2025. The UK’s boosted National AI Strategy funding, record‑breaking private investment (£18.1 billion so far) & a fresh wave of generative‑AI product launches mean employers are jockeying for data scientists, ML engineers, MLOps specialists, AI product managers, prompt engineers & applied researchers. Below are 50 organisations that have advertised UK‑based AI vacancies in the past eight weeks or formally announced growth plans. They’re grouped into five easy‑scan categories so you can jump straight to the kind of employer – & culture – that suits you. For each company you’ll find: Main UK hub Example live or recent vacancy Why it’s worth a look (tech stack, culture, mission) Use the internal links to browse current vacancies on ArtificialIntelligenceJobs.co.uk – or set up a free job alert so fresh roles land in your inbox.