Jobs

Data Platform Engineer


Job details
  • City of London
  • 6 days ago

About the Role

My client is seeking a skilled and experienced Data Warehouse Engineer to maintain and optimise data warehouse infrastructure, develop robust ETL processes, and ensure data quality across the organisation. You will collaborate with business and technology stakeholders to design scalable, automated data pipelines and support AI/ML model infrastructure. This is an exciting opportunity to work in a purpose-led sector, leveraging advanced technologies to create meaningful impact.

Key Responsibilities

Maintain and optimise the organisation's data warehouse infrastructure.
Design, implement, and document ETL/ELT procedures for data intake, adhering to industry standards.
Verify data quality and ensure it meets business requirements.
Monitor, tune, and analyse database performance to ensure reliability and scalability.
Collaborate with stakeholders to design data marts, meta data, and models in partnership with Power BI Engineers.
Maintain all data warehouse architecture codes in AzureDevOps.
Automate tasks and deploy production-standard code with unit testing, continuous integration, and versioning.
Optimise and configure systems to improve reliability, performance, and functionality.
Support and improve AI/ML model infrastructure to meet evolving business needs.
Troubleshoot data-related issues and manage system access for stakeholders.
Deliver high-quality solutions within set timelines and budgets, ensuring customer satisfaction.

Technical Skills & Experience

Bachelor's degree in an analytic field such as information technology, science, or engineering.
5+ years of experience in data warehouse architecture development and management.
Proficiency in Azure Data Factory, Azure Blob Storage, Azure Databricks, and AzureDevOps.
Extensive knowledge of ETL/ELT processes, including pipelines for AI/ML models.
Expertise in performance tuning, optimisation, and governance of Databricks platforms.
Strong experience with dimensional modelling techniques.
Ability to manage end-to-end data platforms, from ingestion to presentation layers.
Proficiency in SQL, Python, and Spark.
Experience with Unity Catalog and data security/privacy measures.
Knowledge of big data tools (e.g., Google Maps API, Apify) and machine learning fundamentals.
Hands-on experience with AI/ML model development, deployment, and performance monitoring.
Ability to explain AI model outcomes and metrics to non-technical stakeholders.

Soft Skills & Attributes

Strong analytic and consultative skills.
Excellent communication and interpersonal abilities to collaborate across diverse teams.
Results-oriented mindset with a focus on delivering against KPIs.
Exceptional time management and multitasking abilities.
Passion for working in a purpose-driven sector.
Fluent in English.

Benefits

💷 Salary: £84,000 per year.
🌴 Holidays: Generous annual leave.
🏦 Pension Scheme: Comprehensive and competitive.
🛍️ Retail Discounts: Access to exclusive discounts on a variety of brands

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Platform Engineer

About the RoleMy client is seeking a skilled and experienced Data Warehouse Engineer to maintain and optimise data warehouse infrastructure, develop robust ETL processes, and ensure data quality across the organisation. You will collaborate with business and technology stakeholders to design scalable, automated data pipelines and support AI/ML model infrastructure....

City of London

Data Platform Engineer / Semantic / RDF

Data Platform Engineer - Remote - Permanent roleWe are seeking an Experienced Data Platform Engineer with strong expertise in Scala and Java, along with a solid understanding of semantic technologies and knowledge representation. In this senior role, you will work closely with delegate architects, data scientists and engineers to design,...

London

Senior Data Engineer

Senior Data Engineer - Python / Data Pipelines / Data Platform / AWS - is required by fast growing, highly successful and tech focused organisation.About the jobYou will play a crucial role in designing, building, and maintaining their data platform, with a strong emphasis on streaming data, cloud infrastructure, and...

Cramlington

Data Scientist - Fintech - £80k - £100k

Data Scientist - FinTech - £80K - £100KOur client is an innovative and growing FinTech - Their software connects bank accounts, credit providers, APIs, Data Aggregators and mobile apps - entire FinTech and Ecommerce solutions can be built and used all around the world.Based in brand new offices in central...

Oliver Bernard

Data Engineer – Google Cloud Platform, GCP

Data Engineer – Google Cloud Platform, GCPContract: 12 Months - 56292Rate: £315 per Day (Inside IR35)Location: Essex offices (near Basildon) and Hybrid 4 days a weekOne of the world’s most advanced engineering companies and a household name is seeking a Data Engineer to work in its Global Data Analytics and...

PeopleWorks Basildon

Platform Engineering Lead - Up to £85,000

Platform Engineering Lead: Join a Pioneering Team in Cutting-Edge TechnologyAre you passionate about driving innovation in Hardware engineering?Ready to lead a multidisciplinary team on ground-breaking projects?We’re looking for aPlatform Engineering Leadwho can bring technical mastery and leadership to an exciting, dynamic team.Why This Role is Great:End-to-End Ownership: You'll oversee the...

Humand Talent Basingstoke