Senior Data Engineer

Hypercube Talent
Birmingham
5 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer

Senior Data Scientist

Senior Data Scientist (MLOps)

Compensation

£70,000 - £85,000 Base + Benefits


TL;DR

  • Principal/Staff level data engineer role
  • Fast growing home energy management start-up, based in Liverpool
  • Remote, flexible work arrangements
  • Responsible for shaping, leading, and driving the data platform
  • Ownership of the data lake and integrated technologies
  • Must have AWS, Kafka, Python, Databricks, Spark
  • Experience in Energy and working with data and AI teams, a bonus



Who are we?

Heatio wants to connect to millions of residential homes and drive down the cost of bills and emissions at scale.


Heatio is a young, fast-growing data and AI platform startup looking to disrupt the energy and data industries through real time household modelling and developing best in class agile software culture. Based in Liverpool, our mix of hardware expertise, knowledge of the market, and our expanding virtual power plant (VPP) technology has enabled us to gain rapid traction from large energy providers to cutting-edge home energy technology manufacturers.


To understand more about who we are and what we do, visit our website here:

https://www.heatio.com


To get a better understanding of how we think and some of the organisations we work with, check out our podcast here:https://open.spotify.com/show/6x4X3u0PjnTM2I7tDZpvGT



Role purpose

First of all - we're adaptable and interested in a mix of people to make the best team. We're currently looking for someone at the Senior or Principal/Staff level in (or a mix of) the following roles: Data Engineering, Machine Learning Engineering (MLOps), and Software Engineering.

This role will primarily be the technical owner of our data lake and the subsequent pipelines and integrations between our platform's services. To keep our data and governance at the highest levels possible. To continually iterate and improve how we use, ingest and model data aligned to our business goals.


We are looking to build a best in class engineering and data business, and as such we are looking for an experienced lead to step change our business and technical development.

Success in terms of data engineering is developing a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective.


Success in this role will be defined by building a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective to support the monitoring of homes and their devices in real time and make intelligent, automated, decisions leveraging best-in-class engineer practices to scale AI and machine learning models across a growing diversity of uses cases.


Day-to-day work will involve project delivery and collaborating with stakeholders across our internal and customer teams. You will achieve leverage through excellent code, strong practices, and enabling your team to deliver more, at pace, in an agile environment. Technical work will include building, testing, deploying, maintaining, packaging, and explaining software to support our machine learning, data platform, and advanced analytics solutions for our customers - built with modern tools across the open source and cloud platform landscape.


You'll spend time shaping requirements and working with the Product team to turn the roadmap into production-grade solutions.


You will act as a champion and subject-matter expert for data engineering across the business, helping to cross-skill and upskill others.


Accountabilities

  • Work with developers, managers, and business stakeholders to understand and define components of the data landscape and how it relates to the data strategy
  • Understand and translate end-user requirements into designs and delivery plans for effective data and analytics solutions
  • Leverage open source and cloud platform technologies to deliver robust solutions
  • Design, develop, execute, and maintain a data platform to support analytics, AI, and machine learning workflows using the latest best practices in Data Engineering
  • Input into and close collaboration with the emerging MLOps and ML Engineering practices here at Heatio
  • Produce high-quality communications, documentation, and presentations of solutions for colleagues and customers
  • Subject-matter expert and evangelist for data / machine learning engineering
  • Helping to grow both our internal knowledge and skill sets as we scale.


Technical skills

We understand that this list is extensive, please apply if you fit some or only part of it we're flexible and are mostly looking for bright people who can adapt as the role grows. We want to see the broadest range of possible candidates from a diverse mix of backgrounds. Technical skills are only part of the equation.


Ideal candidates will have hands-on experience with the following core skills in a previous role:

  • Kafka
  • Python
  • SQL
  • Databricks (and Spark)
  • Cloud platform architecture in AWS


Additional experience with the following would be beneficial, but not essential:

  • Infrastructure-as-Code (Terraform)
  • Data modelling (Kimball, Imnon)
  • Orchestration tools - Apache Airflow / AWS Glue
  • Containers and related services (Docker, Kubernetes)
  • Backend software development (Java, APIs, Scalability, Logging and Monitoring etc.)
  • Warehouse and analytics tools (Spark, Athena)
  • Machine learning
  • Digital twins
  • Energy sector experience
  • Hardware integration


Other desirable skills and experience

  • Scale up experience is essential
  • A proven track record of being a leader within scaling engineering teams and culture.
  • Experience in the energy sector, especially home energy management systems, highly beneficial
  • Ability to act as a driving force in a growing technology start-up
  • Strong stakeholder management
  • Analysis/requirements gathering, solution design, and implementation of technology solutions
  • Experience in collaborating in and leading multidisciplinary teams, including software engineers, DevOps and infrastructure teams, data scientists etc.
  • Exceptional communication skills, both written and verbal, able to translate complex technical subject matter into easily understood presentations and written documentation for mixed technical audiences.


What's in it for you?

We are a small and flat organisation where we believe in radical candour, speed of decision-making, and not being a d\*ck. Those are our core values. We believe every hire is an opportunity to change the business, and that is our intention.


You'll be one of the earliest hires for our organisation and, therefore, will have a huge impact on the culture and how it is shaped. You'll have the chance to influence decisions in a fast-paced start-up and grow with the organisation.


You'll have direct access to our existing team of experienced leaders and their wider network.


Benefits

  • Pension
  • Flexible working
  • Private health insurance


IMPORTANT!!

Heatio is committed to creating a diverse and inclusive employee environment which is as representative as possible of our society. All qualified applicants will receive consideration for employment without regard to age, disability, gender reassignment, marriage and civil partnership, pregnancy/maternity, race, nationality, religion or belief, gender, and sexual orientation.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Job-Hunting During Economic Uncertainty: AI Edition

Artificial intelligence (AI) has become a driving force behind modern technology, transforming industries as diverse as finance, healthcare, retail, and manufacturing. From predictive analytics and natural language processing (NLP) to computer vision and generative AI, countless innovations rely on AI algorithms to solve complex problems and create new business opportunities. Despite its enormous potential, however, the AI job market can be impacted by broader economic uncertainties—recessions, investment slowdowns, or shifting corporate priorities—that lead to more selective hiring and tighter budgets. For job seekers in AI, this can mean grappling with fewer open positions, heightened competition, and extended decision-making timelines from employers. Yet, AI also remains integral to the digital future: as companies seek efficiencies through automation, data-driven insights, and sophisticated machine learning, opportunities persist even in a down market. The key is knowing how to stay visible, adaptable, and resilient when the broader environment feels unstable. In this guide, we’ll explore: Why economic volatility influences AI hiring and how this affects your job search. Proven strategies to maintain a competitive edge, even when budgets and roles shrink. Ways to refine your professional profile, emphasise relevant AI skills, and leverage networking effectively. Practical methods to stay motivated and focused, despite possible hiring slowdowns. How www.artificialintelligencejobs.co.uk can serve as your springboard for targeted AI opportunities. By combining foresight, adaptability, and a robust professional brand, you can secure a valuable AI position that propels your career forward—even during periods of economic uncertainty.

How to Achieve Work-Life Balance in AI Jobs: Realistic Strategies and Mental Health Tips

The Artificial Intelligence (AI) sector is evolving at an astonishing speed, reshaping industries that range from healthcare and finance to retail and cybersecurity. This transformation has triggered a massive demand for AI professionals—from machine learning engineers and data scientists to AI ethics specialists. With abundant opportunities and the allure of cutting-edge projects, it’s no surprise that AI is among the most sought-after career paths. Yet, behind the promise of lucrative salaries and pioneering research lies a pressing question: Is it actually feasible to maintain a healthy work-life balance in high-intensity AI roles? In a field known for demanding hours, intricate problem-solving, and perpetual learning curves, the balance between professional success and personal well-being often becomes precarious. In this article, we’ll explore real-world approaches to achieving work-life balance in the AI jobs sector. We’ll discuss why these roles can be stressful, offer realistic expectations for mental health, and provide actionable strategies for setting boundaries that protect both your career trajectory and your peace of mind. Whether you’re a seasoned AI professional or just stepping into this innovative industry, this guide will help you navigate the intensity without sacrificing your overall well-being.

Shifting from Academia to the AI Industry: How Researchers Can Harness Their Skills to Drive Commercial Artificial Intelligence

Artificial intelligence (AI) has advanced from a specialised academic pursuit to a transformative force in almost every sector—from healthcare diagnostics and autonomous vehicles to recommendation systems and creative generative models. As AI technologies continue to grow in complexity and impact, companies are looking for talent that combines deep theoretical knowledge with the ingenuity to solve real-world challenges. Increasingly, PhDs and academic researchers fit this profile perfectly. This guide will help you map out the transition from academia to industry in artificial intelligence. Whether you specialise in reinforcement learning, computer vision, natural language processing, or another AI discipline, you’ll find actionable advice on how to translate your academic strengths, adapt to commercial constraints, and excel in roles where your research insights can revolutionise products, services, and user experiences.