Senior Data Engineer

Hypercube Talent
Birmingham
7 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer - Databricks

Senior Data Science Engineer

Senior Data Scientist

Senior Data Scientist

Senior Data Scientist - B2B

Senior Data Scientist

Compensation

£70,000 - £85,000 Base + Benefits


TL;DR

  • Principal/Staff level data engineer role
  • Fast growing home energy management start-up, based in Liverpool
  • Remote, flexible work arrangements
  • Responsible for shaping, leading, and driving the data platform
  • Ownership of the data lake and integrated technologies
  • Must have AWS, Kafka, Python, Databricks, Spark
  • Experience in Energy and working with data and AI teams, a bonus



Who are we?

Heatio wants to connect to millions of residential homes and drive down the cost of bills and emissions at scale.


Heatio is a young, fast-growing data and AI platform startup looking to disrupt the energy and data industries through real time household modelling and developing best in class agile software culture. Based in Liverpool, our mix of hardware expertise, knowledge of the market, and our expanding virtual power plant (VPP) technology has enabled us to gain rapid traction from large energy providers to cutting-edge home energy technology manufacturers.


To understand more about who we are and what we do, visit our website here:

https://www.heatio.com


To get a better understanding of how we think and some of the organisations we work with, check out our podcast here:https://open.spotify.com/show/6x4X3u0PjnTM2I7tDZpvGT



Role purpose

First of all - we're adaptable and interested in a mix of people to make the best team. We're currently looking for someone at the Senior or Principal/Staff level in (or a mix of) the following roles: Data Engineering, Machine Learning Engineering (MLOps), and Software Engineering.

This role will primarily be the technical owner of our data lake and the subsequent pipelines and integrations between our platform's services. To keep our data and governance at the highest levels possible. To continually iterate and improve how we use, ingest and model data aligned to our business goals.


We are looking to build a best in class engineering and data business, and as such we are looking for an experienced lead to step change our business and technical development.

Success in terms of data engineering is developing a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective.


Success in this role will be defined by building a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective to support the monitoring of homes and their devices in real time and make intelligent, automated, decisions leveraging best-in-class engineer practices to scale AI and machine learning models across a growing diversity of uses cases.


Day-to-day work will involve project delivery and collaborating with stakeholders across our internal and customer teams. You will achieve leverage through excellent code, strong practices, and enabling your team to deliver more, at pace, in an agile environment. Technical work will include building, testing, deploying, maintaining, packaging, and explaining software to support our machine learning, data platform, and advanced analytics solutions for our customers - built with modern tools across the open source and cloud platform landscape.


You'll spend time shaping requirements and working with the Product team to turn the roadmap into production-grade solutions.


You will act as a champion and subject-matter expert for data engineering across the business, helping to cross-skill and upskill others.


Accountabilities

  • Work with developers, managers, and business stakeholders to understand and define components of the data landscape and how it relates to the data strategy
  • Understand and translate end-user requirements into designs and delivery plans for effective data and analytics solutions
  • Leverage open source and cloud platform technologies to deliver robust solutions
  • Design, develop, execute, and maintain a data platform to support analytics, AI, and machine learning workflows using the latest best practices in Data Engineering
  • Input into and close collaboration with the emerging MLOps and ML Engineering practices here at Heatio
  • Produce high-quality communications, documentation, and presentations of solutions for colleagues and customers
  • Subject-matter expert and evangelist for data / machine learning engineering
  • Helping to grow both our internal knowledge and skill sets as we scale.


Technical skills

We understand that this list is extensive, please apply if you fit some or only part of it we're flexible and are mostly looking for bright people who can adapt as the role grows. We want to see the broadest range of possible candidates from a diverse mix of backgrounds. Technical skills are only part of the equation.


Ideal candidates will have hands-on experience with the following core skills in a previous role:

  • Kafka
  • Python
  • SQL
  • Databricks (and Spark)
  • Cloud platform architecture in AWS


Additional experience with the following would be beneficial, but not essential:

  • Infrastructure-as-Code (Terraform)
  • Data modelling (Kimball, Imnon)
  • Orchestration tools - Apache Airflow / AWS Glue
  • Containers and related services (Docker, Kubernetes)
  • Backend software development (Java, APIs, Scalability, Logging and Monitoring etc.)
  • Warehouse and analytics tools (Spark, Athena)
  • Machine learning
  • Digital twins
  • Energy sector experience
  • Hardware integration


Other desirable skills and experience

  • Scale up experience is essential
  • A proven track record of being a leader within scaling engineering teams and culture.
  • Experience in the energy sector, especially home energy management systems, highly beneficial
  • Ability to act as a driving force in a growing technology start-up
  • Strong stakeholder management
  • Analysis/requirements gathering, solution design, and implementation of technology solutions
  • Experience in collaborating in and leading multidisciplinary teams, including software engineers, DevOps and infrastructure teams, data scientists etc.
  • Exceptional communication skills, both written and verbal, able to translate complex technical subject matter into easily understood presentations and written documentation for mixed technical audiences.


What's in it for you?

We are a small and flat organisation where we believe in radical candour, speed of decision-making, and not being a d\*ck. Those are our core values. We believe every hire is an opportunity to change the business, and that is our intention.


You'll be one of the earliest hires for our organisation and, therefore, will have a huge impact on the culture and how it is shaped. You'll have the chance to influence decisions in a fast-paced start-up and grow with the organisation.


You'll have direct access to our existing team of experienced leaders and their wider network.


Benefits

  • Pension
  • Flexible working
  • Private health insurance


IMPORTANT!!

Heatio is committed to creating a diverse and inclusive employee environment which is as representative as possible of our society. All qualified applicants will receive consideration for employment without regard to age, disability, gender reassignment, marriage and civil partnership, pregnancy/maternity, race, nationality, religion or belief, gender, and sexual orientation.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Portfolio Projects That Get You Hired for AI Jobs (With Real GitHub Examples)

In the fast-evolving world of artificial intelligence (AI), an impressive portfolio of projects can act as your passport to landing a sought-after role. Even if you’ve aced interviews in the past, employers in AI and machine learning (ML) are increasingly asking candidates to demonstrate hands-on experience through the projects they’ve built and shared online. This is because practical ability often speaks volumes about your suitability for a role—far more than any exam or certification alone could. In this article, we’ll explore how to build an outstanding AI portfolio that catches the eye of recruiters and hiring managers, including: Why an AI portfolio is crucial for job seekers. How to choose AI projects that align with your target roles. Specific project ideas and real GitHub examples to help you stand out. Best practices for showcasing your work, from writing clear READMEs to using Jupyter notebooks effectively. Tips on structuring your GitHub so that employers can instantly see your value. Moreover, we’ll discuss how you can use your portfolio to connect with top employers in AI, with a handy link to our CV-upload page on Artificial Intelligence Jobs for when you’re ready to apply. By the end, you’ll have a clear roadmap to building a portfolio that will help secure interviews—and the AI job—of your dreams.

AI Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

In today's competitive AI job market, nailing a technical interview can be the difference between landing your dream role and getting lost in the crowd. Whether you're looking to break into machine learning, deep learning, NLP (Natural Language Processing), or data science, your problem-solving skills and system design expertise are certain to be put to the test. AI‑related job interviews typically involve a range of coding challenges, algorithmic puzzles, and system design questions. You’ll often be asked to delve into the principles of machine learning pipelines, discuss how to optimise large-scale systems, and demonstrate your coding proficiency in languages like Python, C++, or Java. Adequate preparation not only boosts your confidence but also reduces the likelihood of fumbling through unfamiliar territory. If you’re actively seeking positions at major tech companies or innovative AI start-ups, then check out www.artificialintelligencejobs.co.uk for some of the latest vacancies in the UK. Meanwhile, this blog post will guide you through 30 real coding & system-design questions you’re likely to encounter during your AI job interview. This list is designed to help you practise, anticipate typical question patterns, and stay ahead of the competition. By reading through each question and thinking about the possible approaches, you’ll sharpen your problem-solving skills, time management, and critical thinking. Each question covers fundamental concepts that employers regularly test, ensuring you’re well-equipped for success. Let’s dive right in.

Negotiating Your AI Job Offer: Equity, Bonuses & Perks Explained

Artificial intelligence (AI) has proven itself to be one of the most transformative forces in today’s business world. From smart chatbots in customer service to predictive analytics in finance, AI technologies are reshaping how organisations operate and innovate. As the demand for AI professionals grows, so does the complexity of compensation packages. If you’re a mid‑senior AI professional, you’ve likely seen job offers that include far more than just a base salary—think equity, bonuses, and a range of perks designed to entice you into joining or staying with a company. For many, the focus remains squarely on salary. While that’s understandable—after all, your monthly take‑home pay is what covers day-to-day expenses—limiting your negotiations to salary alone can leave considerable value on the table. From stock options in ambitious startups to sign‑on bonuses that ‘buy you out’ of your current contract, modern AI job offers often include elements that can significantly boost your long-term wealth and job satisfaction. This article aims to shed light on the full scope of AI compensation—specifically focusing on how equity, bonuses, and perks can enhance (or sometimes detract from) the overall value of your package. We’ll delve into how these elements work in practice, what to watch out for, and how to navigate the negotiation process effectively. Our goal is to provide mid‑senior AI professionals with the insights and tools to land a holistic compensation deal that accurately reflects their technical expertise, leadership potential, and strategic importance in this fast-moving field. Whether you’re eyeing a leadership role in machine learning at an established tech giant, or you’re considering a pioneering position at a disruptive AI startup, the knowledge in this guide will help you weigh the merits of base salary alongside the potential riches—and risks—of equity, bonuses, and other benefits. By the end, you’ll have a clearer sense of how to align your compensation with both your immediate lifestyle needs and long-term career aspirations.