Senior Data Engineer

Hypercube Talent
Birmingham
6 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Fabric - £70,000 - London

Senior Data Engineer - Snowflake & AWS

Senior Manager Marketing Data & Insights Strategy

Senior Data Scientist (GenAI)

Compensation

£70,000 - £85,000 Base + Benefits


TL;DR

  • Principal/Staff level data engineer role
  • Fast growing home energy management start-up, based in Liverpool
  • Remote, flexible work arrangements
  • Responsible for shaping, leading, and driving the data platform
  • Ownership of the data lake and integrated technologies
  • Must have AWS, Kafka, Python, Databricks, Spark
  • Experience in Energy and working with data and AI teams, a bonus



Who are we?

Heatio wants to connect to millions of residential homes and drive down the cost of bills and emissions at scale.


Heatio is a young, fast-growing data and AI platform startup looking to disrupt the energy and data industries through real time household modelling and developing best in class agile software culture. Based in Liverpool, our mix of hardware expertise, knowledge of the market, and our expanding virtual power plant (VPP) technology has enabled us to gain rapid traction from large energy providers to cutting-edge home energy technology manufacturers.


To understand more about who we are and what we do, visit our website here:

https://www.heatio.com


To get a better understanding of how we think and some of the organisations we work with, check out our podcast here:https://open.spotify.com/show/6x4X3u0PjnTM2I7tDZpvGT



Role purpose

First of all - we're adaptable and interested in a mix of people to make the best team. We're currently looking for someone at the Senior or Principal/Staff level in (or a mix of) the following roles: Data Engineering, Machine Learning Engineering (MLOps), and Software Engineering.

This role will primarily be the technical owner of our data lake and the subsequent pipelines and integrations between our platform's services. To keep our data and governance at the highest levels possible. To continually iterate and improve how we use, ingest and model data aligned to our business goals.


We are looking to build a best in class engineering and data business, and as such we are looking for an experienced lead to step change our business and technical development.

Success in terms of data engineering is developing a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective.


Success in this role will be defined by building a cost-effective delivery of our data lake and subsequent outcomes from an insight, automation and modelling perspective to support the monitoring of homes and their devices in real time and make intelligent, automated, decisions leveraging best-in-class engineer practices to scale AI and machine learning models across a growing diversity of uses cases.


Day-to-day work will involve project delivery and collaborating with stakeholders across our internal and customer teams. You will achieve leverage through excellent code, strong practices, and enabling your team to deliver more, at pace, in an agile environment. Technical work will include building, testing, deploying, maintaining, packaging, and explaining software to support our machine learning, data platform, and advanced analytics solutions for our customers - built with modern tools across the open source and cloud platform landscape.


You'll spend time shaping requirements and working with the Product team to turn the roadmap into production-grade solutions.


You will act as a champion and subject-matter expert for data engineering across the business, helping to cross-skill and upskill others.


Accountabilities

  • Work with developers, managers, and business stakeholders to understand and define components of the data landscape and how it relates to the data strategy
  • Understand and translate end-user requirements into designs and delivery plans for effective data and analytics solutions
  • Leverage open source and cloud platform technologies to deliver robust solutions
  • Design, develop, execute, and maintain a data platform to support analytics, AI, and machine learning workflows using the latest best practices in Data Engineering
  • Input into and close collaboration with the emerging MLOps and ML Engineering practices here at Heatio
  • Produce high-quality communications, documentation, and presentations of solutions for colleagues and customers
  • Subject-matter expert and evangelist for data / machine learning engineering
  • Helping to grow both our internal knowledge and skill sets as we scale.


Technical skills

We understand that this list is extensive, please apply if you fit some or only part of it we're flexible and are mostly looking for bright people who can adapt as the role grows. We want to see the broadest range of possible candidates from a diverse mix of backgrounds. Technical skills are only part of the equation.


Ideal candidates will have hands-on experience with the following core skills in a previous role:

  • Kafka
  • Python
  • SQL
  • Databricks (and Spark)
  • Cloud platform architecture in AWS


Additional experience with the following would be beneficial, but not essential:

  • Infrastructure-as-Code (Terraform)
  • Data modelling (Kimball, Imnon)
  • Orchestration tools - Apache Airflow / AWS Glue
  • Containers and related services (Docker, Kubernetes)
  • Backend software development (Java, APIs, Scalability, Logging and Monitoring etc.)
  • Warehouse and analytics tools (Spark, Athena)
  • Machine learning
  • Digital twins
  • Energy sector experience
  • Hardware integration


Other desirable skills and experience

  • Scale up experience is essential
  • A proven track record of being a leader within scaling engineering teams and culture.
  • Experience in the energy sector, especially home energy management systems, highly beneficial
  • Ability to act as a driving force in a growing technology start-up
  • Strong stakeholder management
  • Analysis/requirements gathering, solution design, and implementation of technology solutions
  • Experience in collaborating in and leading multidisciplinary teams, including software engineers, DevOps and infrastructure teams, data scientists etc.
  • Exceptional communication skills, both written and verbal, able to translate complex technical subject matter into easily understood presentations and written documentation for mixed technical audiences.


What's in it for you?

We are a small and flat organisation where we believe in radical candour, speed of decision-making, and not being a d\*ck. Those are our core values. We believe every hire is an opportunity to change the business, and that is our intention.


You'll be one of the earliest hires for our organisation and, therefore, will have a huge impact on the culture and how it is shaped. You'll have the chance to influence decisions in a fast-paced start-up and grow with the organisation.


You'll have direct access to our existing team of experienced leaders and their wider network.


Benefits

  • Pension
  • Flexible working
  • Private health insurance


IMPORTANT!!

Heatio is committed to creating a diverse and inclusive employee environment which is as representative as possible of our society. All qualified applicants will receive consideration for employment without regard to age, disability, gender reassignment, marriage and civil partnership, pregnancy/maternity, race, nationality, religion or belief, gender, and sexual orientation.

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Ways AI Pros Stay Inspired: Boost Creativity with Side Projects, Hackathons & More

In the rapidly evolving world of Artificial Intelligence (AI), creativity and innovation are critical. AI professionals—whether data scientists, machine learning engineers, or research scientists—must constantly rejuvenate their thinking to solve complex challenges. But how exactly do these experts stay energised and creative in their work? The answer often lies in a combination of strategic habits, side projects, hackathons, Kaggle competitions, reading the latest research, and consciously stepping out of comfort zones. This article will explore why these activities are so valuable, as well as provide actionable tips for anyone looking to spark new ideas and enrich their AI career. Below, we’ll delve into tried-and-tested strategies that AI pros employ to drive innovation, foster creativity, and maintain an inspired outlook in an industry that can be both exhilarating and daunting. Whether you’re just starting your AI journey or you’re an experienced professional aiming to sharpen your skills, these insights will help you break out of ruts, discover fresh perspectives, and bring your boldest ideas to life.

Top 10 AI Career Myths Debunked: Key Facts for Aspiring Professionals

Artificial Intelligence (AI) is one of the most dynamic and rapidly growing sectors in technology today. The lure of AI-related roles continues to draw a diverse range of job seekers—from seasoned software engineers to recent graduates in fields such as mathematics, physics, or data science. Yet, despite AI’s growing prominence and accessibility, there remains a dizzying array of myths surrounding careers in this field. From ideas about requiring near-superhuman technical prowess to assumptions that machines themselves will replace these jobs, the stories we hear sometimes do more harm than good. In reality, the AI job market offers far more opportunities than the alarmist headlines and misconceptions might suggest. Here at ArtificialIntelligenceJobs.co.uk, we witness firsthand the myriad roles, backgrounds, and success stories that drive the industry forward. In this blog post, we aim to separate fact from fiction—taking the most pervasive myths about AI careers and debunking them with clear, evidence-based insights. Whether you are an established professional considering a career pivot into data science, or a student uncertain about whether AI is the right path, this article will help you gain a realistic perspective on what AI careers entail. Let’s uncover the truth behind the most common myths and discover the actual opportunities and realities you can expect in this vibrant sector.

Global vs. Local: Comparing the UK AI Job Market to International Landscapes

How to navigate salaries, opportunities, and work culture in AI across the UK, the US, Europe, and Asia Artificial Intelligence (AI) has evolved from a niche field of research to an integral component of modern industries—powering everything from chatbots and driverless cars to sophisticated data analytics in finance and healthcare. The job market for AI professionals is consequently booming, with thousands of new positions posted each month worldwide. In this blog post, we will explore how the UK’s AI job market compares to that of the United States, Europe, and Asia, delving into differences in job demand, salaries, and workplace culture. Additionally, we will provide insights for candidates considering remote or international opportunities. Whether you are a freshly qualified graduate in data science, an experienced machine learning engineer, or a professional from a parallel domain looking to transition into AI, understanding the global vs. local landscape can help you make an informed decision about your career trajectory. As the demand for artificial intelligence skills grows—and borders become more porous with hybrid and remote work—the possibilities for ambitious job-seekers are expanding exponentially. This article will offer a comprehensive look at the various regional markets, exploring how the UK fares in comparison to other major AI hubs. We’ll also suggest factors to consider when choosing where in the world to work, whether physically or remotely. By the end, you’ll have a clearer picture of the AI employment landscape, and you’ll be better prepared to carve out your own path.