Jobs

Lead Data Engineer


Job details
  • Made Tech
  • Swansea
  • 1 week ago
Applications closed

Description

As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage.


Your role at Made Tech


  • Define, shape and perfect data strategies in central and local government.
  • Help public sector teams understand the value of their data, and make the most of it.
  • Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.
  • As employee growth is a huge focus here, we would expect you to contribute to our recruitment efforts and take on line management responsibilities.


Skills, Knowledge & Expertise

We are looking for candidates with a range of skills and experience, please apply even if you don’t meet all the criteria as if unsuccessful we can provide you with feedback.

  • Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies.
  • Strong experience in IaC and able to guide how one could deploy infrastructure into different environments.
  • Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.
  • Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
  • Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.
  • You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines.
  • Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment.
  • Some knowledge of how you would present diagrams (C4, UML, etc.)
  • Enthusiasm for learning and self-development.
  • You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban.
  • Can own the cloud infrastructure underpinning data systems through a DevOps approach.
  • Design and implement efficient data transformation processes at scale, both in batch and streaming use cases.
  • You are a skilled Data Engineer who has delivered data platforms.
  • Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
  • You can demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders.
  • You have the experience to improve resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit integration, data quality, etc)
  • You are skilled at offering guidance on how one would implement a robust DevOps approach in a data project.
  • You can comfortably talk about tools needed such as DataOps in areas such as orchestration, data integration and data analytics.
Desirable experience

Experience in the following things isn’t essential, but it’s highly desirable!
  • Working at a technology consultancy
  • Working with Docker and virtual environments as part of the development and CI/CD process.
  • Working with senior stakeholders to gather requirements and keep them engaged with
  • Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models
  • Working knowledge of statistics
  • Working with multidisciplinary digital and technology teams
  • Working within the public sector
  • Working with data scientists to productionise advanced data deliverables, such as machine learning models


Job Benefits

Life at Made Tech

We’re committed to building a happy, inclusive and diverse workforce. You can get a sense of what it’s like working here fromour blog, where we talk about mental health, communities of practice and neurodiversity(as well as our client work and best practice).

Like many organisations, we use Slack to chat to each other. The Slack groups that have formed give an idea of the diversity within Made Tech. If you’d like to speak to someone from one of these groups about their experience as an employee, let your recruitment agent or Made Tech Talent Partner know.

The groups are:

  • antiracist-activists
  • disability
  • lgbtqiaplus-allies-and-activists
  • neurodiversity
  • parents-carers
  • women-in-tech
Benefits

We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We’re also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to.

Here are some of our most popular benefits listed below:

✈️30 days Holiday- we offer 30 days of paid annual leave

Flexible Working Hours- we are flexible with what hours you work

Flexible Parental Leave- we offer flexible parental leave options

Remote Working- we offer part time remote working for all our staff

Paid counselling- we offer paid counselling as well as financial and legal advice.

An increasing number of our customers are specifying a minimum of SC (security check) clearance in order to work on their projects. As a result, we're looking for all successful candidates for this role to have eligibility.Eligibility for SC requires 5 years' UK residency and 5 year' employment history (or back to full-time education). Please note that if at any point during the interview process it is apparent that you may not be eligible for SC, we won't be able to progress your application and we will contact you to let you know why.

Made Tech is on a mission to use technology to improve society - for everyone. We help organisations transform, deliver and manage world-class digital products and services.

Today, you can see our services (and people!) in action, such as the design and build of the Homes for Ukraine service, delivered in 2 weeks. We’re helping local authorities make it easier and quicker for people to log housing repairs online. By digitalising access to NHS services we’re making it more accessible, such as children needing mental health support.

All this great experience is enabling us to support new areas, like energy. We’re helping to drive better environmental outcomes by improving network performance through real-time asset monitoring, which means less wasted energy.

We were recently named as a finalist in the Raising the Bar for Workplace Transparency Award in the Shift People Awards. This is a recognition of our many great initiatives, such as our open-access employee handbook that we launched 5 years ago.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Lead Data Engineer (x2) - London - Permanent - Hybrid

Lead Data Engineer (x2) - London - Permanent - HybridThis role requires hybrid working based in Moorgate, LondonThe salary for this role ranges between £65,000 - £74,000Lead Data Engineer required for a leading client based in Moorgate, London. Our customer is seeking a well experienced Lead Data Engineer to come...

City of London

Lead Data Engineer

Lead Data EngineerLocation: CorkSalary: €(phone number removed) (DOE)HybridReperio are working with a major software company who are looking to add to their Data team ahead of a projected busy year in 2025. To facilitate this, they are looking for a Lead Data Engineer to play a crucial role in building...

Cork

Lead Data Engineer

XR is a global technology platform powering the creative economy. Its unified platform moves creative and productions forward, simplifying the fragmentation and delivering global insights that drive increased business value. XR operates in 130 countries and 45 languages, serving the top global advertisers and enabling $150 billion in video ad...

Extreme Reach London

Senior Data Analyst

Senior Data Analytics Consultant London (Hybrid) £60,000 - £75,000 per annum About Us: We are a dynamic and forward-thinking AI consultancy, leveraging cutting-edge artificial intelligence and machine learning solutions to drive transformational change across multiple industries. As a Senior Data Analytics Consultant, you will play a pivotal role in shaping...

83data UK

Data Engineer

About Charlotte Tilbury BeautyFounded by British makeup artist and beauty entrepreneur Charlotte Tilbury MBE in 2013, Charlotte Tilbury Beauty has revolutionised the face of the global beauty industry by de-coding makeup applications for everyone, everywhere, with an easy-to-use, easy-to-choose, easy-to-gift range. Today, Charlotte Tilbury Beauty continues to break records across...

Charlotte Tilbury London

Lead Big Data Engineer - Contract

Requisition ID: R10166531Your Opportunity to Define Possible.Our Opportunity to Deliver the Nation’s Security. Together.Role clearancetype:Must already hold highest level of government clearance.Location:LondonAbout Your Opportunity:As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and...

Northrop Grumman London