Senior Data Engineer

Senior Data Engineer Job Description Data is at the heart of how the most complex problems and critical challenges are solved. A unique position has risen due to the access to vast quantities of data, world leading domain specialists on tap and an extremely diverse range of clients with unique challenges.The Data Intelligence Practice helps clients organise, analyse, and visualize their data to create actionable insight from static and real-time sources using industry leading tools and techniques. Our client’s markets are Aerospace, Defence, Security, Government & Infrastructure (Energy, Water, Transport).We are looking for a passionate Senior Data Engineer who will use data to solve real-world problems, and you will have the satisfaction of seeing the direct results of your work.You will be responsible for interpreting large volumes of data and maintaining pipelines to support creation of the digital solutions. You will apply a strong expertise in developing, maintaining, and testing infrastructures, transforming data into a format that can be easily analysed, and architecting solutions for data scientists that enable them to do their jobs.Responsibilities:This is a key role in a rapidly growing part of our business, and you will:Create and maintain optimal data architectures and pipelines.Assemble large, complex data sets that meet functional and non-functional business requirements.Discover opportunities to acquire new data from other systems.Develop and improve data set processes for data modelling, mining, and production.Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.Recommend and implement ways to improve data reliability, efficiency, and quality.Work with Data Scientists and Machine Learning Engineers to build analytics tools that utilize the data pipeline to provide actionable insights into asset management, operational efficiency, and other key business performance metrics.Collaborate with stakeholders including the Product owner, data science, and design teams to assist with data-related technical issues and support their data infrastructure needs.Create data tools for analytics and data scientist team members that assist them in building and optimizing the products that help business achieving their goals.What you can bring:Degree or equivalent in a relevant subject e.g. Computer Science, Information Systems, or related Technical Discipline.Deep knowledge of SQL, Azure/AWS/GCP Cloud based data pipelines, architectures, and data sets.Experience working with big data tools such as Hadoop, Spark is required.Experience working with large data sets, data pipeline and workflow management tools, Azure cloud services, and stream-processing system.Experience working in an agile environment or organizations with an agile culture.A professional attitude and an ability to think outside of the box to solve complex challenges.Background in programming in Python, Scala, C, C++, or Java would be beneficial.Good written and verbal communication skills along with strong desire to work in cross-functional teams.Overview:Position - Data Engineer DV Cleared – Permanent Location – AldershotSalary - £50k - £85k Keywords: Data Engineer, DV Cleared, SQL, Hadoop, Spark, Python, Scala, C, C++, Computer Science, Cloud based tools, large data sets, data pipeline.Only apply for this role if you currently hold the specific Government clearance: Developed Vetting (DV).Due to the nature of work undertaken at our client's site, incumbents of these positions are required to meet special nationality rules and therefore these vacancies are only open to sole British Citizens. Applicants who meet this criteria will also be required to already have DV clearance.Electus Recruitment Solutions provides specialist engineering and technical recruitment solutions to a number of high technology industries. We thank you for your interest in this vacancy. If you don't hear from us within 7 working days please presume your application has been unsuccessful on this occasion. You are of course free to resubmit your CV/details in the future and we shall assess your suitability at that time.This is a Permanent Role