Senior Data Engineer

About the role -

EO Charging are searching for a highly skilled and experienced senior data engineer, with strong domain knowledge, to take the lead in a data system that will be the foundation for our data reporting and data analytics solutions and will enable the addition of predictive machine learning and modelling-based enhancements to our product offerings.

This role is critical in ensuring our data infrastructure is scalable, reliable, and optimized for analytics, reporting, and future ML capabilities.

Our preferred candidate will be responsible for the collection, transforming and storing of data, ensuring the data is readily available, of good quality, and suitably optimised for supporting our business requirements. We are looking for someone with strong technical knowledge and skills, as well as the ability to clearly communicate with a range of stakeholders, who can help the company get the most value from its data.

Key Role Responsibilities -

• Evaluate options for a new data system for EO Cloud that will support data reporting, data analytics and predictive machine learning and modelling – including evaluating an existing proposal from an external source

• The data engineer will work with:

1. Business stakeholders to understand the business’ data system vision, goals, and requirements
2. The EO DevOps team to define, build and maintain the required infrastructure in Azure
3. Software engineers to understand the data sources
4. Product owners and business intelligence stakeholders to define and develop the required data models and pipelines

• Building data pipelines to gather data from multiple sources, and transforming and aggregating it so that it is ready for consumption and use
• Ensuring data quality by data cleaning, and identifying errors and inconsistencies in data, removing them, and improving data accuracy and reliability
• Ensuring our data system is performant,scalable, cost effective, reliable, secure, and fit for purpose
• Ensure Data Quality & Governance – Implement best practices for data integrity, consistency, and security
• Follow agile development processes

Key Skills / Knowledge / Experience -

• Five or more years as adata engineer, with modern data platforms
• Familiarity with data lake, data warehouse and data modelling principles, technologies, and tools
• Excellent SQL skills and experience with relational databases
• Experience of NoSQL databases such as Cosmos
• Excellent Python skills and experiencewith relevant libraries
• Experience of data visualisation / BI tools
• Excellent communication skills, especially explaining technical concepts to nontechnicalstakeholders
• Familiarity with Microsoft Azure Cloud Platform and the data related technologies available
• Experience building or maintaining ETL processes, and knowledge of relevant tools and technologies
• Experience with Agile software development and practices
• Hands on and self-motivated engineer who can work collaboratively
• Strong problem solving and trouble shooting skills and an ability to produce creative solutions to problems with confidence in presenting ideas and strategies
• Excellent verbal and written communication skills.
• Good time management and organizational skills.
• The ability to keep current with the constantly changing technology industry.
• Ability to effectively articulate technical challenges and solutions
• Ability to take initiative, and to adapt quickly to change
• Work to continuously improve self; understands that different situations call for different skills and approaches
• Degree in a related discipline