Principal Data Engineer - Cloud-based (Azure or AWS) - Remote to suit - £85K DoE - Data Solutions Consultancy Services ProviderPrincipal Data Engineer - Background:
As a Principal Data Engineer, you will oversee the development of our Client's data products, ensuring highly scalable, high-performance, and cost-effective data processing and analytics solutions.
In this role, you will provide strategic leadership and technical expertise in the development of cloud data platforms, IoT analytics, and data integration and migration projects. You will set the standards for Data Engineering best practices across the organisation, leading the creation of robust coding standards and development practices, while being accountable for their adherence.
Principal Data Engineer practical experience should include:
•Experience implementing cloud data platforms in either Azure / AWS or significant on-premise design experience.
•5+ years prior experience in data engineering or similar roles.
•Extensive ETL and data pipeline design experience, technology agnostic.
•Experience in creating and ensuring adherence to coding standards for Python and PySpark development
•Experience developing CI/CD pipelines and deep knowledge of DevOps and source control best practices.
•Strong knowledge of DataOps practices and awareness of MLOps practices
•Database Administration experience, including query optimisation and indexing strategies
•Knowledge of NoSQL databases (e.g. DynamoDB, CosmosDB, MongoDB).
•Experience implementing solutions using at least one of the following technologies Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google Big Query, Alteryx, SSIS, Informatica.
Principal Data Engineer Summary:The role is as remote as you wish, but a preference is for employees to be North East based so the client's Newcastle HQ is accessible.On offer is a competitive salary, good benefits and a career with a growing organisation that offers great career progression.
The latest news, articles, and resources, sent to your inbox weekly.
Principal Data Engineer - Cloud-based (Azure or AWS) - Remote to suit - £85K DoE - Data Solutions Consultancy Services ProviderPrincipal Data Engineer - Background:As a Principal Data Engineer, you will oversee the development of our Client's data products, ensuring highly scalable, high-performance, and cost-effective data processing and analytics solutions.In...
Asset Resourcing Limited Newcastle upon Tyne
A rapidly growing scale-up in London, who specialise in supply-chain SaaS are experiencing another period of growth and need a Principal Data Engineer. With the financial backing of a £billion group, they're in a strong financial position to push on and meet their big ambitions. Their tool has been developed...
Forward Role London
At Elanco (NYSE: ELAN) – it all starts with animals As a global leader in animal health, we are dedicated to innovation and delivering products and services to prevent and treat disease in farm animals and pets. We’re driven by our vision of ‘Food and Companionship Enriching Life’ and our...
Elanco Hook
KennedyPearce are partnered with a Global leading digital agency firm, recruiting for a Principal Data Engineer to join the Data Excellence division, working in a hybrid environment based in London. The business are responsible for the full end to end product life-cycle for some of the World's most exciting and...
Kennedy Pearce Consulting Southwark
Compensation£70,000 - £85,000 Base + BenefitsTL;DRPrincipal/Staff level data engineer roleFast growing home energy management start-up, based in LiverpoolRemote, flexible work arrangementsResponsible for shaping, leading, and driving the data platformOwnership of the data lake and integrated technologiesMust have AWS, Kafka, Python, Databricks, SparkExperience in Energy and working with data and AI...
Hypercube Talent Bristol
Compensation£70,000 - £85,000 Base + BenefitsTL;DRPrincipal/Staff level data engineer roleFast growing home energy management start-up, based in LiverpoolRemote, flexible work arrangementsResponsible for shaping, leading, and driving the data platformOwnership of the data lake and integrated technologiesMust have AWS, Kafka, Python, Databricks, SparkExperience in Energy and working with data and AI...
Hypercube Talent Birmingham