Principal Data Engineer - Cloud-based (Azure or AWS) - Remote to suit - £85K DoE - Data Solutions Consultancy Services Provider Principal Data Engineer - Background: As a Principal Data Engineer, you will oversee the development of our Client's data products, ensuring highly scalable, high-performance, and cost-effective data processing and analytics solutions.
Find out if this opportunity is a good fit by reading all of the information that follows below.
In this role, you will provide strategic leadership and technical expertise in the development of cloud data platforms, IoT analytics, and data integration and migration projects. You will set the standards for Data Engineering best practices across the organisation, leading the creation of robust coding standards and development practices, while being accountable for their adherence. Principal Data Engineer practical experience should include:
Experience implementing cloud data platforms in either Azure / AWS or significant on-premise design experience. 5+ years prior experience in data engineering or similar roles. Extensive ETL and data pipeline design experience, technology agnostic. Experience in creating and ensuring adherence to coding standards for Python and PySpark development Experience developing CI/CD pipelines and deep knowledge of DevOps and source control best practices. Strong knowledge of DataOps practices and awareness of MLOps practices Database Administration experience, including query optimisation and indexing strategies Knowledge of NoSQL databases (e.g. DynamoDB, CosmosDB, MongoDB). Experience implementing solutions using at least one of the following technologies Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google Big Query, Alteryx, SSIS, Informatica. Principal Data Engineer Summary: The role is as remote as you wish, but a preference is for employees to be North East based so the client's Newcastle HQ is accessible. On offer is a competitive salary, good benefits and a career with a growing organisation that offers great career progression.
TPBN1_UKTJ
The latest news, articles, and resources, sent to your inbox weekly.
Principal Data Engineer - Cloud-based (Azure or AWS) - Remote to suit - £85K DoE - Data Solutions Consultancy Services ProviderPrincipal Data Engineer - Background: As a Principal Data Engineer, you will oversee the development of our Client's data products, ensuring highly scalable, high-performance, and cost-effective data processing and analytics...
Asset Resourcing Limited Newcastle Upon Tyne
Principal Data Engineer - Cloud-based (Azure or AWS) - Remote to suit - £85K DoE - Data Solutions Consultancy Services Provider Principal Data Engineer - Background: As a Principal Data Engineer, you will oversee the development of our Client's data products, ensuring highly scalable, high-performance, and cost-effective data processing and...
Asset Resourcing Newcastle upon Tyne
Responsibilities:EngineeringArticulate our technical direction and upskill colleagues(both internal and external) in leveraging our Enterprise Data Platforms to deliver data products and ensure value is well understood.Provide feedback to our Data Platform Engineering Team to improve their services.Drive opportunities from the Data Engineering backlog and provide technical leadership in design and...
Elanco Hook
DescriptionWe are a forward-thinking company that recently launched an innovative Petcare Platform, poised to revolutionize how we utilize real-time event data within our operational and analytical ecosystems. As we continue to grow, we are excited to enhance our data capabilities and processes, bridging Microsoft Azure with Google Cloud Platform to...
Pets at Home Group Plc Handforth
Principal Data Engineerat Capco UK - LondonPrincipal Data EngineerWhy Join Capco?Capco is a global technology and business consultancy, focused on the financial services sector. We are passionate about helping our clients succeed in an ever-changing industry.You will work on engaging projects with some of the largest banks in the world,...
CAPCO London
About usAt Auctane, we are united by a passion to help sellers — wherever they are, however they operate — fulfil the promises they make to consumers. The Auctane mission is to fuel commerce through exceptional delivery. We make it possible for businesses to meet the ever-rising expectations of their...
Metapack London