Jobs

Data Engineering Lead


Job details
  • FalconSmartIT
  • London
  • 3 weeks ago
Applications closed

Role:Data Engineering Lead

Location:London, UK

Is it Permanent / Contract:Permanent

Is it Onsite/Remote/Hybrid:Onsite

Start Date:Immediate


Data Engineering Lead:

Job Summary:

An experienced Data Engineering Lead to deliver a Snowflake migration program, leveraging strong knowledge in Snowflake, Fivetran, DBT, and orchestration tools. As a POD Lead, you will define development and coding standards, set frameworks, define standards, and remove external impediments. You will collaborate with various stakeholders to unblock project blockers and drive the successful migration to Snowflake.


Key Responsibilities:

Technical Leadership

1. Lead the design and implementation of the Snowflake migration program, ensuring successful data migration, integration, and optimization.

2. Define and implement development and coding standards for data engineering, leveraging Snowflake, Fivetran, DBT, Python, and orchestration tools.

3. Strong knowledge in ADO and CI/CD standards/pipelines

4. Set technical frameworks and guidelines for data engineering projects, ensuring alignment with overall technical vision.

5. Collaborate with architects to ensure alignment with overall technical vision.


Snowflake Migration Program

1. Develop and execute a comprehensive migration plan, including data ingestion, processing, and storage.

2. Design and implement data pipelines using Fivetran, DBT, and Snowflake.

3. Ensure data quality, integrity, and security throughout the migration process.

4. Ensure Chaucer data governance policies and procedures are adhered to as well as regulatory rules


POD Leadership

1. Lead a team of data engineers, providing technical guidance and mentorship.

2. Remove external impediments, ensuring the team can deliver high-quality results.

3. Collaborate with product owners, designers, and other stakeholders to define project requirements.

4. Prioritize and manage the team's workload, ensuring efficient delivery of projects.


Collaboration and Communication

1. Collaborate with cross-functional teams, including data science, product, and business stakeholders.

2. Communicate technical plans, progress, and issues to stakeholders.

3. Foster a culture of innovation, experimentation, and continuous learning.

4. Identify and mitigate project blockers, collaborating with stakeholders to resolve issues.

5. Agree and report KPIs on engineering delivery to the leadership team via defined weekly/monthly updates. Take an active part in monthly townhalls representing the engineering workstream.


Requirements:

1. Education: Bachelor's degree in Computer Science, Engineering, or a related field.

2. Experience: 15+ years of experience in data engineering, with 5+ years of experience in a leadership role.

3. Technical Skills: Strong knowledge in Snowflake, Fivetran, DBT, and orchestration tools (e.g., Apache Airflow, Prefect).

4. Leadership Skills: Proven leadership and management experience, with the ability to motivate and inspire teams.

5. Communication Skills: Excellent communication and collaboration skills, with the ability to work with cross-functional teams.


Nice to Have:

1. Certifications in data engineering, such as Snowflake Certified Data Engineer or AWS Certified Data Engineer.

2. Experience with cloud-based data platforms, such as Azure, AWS, or GCP.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineering Lead - AWS & Snowflake

Data Engineering Lead - AWS & Snowflake, Hybrid working: 3 days inTW6, Middlesex offices & 2 days homer/remote, Salary: Negotiable to £70.,000 DOE plus 40 % bonus potential, Job Reference: J12869Full UK working rights required/no sponsorship available Looking for a challenge in one of the worlds largest airfreight logistics organisation...

Datatech Longford

Senior Product Manager, Non-Clinical Safety Products

Job descriptionThe Onyx Research Data Tech organization is GSK’s Research data ecosystem which has the capability to bring together, analyze, and power the exploration of data at scale. We partner with scientists across GSK to define and understand their challenges and develop tailored solutions that meet their needs. The goal...

GSK Stevenage

Senior Data Engineer

Senior Data Engineer 🌟Are you ready to take your career to the next level? We're looking for a Senior Data Engineer to lead the way in transforming data into actionable insights. If you’re passionate about innovation and thrive in a fast-paced, collaborative environment, this is the role for you!🔍 What...

Watford

Head Of Data Engineering & Infrastructure

Location: London Office / Hybrid (3 days a week working from home)Reporting to: Director - Data & AnalyticsThe Role : Head of Data Engineering & InfrastructureThis role offers a unique opportunity to lead and shape the data engineering strategy at an organisation that values the transformative power of data. As...

London

Director Data Engineering

At PeakMetrics, we stand at the forefront of narrative intelligence, harnessing the power of advanced machine learning to safeguard enterprises and government agencies from social media manipulation and narrative attacks. Our platform rapidly sifts through millions of unstructured, cross-channel media datasets, transforming them into actionable insights. By identifying adversarial online...

PeakMetrics Bristol

Director Data Engineering

At PeakMetrics, we stand at the forefront of narrative intelligence, harnessing the power of advanced machine learning to safeguard enterprises and government agencies from social media manipulation and narrative attacks. Our platform rapidly sifts through millions of unstructured, cross-channel media datasets, transforming them into actionable insights. By identifying adversarial online...

PeakMetrics Glasgow