Senior Data Engineer

Senior Data Engineer - London, 2x Weekly - £65,000-£70,000

Scroll down to find the complete details of the job offer, including experience required and associated duties and tasks.

Our client is seeking a Senior Data Engineer to join their growing team in London. In this critical role, you will lead the design, development, and optimization of data pipelines and systems, with a strong focus on Snowflake and Databricks platforms. Your work will involve creating robust ETL processes using Python, enabling the organization to leverage its data more effectively. A background in AI/ML is highly advantageous, as the company is looking to integrate advanced analytics into their data operations.

What You'll Do

• Design, build, and optimise data pipelines using Snowflake and Databricks to support the company’s data infrastructure.
• Develop ETL processes in Python to automate the ingestion, transformation, and integration of data from various sources.
• Collaborate with data scientists and analysts to implement AI/ML models into the data architecture, enhancing the company’s analytical capabilities.
• Work with cross-functional teams to gather data requirements and translate them into scalable, efficient solutions.
• Ensure data quality, reliability, and performance across all data systems.
• Continuously assess and improve existing data processes to enhance efficiency and scalability.
• Stay up to date with emerging technologies and best practices in data engineering, particularly in Snowflake, Databricks, and AI/ML.

About You

• Extensive experience in data engineering with a strong focus on Snowflake and Databricks.
• Proficient in Python, with a proven track record of developing and maintaining ETL processes.
• Solid understanding of data architecture and best practices for building scalable, high-performance data systems.
• Experience with AI/ML technologies and a passion for integrating advanced analytics into data operations.
• Strong problem-solving skills and the ability to work independently in a fast-paced environment.
• Excellent communication skills, with the ability to convey complex technical concepts to both technical and non-technical stakeholders.
• A collaborative team player with experience working across multiple departments to achieve common goals.

Bonus Points If You Have

• Hands-on experience with AI/ML frameworks and integrating machine learning models into data pipelines.
• Familiarity with additional cloud data platforms or tools.
• Experience in a senior or lead role, mentoring junior engineers and guiding technical projects.