Senior Data Engineer

Senior Data Engineer - Full Remote - Outside IR35 - 6 Months +

We are seeking a Senior Data Engineer to assist our client with an exciting project. This fully remote role is UK-based, allowing you to work from anywhere within the UK. You will be responsible for implementing a new data platform (Dataiku), a leading data science and machine learning platform.

The ideal candidate will have a strong background in designing and building efficient data pipelines, as well as experience in creating high-frequency, high-streaming solutions. If you have a Dataiku certification, a deep understanding of modern data engineering practices, and experience with AWS or Microsoft Data solutions, we want to hear from you.

Key Responsibilities:

• Lead the implementation of the new Dataiku platform.
• Design, build, and maintain efficient data pipelines to handle large-scale data processing.
• Develop high-frequency and real-time streaming data solutions to meet project requirements.
• Collaborate with data scientists, analysts, and other engineers to ensure seamless data integration and functionality.
• Provide technical expertise on Dataiku, ensuring best practices are followed.
• Optimize cloud-based data solutions using either AWS or Microsoft Data services.
• Troubleshoot, debug, and enhance data systems for performance and scalability.

Desirables:

• Dataiku certification (essential).
• 4+ years of experience as a Data Engineer.
• Proven track record of designing and implementing data pipelines.
• Strong experience with high-frequency and real-time data streaming solutions.
• Expertise in either AWS or Microsoft Data solutions.
• Familiarity with data warehousing, ETL processes, and big data technologies.
• Ability to work independently and collaborate in a remote, cross-functional team.
• Strong problem-solving skills and attention to detail.

If you are interested in this vacancy, please apply with your CV and I will be in touch.