We have an exciting opportunity to support our Manchester based client on a 6 month Data Engineer contract role.We are looking for a visionary individual to lead the creation of a high-performing, scalable, and compliant data platform. Your role will involve modernizing current ad-hoc data solutions using advanced technologies to generate high-quality data for analysis.Responsibilities: * Collaborate with business users to design and implement efficient, secure, and scalable data pipelines using standardized tools and procedures. * Troubleshoot and resolve data pipeline issues, perform root cause analysis, and implement enhancements to prevent recurrence. * Take full ownership of the data quality within core datasets and pipelines. * Work with other teams to identify and resolve data quality issues. * Ensure data is complete, accessible, and consumable in a fast-paced development environment. * Maintain data security, integrity, and governance by adhering to company standards and best practices. * Promote data quality, governance, and security within product and engineering teams. * Contribute to and evolve best practices for architecture, quality, and non-functional requirements. * Experiment with new tools and technologies to enhance engineering excellence. * Design, build, test, and support high-quality code in line with departmental guidelines and testing strategies.Qualifications: * 5+ years of experience building big data pipelines in distributed environments using tools such as Airflow, Kafka, Hadoop, AWS S3, AWS Lambda, AWS IAM, Spark, SQL, Python, and DBT. * Strong data modeling skills (e.g., Dimensional, Data Vault). * Passionate about Continuous Integration, Continuous Delivery, and Agile methodologies. * Solid understanding of security principles and secure coding practices. * Experience with large-scale, well-governed, and compliant systems. * Proven ability to lead, guide, and coach team members both technically and procedurally. * Basic knowledge of analytics and machine learning concepts. * Excellent communication skills, both written and verbal. * Understanding of cloud security best practices. * Experience with cloud platforms, preferably AWS.If you are interested, please apply with your CV and we will be in touch to discuss further
