Your Role
and What You'll Be Doing
The Senior Data Engineer is responsible for the design, development, and maintenance of data engineering solutions for Irwin Mitchell. They successful candidate will understand requirements, create technical designs, configure applications, write codes, and conduct testing. You will also collaborate with various teams, participate in meetings, provide technical advice to address concerns and ensure quality and reliability by conducting thorough testing, performing code reviews, and implementing best practices in data engineering development.
The Senior Data Engineer role is a key part in accelerating data value creation at IM and unlocking data’s potential, enabling improved data driven decisions and advanced analytics, you will help shape IM transition to the cloud, both through the creation of a modern cloud data platform and as a wider organisation. It will ensure IM’s data is optimised to support the needs of colleagues and Clients.
What You'll Be Doing
Proactively ensuring well architected solutions are achieved; Conducting regular one-on-one sessions with mentees, offering constructive feedback, advice, and career guidance; Sharing knowledge and best practices with the engineering team, fostering a culture of continuous learning and improvement; Creating and facilitating technical training programs or workshops to enhance the skills and capabilities of the engineering team; Mentoring and providing technical guidance to junior data engineers, ensuring adherence to best practices and driving continuous improvement; Provide guidance, mentorship, and support to junior engineers, helping them develop technical skills, problem-solving abilities, and professional growth; Staying up-to-date with the latest advancements in data engineering and Azure technologies, evaluating and recommending new tools, frameworks, and architectures to enhance our data capabilities; Collaborating closely with data scientists and analysts to understand their requirements and providing data engineering support for their advanced analytics and machine learning projects. Monitoring and troubleshooting data pipelines, ensuring data integrity, availability, and security.
About You
We're looking for an experienced Snior Data Engineer who has a broad range of skills with expertise in a specific area, with a good understanding of the end to end data solutions. Our ideal candidate will also have the following:
Experience in develop Databricks Lakehouse using Delta lake and Unity Catalog; In-depth understanding of data modelling, ETL development, and data integration techniques; Experience with Terraform/Bicep for deploying infrastructure as code and application code via Azure DevOps; Demonstrable expertise in Python programming for data engineering tasks, including data extraction, transformation, and loading; Good knowledge of cloud-based data architectures, distributed computing concepts, and big data technologies (e.g., PySpark, Spark); Extensive hands-on experience with Azure data services, such as Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Functions, and Azure Synapse Analytics; Good communication skills, with the ability to conveying complex technical concepts to both technical and non-technical stakeholders. This includes being able to listen actively, ask clarifying questions, and articulate ideas clearly and concisely.
If this sounds like you and you want to join a thriving team hit the apply button below for consideration!
Our Benefits - What We Can Offer You 25 days holidays as standard plus bank holidays - You can ‘buy’ up to 35hrs of extra holiday too. Generous and flexible pension schemes. Volunteering days – Two days of volunteering every year for a cause of your choice (fully paid) Westfield Health membership, offering refunds on medical services alongside our Aviva Digital GP services.
We also offer a wide range of well-being initiatives to encourage positive mental health both in and out of the workplace and to make sure you’re fully supported. This includes our Flexible by Choice programme which gives our colleagues more choice over a hybrid way of working subject to role, team and client requirements.
We have been ranked in the Best Workplaces for Wellbeing for Large Organisations for 2024!
Our responsible business programmes are fundamental to who we are and our purpose. We’re committed to being a diverse and inclusive workplace where our colleagues can flourish, and we have established a number of inclusion network groups across our business to support this aim.
Our commitment to Social Responsibility, community investment activity and tackling climate change is a fundamental part of who we are. It’s made up of four strands: Our People, Our Community, Our Environment and Our Pro Bono.
