Role: Senior Data Engineer

Location: London (2x per week onsite)

Calling all data engineers with experience inApacheSpark,Scalaand ideally commercial and enterprise applications!

We are currently supporting aleading SaaS provider,based in London, who are on an exciting journey of transformational growth. As a business, they are a product focused company, offering a cutting-edge hybrid observability platform powered by AI.

Their innovative platform integrates AI and Machine Learning into every layer, empowering modern enterprises to achieve unparalleled operational visibility and predictability across their IT environments. This supports in enhancing IT team efficiency, reducing alert fatigue, and proactively identifying trends.

They are looking for a Senior Data Engineer with the following skillset:

• Over6 years of experience in software development, focusing oncommercial or enterprise applications.
• More than 4 years of dedicatedScaladevelopment, with a commitment to writing clean, maintainable, and well-tested code while embracing modern software engineering practices.
• Extensive knowledge ofscalable data systems, includingNoSQLdatabases like HBase, distributed object stores, message queues such asKafka, distributed filesystems like S3 and HDFS, and data platforms such asSpark.
• Experience with AI or ML / working with data scientists to scale applications is preferred
• Proven expertise in building, deploying, and optimising jobs withApacheSpark.
• Strong ability to write maintainable, production-ready code with comprehensive testing.
• Familiarity with container technologies likeDockerand Kubernetes.
• Experience collaborating with Data Scientists to transform prototypes into scalable applications.
• Ability to work effectively within a development team, fostering strong and reliable relationships with team members.
• Excellent communication skills, both written and verbal, and the ability to collaborate with various functional teams, including Support Engineering, Tools, and Product.
• Bachelor’s degree or higher in Computer Science or a related field.

What will you be doing?

• Plan and manage deliverables within an agile development framework.
• Architect, document, develop, and test solutions for new platforms or updates to existing systems.
• Collaborate with various internal teams to create software that drives company growth.
• Provide technical leadership and mentorship to team members, guiding them in both design and implementation.
• Translate business requirements into system functionalities and features.
• Diagnose and resolve complex product or application issues escalated for support.
• Work alongside a globally distributed development team across multiple locations, including the US, UK, and Asia.
• Solve intricate performance and design challenges with strong technical expertise.
• Continuously enhance development processes and streamline application deployment.

They have a brilliant culture of collaboration, peer reviewing and development - with a dynamic team of 12, consisting of data scientists, UI engineers, a data architect,javadevelopers and reporting into the Director of AI, the opportunity is agile, forward thinking and high-performing.

If this seems like a strong fit for you, please apply with your up-to-date cv.