DataOps Engineer - London Reference Code: 262615-en_GBContract Type: PermanentProfessional Communities: Software Engineering
The Job You’re Considering
The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP.
Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home; noting that you will be unable to work at home 100% of the time.
If you are successfully offered this position, you will go through a series of pre-employment checks, including: identity, nationality (single or dual) or immigration status, employment history going back 3 continuous years, and unspent criminal record check (known as Disclosure and Barring Service)
Your Role
The Data Ops Engineer role focuses on designing, building, automating, and orchestrating data pipelines and applications within containerised environments, primarily Kubernetes. This role bridges the gap between traditional cloud data engineering and DevOps, emphasising automation and continuous delivery of data solutions. Your work will be to:
- Designing, building, automating and orchestrating data pipelines using tools such as Airflow, Prefect, or Dagster.
- Containerising data applications using Docker and deploying them to Container Platforms (EKS, AKS and Kubernetes).
- Implementing and managing CI/CD pipelines for data applications.
- Implementing and managing comprehensive monitoring and observability solutions using tools like Grafana, Prometheus, and other non-native monitoring tools, ensuring data quality across the entire data flow.
- Working with Infrastructure as Code (IaC) tools (e.g., Terraform, Ansible) to provision and manage data infrastructure within pre-existing platforms.
- Optimising data processing for performance and scalability.
You can bring your whole self to work. At Capgemini equity, diversity and inclusion is part of everyday life, and will be part of your working reality. We have built an inclusive and welcoming environment, for everyone.
Your Skills and Experience
- Proficiency in data pipeline orchestration tools (e.g., Airflow, Prefect, Dagster).
- Extensive experience with Docker and Kubernetes.
- Proficiency in CI/CD principles and tools.
- Familiarity with open-source data tools (e.g., Spark, Kafka, PostgreSQL).
- Competency understanding of IaC concepts (e.g., Terraform, Ansible).
- Understanding of data architecture principles.
- Experience with monitoring and observability tools like Grafana and Prometheus.
Your Security Clearance
To be successfully appointed to this role, it is a requirement to obtain Security Check (SC) clearance.
To obtain SC clearance, the successful applicant must have resided continuously within the United Kingdom for the last 5 years, along with other criteria and requirements.
Throughout the recruitment process, you will be asked questions about your security clearance eligibility such as, but not limited to, country of residence and nationality.
Some posts are restricted to sole UK Nationals for security reasons; therefore, you may be asked about your citizenship in the application process.
What does ‘Get The Future You Want' mean for you?
You will be encouraged to have a positive work-life balance. Our hybrid-first way of working means we embed hybrid working in all that we do and make flexible working arrangements the day-to-day reality for our people. All UK employees are eligible to request flexible working arrangements.
You will be empowered to explore, innovate, and progress. You will benefit from Capgemini’s ‘learning for life’ mindset, meaning you will have countless training and development opportunities from thinktanks to hackathons, and access to 250,000 courses with numerous external certifications from AWS, Microsoft, Harvard ManageMentor, Cybersecurity qualifications and much more.
Why you should consider Capgemini
Growing clients’ businesses while building a more sustainable, more inclusive future is a tough ask. When you join Capgemini, you’ll join a thriving company and become part of a collective of free-thinkers, entrepreneurs and industry experts. We find new ways technology can help us reimagine what’s possible. It’s why, together, we seek out opportunities that will transform the world’s leading businesses, and it’s how you’ll gain the experiences and connections you need to shape your future. By learning from each other every day, sharing knowledge, and always pushing yourself to do better, you’ll build the skills you want. You’ll use your skills to help our clients leverage technology to innovate and grow their business. So, it might not always be easy, but making the world a better place rarely is.
About Capgemini
Capgemini is a global business and technology transformation partner, helping organisations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2024 global revenues of €22.1 billion.
