Jobs

Data Engineer with Data Formats


Job details
  • Capgemini
  • London
  • 1 month ago

Get The Future You Want!

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Role

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have a deep understanding of data engineering principles, data technologies, and a proven track record of designing and building complex data pipelines. This role requires strong expertise in SQL, various data formats, Python, and JavaScript to support our data-driven decision-making processes and enhance our data infrastructure.
• Architect and maintain scalable data pipelines using various programming technologies.
• Use SQL to query, transform, and process data across relational and NoSQL databases.
• Integrate data from APIs, flat files, and streaming sources for consistency and quality.
• Implement real-time data processing using Kafka or Solace.
• Manage data storage in systems and warehouses, optimizing for performance.
• Design data models and apply techniques like partitioning and indexing for efficiency.
• Handle multiple data formats (CSV, JSON, Parquet) and manage unstructured data.
• Utilize Python and JavaScript (Node.js) for data processing, automation, and ETL development.
• Leverage Microsoft technologies, Apache Spark, and Airflow for distributed computing.
• Implement DevOps tools (Jenkins, Git, Docker) for CI/CD and monitor pipeline performance.
 

Your Profile

• Bachelor’s or Master’s degree in Computer Science, Data Science, IT, or related field.
• 8+ years of experience in data engineering, architecture, or related roles.
• Proven track record in building and maintaining large-scale, complex data pipelines.
• Expertise in managing data infrastructure in high-volume environments.
• Strong foundation in designing and optimizing data systems and workflows.
 

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Machine Learning Engineer

The Fitch Group Emerging technology group is seeking aSenior/Lead machine learning engineerto be part of a team that will be dedicated to build and support Generative AI, Machine learning and Data science solutions across the organization.Specific Emerging Technology team objectives are:Gen AI/ML technology implementation with business and product owners ​...

Fitch Ratings London

Senior Machine Learning Engineer

Senior / Lead Machine Learning EngineerThe Fitch Group Emerging technology group is seeking aSenior/Lead machine learning engineerto be part of a team that will be dedicated to build and support Generative AI, Machine learning and Data science solutions across the organization.Specific Emerging Technology team objectives are:Gen AI/ML technology implementation with...

Fitch Ratings Manchester

Data Engineer

About Us We're building the future of uncensored AI infrastructure & products. Our technology powers hyper-immersive experiences and enables the ownership of personalized, interoperable AI characters, unlocking vast monetization opportunities across our ecosystem and beyond. We are initially focused on the Creator and Social-Fi landscapes, building interoperable 'superModel' characters powered...

Oh

Software Engineer

About PRODAAt PRODA (www.proda.ai) we are building software to unlock thefull potential of Real Estate Datano matter the asset class, language or country of origin.Our solution leverages the latest technologies to automatically capture, standardise and quality check Real Estate data into a single, clean source of truth. The goal is...

PRODA LTD London

Senior Verification Engineer

Job Overview:Arm is using Machine Learning and Data Science techniques to empower verification teams to make data-driven decisions and is building automated workflows that enable our engineers to deliver more complex products.We are looking for a creative and versatile senior verification engineer to join the "Machine Learning for Verification" (ML4V)...

ARM Newton

Machine Learning Engineer (The Model Innovator)

Are you passionate about solving complex problems with cutting-edge machine learning techniques? Do you love transforming raw data into intelligent systems that can make predictions, automate processes, and provide deep insights? If you're excited about building scalable, high-performance machine learning models that drive business innovation, thenour clienthas the perfect opportunity...

Unreal Gigs Cambridge