Jobs

Data Engineer with Data Formats


Job details
  • Capgemini
  • London
  • 3 weeks ago

Get The Future You Want!

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Your Role

We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have a deep understanding of data engineering principles, data technologies, and a proven track record of designing and building complex data pipelines. This role requires strong expertise in SQL, various data formats, Python, and JavaScript to support our data-driven decision-making processes and enhance our data infrastructure.
• Architect and maintain scalable data pipelines using various programming technologies.
• Use SQL to query, transform, and process data across relational and NoSQL databases.
• Integrate data from APIs, flat files, and streaming sources for consistency and quality.
• Implement real-time data processing using Kafka or Solace.
• Manage data storage in systems and warehouses, optimizing for performance.
• Design data models and apply techniques like partitioning and indexing for efficiency.
• Handle multiple data formats (CSV, JSON, Parquet) and manage unstructured data.
• Utilize Python and JavaScript (Node.js) for data processing, automation, and ETL development.
• Leverage Microsoft technologies, Apache Spark, and Airflow for distributed computing.
• Implement DevOps tools (Jenkins, Git, Docker) for CI/CD and monitor pipeline performance.
 

Your Profile

• Bachelor’s or Master’s degree in Computer Science, Data Science, IT, or related field.
• 8+ years of experience in data engineering, architecture, or related roles.
• Proven track record in building and maintaining large-scale, complex data pipelines.
• Expertise in managing data infrastructure in high-volume environments.
• Strong foundation in designing and optimizing data systems and workflows.
 

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Platform Engineer

About us Founded in 2018, Causaly accelerates how humans acquire knowledge and develop insights in Biomedicine. Our production-grade generative AI platform for research insights and knowledge automation enables thousands of scientists to discover evidence from millions of academic publications, clinical trials, regulatory documents, patents and other data sources… in minutes. ...

Causaly London

Senior Machine Learning Engineer

The Fitch Group Emerging technology group is seeking aSenior/Lead machine learning engineerto be part of a team that will be dedicated to build and support Generative AI, Machine learning and Data science solutions across the organization.Specific Emerging Technology team objectives are:Gen AI/ML technology implementation with business and product owners ​...

Fitch Ratings London

Senior Machine Learning Engineer

Senior / Lead Machine Learning EngineerThe Fitch Group Emerging technology group is seeking aSenior/Lead machine learning engineerto be part of a team that will be dedicated to build and support Generative AI, Machine learning and Data science solutions across the organization.Specific Emerging Technology team objectives are:Gen AI/ML technology implementation with...

Fitch Ratings Manchester

GCP ML Engineer with Computervision Imaging experience

Machine Learning Engineer – GCP and Computer Vision Imaging3 MonthsHybrid Working with 2 Days Per Week onsiteInside IR35My client a top Global company are currently looking to recruit a Machine Learning Engineer with GCP Cloud and Computer Vision Imaging experience to join their team on a contract basis. Please note...

Lorien London

Data Engineer

DescriptionSalary: Up to £55,000 depending on experience Location: London, Bristol, Manchester - Hybrid Support in applyingIf you need this job description in another format, or other support in applying, please email .We believe we can use tech to make public services better. We also believe this can happen best when...

Made Tech

Data Engineer - Temporary (up to 12 months)

Data Engineer - Temporary (up to 12 months)Salary £49,492 to £58,226 (dependent on experience) Contract type Temporary: Fixed Term Contract or Secondment Hours Full Time Location Poole, Dorset, England Location description Hybrid between home and Poole Closing Date 29-09-2024 Reference 17971 Documents (please view all documents)(PDF, 181.74kb)(PDF, 212.46kb)About usOur purpose...

RNLI Poole