DataOps Engineer – Data Science Operations

Castleton Commodities International LLC
London
3 days ago
Create job alert

Responsibilities:

  • Execute data architecture and data management projects for existing data sources, ensuring alignment with business and technical requirements.

  • Design, enhance, and maintain market data platforms using Python, optimizing for scalability and performance.

  • Manage the end-to-end data ingestion process, including extraction, transformation, loading (ETL), and data publishing for investment and commercial teams.

  • Own and continuously improve the process of mapping, standardizing, and normalizing fundamental analytics data to support consistent usage across business functions.

  • Implement automated workflows for error handling and develop data quality analysis to proactively identify and address systemic issues.

  • Prioritize and resolve critical market data issues based on business impact and user-reported concerns.

  • Coordinate with technology and business stakeholders to align goals, timelines, and deliverables for strategic big data initiatives.

  • Serve as a liaison with commercial (trading) teams to translate their needs regarding data flow, architecture, and the investment process into functional data requirements.

  • Provide operational support for market data platforms, handling performance tuning, incident response, and user assistance.

  • Ensure platform stability and resilience by developing and maintaining operational runbooks, standard operating procedures (SOPs), and incident response protocols.

Qualifications:

  • Bachelor’s degree in Computer Science, Mathematics, Physics, Engineering or related field of study.

  • 5+ years’ experience in data operations production environment, ideally in financial services or energy commodities.

  • Proficient in Python programming and its libraries - Pandas, NumPy, etc.

  • Experience with front-end technologies such as HTML, CSS, JavaScript, and modern front-end frameworks (e.g., React, Angular) is a plus.

  • Prior experience with Snowflake columnar database and ability to design and optimize complex SQL queries.

  • Proficient in using version control systems like Git to manage code repositories effectively.

  • Strong analytical and problem-solving skills to tackle complex technical challenges.

  • Proficiency in debugging and performance optimization techniques.

  • Understanding of the software development lifecycle, from requirements analysis to testing and deployment.

  • Ability to work effectively in a fast-paced, dynamic and high-intensity environment including open-floor plan if applicable to the position, with timely responsiveness and the ability to work beyond normal business hours when required. 

Employee Programs & Benefits:

CCI offers competitive benefits and programs to support our employees, their families and local communities. These include:

  • Competitive comprehensive medical, dental, retirement and life insurance benefits

  • Employee assistance & wellness programs

  • Parental and family leave policies

  • CCI in the Community: Each office has a Charity Committee and as a part of this program employees are allocated 2 days annually to volunteer at the selected charities.

  • Charitable contribution match program

  • Tuition assistance & reimbursement

  • Quarterly Innovation & Collaboration Awards

  • Employee discount program, including access to fitness facilities

  • Competitive paid time off

  • Continued learning opportunities

Visit  https://www.cci.com/careers/life-at-cci/# to learn more!

#LI-CD1

Related Jobs

View all jobs

Data Engineer - DataOps

Data Science Engineer

Data Science Engineer

Data Engineer, Data Engineer Data Analyst ETL Developer BI Developer Big Data Engineer Analytics Engineer Data Platform Engineer Cloud Data Engineer Azure Data Engineer Data Integration Specialist DataOps Engineer Data Pipeline Engineer

Lead DataOps Engineer - Big Data

Data Engineer — DataOps, Cloud Data Pipelines

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

The Skills Gap in AI Jobs: What Universities Aren’t Teaching

Artificial intelligence is no longer a future concept. It is already reshaping how businesses operate, how decisions are made, and how entire industries compete. From finance and healthcare to retail, manufacturing, defence, and climate science, AI is embedded in critical systems across the UK economy. Yet despite unprecedented demand for AI talent, employers continue to report severe recruitment challenges. Vacancies remain open for months. Salaries rise year on year. Candidates with impressive academic credentials often fail technical interviews. At the heart of this disconnect lies a growing and uncomfortable truth: Universities are not fully preparing graduates for real-world AI jobs. This article explores the AI skills gap in depth—what is missing from many university programmes, why the gap persists, what employers actually want, and how jobseekers can bridge the divide to build a successful career in artificial intelligence.

AI Jobs for Career Switchers in Their 30s, 40s & 50s (UK Reality Check)

Changing career into artificial intelligence in your 30s, 40s or 50s is no longer unusual in the UK. It is happening quietly every day across fintech, healthcare, retail, manufacturing, government & professional services. But it is also surrounded by hype, fear & misinformation. This article is a realistic, UK-specific guide for career switchers who want the truth about AI jobs: what roles genuinely exist, what skills employers actually hire for, how long retraining really takes & whether age is a barrier (spoiler: not in the way people think). If you are considering a move into AI but want facts rather than Silicon Valley fantasy, this is for you.

How to Write an AI Job Ad That Attracts the Right People

Artificial intelligence is now embedded across almost every sector of the UK economy. From fintech and healthcare to retail, defence and climate tech, organisations are competing for AI talent at an unprecedented pace. Yet despite the volume of AI job adverts online, many employers struggle to attract the right candidates. Roles are flooded with unsuitable applications, while highly capable AI professionals scroll past adverts that feel vague, inflated or disconnected from reality. In most cases, the issue isn’t a shortage of AI talent — it’s the quality of the job advert. Writing an effective AI job ad requires more care than traditional tech hiring. AI professionals are analytical, sceptical of hype and highly selective about where they apply. A poorly written advert doesn’t just fail to convert — it actively damages your credibility. This guide explains how to write an AI job ad that attracts the right people, filters out mismatches and positions your organisation as a serious employer in the AI space.