DataOps Engineer

RedCloud
London
6 months ago
Applications closed

Related Jobs

View all jobs

Data Operations Engineer

Data Ops Engineer

About RedCloud

RedCloud is leveraging AI-powered technology to break down the barriers to fair and profitable trade in emerging markets.

RedCloud's Intelligent Open Commerce Platform connects FMCG Brands, Distributors, and Local Merchants on a single, equitable marketplace, empowering them with real-world insights and data to help them make better decisions. RedCloud enables FMCG Brands to seize new opportunities in emerging markets, facilitates access to more buyers & streamlines operations for Distributors, and helps Local Merchants spend more time selling products, not searching for them.

The company comprises a highly diverse, dynamic team of driven talented people from over twenty different countries, speaking multiple languages, with a physical footprint in Africa, Europe, and Latin America.

 

The role:

The DataOps Engineer is responsible for the development, implementation, and maintenance of data pipelines and infrastructure. This role focuses on optimizing data flow and collection for cross-functional teams. The ideal candidate has a deep understanding of data engineering, DevOps, and software development principles, and is committed to enhancing data management processes.

Responsibilities:

Pipeline Development & Management:

  • Design, build, and maintain scalable and reliable data pipelines.
  • Automate data ingestion, transformation, and delivery processes.
  • Ensure data quality, integrity, and reliability throughout the data lifecycle.

Infrastructure Management:

  • Manage cloud data infrastructure.
  • Implement and optimize data storage solutions.
  • Monitor and ensure the performance, scalability, and security of data platforms.
  • Setting up alerts to detect anomalies

Collaboration & Support:

  • Collaborate with data scientists, analysts, Engineers, and other stakeholders to understand data requirements and deliver optimal solutions.
  • Provide support for data-related issues and troubleshooting.
  • Assist in the development and implementation of data governance and security policies including access management.

Continuous Improvement:

  • Implement CI/CD processes for data workflows.
  • Optimise existing processes and frameworks for better performance and cost-efficiency.
  • Stay updated with the latest industry trends and technologies to continuously improve data operations. 

Requirements:

Even if you don’t meet all the requirements, we encourage you to apply!

Experience:

  • 3+ years of experience in DataOps, Data Engineering, or a related role.
  • Proven experience with data pipeline tools (Airflow).
  • Hands-on experience with cloud platforms (AWS, Azure, Google Cloud) and data services (Snowflake).

Technical Skills:

  • Proficiency in SQL and experience with relational databases.
  • Strong programming skills in Python.
  • Proficient with containerization and orchestration tools (e.g. Docker, Kubernetes).
  • Experience with CI/CD tools (Terraform, Jenkins, GitHub, Concourse CI).
  • Knowledge of data warehousing and ETL/ELT processes.

Soft Skills:

  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.
  • Attention to detail and a commitment to data quality.

Education:

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field. Master’s degree is a plus

Benefits

Working with a pioneering provider of eCommerce solutions you will have the opportunity to join an international company who are growing massively, we encourage ambition and creativity.

Plus, you will get:

  • 25 Days Annual leave, increasing to 26 days after 12 months in the business
  • Pension
  • Life Insurance
  • Dental cover
  • Private Healthcare
  • Stock / Equity

Check out the links below to see what our CEO Justin Floyd has to say about our plans for growth for the year ahead, and to see our latest video on the mission we’re on!

RedCloud I We're growing!

RedCloud I Red101 App I Open Commerce

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Ways AI Pros Stay Inspired: Boost Creativity with Side Projects, Hackathons & More

In the rapidly evolving world of Artificial Intelligence (AI), creativity and innovation are critical. AI professionals—whether data scientists, machine learning engineers, or research scientists—must constantly rejuvenate their thinking to solve complex challenges. But how exactly do these experts stay energised and creative in their work? The answer often lies in a combination of strategic habits, side projects, hackathons, Kaggle competitions, reading the latest research, and consciously stepping out of comfort zones. This article will explore why these activities are so valuable, as well as provide actionable tips for anyone looking to spark new ideas and enrich their AI career. Below, we’ll delve into tried-and-tested strategies that AI pros employ to drive innovation, foster creativity, and maintain an inspired outlook in an industry that can be both exhilarating and daunting. Whether you’re just starting your AI journey or you’re an experienced professional aiming to sharpen your skills, these insights will help you break out of ruts, discover fresh perspectives, and bring your boldest ideas to life.

Top 10 AI Career Myths Debunked: Key Facts for Aspiring Professionals

Artificial Intelligence (AI) is one of the most dynamic and rapidly growing sectors in technology today. The lure of AI-related roles continues to draw a diverse range of job seekers—from seasoned software engineers to recent graduates in fields such as mathematics, physics, or data science. Yet, despite AI’s growing prominence and accessibility, there remains a dizzying array of myths surrounding careers in this field. From ideas about requiring near-superhuman technical prowess to assumptions that machines themselves will replace these jobs, the stories we hear sometimes do more harm than good. In reality, the AI job market offers far more opportunities than the alarmist headlines and misconceptions might suggest. Here at ArtificialIntelligenceJobs.co.uk, we witness firsthand the myriad roles, backgrounds, and success stories that drive the industry forward. In this blog post, we aim to separate fact from fiction—taking the most pervasive myths about AI careers and debunking them with clear, evidence-based insights. Whether you are an established professional considering a career pivot into data science, or a student uncertain about whether AI is the right path, this article will help you gain a realistic perspective on what AI careers entail. Let’s uncover the truth behind the most common myths and discover the actual opportunities and realities you can expect in this vibrant sector.

Global vs. Local: Comparing the UK AI Job Market to International Landscapes

How to navigate salaries, opportunities, and work culture in AI across the UK, the US, Europe, and Asia Artificial Intelligence (AI) has evolved from a niche field of research to an integral component of modern industries—powering everything from chatbots and driverless cars to sophisticated data analytics in finance and healthcare. The job market for AI professionals is consequently booming, with thousands of new positions posted each month worldwide. In this blog post, we will explore how the UK’s AI job market compares to that of the United States, Europe, and Asia, delving into differences in job demand, salaries, and workplace culture. Additionally, we will provide insights for candidates considering remote or international opportunities. Whether you are a freshly qualified graduate in data science, an experienced machine learning engineer, or a professional from a parallel domain looking to transition into AI, understanding the global vs. local landscape can help you make an informed decision about your career trajectory. As the demand for artificial intelligence skills grows—and borders become more porous with hybrid and remote work—the possibilities for ambitious job-seekers are expanding exponentially. This article will offer a comprehensive look at the various regional markets, exploring how the UK fares in comparison to other major AI hubs. We’ll also suggest factors to consider when choosing where in the world to work, whether physically or remotely. By the end, you’ll have a clearer picture of the AI employment landscape, and you’ll be better prepared to carve out your own path.