Senior Data Engineer - Data Corpus

SoundCloud Ltd
London
2 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Fabric - £70,000 - London

Senior Data Engineer - Snowflake & AWS

Senior Manager Marketing Data & Insights Strategy

Senior Data Scientist (GenAI)

SoundCloud empowers artists and fans to connect and share through music. Founded in 2007, SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources. With over 400+ million tracks from 40+ million artists, the future of music is SoundCloud.

We are looking for an experienced Senior Data Engineer (Level 3) to join the Data Foundations department in our Data Corpus team. You will help us continue building our unified and standardized data warehouse, Corpus, which is used across SoundCloud for reporting, data science, and analytics, building data products, or simply answering questions. You will also help us build out our business-ready data layer to be used in dashboarding and for simplified data usage. You can read more about Data Corpus in our blog post.

About the role

The Data Corpus team is responsible for building and maintaining SoundCloud’s petabyte-scale GCP data warehouse. You will build and maintain the warehouse to abstract the complexity of SoundCloud’s vast data ecosystem to exploit and get value from data. You will work closely with business reporting, data science, and product teams. You will gather and refine requirements, design data architecture and solutions, and build ETL pipelines using Airflow to land data in BigQuery and beyond. You will model and build out the business-ready data layer, designed to feed dashboarding tools with KPIs and simplify data access for business and product stakeholders. You will have knowledge and passion for analytics engineering. You are a strong individual contributor who thrives in a dynamic environment and is motivated by solving challenging data problems.

About you

As a Senior individual contributor, you will be able to manage stakeholders, plan and lead technical projects, and identify and focus the business value of projects. 

Must have:

Senior Level Data Professional +6 years experience ideal, +4 years minimum experience. Experience working with Cloud technologies GCP (required) AWS/Azure is also nice to have Experience working with BigQuery Advanced SQL knowledge Python experience Airflow experience Experience working with big data (terabyte/petabyte scale) Experience in Data Architecture/solution design Experience working in Agile methodology, ideally working with Jira. Experience in data warehousing and analytical data modelling. Experience working with CI/CD pipelines and code repositories (Git preferred) Experiencing in building complex and high-reliability ETL pipelines Experience building data for BI Tools (Looker preferred) Experience building datasets for product and business KPIs Knowledge of basic statistical concepts and methods Experience producing high-quality technical documentation Excellent English-speaking communicator and demonstrator

Nice to have:

Experience in basic QA engineering and testing methodologies Experience with experimentation (A/B testing) tools and processes Experience working with subscription-based businesses Experience integrating third-party tools and systems Data visualisation skills Experience with terraform

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Ways AI Pros Stay Inspired: Boost Creativity with Side Projects, Hackathons & More

In the rapidly evolving world of Artificial Intelligence (AI), creativity and innovation are critical. AI professionals—whether data scientists, machine learning engineers, or research scientists—must constantly rejuvenate their thinking to solve complex challenges. But how exactly do these experts stay energised and creative in their work? The answer often lies in a combination of strategic habits, side projects, hackathons, Kaggle competitions, reading the latest research, and consciously stepping out of comfort zones. This article will explore why these activities are so valuable, as well as provide actionable tips for anyone looking to spark new ideas and enrich their AI career. Below, we’ll delve into tried-and-tested strategies that AI pros employ to drive innovation, foster creativity, and maintain an inspired outlook in an industry that can be both exhilarating and daunting. Whether you’re just starting your AI journey or you’re an experienced professional aiming to sharpen your skills, these insights will help you break out of ruts, discover fresh perspectives, and bring your boldest ideas to life.

Top 10 AI Career Myths Debunked: Key Facts for Aspiring Professionals

Artificial Intelligence (AI) is one of the most dynamic and rapidly growing sectors in technology today. The lure of AI-related roles continues to draw a diverse range of job seekers—from seasoned software engineers to recent graduates in fields such as mathematics, physics, or data science. Yet, despite AI’s growing prominence and accessibility, there remains a dizzying array of myths surrounding careers in this field. From ideas about requiring near-superhuman technical prowess to assumptions that machines themselves will replace these jobs, the stories we hear sometimes do more harm than good. In reality, the AI job market offers far more opportunities than the alarmist headlines and misconceptions might suggest. Here at ArtificialIntelligenceJobs.co.uk, we witness firsthand the myriad roles, backgrounds, and success stories that drive the industry forward. In this blog post, we aim to separate fact from fiction—taking the most pervasive myths about AI careers and debunking them with clear, evidence-based insights. Whether you are an established professional considering a career pivot into data science, or a student uncertain about whether AI is the right path, this article will help you gain a realistic perspective on what AI careers entail. Let’s uncover the truth behind the most common myths and discover the actual opportunities and realities you can expect in this vibrant sector.

Global vs. Local: Comparing the UK AI Job Market to International Landscapes

How to navigate salaries, opportunities, and work culture in AI across the UK, the US, Europe, and Asia Artificial Intelligence (AI) has evolved from a niche field of research to an integral component of modern industries—powering everything from chatbots and driverless cars to sophisticated data analytics in finance and healthcare. The job market for AI professionals is consequently booming, with thousands of new positions posted each month worldwide. In this blog post, we will explore how the UK’s AI job market compares to that of the United States, Europe, and Asia, delving into differences in job demand, salaries, and workplace culture. Additionally, we will provide insights for candidates considering remote or international opportunities. Whether you are a freshly qualified graduate in data science, an experienced machine learning engineer, or a professional from a parallel domain looking to transition into AI, understanding the global vs. local landscape can help you make an informed decision about your career trajectory. As the demand for artificial intelligence skills grows—and borders become more porous with hybrid and remote work—the possibilities for ambitious job-seekers are expanding exponentially. This article will offer a comprehensive look at the various regional markets, exploring how the UK fares in comparison to other major AI hubs. We’ll also suggest factors to consider when choosing where in the world to work, whether physically or remotely. By the end, you’ll have a clearer picture of the AI employment landscape, and you’ll be better prepared to carve out your own path.