Jobs

Senior Data Engineer - Search


Job details
  • SoundCloud Ltd
  • London
  • 23 hours ago

SoundCloud empowers artists and fans to connect and share through music. Founded in 2007, SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources. With over 400+ million tracks from 40+ million artists, the future of music is SoundCloud.

We are looking for a Senior Data Engineer to join the Soundcloud Search team (part of the Music Discovery group), with a mission to help users find and play what they’re looking for and enable them to explore further to discover music that exists nowhere else and connect directly with the artists that make it. You will be crucial in shaping the data infrastructure that powers our search systems, ensuring high-quality, scalable, and real-time data flows. Collaborating with a multidisciplinary team, you will contribute to building robust data pipelines that power all our feedback cycles, from feeding our Machine Learning algorithms to enhancing the search performance and user experience.

About the role:

As a Data Engineer, you will work on building and optimizing high-end data pipelines that drive key performance indicators (KPIs) and train our ML models. You will also be working on the real-time processing of the data pipelines that power search features for millions of users. You’ll work with a range of technologies, including Python and Scala, BigQuery and BigTable, Spark and Dataflow, and collaborate with other teams to ensure data is structured and prepared for both search systems and machine learning models.

About you:

You have a strong background in data engineering (at least 5 years), with strong foundations on algorithms and data structures. You have experience designing and optimizing data pipelines, data architecture and modeling, and ETL processes for large-scale (distributed) systems. You are comfortable working with millions of data points regularly and are passionate about ensuring data quality and consistency, which are key to improving the overall search experience. You are proficient in SQL and Python, ideally also experienced in Scala or Java. You also have experience training, prototyping, and deploying machine learning models. Experience in Search or Recommender Systems is a plus.

You are proactive, detail-oriented, and committed to learning. You thrive in a collaborative, Agile environment, working closely with cross-functional teams to tackle complex data challenges. You are a problem-solver at heart, driven by a passion for data and how it can enhance user experiences. While independent in your work, you excel in a team setting, contributing to a culture of excellence and shared success.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer (Synapse/Databricks),12m FTC Fully Remote

Leading UK Logistics Company require a Senior Data Engineer to play a pivotal role in leading the design, development and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment. Your expertise will ensure the availability, reliability and scalability of their data platform, empowering the organisation with timely...

Birmingham

Senior Data Engineer - London - GCP - 70,000 + Benefits

Senior Data Engineer - London - GCP - Up to £70,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as...

City of London

Senior Data Engineer

Senior Data EngineerLocation: Great Billing, Northampton, NN3 9EX.Salary: £60,000 to £70,000 DOE.Contract: Full time, permanent. 28 days per annum +3 bank holidays (Christmas, Boxing Day, NYD).Billing Finance is a family-owned vehicle financing Company based on the outskirts of Northampton. We focus on customers with non-standard credit profiles that may not...

Great Billing

Senior Data Engineer - London - GCP - Up to £75,000 + Benefits

Senior Data Engineer - London - GCP - Up to £75,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as...

City of London

Senior Data Engineer

Senior Data EngineerLocation:Remote working (Once a month in Oxford)Salary:£80k + competitive benefits packageRole Overview:Our client is seeking a Senior Data Engineer to elevate their data infrastructure's reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while managing end-to-end...

Harnham Nottingham

Senior Data Engineer

Senior Data EngineerLocation:Remote working (Once a month in Oxford)Salary:£80k + competitive benefits packageRole Overview:Our client is seeking a Senior Data Engineer to elevate their data infrastructure's reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while managing end-to-end...

Harnham Liverpool