Jobs

Senior Data Engineer - Search


Job details
  • SoundCloud Ltd
  • London
  • 2 weeks ago
Applications closed

SoundCloud empowers artists and fans to connect and share through music. Founded in 2007, SoundCloud is an artist-first platform empowering artists to build and grow their careers by providing them with the most progressive tools, services, and resources. With over 400+ million tracks from 40+ million artists, the future of music is SoundCloud.

We are looking for a Senior Data Engineer to join the Soundcloud Search team (part of the Music Discovery group), with a mission to help users find and play what they’re looking for and enable them to explore further to discover music that exists nowhere else and connect directly with the artists that make it. You will be crucial in shaping the data infrastructure that powers our search systems, ensuring high-quality, scalable, and real-time data flows. Collaborating with a multidisciplinary team, you will contribute to building robust data pipelines that power all our feedback cycles, from feeding our Machine Learning algorithms to enhancing the search performance and user experience.

About the role:

As a Data Engineer, you will work on building and optimizing high-end data pipelines that drive key performance indicators (KPIs) and train our ML models. You will also be working on the real-time processing of the data pipelines that power search features for millions of users. You’ll work with a range of technologies, including Python and Scala, BigQuery and BigTable, Spark and Dataflow, and collaborate with other teams to ensure data is structured and prepared for both search systems and machine learning models.

About you:

You have a strong background in data engineering (at least 5 years), with strong foundations on algorithms and data structures. You have experience designing and optimizing data pipelines, data architecture and modeling, and ETL processes for large-scale (distributed) systems. You are comfortable working with millions of data points regularly and are passionate about ensuring data quality and consistency, which are key to improving the overall search experience. You are proficient in SQL and Python, ideally also experienced in Scala or Java. You also have experience training, prototyping, and deploying machine learning models. Experience in Search or Recommender Systems is a plus.

You are proactive, detail-oriented, and committed to learning. You thrive in a collaborative, Agile environment, working closely with cross-functional teams to tackle complex data challenges. You are a problem-solver at heart, driven by a passion for data and how it can enhance user experiences. While independent in your work, you excel in a team setting, contributing to a culture of excellence and shared success.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer - London - AWS - £80,000 + Benefits

Data Engineer - London - Hybrid - £70,000 - £80,000 + BenefitsCompany Overview:My client is a modern data consultancy that empowers data-driven organisations to realise the full value of its partnered technologies such as Amazon Web Services (AWS), Snowflake and more! They provide consulting and managed services in data engineering,...

City of London

Senior Data Engineer - Remote - £60k

Senior Data Engineer - Remote - £60kExciting opportunity for an experienced cloud data engineer to join an expanding data team who are using data in an exciting and advanced way. They will support your learning and development from a technical and leadership perspective as you help them design, build and...

Newcastle upon Tyne

Senior Data Engineer

Senior Data Engineer – Remote / Manchester - £65-80,000A SaaS platform is on a mission to revamp its data setup. As it continues to move on-premises SQL and Cosmos DB to the cloud with Azure, a new Data team is being formed to lead the charge. The goal is to...

Manchester

Senior Data Engineer

Senior Data EngineerAre you a seasoned data professional with a passion for designing and implementing scalable data solutions? We are looking for a Senior Data Engineer to join our innovative team. This role offers the chance to work on exciting projects, leverage cutting-edge technologies, and play a key role in...

Bristol

Senior Data Engineer

Senior Data EngineerLocation: DublinSalary Range: €(phone number removed)HybridReperio are working with a well-established but fast-growing fintech company who are looking for a Senior data Engineer to join their ranks. You will design, implement, and maintain reliable and efficient ETL/ELT pipelines to support data integration across multiple sources. This role with...

Dublin

Senior Data Engineer (Synapse/Databricks),12m FTC Fully Remote

Leading UK Logistics Company require a Senior Data Engineer to play a pivotal role in leading the design, development and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment. Your expertise will ensure the availability, reliability and scalability of their data platform, empowering the organisation with timely...

Birmingham