Jobs

Senior Cloud/Data Engineer


Job details
  • Rapid7
  • Belfast
  • 2 weeks ago

Senior Cloud Engineer


Rapid7 seeks an experienced, highly driven, and dynamic Senior Cloud Engineer to take our data engineering function to the next level. Come and join our efforts in unlocking the value of data through industry-leading innovation, cutting edge modern tooling, democratization at scale and building exceptional and trusted data products for the company! 

About the Team
As we spearhead a cultural shift to a data-driven business, Data Engineering serves as the Hub for all teams at Rapid7 from ML Ops, to Sales and Operations to Platform and Engineering. Our team is a highly skilled yet egoless group of data magicians (and humorists) with a penchant for innovation and a knack for problem solving. 

About the Role

As a Senior Cloud Engineer, you will build and maintain data infrastructure within the Data Engineering team's data platform. You’ll be responsible for managing containerized applications and supporting our product event streaming systems in the cloud as you partner with high impact teams such as AI and Product Analytics. You will also build data pipelines using tools such as Airflow, Python, ECS and Snowflake. The Senior Data Engineer will also be expected to drive and mature best practices such as IAC (Terraform) and DevOps within the Data Engineering team. 

In this role, you will:

Build and maintain hosted environments for key tools with AWS ECS/EKS

Manage cloud environments for the data engineering team through Terraform

Support our product events data architecture including Kafka, SQS, EKS &, S3

Develop data pipelines with Fivetran, Snowflake & Airflow using languages such as Python, SQL & Javascript

Provide thought leadership and contribute to the vision of our data engineering function 

Participate in team processes such as on-call rotations, bug triage, technical direction, standards, and execution 

Own delivery architecture/execution of major component(s) from conception to release

Looked up to for technical mentorship within the data engineering team. Make others better through code reviews, focus on documentation, and technical guidance

Understand the tradeoffs between technical and business needs, interact and negotiate with key stakeholders, and deliver solutions that take all of these needs into account 

Regularly take complex designs / codebases and simplify them without being asked

Work closely with leadership to drive adoption of the latest DevOps and DataOps trends and technologies.

The skills you’ll bring include:

5+ years of hands-on software engineering experience 

4+ years working with a major cloud provider (preferably AWS); Experience building/maintaining VPC’s and deploying code using Terraform is a must!

3+ years building and maintaining hosted environments and applications using EKS or another container service is a must!

5+ years of experience in at least one programming language such as Python, Java, Scala is required (Python is our most commonly used language); Advanced SQL expertise is required

Experience working in a modern lakehouse is required (Snowflake is preferred); Modern warehousing best practices should be second nature

Cloud experience is required (AWS is strongly preferred); Terraform is highly preferred

Knowledge and ideally hands on experience working with container services is required (ECS, Kubernetes, etc)

Experience working in a mature SDLC environment (ie: CICD) is required 

Modern tech stack experience is a plus (dbt, Fivetran, Snowflake. Airflow)

Experience as a leader within a data engineering team and ability to mentor teammates 

Strong work ethic, resiliency, persistence, and urgency; Data Engineering holds itself to a high standard so you’ll need to keep up!

Sharp business and interpersonal skills; ability to influence at senior levels across business units to drive change and achieve common goals

BS or MS in Computer Science, Analytics, Statistics, Informatics, Information Systems or
another quantitative field or equivalent experience 


We know that the best ideas and solutions come from multi-dimensional teams. That’s because these teams reflect a variety of backgrounds and professional experiences. If you are excited about this role and feel your experience can make an impact, please don’t be shy - apply today.
 

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Lead Software Engineer; Data, Cloud, ML

Job DescriptionWe have an exciting and rewarding opportunity for you to take your software engineering career to the next levelAs a Senior Lead Software Engineer at JPMorgan Chase within theCorporate Investment Bank, Markets Research Technology Team,you serve as a seasoned member of an agile team to design and deliver trusted...

JP Morgan Chase Bank, National Association London

Senior Java Software Engineer

Senior Java DeveloperLocation: London, 2 days per weekExperience: 5+ yearsAboutMy client, a technology consulting firm that specializes in delivering digital transformation solutions, focusing on areas such as cloud services, data engineering, artificial intelligence, and enterprise application development. They partner with companies across industries to drive innovation and operational efficiency through...

Talent London

Senior Machine Learning Engineer

This is a dynamic and highly rewarding position for someone who is passionate about using the latest technology and science to deliver patient outcomes and building an innovative company from the ground up.We are a techbio food as medicine pre-seed company on a mission to help 1 million people gain...

Healthnix London

Senior Java Developer

Senior Java DeveloperLocation : London, 2 days per weekType : Full-TimeSalary : Competitive, based on experienceExperience : 5+ yearsStart Date : ImmediateAboutMy client, a technology consulting firm that specializes in delivering digital transformation solutions, focusing on areas such as cloud services, data engineering, artificial intelligence, and enterprise application development. They...

Talent International London

Risk, Operational Risk, Technology, Vice President, London

Description RISK The Risk Division is a team of specialists charged with managing the firm’s credit, market, liquidity, operational and capital risk. Whether assessing the creditworthiness of the firm’s counterparties, monitoring market risks associated with trading activities, or offering analytical and regulatory compliance support, our work contributes directly to the...

Asset & Wealth Management London

Senior Machine Learning Engineer (UK)

Are you into writing RAGs? Looking for an exciting opportunity at a leading international product company? Our client is a global leader in the JobTech industry, operating in the realms of: - Data- Platforms- Technology The company’s mission is to drive a lasting change in the job market through the...

yellow brick road London