Jobs

Senior Software Engineer


Job details
  • Rekall Consulting
  • Sheffield
  • 2 weeks ago
Applications closed

Job Title:Senior Software Engineer - Data Engineering

Location:UK, Ireland OR Israel


About Us:


We are a Series A-funded, fast-growing startup revolutionizing data-driven decision-making for platform and security teams in Fortune 500 companies. Our innovative solutions transform raw data into actionable insights that drive efficiency, improve security, and optimize operations. We are seeking a passionateSenior Software Engineer - Data Engineeringto join our dynamic team and help us build world-class data platforms.


Role Overview:


As a Senior Software Engineer - Data Engineering, you will play a pivotal role in designing and implementing robust, scalable data systems that enable real-time processing and large-scale data transformation. You will collaborate with cross-functional teams to develop innovative solutions, optimize existing pipelines, and ensure data quality and integrity. This is an opportunity to work with cutting-edge technologies and directly influence our core platform, enhancing its capability to deliver actionable insights for enterprise clients.


Responsibilities:


  • Design, develop, and optimize large-scale data pipelines to process, transform, and manage high-volume datasets, ensuring reliability, scalability, and performance.
  • Collaborate with product, engineering, and leadership teams to build data systems that align with business objectives and deliver actionable insights for clients.
  • Implement and maintain real-time data streaming and batch processing solutions using tools like Kafka, Spark, and Airflow.
  • Contribute to the development and maintenance of core SDKs and APIs, supporting the integration and utilization of our open-source data platform.
  • Manage and enhance data storage and processing systems, including Snowflake, AWS S3, RDS, and Redshift, optimizing performance for analytical workloads.
  • Ensure data quality and integrity through validation frameworks, automated testing, and monitoring pipelines.
  • Mentor and guide junior team members, fostering best practices in software development and data engineering.
  • Drive continuous improvements in development processes, deployment pipelines, and system monitoring to enhance team velocity and system reliability.


Requirements:


  • Experience:6+ years of professional experience in software and data engineering, with a proven track record of building and maintaining scalable data systems.
  • Programming Skills:Proficiency Go (Golang); experience with additional languages like Python/Java or Scala is a plus.
  • Data Processing:Expertise in real-time data streaming (Kafka) and batch processing frameworks (Spark, Airflow).
  • Data Warehousing:Hands-on experience with Snowflake, Redshift, or similar cloud-based data warehouses.
  • Cloud Technologies:Strong experience with AWS (Lambda, S3, RDS, Redshift, Athena) or other major cloud providers (GCP, Azure).
  • Database Expertise:Proficiency in SQL and NoSQL databases (e.g., PostgreSQL, MongoDB).
  • Development Practices:Familiarity with CI/CD, version control (Git), and infrastructure as code (Terraform, Kubernetes).
  • Problem-Solving:Strong analytical and debugging skills, with the ability to optimize system performance and troubleshoot complex issues.
  • Communication:Excellent written and verbal communication skills, with the ability to document processes clearly and collaborate across teams.
  • Adaptability:Self-motivated and resourceful, with the ability to thrive in a fast-paced, dynamic environment.


Preferred Qualifications:


  • Worked in a lean/agile team or startup (You will be the only data focused engineer)
  • Experience contributing to or managing open-source projects.
  • Familiarity with machine learning workflows and data preprocessing for ML models.
  • Experience with tools like Snowplow, DBT, or other modern data stack components.
  • Knowledge of asset inventory management systems or related domains.


What We Offer:


  • Competitive salary and equity options.
  • Opportunity to work with cutting-edge technologies and make a significant impact on our core platform.
  • Flexible working hours and a remote-first environment.
  • Professional growth opportunities, including mentorship and access to industry-leading tools and resources.
  • Collaborative, inclusive company culture with a focus on innovation and employee well-being.


Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Software Engineer - Machine Learning Tools

The world’s software is built on Arm technology, and as such it is essential that we meet developers where they work – ensuring that the best developer experiences are on Arm platforms and that the full power of Arm’s technology is easily available for those developers to consume.Job Overview:In the...

Cambridge

Senior Software Engineer

London (hybrid) – Senior Software Engineer (device driver development) – (Apply online only)k+ (with an additional 80% stock options)Platform have partnered with an exciting start up that have just secured one of the largest Series-A funding rounds in Europe. They are working on revolutionising data centres and reducing energy consumption...

Farringdon

Senior Software Engineer

Holt Executive is partnered with a leading electro-optics design and manufacturing business, seeking a highly skilled Senior Software Engineer to join their innovative team, supporting cutting-edge video and imaging processing products.Key Responsibilities for Senior Software Engineer:Design, develop, and test application software and Linux drivers for video applications on custom embedded...

Wokingham

Senior Software Engineer - Robotics - Navigation

The MissionProactive Global have partnered with an exciting AI business who are striving to create the world'sleading, commercially scalable, safe, and advanced humanoid robots that seamlessly integrate intodaily life and amplify human capacity.VisionIn a world where artificial intelligence opens up new horizons, our faith in its potential unveils a newoutlook...

London

Senior Software Engineer - Perception

Senior Software Engineer - Robotics - Perception- work with AI technologies and develop Human-like robots.Hybrid, London Our client is fast-growing company that specializes in the robotics engineering and advanced AI technologies aimed at human-like automation. They have an exciting opportunity for a Software Engineer - Perception to join their team....

London

Senior Software Engineer

Senior Software EngineerFull Stack OR BackendMilton Keynes - HybridSalary up to £70,000 DOE!What are we looking for in our next Senior Software Engineer?Experienced in leading and empowering teams to deliver results within structured IT development environments.Capable of supporting architectural activities, establishing, managing, and maintaining client-focused software solutions, including secure private...

Milton Keynes