Senior Data Engineer (REMOTE)

Metapack
London
10 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer - Databricks

Senior Data Engineer_London_Hybrid

Senior Data Engineer - Snowflake - £100,000

Senior Data Scientist

Senior Data Scientist

About us

At Auctane, we are united by a passion to help sellers — wherever they are, however they operate — fulfil the promises they make to consumers. The Auctane mission is to fuel commerce through exceptional delivery. We make it possible for businesses to meet the ever-rising expectations of their customers, and we make the world smaller and more accessible to consumers everywhere. Auctane brands enable hundreds of thousands of merchants to annually deliver billions of products — over $200 billion worth — to customers around the globe. And Auctane is just getting started.

Auctane is a team of shipping and software experts with a passion for helping merchants move their ideas, dreams and innovations around the globe. The Auctane family includes ShipStation, ShipWorks, ShipEngine, ShippingEasy, Stamps, Endicia, Metapack, Shipsi, GlobalPost, and Packlink. Our partners include Amazon, UPS, USPS, eBay, BigCommerce, Shopify, WooCommerce, and Walmart.

Our values

About the team

The Auctane Engineering Tech and Data team does one thing first - provide our customers with world class production software. This team ensures that our customers experience a fast and reliable system and provides our engineering teams with the tools to deploy, monitor, and maintain our production systems.

About the role

Data is key to Auctane’s strategy.We work at scale, pace and with the latest architecture patterns and tech.We process thousands of events per second and our massive dataset keeps growing at a staggering pace. We keep improving our data platform and data engineering stack to accommodate growth, enable novel solutions and provide the best service to our customers.

We have a flat and open engineering culture where data & evidence beats opinion and hierarchy, backed by honest and frank discussions.We passionately believe in forming autonomous, cross functional teams who are empowered to deliver our ambitious strategy. Energy and passion for our business and customers is a part of the Auctane culture – and we love working with like-minded people.

What you'll be doing?

Contribute to the design, build and operational management of our data lake and analytics solution on top of proven AWS data technologies like S3, Athena, Lambda, Kinesis and ECS  Use state of the art technologies like Airflow, dbt and Spark to process data and get our dataset just right Develop frameworks and solutions that enable us to acquire, process, monitor and extract value from our massive dataset Support the Data Analysts and Data Scientists with automation, tooling, data pipelines and data engineering expertise, enabling them to deliver complex analytics products and machine learning solutions Deliver highly reliable software and data pipelines using Software Engineering best practices like automation, version control, continuous integration/continuous delivery, testing, security, etc. Define, implement and enforce automated data security and data governance best practices within the solutions designed Mentor more junior colleagues and receive mentorship by more senior colleagues

What are we looking for?

A Software Engineering background Experience developing and supporting robust, automated and reliable data pipelines in Python and SQL Experience with data processing frameworks like Pandas, Polars, dbt or Spark Experience with streaming data processing AWS, Azure or Google Cloud experience Continuous integration/delivery environment experience with a passion for automation Knowledge of a data orchestration solution like Airflow, Oozie, Luigi or Prefect Knowledge of both relational and non-relational database design and internals Knowledge of how to design distributed systems and the trade-offs involved Experience working with software engineering best practices for development, including source control systems, automated deployment pipelines like Jenkins and devops tools like Terraform

What will make you stand out?

Production experience working with very large datasets Knowledge and direct experience of using business intelligence and analytics tools (Tableau, Looker, Power BI, etc.) Practical understanding of PII related issues and other considerations regarding data security Experience with big data cloud technologies like EMR, Athena (Trino), Glue, Big Query, Dataproc, Dataflow. MLOps know-how A desire to constantly challenge the norm Fast-learner with a keen interest in evaluating and adopting new technologies: Apache Iceberg, Dagster, dbt, GreatExpectations, Prefect, Snowflake, etc. Willing to attend conferences, webinars and meet-ups and share the learning

What do we offer?

Clear compensation. We'll ask you about your salary expectations in the first interview to ensure we're on the same page. Tools for the job: Auctane will provide you with all equipment you need, ensuring you can seamlessly and securely work from either the London office or the comfort of your home.Flexible hybrid working approach: Hybrid working offers the flexibility to balance on-site collaboration and remote productivity, leading to enhanced efficiency and well-being. As part of our approach, we ask that you attend the office two days a week, ensuring a blend of in-person connection and remote work benefits.Central London location: Experience the best of both worlds and join us at our fantastic office. Immerse yourself in our dynamic and open culture. Enjoy the array of complimentary drinks and snacks, and join our monthly social activities. Our London office serves as a vibrant hub within our global community, embodying true international diversity with representatives from over 20 different nationalities, speaking 10 languages. 25 days holiday (plus public holidays). Your holiday entitlement will increase to max. of 30 days, based on your length of service(2 yrs / 27 days, 3yrs / 28 days, 4yrs / 29 days and 5 yrs / 30 days)CompanyPension:Auctane operates a contributory pension scheme on behalf of its employees, and will contribute up to 4%, providing the employee matches the contribution.❤️‍ Life insurance:Auctane will provide 4x of base salary. This benefit is available from the first day of employment. Long term income protection: 50% of your base salary for up to 5 years. This benefit is available from the first day of employment. PrivateMedical and Dental Insurance:Both benefits are via our partner Bupa and available post probation. (Dental enrolment only occurs in May)Personal Training Budget. We offer a generous training budget of up to £2000 per year dedicated to your professional development. Whether it's investing in certifications, attending conferences, or exploring other educational opportunities, we are committed to supporting you in enhancing your expertise. We also provide access to LinkedIn Learning. This benefit is available post-probation. Health and Wellbeing: We have a wealth of health and wellbeing benefits available. Here’s just some of what we offer; gym membership and subsidies, 24/7 EAP, virtual GP appointments, subsidised eye care, counselling sessions, physiotherapy sessions, PT, and nutrition advice, financial and legal support. There is also an extensive resource library of podcasts, webinars and articles.Tax-Free Childcare: You may be eligible for tax-free childcare, subject to the criteria set by the government. If successful, you can get up to £500 every 3 months (£2,000 a year) for each of your children to help with the costs of childcare.Cycle to work scheme: Auctane offers a subsidised cycle purchase scheme, Through this scheme, you will enjoy exclusive benefits, including attractive savings and convenient payment plans. This benefit is available post-probation. Interest-free season ticket loan: Auctane can provide an interest-free loan of up to £7,000 to purchase an annual season ticket for travel requirements. This benefit is available post-probation. Referral Bonus:Our Employee Referral Bonus Program is designed to reward you for helping us build an even stronger and more talented team. You could earn up to £3,000, depending on the role and subject to the bonus program criteria. Postal Services:Auctane offers 99% discount on personal shipments using Packlink.pro

#LI-REMOTE

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Portfolio Projects That Get You Hired for AI Jobs (With Real GitHub Examples)

In the fast-evolving world of artificial intelligence (AI), an impressive portfolio of projects can act as your passport to landing a sought-after role. Even if you’ve aced interviews in the past, employers in AI and machine learning (ML) are increasingly asking candidates to demonstrate hands-on experience through the projects they’ve built and shared online. This is because practical ability often speaks volumes about your suitability for a role—far more than any exam or certification alone could. In this article, we’ll explore how to build an outstanding AI portfolio that catches the eye of recruiters and hiring managers, including: Why an AI portfolio is crucial for job seekers. How to choose AI projects that align with your target roles. Specific project ideas and real GitHub examples to help you stand out. Best practices for showcasing your work, from writing clear READMEs to using Jupyter notebooks effectively. Tips on structuring your GitHub so that employers can instantly see your value. Moreover, we’ll discuss how you can use your portfolio to connect with top employers in AI, with a handy link to our CV-upload page on Artificial Intelligence Jobs for when you’re ready to apply. By the end, you’ll have a clear roadmap to building a portfolio that will help secure interviews—and the AI job—of your dreams.

AI Job Interview Warm‑Up: 30 Real Coding & System‑Design Questions

In today's competitive AI job market, nailing a technical interview can be the difference between landing your dream role and getting lost in the crowd. Whether you're looking to break into machine learning, deep learning, NLP (Natural Language Processing), or data science, your problem-solving skills and system design expertise are certain to be put to the test. AI‑related job interviews typically involve a range of coding challenges, algorithmic puzzles, and system design questions. You’ll often be asked to delve into the principles of machine learning pipelines, discuss how to optimise large-scale systems, and demonstrate your coding proficiency in languages like Python, C++, or Java. Adequate preparation not only boosts your confidence but also reduces the likelihood of fumbling through unfamiliar territory. If you’re actively seeking positions at major tech companies or innovative AI start-ups, then check out www.artificialintelligencejobs.co.uk for some of the latest vacancies in the UK. Meanwhile, this blog post will guide you through 30 real coding & system-design questions you’re likely to encounter during your AI job interview. This list is designed to help you practise, anticipate typical question patterns, and stay ahead of the competition. By reading through each question and thinking about the possible approaches, you’ll sharpen your problem-solving skills, time management, and critical thinking. Each question covers fundamental concepts that employers regularly test, ensuring you’re well-equipped for success. Let’s dive right in.

Negotiating Your AI Job Offer: Equity, Bonuses & Perks Explained

Artificial intelligence (AI) has proven itself to be one of the most transformative forces in today’s business world. From smart chatbots in customer service to predictive analytics in finance, AI technologies are reshaping how organisations operate and innovate. As the demand for AI professionals grows, so does the complexity of compensation packages. If you’re a mid‑senior AI professional, you’ve likely seen job offers that include far more than just a base salary—think equity, bonuses, and a range of perks designed to entice you into joining or staying with a company. For many, the focus remains squarely on salary. While that’s understandable—after all, your monthly take‑home pay is what covers day-to-day expenses—limiting your negotiations to salary alone can leave considerable value on the table. From stock options in ambitious startups to sign‑on bonuses that ‘buy you out’ of your current contract, modern AI job offers often include elements that can significantly boost your long-term wealth and job satisfaction. This article aims to shed light on the full scope of AI compensation—specifically focusing on how equity, bonuses, and perks can enhance (or sometimes detract from) the overall value of your package. We’ll delve into how these elements work in practice, what to watch out for, and how to navigate the negotiation process effectively. Our goal is to provide mid‑senior AI professionals with the insights and tools to land a holistic compensation deal that accurately reflects their technical expertise, leadership potential, and strategic importance in this fast-moving field. Whether you’re eyeing a leadership role in machine learning at an established tech giant, or you’re considering a pioneering position at a disruptive AI startup, the knowledge in this guide will help you weigh the merits of base salary alongside the potential riches—and risks—of equity, bonuses, and other benefits. By the end, you’ll have a clearer sense of how to align your compensation with both your immediate lifestyle needs and long-term career aspirations.