Senior Data Engineer

Unify Talent UK
Bristol
2 months ago
Applications closed

Related Jobs

View all jobs

Senior Data Engineer

Senior Data Engineer

Senior Data Engineer - Fabric - £70,000 - London

Senior Data Engineer - Snowflake & AWS

Senior Manager Marketing Data & Insights Strategy

Senior Data Scientist (GenAI)

Senior Data EngineerInitial 3-month contract£(Apply online only) per day, Outside IR35Start date: 29th of January 2025Remote – 1 day per month in BristolContractor must be based in the UK (ideally South West or M4 Corridor)Unify are proud to be exclusive representing a cutting edge Startup who are experiencing rapid growth.As the team scales and matures the business is looking to engage the services of a Senior Data Engineer on a contract basis for initially 3 months, to help them build a robust, futureproof data warehouse system to enhance and optimize their Data capabilities.About the Team:They are a fast growing team with 8 engineers and the foundations of a data science team. They are transitioning towards a data-driven culture, focusing on enhancing access to their data and enabling reporting capabilities without extensive engineering involvement.Current Data Infrastructure:- Data Flow: Data is collected primarily through API, but also via client side analytics.- Data Stores:- Primary Store: MongoDB, storing the majority of their data.- Reporting Tool: ElasticSearch, used increasingly for serving reports and analytics through frontend applications.Challenges:- Latency issues with large data volumes.- Difficulty generating ad-hoc reports without engineering support.Objectives:- Unlock access to existing data to allow their data scientist to generate reports independently.- Optimise current data systems and usage.- Support the business in harnessing AI capabilities for data analysis.- Create a robust and efficient data warehouse to streamline reporting processes and accommodate future growth.Scope of responsibilities: 1. System Review: Assess the current data architecture and reporting capabilities. 2. Stakeholder Collaboration: Work closely with the VP of Engineering, senior engineers, tech leads, and data scientists to gather requirements and understand business needs. 3. Design and Proposal: Produce a proposal outlining the architecture and design of the new data warehouse, considering factors such as scalability, performance, and cost. Include recommendations for optimisations of current systems. Present this proposal no later than the end of Month 1. 4. Implementation: Develop and implement the data warehouse using appropriate technology (such as AWS, BigQuery, Snowflake, etc.). Ensure that the architecture is well-documented and meets the identified requirements. 5. Handover: Assist in onboarding a newly recruited mid-level data engineer and provide comprehensive documentation for them to understand the system.Deliverables:- A documented proposal for the data warehouse architecture (Month 1).- Recommendations for improvements and optimisations to current systems (Month 1).- Implementation of the data warehouse, ensuring it meets performance and reporting needs (Month 2).- Comprehensive documentation and training for the new data engineer (Month 3).- Final rollout and verification of the implemented system.Technical Skills, Qualifications and background:- Proven experience designing and implementing data warehouses.- Proficiency in MongoDB and ElasticSearch; familiarity with alternative data storage solutions (e.g., BigQuery, Snowflake etc).- Strong understanding of data modeling and ETL processes.- Ability to conduct performance analyses and troubleshoot latency issues.- Excellent communication skills for collaborating with technical and non-technical stakeholders.- Ideally experience in a similar role in a Startup environment and/or Fintech industry experience.Project Methodology:- The core Engineering team follows a form of the ShapeUp process, though the contractor will not be required to adhere strictly to this framework.- Expected to be visible and present progress updates to the team throughout the contract duration.Virtual interviews will be held on the 22nd of January. The preferred candidate will be able to start the assignment on the 29th of January.Please reach out to our Talent Manager, Mark Brereton for more information.Thanks

Get the latest insights and jobs direct. Sign up for our newsletter.

By subscribing you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

10 Ways AI Pros Stay Inspired: Boost Creativity with Side Projects, Hackathons & More

In the rapidly evolving world of Artificial Intelligence (AI), creativity and innovation are critical. AI professionals—whether data scientists, machine learning engineers, or research scientists—must constantly rejuvenate their thinking to solve complex challenges. But how exactly do these experts stay energised and creative in their work? The answer often lies in a combination of strategic habits, side projects, hackathons, Kaggle competitions, reading the latest research, and consciously stepping out of comfort zones. This article will explore why these activities are so valuable, as well as provide actionable tips for anyone looking to spark new ideas and enrich their AI career. Below, we’ll delve into tried-and-tested strategies that AI pros employ to drive innovation, foster creativity, and maintain an inspired outlook in an industry that can be both exhilarating and daunting. Whether you’re just starting your AI journey or you’re an experienced professional aiming to sharpen your skills, these insights will help you break out of ruts, discover fresh perspectives, and bring your boldest ideas to life.

Top 10 AI Career Myths Debunked: Key Facts for Aspiring Professionals

Artificial Intelligence (AI) is one of the most dynamic and rapidly growing sectors in technology today. The lure of AI-related roles continues to draw a diverse range of job seekers—from seasoned software engineers to recent graduates in fields such as mathematics, physics, or data science. Yet, despite AI’s growing prominence and accessibility, there remains a dizzying array of myths surrounding careers in this field. From ideas about requiring near-superhuman technical prowess to assumptions that machines themselves will replace these jobs, the stories we hear sometimes do more harm than good. In reality, the AI job market offers far more opportunities than the alarmist headlines and misconceptions might suggest. Here at ArtificialIntelligenceJobs.co.uk, we witness firsthand the myriad roles, backgrounds, and success stories that drive the industry forward. In this blog post, we aim to separate fact from fiction—taking the most pervasive myths about AI careers and debunking them with clear, evidence-based insights. Whether you are an established professional considering a career pivot into data science, or a student uncertain about whether AI is the right path, this article will help you gain a realistic perspective on what AI careers entail. Let’s uncover the truth behind the most common myths and discover the actual opportunities and realities you can expect in this vibrant sector.

Global vs. Local: Comparing the UK AI Job Market to International Landscapes

How to navigate salaries, opportunities, and work culture in AI across the UK, the US, Europe, and Asia Artificial Intelligence (AI) has evolved from a niche field of research to an integral component of modern industries—powering everything from chatbots and driverless cars to sophisticated data analytics in finance and healthcare. The job market for AI professionals is consequently booming, with thousands of new positions posted each month worldwide. In this blog post, we will explore how the UK’s AI job market compares to that of the United States, Europe, and Asia, delving into differences in job demand, salaries, and workplace culture. Additionally, we will provide insights for candidates considering remote or international opportunities. Whether you are a freshly qualified graduate in data science, an experienced machine learning engineer, or a professional from a parallel domain looking to transition into AI, understanding the global vs. local landscape can help you make an informed decision about your career trajectory. As the demand for artificial intelligence skills grows—and borders become more porous with hybrid and remote work—the possibilities for ambitious job-seekers are expanding exponentially. This article will offer a comprehensive look at the various regional markets, exploring how the UK fares in comparison to other major AI hubs. We’ll also suggest factors to consider when choosing where in the world to work, whether physically or remotely. By the end, you’ll have a clearer picture of the AI employment landscape, and you’ll be better prepared to carve out your own path.