Be at the heart of actionFly remote-controlled drones into enemy territory to gather vital information.

Apply Now

Data lakes, Hadoop Developer

N Consulting Ltd
London
9 months ago
Applications closed

Related Jobs

View all jobs

Data Scientist

Staff Data Scientist

Data science - Geology

Data Scientist - Hybrid

Data Science Engineer

Data Scientist


Job Title: Data lakes, Hadoop Developer
Location: London
Work model: Hybrid

Key Responsibilities
Design, build, and manage scalable Data Lakes to support large-scale data processing and analytics.
Develop and maintain Big Data solutions using the Hadoop ecosystem (HDFS, Hive, HBase, Spark, Pig, MapReduce, etc.).
Implement data ingestion pipelines and workflows for structured, semi-structured, and unstructured data.
Optimize data processing and storage to ensure high performance and low latency.
Collaborate with data engineers, analysts, and scientists to provide robust and efficient data access solutions.
Monitor and troubleshoot data pipelines and applications to ensure reliability and accuracy.
Implement data security, governance, and compliance practices across the data lake and Hadoop systems.
Stay updated with emerging Big Data technologies and recommend tools or approaches to enhance the data platform.

Required Skills and Qualifications
Proven experience with Hadoop ecosystems, including HDFS, YARN, Hive, HBase, MapReduce, and Spark.
Expertise in Data Lake architectures and principles.
Proficiency in programming languages such as Python, Java, or Scala for Big Data processing.
Hands-on experience with ETL tools, data ingestion frameworks, and workflow schedulers (e.g., Apache Nifi, Airflow).
Strong knowledge of cloud platforms such as AWS (S3, EMR, Glue), Azure (Data Lake Storage, Synapse), or Google Cloud (BigQuery, Dataflow).
Familiarity with query languages like SQL, HiveQL, or Presto.
Understanding of data governance, security, and compliance (e.g., GDPR, HIPAA).
Excellent problem-solving skills and the ability to debug and resolve issues in distributed systems.

Preferred Qualifications
Experience with Kubernetes, Docker, or other containerization technologies for Big Data deployments.
Knowledge of streaming frameworks like Kafka, Flume, or Spark Streaming.
Hands-on experience in implementing machine learning workflows in a Big Data environment.
Certifications in Big Data technologies or cloud platforms (e.g., AWS Big Data Specialty, Cloudera Certified Professional).
Familiarity with tools like Databricks, Delta Lake, or Snowflake.
 

Subscribe to Future Tech Insights for the latest jobs & insights, direct to your inbox.

By subscribing, you agree to our privacy policy and terms of service.

Industry Insights

Discover insightful articles, industry insights, expert tips, and curated resources.

Careers Education

The Best Free Tools & Platforms to Practise AI Skills in 2025/26

Artificial Intelligence (AI) is one of the fastest-growing career fields in the UK and worldwide. Whether you are a student exploring AI for the first time, a graduate looking to build your portfolio, or an experienced professional upskilling for career growth, having access to free tools and platforms to practise AI skills can make a huge difference. In this comprehensive guide, we’ll explore the best free resources available in 2025, covering AI coding platforms, datasets, cloud tools, no-code AI platforms, online communities, and learning hubs. These tools allow you to practise everything from machine learning models and natural language processing (NLP) to computer vision, reinforcement learning, and large language model (LLM) fine-tuning—without needing a huge budget. By the end of this article, you’ll have a clear roadmap of where to start practising your AI skills for free, how to build real-world projects, and which platforms can help you land your next AI job.

Jobs

Top 10 Skills in Artificial Intelligence According to LinkedIn & Indeed Job Postings

Artificial intelligence is no longer a niche field reserved for research labs or tech giants—it has become a cornerstone of business strategy across the UK. From finance and healthcare to manufacturing and retail, employers are rapidly expanding their AI teams and competing for talent. But here’s the challenge: AI is evolving so quickly that the skills in demand today may look different from those of just a few years ago. Whether you’re a graduate looking to enter the industry, a mid-career professional pivoting into AI, or an experienced engineer wanting to stay ahead, it’s essential to know what employers are actually asking for in their job ads. That’s where platforms like LinkedIn and Indeed provide valuable insight. By analysing thousands of job postings across the UK, they reveal the most frequently requested skills and emerging trends. This article distils those findings into the Top 10 AI skills employers are prioritising in 2025—and shows you how to present them effectively on your CV, in interviews, and in your portfolio.

Jobs

Translucent Careers: Senior Artificial Intelligence Engineer in London

The global landscape of artificial intelligence is evolving rapidly, and nowhere is this transformation felt more strongly than in the financial and accounting industries. AI is no longer just a supporting technology; it is becoming the backbone of innovation, efficiency, and decision-making. One of the most exciting companies at the forefront of this movement is Translucent, a dynamic business redefining how accounting professionals work with AI-driven tools. For professionals seeking to combine technical excellence with meaningful industry impact, Translucent represents a rare career destination. At the heart of their current expansion is an opening for a Senior Artificial Intelligence Engineer in London. This role combines high-level technical leadership, hands-on development, and an opportunity to influence the direction of an emerging force in AI. In this article, we’ll explore: Who Translucent are and why they matter. The significance of AI in financial technology (fintech) and accounting. A deep dive into the Senior AI Engineer role. Skills and requirements needed for success. Career growth and opportunities at Translucent. How artificialintelligencejobs.co.uk helps professionals connect with transformative employers like Translucent.

🍪 We use cookies to enhance your browsing experience on our website. By continuing to use this site, you consent to the use of cookies as described in our Cookie Policy. You can review our Cookie Policy for more information.