Jobs

Senior Data Engineer


Job details
  • idpp
  • Manchester
  • 1 week ago
Applications closed

Job Title: Senior Data Engineer

Salary: £70-90k

Location: Manchester

(NO SPONSORSHIP OFFERED IN THIS ROLE)


Job Description:We’re looking for a highly skilled and motivated Senior Data Engineer to join a forward-thinking startup team. If you have a strong background in data engineering, data governance, and metadata management, along with expertise in AWS and Python, we want to hear from you!


Key Responsibilities:

Data Engineering:

  • Design, develop, and maintain robust data pipelines and ETL processes for a Dynamic Metadata system and risk index technology.
  • Implement real-time data processing solutions to ensure timely and accurate data for the clients product
  • Optimize data storage and retrieval processes to enhance system performance and scalability.


AWS:

  • Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure.
  • Implement best practices for security, monitoring, and cost management within the AWS ecosystem.
  • Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions.


Data Governance and Metadata Management:

  • Establish and enforce data governance policies to ensure data quality, integrity, and compliance.
  • Develop and maintain metadata management frameworks to support dynamic data processing and real-time analytics.
  • Collaborate with cross-functional teams to define data standards and ensure consistency across the organization.



Python Programming:

  • Develop and maintain Python scripts and applications for data processing, analysis, and automation tasks.
  • Implement machine learning algorithms and statistical models to enhance risk assessment and insurance policy calculations.
  • Write clean, efficient, and well-documented code to ensure maintainability and reproducibility.


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer, with a focus on data governance and metadata management.
  • Strong proficiency in AWS services and cloud architecture.
  • Advanced skills in Python programming and related libraries (e.g., pandas, NumPy, scikit-learn).
  • Experience with real-time data processing frameworks (e.g., Apache Kafka, Apache Spark) is a plus.
  • Solid understanding of data security, privacy regulations, and compliance standards.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.


What the client Offers:

  • Competitive salary and benefits package.
  • Opportunity to work with a dynamic and innovative team at the forefront of insurance technology.
  • Professional development and growth opportunities.
  • Flexible working environment with a focus on work-life balance.



Ready to Innovate? Apply Now!

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer (Synapse/Databricks),12m FTC Fully Remote

Leading UK Logistics Company require a Senior Data Engineer to play a pivotal role in leading the design, development and maintenance of robust data pipelines and infrastructure within their Microsoft Azure environment. Your expertise will ensure the availability, reliability and scalability of their data platform, empowering the organisation with timely...

Birmingham

Senior Data Engineer - London - GCP - 70,000 + Benefits

Senior Data Engineer - London - GCP - Up to £70,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as...

City of London

Senior Data Engineer

Senior Data EngineerLocation: Great Billing, Northampton, NN3 9EX.Salary: £60,000 to £70,000 DOE.Contract: Full time, permanent. 28 days per annum +3 bank holidays (Christmas, Boxing Day, NYD).Billing Finance is a family-owned vehicle financing Company based on the outskirts of Northampton. We focus on customers with non-standard credit profiles that may not...

Great Billing

Senior Data Engineer - London - GCP - Up to £75,000 + Benefits

Senior Data Engineer - London - GCP - Up to £75,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as...

City of London

Senior Data Engineer

Senior Data EngineerLocation:Remote working (Once a month in Oxford)Salary:£80k + competitive benefits packageRole Overview:Our client is seeking a Senior Data Engineer to elevate their data infrastructure's reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while managing end-to-end...

Harnham Nottingham

Senior Data Engineer

Senior Data EngineerLocation:Remote working (Once a month in Oxford)Salary:£80k + competitive benefits packageRole Overview:Our client is seeking a Senior Data Engineer to elevate their data infrastructure's reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while managing end-to-end...

Harnham Liverpool