Jobs

Senior Data Engineer


Job details
  • idpp
  • Manchester
  • 1 week ago

Job Title: Senior Data Engineer

Salary: £70-90k

Location: Manchester

(NO SPONSORSHIP OFFERED IN THIS ROLE)


Job Description:We’re looking for a highly skilled and motivated Senior Data Engineer to join a forward-thinking startup team. If you have a strong background in data engineering, data governance, and metadata management, along with expertise in AWS and Python, we want to hear from you!


Key Responsibilities:

Data Engineering:

  • Design, develop, and maintain robust data pipelines and ETL processes for a Dynamic Metadata system and risk index technology.
  • Implement real-time data processing solutions to ensure timely and accurate data for the clients product
  • Optimize data storage and retrieval processes to enhance system performance and scalability.


AWS:

  • Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure.
  • Implement best practices for security, monitoring, and cost management within the AWS ecosystem.
  • Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions.


Data Governance and Metadata Management:

  • Establish and enforce data governance policies to ensure data quality, integrity, and compliance.
  • Develop and maintain metadata management frameworks to support dynamic data processing and real-time analytics.
  • Collaborate with cross-functional teams to define data standards and ensure consistency across the organization.



Python Programming:

  • Develop and maintain Python scripts and applications for data processing, analysis, and automation tasks.
  • Implement machine learning algorithms and statistical models to enhance risk assessment and insurance policy calculations.
  • Write clean, efficient, and well-documented code to ensure maintainability and reproducibility.


Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer, with a focus on data governance and metadata management.
  • Strong proficiency in AWS services and cloud architecture.
  • Advanced skills in Python programming and related libraries (e.g., pandas, NumPy, scikit-learn).
  • Experience with real-time data processing frameworks (e.g., Apache Kafka, Apache Spark) is a plus.
  • Solid understanding of data security, privacy regulations, and compliance standards.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.


What the client Offers:

  • Competitive salary and benefits package.
  • Opportunity to work with a dynamic and innovative team at the forefront of insurance technology.
  • Professional development and growth opportunities.
  • Flexible working environment with a focus on work-life balance.



Ready to Innovate? Apply Now!

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data Engineer

Senior Data EngineerLocation: Great Billing, Northampton, NN3 9EX.Salary: £60,000 to £70,000 DOE.Contract: Full time, permanent. 28 days per annum +3 bank holidays (Christmas, Boxing Day, NYD).Billing Finance is a family-owned vehicle financing Company based on the outskirts of Northampton. We focus on customers with non-standard credit profiles that may not...

Great Billing

Senior Data Engineer - London - GCP - Up to £75,000 + Benefits

Senior Data Engineer - London - GCP - Up to £75,000 + BenefitsDo you want to work with cutting edge technology? Grow or develop your skills in AI? - A space that could soon dominate the industry. All while working for a company who value your well-being as well as...

City of London

Senior Data Engineer

Senior Data EngineerLocation:Remote working (Once a month in Oxford)Salary:£80k + competitive benefits packageRole Overview:Our client is seeking a Senior Data Engineer to elevate their data infrastructure's reliability and scalability. Reporting to the Data & Analytics Director, you will drive the development of a larger data mesh setup while managing end-to-end...

Harnham Bristol

Senior Data Engineer

Lead Data EngineerSalary £80,000 + Excellent BenefitsHigh Wycombe - 2 days per week in the office, three day working from homeThis is a brand-new role, reflecting our clients continuing focus on data as they continue to drive their business objectives through innovative data solutions. As the Lead Data Engineer, you...

The Future Project Ltd High Wycombe

Senior Data Engineer - 12 month FTC

Summary and purpose of position: This is a 12 month FTC remote position. As a Senior Data Engineer at Wincanton, you will play a pivotal role in leading the design, development, and maintenance of robust data pipelines and infrastructure within our Microsoft Azure environment. Your expertise will ensure the availability,...

Wincanton Allington

Senior Data Engineer

Description Data Engineer Location: Farnborough, UK Clearance: High level of security clearance - (SC/ DV -Developed Vetting) UNLEASH YOUR POTENTIAL Everything we do is built on a commitment to do the right thing for our customers, our people and our community. Our mission and our values guide the way we...

Leidos Mytchett