Senior Data Engineer

Job Title: Senior Data Engineer

Salary: £70-90k

Location: Manchester

(NO SPONSORSHIP OFFERED IN THIS ROLE)

Job Description:We’re looking for a highly skilled and motivated Senior Data Engineer to join a forward-thinking startup team. If you have a strong background in data engineering, data governance, and metadata management, along with expertise in AWS and Python, we want to hear from you!

Key Responsibilities:

Data Engineering:

• Design, develop, and maintain robust data pipelines and ETL processes for a Dynamic Metadata system and risk index technology.
• Implement real-time data processing solutions to ensure timely and accurate data for the clients product
• Optimize data storage and retrieval processes to enhance system performance and scalability.

AWS:

• Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to build and manage scalable data infrastructure.
• Implement best practices for security, monitoring, and cost management within the AWS ecosystem.
• Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions.

Data Governance and Metadata Management:

• Establish and enforce data governance policies to ensure data quality, integrity, and compliance.
• Develop and maintain metadata management frameworks to support dynamic data processing and real-time analytics.
• Collaborate with cross-functional teams to define data standards and ensure consistency across the organization.

Python Programming:

• Develop and maintain Python scripts and applications for data processing, analysis, and automation tasks.
• Implement machine learning algorithms and statistical models to enhance risk assessment and insurance policy calculations.
• Write clean, efficient, and well-documented code to ensure maintainability and reproducibility.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer, with a focus on data governance and metadata management.
• Strong proficiency in AWS services and cloud architecture.
• Advanced skills in Python programming and related libraries (e.g., pandas, NumPy, scikit-learn).
• Experience with real-time data processing frameworks (e.g., Apache Kafka, Apache Spark) is a plus.
• Solid understanding of data security, privacy regulations, and compliance standards.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

What the client Offers:

• Competitive salary and benefits package.
• Opportunity to work with a dynamic and innovative team at the forefront of insurance technology.
• Professional development and growth opportunities.
• Flexible working environment with a focus on work-life balance.

Ready to Innovate? Apply Now!