Jobs

Data Engineer


Job details
  • SearchWorks
  • Manchester
  • 4 days ago

About the Role:

Join a dynamic team that is focused on building cutting-edge data solutions. As a Data Engineer, you'll play a key role in developing, maintaining, and improving our data pipeline, leveraging advanced technologies to extract, transform, and analyze large datasets.


Responsibilities:

  • Develop and maintain data infrastructure using cloud technologies.
  • Automate data processing and scheduling scripts.
  • Evaluate and implement new technologies to improve the data platform.
  • Support production systems and troubleshoot issues.
  • Conduct code reviews and provide feedback.
  • Collaborate with stakeholders to understand requirements.
  • Serve as a subject matter expert for the data platform.


Qualifications:

  • Strong problem-solving skills.
  • Knowledge of cloud technologies (AWS or equivalent).
  • Expertise in serverless technologies, frameworks, and best practices.
  • Experience with infrastructure automation tools (CloudFormation, Terraform).
  • Proficiency in Scala, Java, C#, SQL, or Python.
  • High-quality coding and testing practices.
  • Willingness to learn new technologies.
  • Knowledge of agile software development practices.
  • Strong interpersonal skills and a positive attitude.
  • Experience debugging and troubleshooting critical systems.


Preferred Qualifications:

  • Exposure to Apache Spark, Trino, or other big data processing systems.
  • Knowledge of streaming data principles.
  • Understanding of database technologies and standards.
  • Experience working with large and complex datasets.
  • Exposure to data engineering practices for machine learning.
  • Experience with Git, Jenkins, and CI/CD tools.

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Data Engineer

I am currently working with a large private sector company in the West Midlands on the hunt for an Analytics/Data Engineer to join a growing team. If you are a data professional looking for the opportunity to join a large growing company and progress your career, please read through the...

Birmingham

Data Engineer

Data EngineerPay up to £58,347, plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance.As a Data Engineer you'll be working within a high-performing team of engineers, developing data-centric solutions that positively impact millions of DWP users, helping them to find and use essential DWP services.DWP....

Marton, Lancashire

Data Engineer

Data EngineerPay up to £58,347, plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance.As a Data Engineer you'll be working within a high-performing team of engineers, developing data-centric solutions that positively impact millions of DWP users, helping them to find and use essential DWP services.DWP....

High Heaton

Data Engineer

Data EngineerPay up to £58,347, plus 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance.As a Data Engineer you'll be working within a high-performing team of engineers, developing data-centric solutions that positively impact millions of DWP users, helping them to find and use essential DWP services.DWP....

Richmond Hill

Data Engineer - Hybrid/Bristol - Up to £55k

Data Engineer - Hybrid/Bristol - Up to £55,000Job Title: Data EngineerLocation: Hybrid/Bristol (Min. 2 days per week)Remuneration: £45,000 - £55,000 per annumResponsibilities:Pipeline Development and Optimisation: Continuously assess and improve the performance of data enrichment pipelines, ensuring their efficiency, dependability, and scalability.Data Management: Design and implement robust processes for data ingestion...

Bristol

Data Engineer

Contract type: PermanentHours: Full Time, 37.5 hours per weekSalary: circa £60,000 depending on experienceLocation: Canary WharfWFH policy: Employees are required to attend the office 2 days/weekFlexible working: Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight.Reports to: Lead Data EngineerDeadline Note: We reserve the right...

Canary Wharf