Data Engineer -SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake
Highly technical Data Engineer required for a cloud native, Lloyd's market insurance organisation. This company is going through a period of hyper-growth and are extremely ahead of the industry curve in their technology offering. With deep experience in Azure platform architecture, SQL and Python, the successful Data Engineer will be teaming up with Data Scientists to build ETL / ELT pipelines for their pricing and risk selection tools in a greenfield environment. Their stamp capacity has doubled in two years and are well-set to reach £1bn in the near future.
As the company are incredibly forward-thinking in their use of Data Science, you will need to be well-versed in the challenges faced by the team where their 300 source databases are ever-increasing. Within the first month, you will have a full DevOps board to action and deliver. You will be an excellent communicator and have the ability to contribute and take ownership of your work.
Responsibilities:
- Solve complex business challenges by building data solutions and applications
- Collaborate closely with Data Scientists and wider team to build robust and scalable data pipelines
- Work exclusively in Azure in a data and technology-focused environment
- Use DevOps best practice for scalability and re-usability of deployment
- Forge strong professional relationships across the business
Requirements:
- Extensive experience in SQL, Python and Azure
- Proven experience building ETL / ELT data pipelines
- Knowledge of DevOps and project delivery methodologies Waterfall and Agile
- Lloyd's market experience would be a significant advantage
- Demonstrable experience in cloud data services - Azure, Databricks, Snowflake
Data Engineer -SQL, Python, Azure, ADF, Synapse, DevOps, Databricks, Spark, Snowflake
