Data Engineer (SC Cleared,Databricks)
This role involves designing and maintaining scalable data pipelines on Azure, with a strong focus on Databricks, Delta Lake, and Spark-based processing. The engineer will implement data transformation logic, ensure data quality and governance using Azure Purview, and collaborate with data scientists and analysts to deliver reliable data solutions. Work includes ETL/ELT development, DevOps automation, and optimising cloud-native data platforms in an Agile environment.