Data focused tech business within the automotive industry.
Role - Data Engineer
Type - Fixed term contract (6 months)
Salary - £65,000 - £75,000
Location - Hybrid, 2 days per week in the office (Victoria, London)
Spec -
PURPOSE OF POST:
To implement scalable and efficient data models, databases, and processing systems
To build robust, fault-tolerant data pipelines for ingesting, processing and transforming large volumes of data
To collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand their data requirements and provide solutions
To assist with report/data extract creation and data delivery activities related to the transition of services for stakeholders
QUALIFICATIONS / SKILLS / ATTRIBUTES REQUIRED BY JOB HOLDER:
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Proven experience as a Data Engineer or similar role.
Proficiency with SQL
A thorough understanding of data modelling in a traditional Relational Database environment
Proficiency in programming languages such as Python, Java, or Scala.
Strong knowledge of databases (e.g., SQL, NoSQL), data warehousing, and big data technologies.
Experience with Azure services, such as Azure SQL Database, Azure Synapse Analytics, Azure Data Lake, and Azure Blob Storage.
Experience implementing data quality checks and validation processes to ensure data consistency and integrity
Familiarity with data modelling tools and techniques.
Excellent problem-solving and communication skills.
MAIN DUTIES INCLUDE:
Data Pipeline Development:
Build robust, fault-tolerant data pipelines for ingesting, processing, and transforming large volumes
of data.
Integrate data from various sources and ensure data quality and consistency.
Database Management:
Administer and optimise databases for performance, scalability, and reliability.
Implement and manage ETL (Extract, Transform, Load) processes.
Infrastructure Management:
Work with IT and DevOps teams to set up and maintain the necessary infrastructure for data storage
and processing.
Ensure data security, compliance, and privacy.
Collaboration:
Collaborate with cross-functional teams, including data scientists, analysts, and business
stakeholders, to understand their data requirements and provide solutions.
Performance Optimisation:
Identify and resolve performance bottlenecks in data systems.
Monitor and tune data processing systems for optimal performance.
Data Modelling and Warehousing:
Create and manage data views and materialized views for reporting and analytics purposes.
Data Visualization Support:
Create data sets for visualization tools like Power BI and Tableau, enabling data analysts and stakeholders to access insights.
Documentation:
Create and maintain comprehensive documentation for data infrastructure, processes, and workflowsGCS is acting as an Employment Agency in relation to this vacancy
