Senior Data Engineer - GCP Cloud - Essex

Job Title: Senior Data Engineer - GCP Location: Dunton office - Once a week (every Tuesday) Salary/Rate: up to £318 a day Inside ir35 Start Date: 30/09/24 Job Type: 12 month Contract Company Introduction I am looking for a Senior GCP Data Engineer to join our client who are a Motor Vehicle Manufacturing organisation. The successful candidate for this role will be able to drive into their office in Dunton Essex office once a week (every Tuesday). Required Skills/Experience Develop custom cloud solutions and pipelines with GCP native tools - Data Prep, Data Proc, Data Fusion, Data Flow, DataForm, DBT, and Big Query Expertise in GCP Cloud and open-source tools like Terraform. Proficiency in SQL, Python, and PySpark. Experience with CI/CD practices and tools such as Tekton. Knowledge of workflow management platforms like Apache Airflow and Astronomer. Proficiency in using GitHub for version control and collaboration. - Ability to design and maintain efficient data pipelines. Familiarity with data security, governance, and compliance best practices. Strong problem-solving, communication, and collaboration skills. Ability to work autonomously and in a collaborative environment. Ability to design pipelines and architectures for data processing. Experience with data security, governance, and compliance best practices in the cloud. An understanding of current architecture standards and digital platform services strategy. Excellent problem-solving skills, with the ability to design and optimize complex data pipelines. Meticulous approach to data accuracy and quality Extensive experience programming and scripting experience with SQL, Python, and PySpark. Ability to work effectively across organizations, product teams and business partners. Knowledge Agile Methodology, experience in writing user stories Demonstrated ability to lead data engineering projects, design sessions and deliverables to successful completion. GCP Cloud experience with solutions designed and implemented at production scale. Knowledge of Data Warehouse concepts - experience with Data Warehouse/ ETL processes Strong process discipline and thorough understating of IT processes (ISP, Data Security). Critical thinking skills to propose data solutions, test, and make them a reality. Deep understanding of data service ecosystems including data warehousing, lakes, metadata, meshes, fabrics and AI/ML use cases. User experience advocacy through empathetic stakeholder relationship. Must be able to take customer requirements, conceptualize solutions, and build scalable/extensible systems that can be easily expanded or enhanced in the future. Excellent communication, collaboration and influence skills; ability to energize a team. Knowledge of data, software and architecture operations, data engineering and data management standards, governance and quality Hands on experience in Python using libraries like NumPy, Pandas, etc. Extensive knowledge and understanding of GCP offerings, bundled services, especially those associated with data operations Cloud Console, BigQuery, DataFlow, DataFusion, PubSub / Kafka, Looker Studio, VertexAI Experience with recoding, re-developing and optimizing data operations, data science and analytical workflows and products. Data Governance concepts including GDPR (General Data Protection Regulation) and how these can impact technical architecture. Strong communication and collaboration skills, capable of working effectively with both technical and non-technical stakeholders as part of a large global and diverse team. Ability to work autonomously in areas of high ambiguity. Evidence of a proactive mindset to problem solving and willingness to take the initiative. Strong prioritization, co-ordination, organizational skills, and a proven ability to balance workload and competing demands to meet deadlines. Ability to work in a collaborative working environment, promoting knowledge sharing with the product team, and supporting other team members with technical expertise if required. Skills Preferred: Experience of Java, MDM - Front-end experience, e.g., angular or react. Experience with data visualization tools (e.g., Tableau, Power BI). - Software Quality and Performance (e.g., Sonarqube, Checkmarx, FOSSA, and Dynatrace If you are interested in this opportunity, please apply now with your updated CV in Microsoft Word/PDF format. Disclaimer Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies. Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.