Jobs

Principal Data Engineer


Job details
  • HSBC Global Services Limited
  • Sheffield
  • 1 month ago
Applications closed

Join a digital first bank that’s powered by people. Our technology team builds innovative digital solutions rapidly and at scale to deliver the next generation of banking services for our customers around the world.
 


The Principal Data Engineer role is a key technical role within the Platform & Data Engineering Team, contributing to, coordinating, and leading data engineering, data acquisition, cloud infrastructure and platform engineering, platform operations, and production support activities using ground-breaking cloud and big data technologies. Cybersecurity-specific knowledge is preferred for the role, but exceptional candidates from other technical disciplines are also encouraged to apply.

As an HSBC employee in the UK, you will have access to tailored professional development opportunities and a competitive pay and benefits package. This includes private healthcare for all UK-based employees, enhanced maternity and adoption pay and support when you return to work, and a contributory pension scheme with a generous employer contribution.

 

In this role you will:

• Ingestion and provisioning of raw datasets, enriched tables, and/or curated, re-usable data assets to enable Cybersecurity use cases.
• Driving improvements in the reliability and frequency of data ingestion including increasing real-time coverage.
• Support and enhancement of data ingestion infrastructure and pipelines.
• Designing and implementing data pipelines that will collect data from disparate sources across the enterprise, and from external sources, transport said data, and deliver it to our data platform.
• Extract Translate and Load (ETL) workflows, using both advanced data manipulation tools and programmatically manipulating data throughout our data flows, ensuring data is available at each stage in the data flow, and in the form needed for each system,       service, and customer along said data flow.
• Identifying and onboarding data sources using existing schemas and, where required, conducting exploratory data analysis

 

To be successful in this role you should meet the following requirements:

 

• Experience with SRE and Azure DevOps
• Ability to script (Bash/PowerShell, Azure CLI), code (Python, C#, Java), query (SQL, Kusto query language) coupled with experience with software versioning control systems (e.g., GitHub) and CI/CD systems.
• Programming experience in the following languages: PowerShell, Terraform, Python Windows command prompt and object orientated programming languages.
• Technical knowledge and breadth of Azure technology services (Identity, Networking, Compute, Storage, Web, Containers, Databases)
• Cloud & Big Data Technologies such as Azure Cloud, Azure IAM, Azure Active Directory (Azure AD), Azure Data Factory, Azure Databricks, Azure Functions, Azure, Kubernetes, Service, Azure Logic    App, Azure Monitor, Azure Log Analytics, Azure Compute, Azure Storage, Azure Data Lake Store, S3, Synapse Analytics and/or PowerBI
• Experience with server, operating system, and infrastructure technologies such as Nginx/Apache, CosmosDB, Linux, Bash, PowerShell, Prometheus, Grafana, Elasticsearch)
• Positive attitude, strong work ethic and passion for learning.

 

This role can be based in both Sheffield and Edinburgh
 

 

Being open to different points of view is important for our business and the communities we serve. At HSBC, we’re dedicated to creating diverse and inclusive workplaces - no matter their gender, ethnicity, disability, religion, sexual orientation, or age. We are committed to removing barriers and ensuring careers at HSBC are inclusive and accessible for everyone to be at their best. We take pride in being a Disability Confident Leader and will offer an interview to people with disabilities, long term conditions or neurodivergent candidates who meet the minimum criteria for the role.

 

If you have a need that requires accommodations or changes during the recruitment process, please get in touch with our Recruitment Helpdesk:

Email:

Telephone:

Sign up for our newsletter

The latest news, articles, and resources, sent to your inbox weekly.

Similar Jobs

Senior Data engineer

Role: Senior Data EngineerLocation: UK Remote Rate £400.00 As a Senior Data Engineer, you’ll play a key role in crafting the data platforms, models and pipelines that inform strategic decision-making for our customers and prepare data for a plethora of use cases from simple analytics to Generative AI and Data...

London

Data Engineer

Want to bring your experience to an industry leader and contribute to our digital transformation?This Data Engineer role will be multi-faceted, working on data pipelines as well as our new strategic data platform and supporting our analytical/data science workstreams.Reporting to the Head of Data, Insights & Analytics, you will be...

Davyhulme

Principal Data Scientist

Principal Data ScientistLocation: Nottinghamshire (Hybrid 3days/week)Salary: £80,(Apply online only) – £90,(Apply online only)Are you ready to take the lead in shaping the future of data science? We are recruiting on behalf of an exciting organisation for a Principal Data Scientist role based in Nottinghamshire. This is a hybrid position that...

Basford

Principal Data Product Manager – Insight & Analytics

Job DescriptionMost of our Talent team are currently on leave for the holiday period, so your application is likely to be reviewed in January. Enjoy the break, we’ll get back to you in the new year!  Principal Data Product Manager London (Hybrid, 40% in office)  £Salary + Bonus + Shares...

Trainline London

Data & Infrastructure Engineer (CA)

About Element HumanOur vision is to bring empathy to digital interactions. Emotions make us human. Technology doesn’t account for human emotions. We’re going to change that. Element Human believes in a world where people are first, always.  We are a multi-disciplinary team using AI to build the emotion layer for...

Element Human London

EV Data Science and Modelling Expert

Head over to our main website to hear more about our storyABOUT ZENOBEOur goal is to make clean power accessible, to accelerate the shift to zero carbon power and transport.We’re building and operating the world’s most sophisticated battery systems to enable the uptake of more renewable power and accelerating fleet...

Zenobē London