Data Engineer DM for more info I'm working with a leading tech company in London that's at the forefront of data engineering innovation. They're seeking a talented Data Engineer to join their dynamic team. This is an exciting opportunity to work on cutting-edge data projects in a hybrid work environment. Job Responsibilities: - Design, build, and maintain scalable ETL/ELT pipelines for processing large volumes of data - Develop and optimise data storage solutions using cloud-based technologies - Implement real-time data streaming and processing systems - Ensure data quality, reliability, and security across all data platforms - Collaborate with cross-functional teams to understand and implement data requirements - Implement monitoring and alerting systems for data pipelines and infrastructure Technical Skills Required: - Strong proficiency in Python and SQL - Experience with cloud platforms, preferably AWS or Azure - Expertise in big data technologies such as Apache Spark, Kafka, or Hadoop - Familiarity with data warehousing solutions like Snowflake or Redshift - Experience with workflow orchestration tools like Apache Airflow or Dagster - Knowledge of Infrastructure as Code (IaC) tools, preferably Terraform Nice to Have: - Experience with containerisation technologies like Docker - Familiarity with NoSQL databases - Knowledge of data governance and compliance standards (e.g., GDPR, PCI DSS) - Experience with machine learning pipelines and MLOps Qualifications: - Bachelor's or Master's degree in Computer Science, Engineering, or related field - 3 years of professional experience in data engineering - Strong problem-solving skills and attention to detail - Excellent communication skills to collaborate with diverse teams Compensation: - Competitive salary range: £50,000 - £70,000 per annum, depending on experience - Performance-based bonuses - Generous stock option plan - Comprehensive benefits including health insurance and pension scheme This is an excellent opportunity to work on challenging data problems and make a significant impact through innovative data solutions. If you're passionate about data engineering and want to be part of a dynamic team, please send me a direct message with your CV and a brief introduction. Alternatively, you can apply directly through this post . We look forward to hearing from you