Data Engineer

Job Overview:

Our client is looking for a highly skilled AWS Data Engineer to play a pivotal role in building and maintaining their data infrastructure. This position will involve working with a team of data scientists, analysts, and engineers to ensure the seamless integration, transformation, and storage of large datasets. The ideal candidate will bring expertise in AWS cloud services, data pipelines, and a passion for optimising data processes.

Key Responsibilities:

• Design, develop, and manage scalable data pipelines on AWS.
• Implement efficient ETL processes to handle large datasets from various sources.
• Collaborate with data scientists and analysts to enhance data storage, access, and retrieval processes.
• Monitor data pipeline performance, identifying and resolving any issues to ensure reliability.
• Maintain high standards of data quality, security, and governance.
• Develop comprehensive documentation for data processes and system architecture.
• Stay informed about the latest AWS features and data engineering trends to continually improve infrastructure.

Qualifications:

• Education:Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Experience:
• 3+ years in data engineering roles.
• Expertise with AWS services including S3, Redshift, RDS, Lambda, Glue, and EMR.
• Strong skills in SQL, Python, and ETL frameworks.
• Experience in data modeling, schema design, and data warehousing.
• Familiarity with big data technologies such as Hadoop, Spark, and Kafka.

• Skills:
• Strong problem-solving abilities, with a focus on automation and process optimization.
• Ability to collaborate effectively in a fast-paced, dynamic environment.
• Excellent communication skills for interacting with technical and non-technical stakeholders.
• Knowledge of data governance, security, and compliance standards (e.g., GDPR, HIPAA).

Preferred Qualifications:

• Experience with Infrastructure as Code (IaC) tools like Terraform or CloudFormation.
• Familiarity with machine learning workflows and model deployment.
• AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect.

Why Join Our Client’s Team:

• Competitive compensation and performance-based bonuses.
• Comprehensive benefits package including health, dental, and vision insurance.
• Flexible work arrangements, including remote options.
• Opportunities for professional growth and certifications.
• Collaborative, innovative, and inclusive work culture.