The Role:
As Senior Data Engineer at ONYX Insight, you will play a pivotal role in developing and maintaining the data infrastructure that powers our advanced analytics and solution development. Working within our innovative team, you will design and build high-performance batch and real-time data pipelines, create ETL processes, and transform raw data into insightful, consumable datasets for both technical and non-technical stakeholders.
You'll collaborate with engineering, analytics, and data science teams to deploy machine learning models, automate workflows, and ensure our data platforms are secure, scalable, and optimized for performance. This is an opportunity to immerse yourself in cloud technologies, leverage AWS, and work with a talented, multidisciplinary team to drive impact in the global wind energy space.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines for real-time and batch processing.
- Build robust ETL processes to extract, transform, and load data from diverse sources.
- Automate data ingestion, aggregation, and processing workflows to streamline operations.
- Prepare and optimize datasets in data lakes and warehouses, making them accessible for analytics and decision-making.
- Partner with Data Scientists, Analysts, and Engineers to deploy machine learning models into production.
- Ensure data integrity, security, privacy, and compliance across all data workflows.
- Continuously monitor system performance and implement strategies to enhance efficiency.
Ideally you'll have/be:
- Experience in building Data Platforms to ingest & process high frequency data.
- Strong expertise in AWS cloud platforms and data engineering tools.
- Proficiency in building and maintaining data lake/warehouse solutions.
- Advanced skills in SQL and relational database design.
- Experience with data ingestion and ETL tools.
- Strong programming skills in Python or other object-oriented languages.
- Familiarity with data pipeline and workflow management tools.
- Excellent problem-solving abilities, with a passion for working on complex, real-world challenges.
About ONYX
ONYX Insight is a growing technology and engineering organisation in the renewable energy sector. Our vision is to build a more efficient future by becoming the world's most innovative provider of predictive technology solutions. Our advanced sensing, software and analytics combined with our engineering experience are deployed on wind turbines around the world to maximise production and make turbines more reliable for longer, optimising energy production.
ONYX Insight is part of the Macquarie Group. Macquarie is a global financial services group operating in 34 markets in asset management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory services, capital raising and principal investment. The diversity of the Macquarie Group operations combined with a strong capital position and robust risk management framework has contributed to a 54 year-record of unbroken profitability.
For any further information, or to understand our products and services better, please feel free to look through our website:https://onyxinsight.com/
ONYX Insight are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
