A leading organisation undergoing significant investment in its data and analytics capabilities is seeking a Lead Data Engineer to drive the development of a modern cloud-based data platform. Working within a collaborative data team, you will play a key role in enabling data-driven decision-making through the delivery of scalable, trusted and high-quality data solutions.
Your new role
As the Lead Data Engineer, you will provide technical leadership across data engineering initiatives, designing and delivering robust data pipelines, curated datasets and scalable platform capabilities that support enterprise reporting, analytics and advanced data use cases.Working closely with analysts, data scientists and business stakeholders, you will help shape the organisation's data strategy while ensuring best-practice engineering standards are embedded across the platform.
Key responsibilities include:
- Leading the design, development and optimisation of enterprise-scale ETL/ELT pipelines.
- Building and maintaining scalable data solutions using Azure Data Factory, Databricks, Python (PySpark) and SQL.
- Developing and optimising data models and curated datasets for reporting and analytics.
- Implementing data quality, monitoring and validation frameworks to ensure trusted and reliable data assets.
- Driving continuous improvement across data ingestion, transformation and automation processes.
- Troubleshooting complex data issues and conducting root cause analysis.
- Providing technical leadership, mentorship and guidance to engineering team members.
- Collaborating with technical and business stakeholders to deliver practical, business-aligned data solutions.
- Contributing to the future roadmap and strategic direction of the data platform.
To be successful in this role, you will bring:
- Extensive experience in Data Engineering, Analytics Engineering or Data Platform roles.
- Strong expertise in:
- Azure Data Factory (ADF)
- Azure Databricks
- Python (PySpark)
- SQL
- Power BI
- Proven experience designing and managing enterprise data platforms and cloud-based data solutions.
- Strong understanding of data modelling, ETL/ELT architectures and modern data engineering practices.
- Experience implementing data governance, testing, automation and performance optimisation frameworks.
- Excellent problem-solving and analytical skills.
- Strong stakeholder engagement and communication skills with the ability to explain complex technical concepts in plain language.
- Demonstrated experience leading technical teams and driving best-practice engineering standards.
- Opportunity to lead a modern cloud-based data platform.
- Exposure to large-scale analytics and data transformation initiatives.
- Collaborative and high-performing technology environment.
- Long-term career development and leadership opportunities
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.
#3011713
About us
At Hays, we invest in lifelong partnerships that empower people and businesses to succeed. You are at the heart of everything we do. With over 50 years’ experience and a workforce of more than 10,000 people across 32 countries, we collectively put our customers, at the heart of everything we do.
Drawing on knowledge that’s unique to our scale, our commitment to understanding your needs and our ability to meaningfully innovate we are more than just a specialist recruitment business. By providing advice, insights and expertise on issues you face in today’s fast paced world of work, we’ll help you make the right decisions for tomorrow.
Looking for the right role for you?
At Hays we know that finding the right role at the right time takes careful consideration. As your lifelong career partners, we’re by your side, every step of the way.
Whether you’re seeking a new opportunity or support in navigating a career change, we bring the expertise and the connections to partner with you to help you realise your ambition.
Providing an unmatched breadth of jobs across industries and professions whilst leveraging our knowledge, employer relationships, learning opportunities and support, we can offer you roles that challenge and excite you.
Take the next step at hays.com.au
