Lead Data Engineer
Contract Type
Location
Industry
Specialisation
Salary
Contact Name
Contact Email
Date published
Job Reference
Description
📍 Sydney | 💰 $1,200 per day + Super | 📅 Contract until 30 June 2027
About the Role
We're working with a leading financial services organisation to hire a highly skilled Lead Data Engineer (Databricks) to play a critical role in building and scaling a modern data and analytics platform.
This position sits at the heart of a high-impact data transformation program, where you'll design and deliver robust data pipelines, enable advanced analytics, and support machine learning initiatives across the business.
Key Responsibilities
Lead the design and development of scalable data pipelines and architecture
Establish data engineering standards, governance, and best practices
Validate, cleanse, and transform data across multiple operational systems
Collaborate with stakeholders to define and deliver data requirements
Build and optimise ETL/ELT pipelines for batch and real-time processing
Design and engineer data features to support machine learning models
Assemble and manage large, complex data sets for business use
Develop data tools leveraging analytics and machine learning techniques
Ensure data is captured, stored, and processed efficiently across the platform
Mentor and upskill team members in data engineering best practices
Key Skills & Experience
Strong experience as a Lead Data Engineer or Data Engineering Lead
Proven expertise in Databricks, Python, and Data Warehousing (essential)
Deep understanding of data architecture and platform design
Hands-on experience with ETL frameworks, batch processing, and real-time data streaming
Strong knowledge of data modelling techniques (3NF, Star Schema, Big Tables, Columnar, JSON, Key-Value)
Experience across data management, quality, and analytics platforms
Ability to work across teams and influence stakeholders in complex environments
Background in financial services (highly regarded)
Qualifications
Tertiary degree or equivalent experience (required)
Postgraduate qualifications (desirable)
Why Apply?
Join a market-leading financial services organisation
Long-term contract providing stability through to mid-2027
Work on a cutting-edge data platform leveraging Databricks
High-impact role with enterprise-wide visibility
Competitive rate of $1,200 + Super per day