Data Engineer
Contract Type
Location
Industry
Specialisation
Salary
Contact Name
Contact Email
Date published
Job Reference
Description
Role: Data Engineer
Salary: $120,000 + Super
Contract Length: 3 years
Location: Western Sydney/WFH
Join our client's dynamic team and play a key role in shaping data solutions using Azure services. We are seeking an innovative and detail-oriented Data Engineer to help build and optimize our data infrastructure, ensuring high-quality, scalable, and efficient data solutions that support business objectives.
The Role
As a Data Engineer, you will be responsible for developing and maintaining scalable ETL pipelines, data models, and analytics solutions in the Azure ecosystem. You will collaborate with cross-functional teams to integrate data from various sources, implement governance frameworks, and enable advanced analytics capabilities. This role offers the opportunity to contribute to a large-scale data warehouse development project and work on cutting-edge data engineering practices.
Key Responsibilites
Design, build, and manage scalable ETL pipelines using Azure Data Factory.
Develop and optimize data models in Azure Databricks and Power BI for performance and scalability.
Utilize Azure Data Lake Storage (Gen2) and Delta Lake for managing and transforming data.
Implement and enforce data governance and quality frameworks using Azure Purview.
Support advanced analytics use cases by providing clean, structured, and reliable data.
Develop CI/CD pipelines and implement DevOps best practices to enhance workflow efficiency.
Monitor, maintain, and continuously improve data solutions and integrations within the Azure platform.
Ensure compliance with data protection regulations and industry standards.
Collaborate with stakeholders to translate business needs into actionable data solutions.
Provide technical guidance and training to team members.
About You
Essential:
Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
5+ years of experience in data engineering, data modelling, and data management with Azure cloud services.
Strong expertise in ETL processes, data architecture, and data governance.
Proficiency in Python and SQL, with hands-on experience in Azure Data Factory and Azure Databricks.
Experience with DevOps practices, including CI/CD pipelines and Git integration.
Experience ingesting data from on-premises RDBMS, APIs, and formats like CSV, XLS, and JSON.
Strong analytical and problem-solving skills.
Excellent communication and collaboration skills to work effectively with cross-functional teams.
Desirable:
Experience in Power BI reporting.
Knowledge of Jira, Confluence, and agile methodologies.
Experience working within a Local Government environment.
Familiarity with Machine Learning (ML) and AI tools.
Experience with Civica Authority and Project & Performance Monitoring Systems.
For YOUR next opprtunity, APPLY today!