Senior Data Engineer
Broad and Varied Role - Exposure to Entire Data Lifecycle
Circa $150k + Super, Parramatta Location - Impressive Work Environment
Job Description
The Senior Data Engineer position has been added to play a leading role in the design and uplift of the data function for the organisation.
This is a broad role that will see you work with legacy environments as well as new technologies to enhance the performance of the data platform.
Main Responsibilities:
1. Design, Develop, and Maintain Data Integration Platform using Azure Services.
2. Architect and Roll Out Webhook-Based Notification System.
3. Develop and Manage Data Pipelines and Workflows using Azure Data Factory.
4. Engage with Other Teams to Define, Build, and Deliver New Features.
5. Build Data Pipelines Deploying Models, Maintain DevOps Process.
6. Create Data Tools and Scripts to Support Analytics Capabilities.
7. Develop and Maintain Microservices using C++, C#, and Javascript as Required.
8. Ensure Ongoing Performance, Quality, and Responsiveness of Data Systems, Whilst Looking for Improvement Opportunities.
9. Maintain Legacy, On-Prem Infrastructure as Well as Azure Cloud Platform.
10. Write and Document Clean, Scalable Code & Participate in Code Reviews.
About You
You are an Experienced Data Engineer with Oversight of Entire Data Lifecycle.
Technical Expertise includes Azure Cloud, Data Factory, Event Hub, API Management & MS Fabric (or Synapse), with Azure Certifications Held in High Regard.
Prior Experience Managing Hybrid Environments, Including On-Prem Servers.
'Hands-On' Experience with ETL, SSIS, SSAS & SSRS.
Strong at Building Data Pipelines and Working with Data Tools to Achieve Outcomes.
Proven Data Engineer with Experience Overseeing Entire Data Lifecycle.
Ability to Program during Course of Role (IE: C++, C#, Python or R).
Skilled with Database Technologies (MS SQL, SQL, NoSQL, ORM Frameworks etc).