Senior Data Engineer
A Broad and Varied Role with Exposure to the Entire Data Lifecycle
Career Overview
We are seeking a seasoned Data Engineer to lead the design and uplift of our data function, playing a key role in shaping our organisation's data platform. As a Senior Data Engineer, you will work closely with our team to drive innovation and improvement across our data lifecycle.
About the Role
This is a broad and varied position that offers exposure to our entire data lifecycle. You will be working with both legacy environments and cutting-edge technologies to enhance the performance of our data platform. Your responsibilities will include:
* Designing, developing, and maintaining our data integration platform using Azure services.
* Architecting and rolling out a webhook-based notification system.
* Developing and managing data pipelines and workflows using Azure Data Factory.
* Collaborating with other teams to define, build, and deliver new features.
* Building data pipelines deploying models, maintaining the DevOps process.
* Creating data tools and scripts to support our Analytics capabilities.
* Developing and maintaining microservices using C++, C#, and JavaScript as required.
* Ensuring the ongoing performance, quality, and responsiveness of our data systems, identifying opportunities for improvement.
* Maintaining our legacy on-prem infrastructure and Azure cloud platform.
* Writing and documenting clean, scalable code and participating in code reviews.
Your Background and Experience
To succeed in this role, you will have:
* Experience as a Data Engineer, overseeing the entire data lifecycle.
* Technical expertise in Azure cloud, including Data Factory, Event Hub, API Management, and MS Fabric (or Synapse), with Azure certifications held in high regard.
* Prior experience managing hybrid environments, including on-prem servers.
* ETL experience and 'hands-on' experience with SSIS, SSAS & SSRS.
* Strong skills in building data pipelines and working with data tools to achieve outcomes.
* The ability to program during the course of your role (IE: C++, C#, Python or R).
* Experience with database technologies (MS SQL, SQL, NoSQL, ORM frameworks etc).
What We Offer
We offer a competitive salary package, excellent career growth opportunities, and a collaborative work environment.