We are seeking a Data Automation Engineer to join our team for an initial 3 month contract to assist with automating data provisioning workflows. This position will focus on transforming currently manual, complex data delivery processes into streamlined, scalable, and auditable automated solutions.
You will be required to work across Azure data services, ETL pipelines, workflow automation, and secure data delivery mechanisms to enable faster, more efficient access to de‑identified linked datasets for research and analytics. This is a hands‑on technical role with significant influence over solution architecture, automation strategy, and data governance uplift.
Key Responsibilities
Data Automation & ETL Development
* Design, build, and maintain automated ETL pipelines to extract, transform, and deliver linked datasets into secure virtual environments.
* Implement dynamic data refresh capabilities and automated data selection processes.
* Ensure data quality through automated validation, schema checks, and unit testing.
Azure Data Platform Engineering
* Develop and optimise solutions using Azure SQL, Azure Data Factory, and Azure Databricks.
* Implement secure, scalable data orchestration workflows aligned with privacy and governance requirements.
* Integrate pipelines with research‑friendly output formats (Python, R, Excel).
Workflow & Request Automation
* Build user‑friendly SharePoint‑based request forms for data provisioning.
* Implement workflow automation using Power Automate for approvals, notifications, and metadata capture.
* Streamline end‑to‑end request‑to‑delivery processes to reduce manual effort and turnaround times.
Key Selection Criteria
* Experience with building automated ETL pipelines, preferably in Azure environments
* Azure SQL
* Azure Data Factory
* Azure Data bricks
* PySpark / Spark, data validation
* Azure DevOps
* Ability to Build structured request forms, metadata capture with Sharepoint
* Experience with Power Automate and workflow automation, approvals, notifications, integration with Azure services
* Python and SQL scripting is highly desired