Job Title: Azure Data Factory Engineer
Azure Data Factory Engineers are responsible for designing, implementing, and optimising data integration pipelines using Azure Data Factory and SQL.
Key Responsibilities:
* Develop and implement efficient data processing pipelines to ensure secure data transfer across systems.
* Collaborate with stakeholders to design innovative solutions for secure, efficient data flows.
* Implement validation and quality checks to identify and resolve anomalies in data integration processes.
* Design and maintain data models ensuring accuracy, consistency, and performance optimisation.
* Monitor and optimise data flow processes to enhance efficiency and reduce latency.
* Produce and maintain technical documentation (specifications, flow diagrams, procedures).
* Troubleshoot integration issues and apply preventative solutions.
Requirements:
* Expert-level skills in Microsoft Azure Data Factory.
* Experience in data engineering, including data integration, ETL processes, and data modelling.
* Strong SQL skills and familiarity with data warehousing concepts.
* Knowledge of data governance, security, and compliance best practices.
* Excellent problem-solving skills and ability to collaborate in teams.
* Effective communication with technical and non-technical stakeholders.
Desirable Criteria:
* Proficiency with Microsoft Azure tools/services.
* Bachelors degree in Computer Science, IT, or related field.
* Relevant certifications such as Microsoft Azure Data Engineer or AWS Data Analytics.