Job Description:
A lead data engineer is required to design, develop, and maintain data integration solutions that connect on-premises and cloud-based enterprise applications. The successful candidate will leverage Microsoft Azure tools and technologies to create efficient data pipelines, ensure data quality, optimize performance, and adhere to security and compliance standards.
Key Responsibilities:
* Designing data integration solutions that meet business requirements using Microsoft Azure tools.
* Developing, implementing, and maintaining ETL pipelines for secure and efficient data transfer between various systems.
* Maintaining data models to ensure data accuracy, consistency, availability, scalability, and performance optimisations.
* Implementing data validation and quality checks to identify and rectify data anomalies, errors, and inconsistencies within integrated systems.
* Monitoring and optimizing data integration processes to enhance performance, reduce latency, and minimize resource consumption.
* Creating and maintaining comprehensive documentation for data integration solutions, including technical specifications, data flow diagrams, and operational procedures.
Essential Skills and Qualifications:
* Proven experience in data engineering, including data integration, ETL processes, and data modelling.
* Strong SQL skills and experience with data warehousing concepts.
* Knowledge of data governance, security, and compliance best practices.
* Excellent problem-solving skills and ability to work effectively in a collaborative team environment.
* Effective communication skills for collaborating with technical and non-technical stakeholders.
Benefits:
The role involves creating efficient data pipelines, ensuring data quality, optimising performance, and adhering to security and compliance standards. This requires strong collaboration and communication skills.
How to Apply:
Please provide an updated CV (a maximum of 3 pages) reflecting your suitability for the role based on the job description. You will also need to complete a response to the essential skills and qualifications above in a summary no more than 5000 characters in total.