Job Title
Talent Acquisition and HR Recruiter is a pivotal role that involves sourcing, screening, and employee engagement.
This individual will work with skilled professionals committed to sustainable development.
Key Responsibilities
* Create and develop efficient ELT pipelines using Azure Data Factory and Databricks for data engineering.
* Optimize and maintain high-quality data workflows.
* Perform tuning and monitoring of pipelines for quality and integrity.
* Develop notebooks using Python, SQL, and/or PySpark for big data processing.
* Implement best practices for data engineering, including governance and security measures.
Requirements
* Prolific experience building robust data pipelines in a Databricks Lakehouse environment.
* Well-versed with Spark and other big data technologies for seamless integration.
* Excellent coding skills using SQL and Python for effective problem-solving.
* Strong background developing solutions in an Azure Cloud environment with strong ADF development skills.
This role requires someone who is passionate about technology and transformation, driven by curiosity, innovation, and continuous learning.