Job Title: Data Engineering Automation Specialist
The role of the Data Engineering Automation Specialist is to oversee and implement data pipelines, ensuring they are efficient, scalable, and reliable.
This position focuses on DataOps best practices, CI/CD automation, cloud infrastructure, observability, and security, enabling seamless data delivery across the organization.
The ideal candidate has expertise in DevOps, cloud data platforms, infrastructure automation, and data pipeline orchestration. They will work closely with Data Engineers, Data Scientists, Platform Engineers, and Security teams to improve data availability, governance, and operational efficiency.
Key Responsibilities:
* Automate Data Pipelines: Design, implement, and maintain CI/CD pipelines for automated data workflow deployment.
* Develop Cloud Infrastructure: Develop infrastructure-as-code (IaC) templates for provisioning cloud-based data environments/resources.
* Orchestrate ETL Workflows: Automate ETL/ELT workflow management using orchestration tools like Apache Airflow, Prefect, or AWS Step Functions.
* Optimize Data Processing: Optimize data ingestion, transformation, and processing pipelines for scalability and efficiency.
Requirements:
* Experience: 3+ years of experience in DevOps, Data Engineering, or Cloud Infrastructure roles.
* Skills: Proficiency in orchestration tools, strong understanding of ETL/ELT pipelines, workflow scheduling, and automation.
* Qualifications: Bachelor's or Master's degree in Computer Science, Data Engineering, Cloud Computing, or a related field/relevant experience.
Benefits:
* Competitive Salary: A competitive salary plus generous uncapped commission scheme.
* Career Opportunities: The opportunity to work with a well-known, household brand and public listed company.
* Work Environment: Work with a team of highly energized, motivated, and driven professionals.
* Employee Benefits: An impressive Employee Benefits Program.