Senior Data Automation Specialist
We are seeking a skilled Senior Data Automation Specialist to join our team. As a key member of our data operations group, you will be responsible for designing, implementing and maintaining automated data workflows that enable seamless data delivery across the organization.
Your primary objectives will include streamlining data pipeline deployment through continuous integration and continuous delivery (CI/CD), ensuring observability, performance and security in cloud data environments, automating infrastructure management and data workflow orchestration, and driving best practices for data automation, governance and cost optimization.
Key Responsibilities:
* Design, implement and maintain CI/CD pipelines for automated data workflow deployment
* Develop infrastructure-as-code (IaC) templates for provisioning cloud-based data environments/resources
* Automate ETL/ELT workflow management using orchestration tools like Apache Airflow, Prefect or AWS Step Functions
* Optimize data ingestion, transformation and processing pipelines for scalability and efficiency
Requirements:
* 3+ years of experience in DevOps, Data Engineering or Cloud Infrastructure roles
* Experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps etc.)
* Proficiency in orchestration tools (Apache Airflow, Prefect, Dagster, AWS Step Functions etc.)
* Strong understanding of ETL/ELT pipelines, workflow scheduling and automation
* Hands-on experience with cloud data platforms (AWS, Azure, GCP)
* Proficiency in Terraform for IaC
* Experience with observability tools (Datadog, Prometheus, Grafana, CloudWatch, Splunk etc.)
* Strong troubleshooting skills for data pipeline failures, latency and performance optimization
* Proficiency in Python, Bash or PowerShell for automation and scripting
* Experience with SQL and NoSQL databases (PostgreSQL, Snowflake, BigQuery, DynamoDB, etc.)
* Ability to work with cross-functional teams (Data Engineering, IT, Security, Business Intelligence)
Benefits:
* A competitive salary plus generous uncapped commission scheme
* The opportunity to work with a well-known household brand and public listed company
* Work with a team of highly energised, motivated and driven professionals
* Three recharge days per year (yes, in addition to your annual leave)
* A free coffee each day, a funky café and a state of the artwork space
* An impressive Employee Benefits Programs