Overview
We are looking for a Mid-Level Data Engineer to join our Data Engineering team. This is a fantastic opportunity to work with cloud technologies, contribute to building scalable data pipelines, and collaborate with both technical teams and senior stakeholders.
Responsibilities
* Developing, deploying, and maintaining data pipelines and ETL processes on Google Cloud Platform (GCP) using Cloud Composer (Apache Airflow) and dbt with Python.
* Support CI/CD pipelines (Buildkite preferred) to ensure reliable and automated code deployment.
* Manage Git repositories, including pull requests, and link changes to Jira service requests.
* Contribute to Slowly Changing Dimension (SCD) Type 2 processes for historical data updates.
* Schedule and orchestrate workloads to optimize performance, scalability, and reliability.
* Follow data governance and security best practices to ensure compliance and data integrity.
* Collaborate with analysts and data scientists to enable access to structured and unstructured data.
* Document changes clearly in Atlassian Confluence and present deployment updates to CAB when required.
Required Experience & Skills
* 2 – 3 years of experience in data engineering, ETL and cloud-based data platforms.
* Knowledge and experience with GCP services such as Cloud Composer, BigQuery, and Pub/Sub will be an added advantage.
* Familiarity with dbt using Python to build ETL models and logical tests.
* Understanding of CI/CD processes, preferably using Buildkite or similar tools.
* Experience managing Git repositories and working with Jira for tracking changes.
* Knowledge of SCD Type 2 and basic data modeling concepts.
* Exposure to orchestration and scheduling tools (Apache Airflow preferred).
* Familiarity with other cloud platforms (AWS, Azure DevOps) is acceptable if you can apply similar concepts.
Soft Skills
* Comfortable communicating with senior leaders.
* Able to explain technical approaches to non-technical stakeholders.
* Confident summarising changes for documentation and deployment purposes.
* Comfortable presenting technical changes to CAB.
#J-18808-Ljbffr