We are seeking a highly skilled IT DataOps Support Engineer to join our team. This role is critical to ensuring the efficiency, reliability, and scalability of our data operations.
Job Description
A Sydney-based role with the chance to be part of a team within the growing Managed Services business AgileOps. We provide a diverse environment with multiple technologies and platforms in use.
The ideal candidate will have at least five years of experience in the field, combined with a strong educational background in technology. This role involves managing data pipelines, automating processes, and maintaining the integrity of our data systems.
* Data Pipeline Management:
o Design, build, and manage data pipelines using Snowflake, DBT, and Fivetran.
o Ensure the seamless integration and synchronization of data from multiple sources.
o Monitor and optimize data flow to ensure efficiency and reliability.
* Data Infrastructure Maintenance:
o Maintain and troubleshoot the data infrastructure to ensure high availability and performance.
o Implement best practices for data management, including data security, data quality, and data governance.
* Automation and Optimization:
o Develop and implement automation scripts to streamline data operations processes.
o Continuously seek opportunities to optimize data pipelines and improve overall system performance.
* Collaboration and Support:
o Work closely with data analysts, data scientists, and other stakeholders to understand data requirements and deliver appropriate solutions.
o Provide technical support and guidance to team members and stakeholders on data-related issues.
* Documentation and Reporting:
o Create and maintain comprehensive documentation for data pipelines, processes, and systems.
o Generate regular reports on data pipeline performance, issues, and improvements.
Required Skills and Qualifications
This role requires:
* Knowledge of databases such as MySQL, MongoDB, PostgreSQL or similar.
* Ability to work with version control systems like Git.
* Knowledge of RESTful API (Application Programming Interfaces) design and development.
* Experience with cloud platforms such as AWS (Amazon Web Services), Azure or GCP (Google Cloud Platform).
* Understanding of software development methodologies such as Agile or Scrum.
* Strong problem-solving and debugging skills.
* Effective communication and teamwork abilities.
* Adaptability - able to pick up new technologies as and when required depending on the client's requirements.
Benefits
This role offers a competitive salary range and opportunities for growth and development.