Ayan Infotech are looking for an ADB + Azure DevOps Consultant for a long term contract job opportunity in Sydney.
All applicants must have full unrestricted work rights in Australia.
Title: ADB + Azure DevOps
Location: Sydney
Type: Contract (6 months +)
Nature of work: Hybrid
Required Skills and Experience:
Core Responsibilities
Databricks Development
- Design and develop scalable data pipelines using Azure Databricks, PySpark, and SQL
- Implement structured streaming, Delta Lake, and Unity Catalog.
- Optimize Spark jobs and manage cluster performance.
- Experience in a production support environment.
- Expertise with Azure Databricks solutions.
DevOps Integration
- Build and maintain CI/CD pipelines using Azure DevOps, GitHub, Jenkins, and Terraform.
- Automate deployment of notebooks, clusters, secrets, and data workflows.
- Manage version control, branching strategies, and code reviews.
- BODS ETL skills are a significant advantage as the scope of work includes supporting BODS ETL framework-based Oracle database reporting systems.
Cloud & Security
- Work with Azure services: Data Factory, Blob Storage, Key Vault, Synapse, EventHub, and Power BI.
- Implement RBAC/ABAC, encryption, and data masking for secure data handling.
Collaboration & Documentation
- Collaborate with cross-functional teams for requirement gathering and solution design.
- Document technical specifications, data dictionaries, and architecture blueprints.
Positive to Have
- Experience with MLflow, Power BI, and Databricks Dashboards.
- Familiarity with Delta Live Tables.
- Exposure to Agile, JIRA, and test management tools
Contact: 02 9412 4178 for more details.
www.ayaninfotech.com
Required Skill Profession
Computer Occupations