Overview Ayan Infotech are looking for an ADB + Azure DevOps Consultant for a long term contract job opportunity in Sydney.
All applicants must have full unrestricted work rights in Australia.Title: ADB + Azure DevOpsLocation: SydneyType: Contract (6 months +)Nature of work: Hybrid Core Requirements Required Skills and Experience Databricks Development Design and develop scalable data pipelines using Azure Databricks, PySpark, and SQLImplement structured streaming, Delta Lake, and Unity Catalog.Optimize Spark jobs and manage cluster performance.Experience in a production support workplace.Expertise with Azure Databricks solutions.
DevOps Integration Build and maintain CI/CD pipelines using Azure DevOps, GitHub, Jenkins, and Terraform.Automate deployment of notebooks, clusters, secrets, and data workflows.Manage version control, branching strategies, and code reviews.BODS ETL skills are a significant advantage as the scope of work includes supporting BODS ETL framework-based Oracle database reporting systems.
Cloud & Security Work with Azure services: Data Factory, Blob Storage, Key Vault, Synapse, EventHub, and Power BI.Implement RBAC/ABAC, encryption, and data masking for secure data handling.
Collaboration & Documentation Collaborate with cross-functional teams for requirement gathering and solution design.Document technical specifications, data dictionaries, and architecture blueprints.
Good to Have Experience with MLflow, Power BI, and Databricks Dashboards.Familiarity with Delta Live Tables.Exposure to Agile, JIRA, and test management toolsContact: for more details.