Get AI-powered advice on this job and more exclusive features.
Halo Labs is a future focused, end-to-end data solutions firm - transforming tomorrow, today. Our intelligent and secure technology systems and data driven solutions drive meaningful outcomes and unlock lasting value.
Why work at Halo Labs?
* Leading Innovation: We don't just solve problems; we illuminate a never-ending stream of innovation.
* Exceptional Perks: Enjoy outstanding perks like a dedicated learning budget, performance bonuses, and comprehensive wellbeing support.
* Remote-First Organisation: Experience the perks of remote work while having the flexibility to travel to client locations throughout Australia.
* Inclusive and Engaging: Celebrate diversity in a welcoming space that thrives on new ideas and open conversations, all in a respectful environment.
* Inspiring Origins: With a compelling founder story, we are a customer-focused, culture-first organisation.
About the Role:
* Framework Development: Design, develop, and enhance in-house PySpark frameworks to ensure standardised implementations and promote reusability across projects.
* Mentorship: Provide technical guidance and mentorship to junior team members, fostering skill development within the analytics community.
* Stakeholder Collaboration: Collaborate with internal and external stakeholders to deliver high-quality, data-driven solutions that meet business needs.
* Data Analysis & Engineering: Conduct exploratory data analysis and design end-to-end data engineering solutions, including ETL/ELT pipelines using Azure Data Framework,Databricks, and other Azure services.
* Pipeline Implementation: Build, test, and deploy scalable data pipelines using Python, PySpark, and Azure services, ensuring adherence to best practices for automated testing, documentation, and CI/CD via Azure DevOps (Git, Azure Pipelines).
* Platform Monitoring: Monitor and support batch operations for the Data and Insights Platform, ensuring reliability and performance.
About You:
* Cloud Expertise: Hands-on experience with Azure Cloud Services, includingDatabricks, Azure Data Factory, Azure SQL Server, and Azure Storage.
* Databricks Proficiency: Strong experience withDatabricksfor big data processing.
* Leveraging Databricks notebooks for collaborative data engineering and analytics.
* Utilising Databricks clusters for scalable and efficient data processing.
* Data Engineering Tools: Proficiency in SQL, Python, and PySpark for data processing and pipeline development.
* Data & Analytics Concepts: Strong understanding of data warehousing, data lakes, ETL/ELT processes, and visualisation/reporting tools (Power BI, Tableau) to drive business value.
* Data Architecture: Deep knowledge of data architecture, data modelling, data marts, and metadata management best practices.
* Modern Data Platforms: Minimum 3 years of experience working with modern data platforms (AWS, Azure) and data engineering, with a focus on Agile delivery methodologies.
* DevOps Practices: Expertise in Azure DevOps, including Git for version control and Azure Pipelines for CI/CD.
* Education: Degree in Computer Science, Data Science, IT, or a related field
While Queensland-based candidates are preferred, outstanding applicants from other locations will also be considered.
You're interested in this exciting opportunity and feel you're the right fit please click "apply"
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Full-time
Job function
Job function
Information Technology
Industries
Business Consulting and Services
Referrals increase your chances of interviewing at Halo Labs by 2x
Sign in to set job alerts for "Data Engineer" roles.
Herston, Queensland, Australia 1 week ago
Brisbane, Queensland, Australia 1 month ago
Software Development Engineer - Internship
Brisbane, Queensland, Australia 2 weeks ago
Brisbane, Queensland, Australia 1 week ago
Brisbane, Queensland, Australia 1 month ago
Software Development Graduate (2025, Stores)
Brisbane, Queensland, Australia 2 weeks ago
Brisbane, Queensland, Australia 4 weeks ago
Software Engineer (Typescript/React/Node/AWS)
Brisbane, Queensland, Australia 2 months ago
Brisbane, Queensland, Australia 2 weeks ago
Brisbane, Queensland, Australia 3 weeks ago
Brisbane, Queensland, Australia 1 month ago
Full Stack Web Developer (Flexible Location)
Brisbane, Queensland, Australia 3 days ago
Brisbane, Queensland, Australia 2 weeks ago
Brisbane, Queensland, Australia 3 weeks ago
Brisbane, Queensland, Australia 3 days ago
Brisbane, Queensland, Australia 1 week ago
Brisbane, Queensland, Australia 2 weeks ago
Brisbane, Queensland, Australia 1 week ago
Brisbane, Queensland, Australia 4 weeks ago
Brisbane, Queensland, Australia 4 days ago
Brisbane, Queensland, Australia 1 month ago
Brisbane, Queensland, Australia 1 week ago
Intermediate Software Engineering - Product & Technology
Brisbane, Queensland, Australia 3 days ago
Software Engineer/Team Lead (Typescript/Node/React/AWS)
Brisbane, Queensland, Australia 3 months ago
Brisbane, Queensland, Australia 4 days ago
Software Engineers - AI Team (Typescript/React/Node/AWS)
Brisbane, Queensland, Australia 3 weeks ago
Senior Software Engineer Brisbane, Sydney, Melbourne
Brisbane, Queensland, Australia 1 day ago
Software Development Engineer - Internship
Brisbane, Queensland, Australia 3 days ago
Brisbane, Queensland, Australia 1 week ago
Brisbane, Queensland, Australia 1 week ago
Brisbane, Queensland, Australia 4 days ago
Software Engineer - Solutions Engineering
Brisbane, Queensland, Australia 1 week ago
Brisbane City, Queensland, Australia 1 day ago
Brisbane, Queensland, Australia 2 weeks ago
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr