Tech Hub enables our company’s businesses to achieve their technology-driven goals. The team responsible for designing, implementing, and maintaining the organization's IT backbone guarantees robust security, data storage and backup solutions, and technical support across networks, servers, data centers, and cloud services. As a Data Platform Lead, you will oversee the design, implementation, and maintenance of our IT infrastructure, ensuring it is resilient, scalable, and secure to meet business growth and operational needs.
What you’ll do
* Lead the design and implementation of infrastructure solutions that meet business requirements and align with industry best practices.
* Ensure the stability, security, and scalability of the company's IT infrastructure.
* Lead and mentor a team of infrastructure engineers, fostering professional growth and development.
* Drive team uplift, promoting recommendations and implementing innovative solutions to improve infrastructure efficiency and effectiveness.
* Collaborate with other IT teams and business units to align infrastructure projects with business goals.
* Oversee the maintenance and support of infrastructure systems, ensuring minimal downtime and optimal performance.
* Develop and enforce infrastructure policies, procedures, and standards.
What we’re looking for
* Technology specific experience:
o Strong Spark, SQL, and Python/PySpark skills; practical experience with batch and streaming pipelines (Structured Streaming, Auto Loader, Kafka/Event Hubs/Kinesis).
o Define and implement platform guardrails and standards: Unity Catalog and privilege model, cluster/SQL warehouse policies, workspace strategy, code repositories, naming conventions, and environments.
o Build scalable ingestion and transformation frameworks using Delta Lake, Auto Loader, and Delta Live Tables; define medallion (bronze/silver/gold) patterns for batch and streaming.
o Establish CI/CD pipelines and infrastructure-as-code for repeatable provisioning (e.g., Terraform, Databricks Terraform provider, GitHub Actions/Azure DevOps/Jenkins, Databricks Repos) promoting changes safely across dev/test/prod.
o Implement observability and reliability practices: logging, metrics, lineage integration, data quality checks/expectations, SLAs/SLOs, incident response, and capacity planning.
o Build and operate a Databricks lakehouse platform (workspaces, Delta Lake, Unity Catalog, jobs/workflows, Databricks SQL) aligned to enterprise architecture and the data operating model.
* Industry experience:
o Security and networking proficiency on a major cloud (AWS/Azure/GCP): identity federation/SCIM, secrets management, private networking, firewalling, encryption, and compliance controls.
o FinOps and capacity management: cost modeling, tagging/chargeback, cluster policy design, autoscaling strategies, and spend optimization for compute and storage.
o Solid understanding of lakehouse architectures and data engineering patterns (medallion, CDC, schema evolution, data quality/expectations, performance tuning including Photon).
* Other specific role requirements:
o Strong analytical and structured problem-solving skills, with ability to translate between business and technical teams.
o Skilled in assessing and prioritizing AI opportunities based on value and feasibility, balancing ambition, risk, and delivery constraints.
o Experienced in process mapping, requirements definition, stakeholder engagement, and confident collaborating with senior stakeholders.
o Clear communication skills for executive and delivery audiences, supported by formal education in business or related fields and foundational AI training.
What you’ll gain
* The opportunity to work with leading organizations and cutting-edge technology that challenge and expand your expertise.
* Flexibility that lets you choose when, where, and how you work—balancing what’s best for you, your team, and your clients to grow and thrive together.
* Clear paths for career progression supported by continuous learning and leadership development.
* Generous leave entitlements including four weeks’ annual leave and float public holidays to support your work‑life balance.
We’re committed to treating all our job applicants fairly and with respect, irrespective of their actual or assumed background, disability, neurodivergence, or any other protected characteristic. We want you to have every opportunity to thrive in our selection process. In the application form, you can let us know what adjustments you require during our recruitment process and/or any workplace accommodations you anticipate needing to help you perform your role.
#J-18808-Ljbffr