Engineering Lead – AI
Join to apply for theEngineering Lead – AIrole atTyro Payments.
Why Tyro?
We're a payments, banking and lending solutions provider with 21 years of experience, powering over 73,000 merchants across Australia.
We combine the best people, technology, and partners to deliver simplified payments and seamless business banking to our customers.
Our close to 600 team members are highly collaborative, smart, and motivated.
We live our values: commit to greatness, stay hungry, wow the customer, be good and win together.
About the Role
Build the intelligence behind Tyro's merchant experiences.
Step in as Tyro's Agentic AI Engineering Lead and turn cutting-edge AI into real merchant outcomes.
You'll own the platform that lets safe, autonomous agents act across onboarding, servicing, and cross-sell, shipping to production in our Merchant channels and internal support tooling.
The result: rock-solid, cost-efficient, always-on services that merchants and Tyro teams trust every day.
You'll partner with Product, Data, Security, Risk, Operations, and Compliance to land measurable lift in merchant experience, time-to-value, and unit economics.
What You'll Do
Agentic AI Strategy & Collaboration
Define and own the agentic AI vision, strategy, and multi-quarter roadmap aligned to Tyro's product strategy and technology north stars.
Partner with Product, Data, and Operations to discover, size, and prioritise high-value agent use cases.
Establish guardrails, patterns, and reference implementations that enable delivery squads to adopt agentic AI safely and quickly.
Drive cross-functional alignment on ROI targets, evaluation criteria, and success metrics for each use case.
Architecture & Platform Foundations
Own the core platform for agent orchestration, retrieval-augmented generation, memory/state, and tool registry.
Define APIs, SDKs, and contracts for integrating agents into products and back-office systems; champion event-driven designs.
Implement test harnesses, offline/online test suites, and sandboxes for agents, prompts, and tools; automate datasets and regression tests.
Build observability for AI systems (traces, prompts, tokens, costs, latency, safety signals) and implement cost/performance optimisation levers.
Ensure secure and compliant data flows and robust rollout mechanisms.
Reliability, Safety & Operations
Set and meet SLOs for agent reliability, accuracy, latency, and cost efficiency; lead 24/7 operational readiness, on-call, and incident response for AI runtime services.
Run post-incident reviews and drive systemic improvements across platform, tooling, and practices.
Ensure safety is built in across design, development, and runtime through layered controls, policy enforcement, continuous testing, and full audit trails.
Product Delivery & Ways of Working
Work alongside delivery squads to ship secure, resilient agentic capabilities and platform features.
Institutionalise engineering best practices: trunk-based development, CI/CD, IaC, automated testing, continuous evaluation, and progressive delivery of AI features.
Identify gaps and opportunities to improve engineering throughput, quality, and developer experience; measure and improve lead time, change fail rate, and recovery.
People & Team Development
Hire, lead, and mentor a diverse team of engineers (software, ML/LLM, platform).
Conduct regular 1:1s, craft growth plans, and cultivate a culture of ownership, learning, and high performance.
Model excellent written and verbal communication to both technical and non-technical stakeholders.
What You'll Bring
Proven experience leading engineering teams that build and operate production LLM/agentic systems, platforms, or applied AI products.
Strong technical depth across Python, distributed systems, and cloud (preferably AWS); hands-on with containers/Kubernetes, CI/CD, infrastructure-as-code, and observability.
Practical knowledge of LLM orchestration and retrieval: prompt and tool design, multi-step planning, RAG, vector databases, embeddings, and caching.
Experience with one or more agent/LLM frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel) and with evaluation frameworks/testing strategies for AI systems.
Familiarity with fine-tuning/adapters, safety/guardrails, red-teaming, prompt-injection/jailbreak mitigation, and content filtering.
Demonstrated excellence in incident management, root-cause analysis, and continuous improvement in high-availability, high-stakes environments.
Ability to manage budgets and optimise for cost, performance, and reliability; experience building cost telemetry and unit-economics for AI workloads.
Strong stakeholder management and communication skills; ability to influence and educate across engineering, product, risk, compliance, and operations.
Highly regarded: Experience in payments/FinTech, risk/fraud detection, data governance and privacy (e.g., PCI awareness), and secure software development practices.
Performance Indicators
Business value delivered/enabled: Automation ROI, cost-to-serve, revenue lift, or cycle-time reduction linked to Product/Value Stream OKRs.
Agent quality & safety: Task success/pass rates, factuality/hallucination rates, and evaluation coverage (offline and online).
Platform reliability: Meet or exceed SLO targets, proactive capacity and cost management.
Incident management: Ensure rapid resolution of platform incidents, with 100% post-incident reviews completed within 7 business days.
Operational readiness: 100% of releases meet defined operational readiness criteria prior to deployment.
Engineering effectiveness & adoption: Release cadence, developer experience measures, and number of squads successfully adopting agentic patterns.
Team engagement & growth: Retention, engagement signals, and progress against development plans.
What's in it for you?
A mix of in-office and remote working
Learning and career development opportunities
16 weeks paid primary carers leave
12 weeks paid secondary carers leave
Annual team-based volunteer day
Birthday Leave
Power Up Day (Additional day of leave)
Weekly team social events, snacks, craft beer and wine, ping pong and video games
Taco Tuesdays
Mental health and wellness initiatives
Novated leasing
Tyro is committed to a diverse, inclusive workplace where everyone thrives.
We welcome applicants of all backgrounds and are an equal opportunity employer.
If you need accommodations or adjustments at any stage of the recruitment process, simply inform our Talent team during your conversation with them.
Still with us?
If you've got this far, then you might just be a great fit for us.
Don't tick all the boxes above?
That's ok, apply anyway and our Talent team will review your profile – you might be a fit for future roles.
#J-*****-Ljbffr