Senior Software Engineer - Data Platform
+ Higher Super, Great Bonus and Share Options
With 2024 sales and revenues of $64.8 billion, Caterpillar Inc. is the world's leading manufacturer of construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives.
Caterpillar does business on every continent, principally operating through three primary segments – Construction Industries, Resource Industries and Energy & Transportation – and providing financing and related services through our Financial Products segment.
About The Opportunity:
Caterpillar products generate and process large amounts of data from sensors, on-board models, and control algorithms in real-time creating real-world machine usage information.
As part of the overall digital strategy Caterpillar has developed an integrated family of machine-based information technology products that interconnect machines to provide real time guidance, tracking, monitoring and supervisory control of the operational mining fleet. This family of products is branded MineStar.
The MineStar product range links with other mining and business information systems and is an integral part of the Mining Technology Enabled Solutions vision.
About the position:
We're seeking an experiencedSenior Engineer to join a specialist team focused on building a scalable data platform which ingests high-frequency telemetry data from mobile field machines and supportsdata science and machine learning workloads.
You'll be instrumental in transforming a legacy Java Spring Boot monolith into acontainerized, scalable, cloud-ready architecture, while enablingstream and batch data processing,lakehouse persistence, andlow-latency predictive model hosting.
Responsibilities:
Design and implement robust, scalable components for ingesting, processing, and persisting high-frequency telemetry data.
Collaborate with data scientists to host, orchestrate and optimize workloads in Python, Scala, and Java.
Design and build components using technologies likeApache Spark,Delta Lake,Redis/Valkey,MQTT, andPostgreSQL.
Drive modernization efforts including:
Containerization and deployment onKubernetes
Integration withS3-compatible object stores(e.g., Ceph)
Evaluate and integrate emerging technologies (e.g.,Flink,Trino,Kafka,DuckDB,Dask,Daft) to optimize performance and scalability.
Use your experience to contribute to architectural decisions involvingevent sourcing,CQRS, and hybrid cloud deployments.
Ideal Candidate Profile:
Extensive experiencein backend development withlanguages such as Java, Scala and Python.
Proven track record working in teams to develop large, complex applications.
Deep understanding ofstreaming and batch data processing, ideally withApache Sparkor similar.
Experience withcontainerization (Docker)andorchestration (Kubernetes).
Familiarity withdata lake/lakehouse architectures, especiallyDelta Lake.
Strong knowledge ofmessage brokers(MQTT, Kafka) andcaching systems(Redis/Valkey).
Comfortable working acrossmultiple languages(Java, Python, Scala).
Experience in designing systems forscalability,multi-tenancy, andhybrid deployments.
Prior experience in Data Engineering roles, and expertise in machine learning algorithms and statistical modelling will be highly regarded
Mining Industry knowledge will be desirable, however not mandatory
Why Join Us?
Work on a technically challenging and meaningful application in the mining domain.
Be part of a forward-thinking team driving innovation in data-centric systems.
Influence architectural direction and technology choices.
Collaborate with experts in autonomy, data science, and distributed systems.
Compensation & Benefits:
Competitive salary based on degree and professional industry working experience. The Total Rewards package includes:
Competitive remuneration package
Attractive Bonus and Share options
Career development with global prospects
A strong commitment to safety and your wellbeing
An inclusive workplace culture focused on quality, customer service and the environment
A commitment to diversity and inclusion, equal opportunity, and equal outcome
SMART spending APP
The opportunity to do truly meaningful work in a supportive, constructive culture that encourages you to make the most of your talents.
Additional Information:
This position is not offering hybrid working arrangements, the successful candidate must be available to work 5 days from the office.
How to Apply:
If you are looking for a challenging and rewarding career as part of the Caterpillar team, apply today via:www.caterpillar.com/careersby attaching a copy of your resume.
Application close 11th September 2025
Your road to success begins with a Caterpillar career. By joining the Caterpillar team, you'll discover that working for a global leader creates endless opportunities for you.
Caterpillar of Australia is not currently hiring individuals for this position who now or in future require sponsorship for employment-based non-immigrant and immigrant visas. However, as a global company, Caterpillar offers many job opportunities outside of Australia which can be found through our employment website http://www.caterpillar.com/careers.
Caterpillar is an Equal Opportunity Employer.
Unlock job insights
Salary match Number of applicants Skills match
Manufacturing, Transport & Logistics More than 10,000 employees
With 2021 sales and revenues of $51.0 billion, Caterpillar Inc. is the world's leading manufacturer of construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives.
For nearly 100 years, we've been helping customers build a better, more sustainable world and are committed and contributing to a reduced-carbon future. Our innovative products and services, backed by our global dealer network, provide exceptional value that helps customers succeed.
With 2021 sales and revenues of $51.0 billion, Caterpillar Inc. is the world's leading manufacturer of construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives.
For nearly 100 years, we've been helping customers build a better, more sustainable world and are committed and contributing to a reduced-carbon future. Our innovative products and services, backed by our global dealer network, provide exceptional value that helps customers succeed.
Perks and benefits Our Culture Diversity and Inclusion Mentoring programs - The Guardian Program
To help fast track investigation, please include here any other relevant details that prompted you to report this job ad as fraudulent / misleading / discriminatory.
#J-18808-Ljbffr