Join or sign in to find your next jobJoin to apply for the Data Engineer (Kafka) role at Optiver1 week ago Be among the first 25 applicantsJoin to apply for the Data Engineer (Kafka) role at OptiverWho We AreOptiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and risk management. By providing liquidity on multiple exchanges across the world in various financial instruments we participate in the safeguarding of healthy and efficient markets. We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products: listed derivatives, cash equities, ETFs, bonds and foreign currencies.Who We AreOptiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are a leading liquidity provider, with close to 2,000 employees in offices around the world, united in our commitment to improve the market through competitive pricing, execution and risk management. By providing liquidity on multiple exchanges across the world in various financial instruments we participate in the safeguarding of healthy and efficient markets. We provide liquidity to financial markets using our own capital, at our own risk, trading a wide range of products: listed derivatives, cash equities, ETFs, bonds and foreign currencies.Optiver’s Sydney office is one of the primary players within Asian markets, trading a range of products. Established in 1996, we're an active participant on the Hong Kong, Korea, Singapore, Taiwan and Japan exchanges, and act as Optiver’s APAC head office.What You'll DoWe're looking for a skilled Data Engineer with strong Kafka experience to help design, build, and maintain our real-time data pipelines. You'll work closely with researchers and engineers to ensure the performance, reliability, and scalability of data systems that support our trading and research platforms.This is a hands-on role with a focus on Kafka infrastructure, stream processing, and integration with our broader data architecture. You’ll play a key role in shaping our data platform and ensuring we meet the growing demands of our business.Design and manage scalable Kafka-based data pipelines.Build and maintain Kafka producer/consumer libraries.Monitor and optimise Kafka performance, latency, and reliability.Collaborate with teams to integrate streaming pipelines into research workflows.Implement access control, authentication, and encryption for Kafka.Support disaster recovery planning and production stability.Deliver data to S3 and support lakehouse ingestion.Document systems and share Kafka best practices across teams.Stay up to date with emerging technologies and recommend improvements.Who You AreMust-Haves3+ years of experience in data engineering.Strong hands-on experience with Apache Kafka in production.Solid understanding of Kafka architecture and components.Experience deploying, scaling, and monitoring Kafka clusters.Proficient in Python, Java, Scala, or Bash.Comfortable working with C++.Experience in Linux environments.Good understanding of networking and security best practices.Nice-to-HavesExperience with Kafka Streams or Kafka Connect.Familiarity with tools like Spark, Flink, or Beam.Exposure to cloud-based Kafka (e.g., AWS MSK, Confluent Cloud).Knowledge of IaC tools (e.g., Terraform, Ansible).Interest in trading systems or financial data.What You'll GetYou’ll join a culture of collaboration and excellence, where you’ll be surrounded by curious thinkers and creative problem solvers. Driven by a passion for continuous improvement, you’ll thrive in a supportive, high-performing environment alongside talented colleagues, working collectively to tackle some of the most complex problems in the financial markets.In return for your expertise, you will be offered a competitive salary package as well as access to a range of Optiver perks, including:The chance to work alongside best-in-class professionalsCompetitive remuneration, including an attractive bonus structure and additional leave entitlementsTraining, mentorship and personal development opportunitiesGym membership plus weekly in-house chair massagesDaily breakfast, lunch and an in-house baristaRegular social events including an annual company tripOptiver is committed to diversity and inclusion, and it is hardwired through every stage of our hiring process. We encourage applications from candidates from any and all backgrounds, and we welcome requests for reasonable adjustments during the process to ensure that you can best demonstrate your abilities.Questions? Get in touch with the recruitment team at careers@optiver.com.auSeniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionInformation TechnologyReferrals increase your chances of interviewing at Optiver by 2xGet notified about new Data Engineer jobs in Sydney, New South Wales, Australia.Sydney, New South Wales, Australia 1 day agoMacquarie Park, New South Wales, Australia 4 months agoSydney, New South Wales, Australia 3 weeks agoSydney, New South Wales, Australia 2 days agoSydney, New South Wales, Australia 3 weeks agoSydney, New South Wales, Australia 4 days agoSydney, New South Wales, Australia 2 weeks agoPyrmont, New South Wales, Australia 4 weeks agoSurry Hills, New South Wales, Australia 1 week agoSydney, New South Wales, Australia A$130,000.00-A$150,000.00 3 days agoSydney, New South Wales, Australia 4 days agoSoftware Engineer, Early Career, NetSoftMillers Point, New South Wales, Australia 3 days agoSydney, New South Wales, Australia 1 day agoBaulkham Hills, New South Wales, Australia 1 week agoSydney, New South Wales, Australia 3 days agoMacquarie Park, New South Wales, Australia 6 months agoSydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia A$150,000.00-A$160,000.00 3 days agoSydney, New South Wales, Australia 3 weeks agoSydney, New South Wales, Australia 17 hours agoSydney, New South Wales, Australia 1 month agoSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 1 day agoSydney, New South Wales, Australia 2 months agoGreater Sydney Area A$140,000.00-A$190,000.00 1 week agoKensington, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 3 weeks agoData Engineer - Brisbane, Sydney or Perth locationSydney, New South Wales, Australia 3 days agoSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 2 weeks agoSydney, New South Wales, Australia 1 day agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr