Senior Data Infrastructure Specialist
Are you ready to elevate your skills in building scalable and reliable data infrastructure? We're seeking a talented Senior Data Infrastructure Specialist to join our team.
This is a unique opportunity to shape the future of our organization by designing, implementing, and maintaining large-scale data pipelines, warehouses, and datalakes that support business-critical insights and operations. Our ideal candidate will have expertise in observability, reliability, and automation, with a passion for continuous improvement and self-service enablement.
We value collaboration and strong communication skills, as well as a mindset focused on innovation, experimentation, and learning from failures. If you're passionate about data engineering, observability, and scalability, we encourage you to apply for this exciting role.
* Key Responsibilities:
* Establish and standardize observability frameworks for data pipelines, ensuring monitoring of system health, data freshness, SLAs, and automated alerting.
* Proactively monitor and troubleshoot pipeline performance issues, including failures, latency, and reliability bottlenecks, with robust logging, retry logic, and recovery mechanisms in place.
* Implement and automate data quality validation, including data checks, testing, and lineage tracking, to ensure trust, reliability, and schema consistency across data products.
* Collaborate with data engineers and domain teams to define and enforce data governance practices, including data SLAs, contracts, access control, encryption, and PII handling.
* Maintain and evolve CI/CD pipelines and Infrastructure-as-Code (IaC) to ensure reproducibility, scalability, and safe deployment of platform components across environments.
* Lead incident response processes, including root cause analysis and postmortems, to drive continuous reliability improvements.
* Own release management workflows for data platform code, including branching strategies, review processes, and approvals.
* Build and maintain a central data catalog that supports data discovery, trust, and documentation for technical users, enabling self-service access to high-quality data products.
* Develop reusable infrastructure patterns and standards that empower teams to independently build, deploy, and manage data pipelines and products with consistency and reliability.
Qualifications:
* Bachelor's degree in Computer Science, Software Engineering, or equivalent practical experience.
* 4+ years of experience in DataOps, DevOps, or Data Engineering roles with a focus on observability and reliability.
* Proficiency in Python (or other scripting languages) and SQL skills for data transformation and validation.
* Experience building and managing data infrastructure in AWS, solid understanding of CI/CD pipelines, and version control.
* Familiarity with orchestration tools such as Airflow, Dagster, or Prefect .
* Experience with observability, alerting, and incident response for production data systems.
* Experience with real-time data streaming tools and patterns (e.g., Kafka, Kinesis).
* Understanding of compliance requirements in regulated environments (e.g., GDPR, ISO, GLI).
* Strong collaboration and communication skills.
* A mindset focused on automation, continuous improvement, and self-service enablement.
Benefits:
* Work alongside top engineering talent using a vast cloud-native and big data technology stack.
* Exposure to building global, large-scale volume data pipelines, data warehouses, and datalakes that consume requests at thousands per second frequency.
* Access to over 9,000 courses across our Learning and Development Platform.
* EAP access for you and your family.
* Be rewarded with lucrative annual bonuses.
* Give back with a paid volunteer day.
* Fuel your day with daily breakfast and open pantries brimming with unlimited snacks and refreshments, all on the house.
* Break up the week with on-site remedial massage Wednesdays.
* In-house full-time baristas providing you your daily coffee needs.
* Weekly team lunches and happy hour in the office from 4pm on Fridays.
* Enjoy a bustling office with the option for up to 2 days work from home per week.
* Fun office environment with F1 simulators, table tennis, and all your favorite gaming consoles.