Role Description & Requirements
Lead technical architecture and solution design for large scale data platform solutions.
Interact with the customer's data engineering team to provide opinionated guidance on data and analytics platform architecture, best practices, solution design and development.
Independently develop solutions, i.e., perform hands‐on coding for the designed solution, and handover the developed solution to the customer's technical team.
Perform pair programming with the customer's data engineers.
Project manage small to mid‐sized projects, managing scope, priorities, deliverables, risks/issues, and timelines for successful outcomes.
Collaborate with a cross‐disciplinary project team, playing the role of workstream or overall project tech lead depending on the size and scale of the project or program.
Minimum Qualifications
* Expertise Required
* In‐depth knowledge and experience of GCP data and analytics technologies.
* Designing data platform architecture and design for (a) migrating open‐source or other public cloud‐based data platforms to GCP cloud native technologies (not just lift‐and‐shift migration but re‐engineering to native services); and (b) designing green‐field data platforms on cloud.
* Define solution architecture and detailed design, and perform hands‐on implementation for data pipelines for batch and event‐driven ingestion and processing of data from a variety of sources such as on‐prem files, on‐prem databases, APIs, etc.; as well as data pipelines for real‐time data ingestion and processing.
* Automatic transpilation of legacy code (HIVE, Teradata, python logic, etc.) to BQ SQL.
* BQ query performance optimisation.
* CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform.
* Data governance solutioning using GCP governance tooling.
#J-18808-Ljbffr