Data Engineering Position
As part of our digital transformation, we are establishing a function within Human Resources. We bring an engineering culture and passion for DevSecOps and GitOps within the cloud.
* We are looking for a skilled Data Engineer to design, create and manage cloud databases and data pipelines underpinning our decoupled cloud architecture and API first approach.
The ideal candidate will have experience working through performance and scaling through horizontal scaling designs vs database tuning.
Key Responsibilities:
* Design and implement databases for data integration in the enterprise
* Performance tune applications from a database code and design perspective
* Automate data ingestion and transformation processes using scheduling tools
* Monitor and troubleshoot data pipelines to ensure reliability and performance
Requirements:
* Proven expertise in database design, data ingestion, transformation, data writing, scheduling and query management within a cloud environment
* Extensive experience with AWS Cloud Infrastructure Engineers, Software/API Developers and Architects
* Proficiency in programming languages like Python, Scala or Java for developing data ingestion and transformation scripts
* Strong knowledge of SQL for writing, optimising, and debugging queries
* Familiarity with database design, indexing, and normalisation principles
* Understanding of data formats (JSON, CSV, XML) and techniques for converting between them
* Ability to handle data validation, cleaning, and transformation