About the Role
As a Data Engineer, you will be responsible for designing and implementing efficient data systems and architectures. Our team is growing rapidly, and we need someone with your skills to help expand and optimize our data pipeline infrastructure.
The successful candidate will be responsible for:
* Identifying and automating internal process improvements, optimizing data delivery, and redesigning infrastructure for greater scalability.
* Collaborating with stakeholders, including the executive, product, data, and design teams, to assist with data-related technical issues and support their data infrastructure needs.
* Creating data tools for analytics and data scientist team members to assist them in building and optimizing our products.
You must be self-directed, comfortable supporting multiple teams, systems, and products, and have excellent client and stakeholder relationship-building skills.
Key Responsibilities
* Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
* Work with unstructured datasets using strong analytic skills.
* Qualified with a graduate degree in computer science, statistics, informatics, information systems, or another quantitative field.
Preferred Experience
* SQL knowledge and experience working with relational databases, query authoring, and familiarity with various databases and RESTful API methods.
* Build processes supporting data transformation, metadata dependency, and workload management.
* Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
* Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
* AWS cloud services, EC2, EMR, RDS, Redshift, and experience with stream-processing systems, such as Storm and Spark-Streaming.
* Building and optimizing big data data pipelines architectures and datasets.
* Existing middleware ETL platform experience, such as Talend, Pentaho, and NiFi.
Perks
* Full remote working setup.
* Join a supportive and close-knit team.
* Clear career development pathway and ongoing training support.
* Continuous learning and development initiatives.
About Us
We are passionate about making a difference and putting clients first. We're a high-trust environment that celebrates success and thrives together.