Data Engineer
Permanent
Cape Town
Posted 1126 years ago
Seniority level
Intermediate
Experience
3 - 5 Years
Remuneration
R 45 000 - R 65 000
Remuneration type
Salary
Remuneration frequency
Monthly
Benefits
20 Days Leave | Skills Development Levy | Internet Allowance | Performance Based Increases
The Company
A premier AI consulting firm, headquartered in the US and founded in South Africa, helps global clients unlock the value in their data through AI-driven solutions that increase revenue, optimize operations, and improve customer experiences. Their areas of expertise include Natural Language Processing, GenAI, LLMs, Predictive Analytics, and Machine Learning.
The Role
As a Data Engineer, you will build modern database structures storing terabytes of data, develop and maintain machine learning models in a cloud environment, and collaborate with software engineering stakeholders to define and implement new data-driven solutions. You will own best practices for data organization, security, and versioning while ensuring compliance with GDPR and other data privacy standards.
Requirements
-
3+ years of experience in data engineering, implementing, and supporting robust data transformation pipelines in a production Cloud environment.
-
Experience with RDBMS systems for OLTP workloads (Postgres, MySQL).
-
Strong data architecture and optimization skills.
-
Experience implementing big data security and quality measures.
-
Proficiency in Python or R for data manipulation.
-
Familiarity with Spark, Hadoop, Presto, Hive, AWS Athena, and Terraform.
-
Experience with container technology (Docker).
-
JavaScript frameworks such as Vue, Node.js (a plus).
-
Full stack development experience is a plus.