Data Engineer

The Company
A premier AI consulting firm, headquartered in the US and founded in South Africa, helps global clients unlock the value in their data through AI-driven solutions that increase revenue, optimize operations, and improve customer experiences. Their areas of expertise include Natural Language Processing, GenAI, LLMs, Predictive Analytics, and Machine Learning.

The Role
As a Data Engineer, you will build modern database structures storing terabytes of data, develop and maintain machine learning models in a cloud environment, and collaborate with software engineering stakeholders to define and implement new data-driven solutions. You will own best practices for data organization, security, and versioning while ensuring compliance with GDPR and other data privacy standards.

Requirements

• 3+ years of experience in data engineering, implementing, and supporting robust data transformation pipelines in a production Cloud environment.

• Experience with RDBMS systems for OLTP workloads (Postgres, MySQL).

• Strong data architecture and optimization skills.

• Experience implementing big data security and quality measures.

• Proficiency in Python or R for data manipulation.

• Familiarity with Spark, Hadoop, Presto, Hive, AWS Athena, and Terraform.

• Experience with container technology (Docker).

• JavaScript frameworks such as Vue, Node.js (a plus).

• Full stack development experience is a plus.