Data Engineer – Cape Town

Recruiter:

Career Circuit

Job Ref:

Data Engineer – Cape..

Date posted:

Tuesday, April 19, 2022

Location:

CapeTown, South Africa

Salary:

Market Related

SUMMARY:
Data Engineer – Cape Town

JOB DESCRIPTION:

Experience:

vIntermediate in Data Engineer- 2+ years in Data or at least 1 year in Data Engineer.

vSenior Data Engineer- 2+ years or rather working in IT for 5+ years.

v

Requirements:

vFluency in Python and some variety of SQL.

vA strong degree in computer science, or a quantitative discipline.

vExperience in designing and setting up large data systems, with an ability to assess the trade- offs in architectural decisions.

vExperience with distributed processing frameworks (Hadoop, Spark etc).

vKnowledge of large data architectures (data warehouses, lakes, meshes, etc).

vExperience working in cloud environments, especially Azure.

vExperience in building and optimizing big data pipelines.

vDesigning and implementing data warehouses, data lakes and data meshes.

vAdvanced knowledge of relational, non-relational databases with strong experience in SQL.

vWorking knowledge of streaming, message queuing and highly scalable data stores.

vUnderstanding of DevOps processes, CI/CD, and agile development.

vExperience in testing and observability in the context of big data.

vExperience with distributed processing frameworks (Apache Spark, Hive, Kafka, etc.)

vHaving worked in a cloud environment (Azure, AWS).

vSpecific technologies: - Python, R, Scala - SQL (MS SQL Server, Postgres) - Apache Spark, Hadoop, Hive - Databricks, EMR.

NB! This job is now closed. You can apply for other jobs by uploading your CV.

Similar jobs you might be interested in:

Senior Data and Vehicle Support Engineer (Telematics) Cape Town
Location: Cape Town
Salary:
Senior data and Vehicle Support engineer (Telematics) vacancy in cape town.Â BEng or MEng (Electronic or Mechatronic engineering) with a minimum of 5 years working experience in telematics systems and -components including data management and data dashboards. Proficient in interpreting vehicle log data to support data analysis relevant to client reports and electric vehicle architecture design.
19 days ago

Senior Data Engineer
Location: Cape Town
Salary: 800 000 Annually
A leading technology company is on the lookout for a Senior data engineer to join their dynamic team. This full-time, hybrid role, based in cape town, offers flexibility with work-from-home options.
2 days ago

Senior Data Engineer
Location: Cape Town
Salary: 950000.00 Annually
Our client is looking for a skilled and experienced Senior data engineer to join their team. This role offers the opportunity to work with cutting-edge data engineering technologies, build scalable solutions, and collaborate with cross-functional teams to drive innovative, data-driven strategies. The ideal candidate will have a strong background in data engineering, data modeling, and working with...
8 days ago

Senior Data Engineer
Location: Cape Town
Salary: 950000.00 Annually
Our client is looking for a skilled and experienced Senior data engineer to join their team. This role offers the opportunity to work with cutting-edge data engineering technologies, build scalable solutions, and collaborate with cross-functional teams to drive innovative, data-driven strategies. The ideal candidate will have a strong background in data engineering, data modeling, and working with...
8 days ago

Senior Data Engineer
Location: Cape Town
Salary:
11 days ago

Data Streaming Engineer
Location: Cape Town
Salary:
23 days ago

Data Engineer
Location: Cape Town
Salary:
23 days ago

Software Engineer - Data, Group Data & ML Platform Tribe
Location: Cape Town
Salary: market related Monthly
What will you do?Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The company’s main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of our c...
27 days ago

Senior Software Engineer - Data, Group Data & ML Platform Tribe
Location: Cape Town
Salary: market related Monthly
What will you do?Our client is a newly created engineering organisation on a mission to empower and accelerate autonomous value creation through insights and ML across the group. The company main users are the data scientists and analysts who sit inside the business units and support them in developing and re-developing their financial and digital products to better meet the needs of the company c...
27 days ago

AWS Data Engineer
Location: Cape Town
Salary:
61 days ago

Data Engineer – Cape Town

Similar jobs you might be interested in:

Create a free job alert for Data Engineer – Cape Town in CapeTown

Jobseekers

Recruiter

General