Data Engineer

 

Recruiter:

HR Genie

Job Ref:

Data Engineer

Date posted:

Monday, January 10, 2022

Location:

South Africa, South Africa

Salary:

Market related


SUMMARY:
We value a Data Engineer as someone who works behind the scenes to obtain, process and supply data v

JOB DESCRIPTION:

We value a Data Engineer as someone who works behind the scenes to obtain, process and supply data via various methodologies and technologies, to various consumers, in ways and forms that makes sense and add value. This definition is very broad, as the field of data engineering is just as broad. You may be the type of Data Engineer that develops API endpoints for the consumption of data by end users or even another data pipeline, or you may be the type of Data Engineer that develops highly distributed, high availability data processing pipelines in an effort to satisfy the need of the ever questioning data analysts and/or data scientists.

 

You have awesome knowledge about the following concepts:

  • Data modelling
  • Relational data modelling in traditional relational database management systems. (Microsoft SQL Server, MySQL, PostgreSQL, etc.)
  • Coercing unstructured and semi-structured data into a structured form.
  • Data pipelining knowledge - data extraction and transformation.
  • Data transformation knowledge for reporting and analytics purposes.
  • Knowledge of the MapReduce and related data processing paradigms would be a boon.

 

You have the following technical competencies:

  • Writing SQL queries, that can relate, transform and aggregate data from many differing sources where natural keys may or may not exist.
  • Experience with writing data pipelines that move and transform data, for various uses.
  • Working knowledge of a general purpose programming language like Python would be a boost.
  • Working knowledge of columnar databases such as Google BigQuery, and SAP HANA would be a boost.
  • Working knowledge of highly distributed technologies such as Apache Hadoop or Apache Spark would be a boost.
  • Working knowledge of NoSQL technologies, such as Apache Solr would be a boost.

 

You have the following personal competencies:

  • The ability to solve problems.
  • The ability to rotate around a problem, to see if solutions can be gained in different ways.
  • The ability to work in an ever changing, unstructured environment.
  • The ability to work as part of a team, with vastly differing skill sets and opinions.
  • The ability to contribute ideas to the quorum.
  • The ability to mentor and provide guidance for other team members.
  • A systems approach to thinking, as opposed to a siloed approach. The candidate needs to understand how their work affects the greater system.
  • The ability to work without supervision, and take accountability for the work they deliver.
  • The ability to liaise with a client, sifting through the fluff and extracting the actual requirements.

 

If this is you - apply now and we'll get in touch!!

 

NB! This job is now closed. You can apply for other jobs by uploading your CV.



 

 

 

Similar jobs you might be interested in:

Data Engineer - Lumos - Sandton- 12 months - Start Date - January 2025
Location: Sandton
Salary: Market related
data, engineer, Lumos, Sandton, 12, months, Start, Date, January, 2025
9 days ago


Data Engineer (Fully remote)
Location: Johannesburg
Salary: 1000 Annually
The core advanced data engineering skillset is a comprehensive combination of technical expertise, platform knowledge, and problem-solving abilities required to build, maintain, and optimize robust, scalable, and efficient data systems.
10 days ago


Intermediate Azure Data Engineer – Johannesburg – R470k up to R570k per annum
Location: Johannesburg
Salary: 570000
Intermediate Azure data engineer – Johannesburg – R470k up to R570k per annum
11 days ago


REF#88265- Healthcare Azure Data Engineer (Road Logistics)
Location: Kempton Park
Salary:
15 days ago


Data Engineer
Location: Johannesburg
Salary: Negotiable
The role is responsible for the design, development, testing, implementation, maintenance and support of the BI Report and data warehouse solutions in the Regional Africa Business Units. The data engineer will participate in BI Architecture design sessions,
17 days ago


Data Engineer
Location: Johannesburg
Salary:
data engineer
18 days ago


Data Engineer
Location: Midrand
Salary:
We are looking for an experienced database, ML & AI engineer to join our team to help shape our ML/AI strategy and showcase the potential for ML/AI through early-stage solutions. AI (our general term for data modeller, machine learning, and deep learning) is one of the decade's most exciting technologies. This role is your opportunity to build and deploy new AI products from the ground up...
19 days ago


Data Engineer – Johannesburg - R800k to R1mil per annum
Location: Johannesburg
Salary: 800000
data engineer – Johannesburg - R800k to R1mil per annum
23 days ago


Senior Data Engineer
Location: Centurion
Salary: R800,000.00
data engineer (Analytical Department)Location: Bryanston / CenturionWork Model: HybridEmployment Type: Full-TimeSalary: R840,000 per annum (plus company benefits)Are you a self-driven data engineer looking for an exciting opportunity to make a real impact?Join our fun and inclusive team, where we consider each other family and value long-term relationships. In this role, you’ll take own...
24 days ago


Junior Data Engineer - Centurion – R330k to R430k per annum
Location: Pretoria
Salary: 430000
Junior data engineer - Centurion – R330k to R430k per annum
31 days ago


Create a free job alert for Data Engineer in South Africa

Enter your email address below and we will email you similar jobs when they become available:

You can cancel at any time. We will not spam you.
By giving us your email address your agree to our Terms and Conditions