Datafin Recruitment was established in 1999 and is one of South Africa’s leading Recruitment companies. Owned and managed by two sisters Lindy and Bev Sollinger, we focus on connecting with both our clients and candidates in an authentic conscious meaningful manner. We focus on the Tech, Digital/Online, Data, Finance and HR industries.
DATA ENGINEER – PYTHON (CPT HYBRID) AT DATAFIN RECRUITMENT
DATAFIN
R UndisclosedPermanent Executive positionDurbanville, Western CapePosted 07 Jan 2023 by DatafinExpires in 5 daysJob 2496650 – Ref 23006
SAVEAPPLY NOW
ABOUT THE POSITION
ENVIRONMENT:
DO you consider yourself an all-round Data Engineer experienced in every step of data flow, from configuring data sources to integrating analytical tools. Then a Specialist IT Service Provider in Durbanville wants you as its next Data Engineer who will contribute to architecting, building, testing, and maintaining the data platform as a whole. The ideal candidate must possess a Bachelor’s Degree in a Scientific or Engineering discipline, have Certification/Experience with Agile or other methodologies such as Scrum or Kanban and ideally be busy with or have obtained an AWS Certification. You must have experience implementing data pipelines using cloud infrastructure and services, Intermediate to Advanced R, Python or SQL optimization, developing ETL strategies; Infrastructure: AWS (Kinesis, API Gateway, S3, DMS); Dev Tools: Git, Docker, Elastic Container Service (ECS), Elastic Kubernetes Service (EKS) and be able to conduct systems analysis and prepare requirement specifications concerning data-related business processes and systems.
DUTIES:
Mission –
Deliver accurate data reliably within the required processing time, ready for processing by analytics applications.
You will work across multiple business teams to implement new and improve existing systems for:
Extracting data from current sources
Data storing/transition for all data gathered for analytical purposes.
Transformation: Cleaning, structuring, and formatting the data sets to make data consumable for processing or analysis.
An all-round Data Engineer, understand what is required from the users and deliver an appropriate data driven technical solution
Contribute to strategic design of the architecture of a data platform.
Develop data systems tools, customize and manage integration tools, databases, warehouses, and analytical systems.
Data pipeline maintenance/testing.
Machine Learning algorithm deployment. Machine Learning models designed by Data Scientists, deployed into production environments, managing computing resources and setting up monitoring tools.
Manage data and meta-data storage, structured for efficiency, quality and performance.
Track pipeline stability.
Monitor the overall performance and stability of the systems.
Keep track of related infrastructure costs and manage these as efficiently as possible, continuously balancing performance and cost.
REQUIREMENTS:
Qualifications –
Minimum of a Bachelor’s Degree in a Scientific or Engineering related field.
Certification or experience with Agile or other development methodologies – Agile, Kanban or Scrum
Ideally busy with or obtained AWS Certifications.
Experience/Skills –
Implementing data pipelines using cloud infrastructure and services.
Intermediate to Advanced R, Python or SQL optimization, developing ETL strategies.
Infrastructure: AWS (Kinesis, API Gateway, S3, DMS).
Dev Tools: Git, Docker, Elastic Container Service (ECS), Elastic Kubernetes Service (EKS).
Ability to conduct systems analysis and prepare requirement specifications concerning data-related business processes and systems.
AWS analytics architecture experience will be a real advantage.
ATTRIBUTES:
Willingness to learn new technology and skills, figure it out attitude
Dynamic, driven by results. Enjoy getting things done.
A proactive, results-oriented, and can-do attitude is highly desirable
Self-starter with the ability to successfully plan, organize, and execute assigned initiatives with minimal guidance and direction.
Strong listening, problem-solving and analytical skills.
Willing to take the initiative.
Excellent written and verbal communication skills.
Exhibits close attention to detail and is a champion for accuracy.
High level of Integrity.
Proven ability to meet deadlines, ability to multi-task effectively
The ability and willingness to do a variety of different tasks.
While we would really like to respond to every application, should you not be contacted for this position within 10 working days please consider your application unsuccessful.
COMMENTS:
When applying for jobs, ensure that you have the minimum job requirements. OnlySA Citizens will be considered for this role. If you are not in the mentioned location of any of the jobs, please note your relocation plans in all applications for jobs and correspondence. Apply here [URL Removed] e-mail a Word copy of your CV to [Email Address Removed] and mention the reference number of the job.
Desired Skills:
Data
Engineer
Python
apply here
