Lets Recruit Logo
Linkedin
Application deadline date has been passed for this Job.
This job has been Expired
Work Remotely
  • Post Date: September 17, 2024
Shortlist
Job Description
Job title:  Senior Data Engineer

Location: Cape Town (Remote)
We seek a talented Senior Data Engineer to join our AI Software client’s team.

In this role, you can work on exciting projects, collaborate with experienced developers, and contribute to a positive and dynamic company culture. If you think the prospect of solving unique and challenging problems appeals to you, we encourage you to apply for this opportunity.

Tech Stack:

As a Data Engineer with a focus on Kafka pipelines and Elastic, you will work with the following technologies:

Data Pipelines:

o   Kafka / stream processing

o   Python

o   Redis

Data Storage and Analysis:

o   Elasticsearch

o   Elasticsearch clusters management and optimisation

o   PostgreSQL

DevOps:

o   AWS

Requirements:

  • To excel in this role, you should possess the following qualifications and skills:
  • Proven experience in designing and implementing data pipelines using stream processing technologies.
  • Experience with end-to-end testing of analytics pipelines.
  • In-depth expertise in managing and optimising Elasticsearch clusters, including performance tuning and scalability.
  • Strong proficiency with data extraction, transformation, and loading (ETL) processes.
  • Familiarity with data modeling and schema design for efficient data storage and retrieval.
  • Proficiency in troubleshooting data pipeline and Elastic-related issues to ensure data integrity and availability.
  • Solid programming and scripting skills, particularly in languages like Python, Scala, or Java.
  • Knowledge of DevOps and automation practices related to data engineering.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.
  • Strong analytical and problem-solving abilities, with a keen attention to detail.
  • A commitment to staying up-to-date with the latest developments in data engineering and technology.
  • Alignment with our company values and a dedication to driving positive change through data.

Benefits:

What’s in it for you?

  • Flexible remote work options
  • Competitive compensation package
  • Impactful work that directly benefits customers and companies
  • Inclusive and diverse work environment
  • Opportunity to make a lasting difference while advancing your career
  • Highly regarded company culture
  • Investment in upskilling and professional development.

Interested? If you’re a passionate Senior Data Engineer with expertise in Kafka pipelines and a thorough understanding of Elastic, looking to contribute to cutting-edge technology and make a difference in the financial services industry, we have the perfect opportunity for you!
Note:

  • Although we endeavour to provide feedback to all applicants, should you not hear from us within 14 days of applying, please accept your application as unsuccessful.
  • Successful applicants will be contacted within 14 days of applying.
  • Let’s Recruit reserves the right to cancel or amend an advertised vacancy at any time.
To apply, send your comprehensive CV and full academic transcripts (NSC & University) to cv@letsrecruit.co.za

Related Jobs (13)

Senior Data Engineer View all Jobs