BRIEF DESCRIPTION:-
The Python/Spark/AI Developer role involves modernizing data platforms and creating scalable AI-driven solutions using Python, Spark, and related technologies. The main responsibilities include developing distributed data pipelines, managing APIs, and utilizing lakehouse technologies. Key requirements include a bachelor’s degree, 4 years of Python development experience, and 2 years of Spark production experience, along with proficiency in SQL, testing, and Docker.
Job Title: Remote Python/Spark/AI Developer
Company: MSP Staffing (PTY) LTD
Salary: R62 500.00 - R87 500.00 Per Month
Job Type: Permanent
Sector: IT
Reference: Python2026
Vacancy Details
Employer: MSP Staffing (PTY) LTD
Our client is looking for a seasoned Python/Spark/AI Developer to join a dynamic, technology-focused team aimed at modernizing data platforms and creating scalable AI-driven solutions. This role is perfect for developers who thrive on working with distributed data, crafting clean and testable Python code, managing APIs, and utilizing contemporary lakehouse technologies.
Key Requirements
- Bachelor’s degree in Computer Science, Engineering, or equivalent experience. - At least 4 years of professional Python development experience. - Over 2 years of production experience in developing Spark or similar distributed data pipelines. - Proficient in Python 3.12, including type hints, Pydantic, and modern packaging techniques. - Strong knowledge of Apache Spark/PySpark, including Spark SQL, DataFrame APIs, partitioning, and performance optimization. - Experience with Delta Lake or equivalent technologies like Iceberg or Hudi. - Solid SQL skills and the ability to convert legacy T-SQL logic into Spark SQL. - Practical experience with pytest and automated testing. - Familiarity with developing REST APIs using FastAPI or similar technologies. - Experience with Docker-based development environments. - Strong Git and CI/CD practices.
Advantageous
- Experience integrating LLMs and AI services. - Knowledge of data privacy, PII handling, and POPIA/GDPR concepts, along with data governance. - Exposure to Hive Metastore, Trino, or Apache Ranger. - Azure data platform experience, including ADLS Gen2, Synapse, or ADF. - Experience with observability tools and structured logging. - Previous data migration and pipeline parity experience. - Databricks or equivalent Spark certification.
If you meet these criteria, please email your CV to [Email hidden - Login to reveal]. You can also reach out to the IT team on XXX-XXXX or visit our website at https://mspstaffingza.co/.
NOTE: When replying to the advert, include the reference number in the subject line. Correspondence will only be conducted with shortlisted candidates. If you do not hear from us within 3 days, please consider your application unsuccessful.
APPLY FROM SOURCE
Interested and qualified? Make sure you are logged in or register an account if you dont have one then click to goto Python/Spark/AI Developer – Remote application page to apply.
APPLICATION INFORMATION
-
Make sure you are logged in and your email is verified (Register if you dont have an account).
-
Click the Apply Now button above.
-
Your default email application or application link will open.
-
Attach your Application letter, updated Curriculum Vitae (CV) and any supporting documents required.
-
Use a professional subject line such as Application for "Indicate Position"
-
Send your application before the closing date.
Note: Only shortlisted candidates are contacted.
