BRIEF DESCRIPTION:-
The Python/Spark/AI Developer role involves modernizing data platforms and creating scalable AI-driven solutions using Python, Spark, and lakehouse technologies. The main responsibilities include developing distributed data pipelines, managing APIs, and utilizing contemporary data technologies. The ideal candidate should have a Bachelor's degree in Computer Science or equivalent, 4+ years of Python development experience, and 2+ years of experience in Spark or similar distributed data pipelines.
Job Title: Remote Python/Spark/AI Developer Company: MSP Staffing (PTY) LTD
Salary: R62 500.00 - R87 500.00 Per Month Job Type: Permanent Sectors: IT Reference: Python2026
Vacancy Details
Employer: MSP Staffing (PTY) LTD
Our client is in search of a seasoned Python/Spark/AI Developer to join a forward-thinking team dedicated to the modernization of data platforms and the creation of scalable AI-driven solutions. This position suits an individual who thrives on working with distributed data, writing clean and testable Python code, managing APIs, and utilizing contemporary lakehouse technologies.
Key Requirements - Bachelor's degree in Computer Science, Engineering, or equivalent relevant experience. - 4+ years of professional Python development experience. - 2+ years of production experience in developing Spark or similar distributed data pipelines. - Proficient in Python 3.12, including type hints, Pydantic, and modern packaging practices. - Strong knowledge of Apache Spark/PySpark, including Spark SQL, DataFrame APIs, partitioning, and performance optimization. - Experience with Delta Lake or comparable technologies such as Iceberg or Hudi. - Strong SQL skills and the ability to convert legacy T-SQL logic into Spark SQL. - Practical experience with pytest and automated testing. - Experience developing REST APIs with FastAPI or similar technologies. - Familiarity with Docker-based development environments. - Strong Git and CI/CD practices.
Advantageous: - Experience integrating LLMs and AI services. - Knowledge of data privacy, PII handling, POPIA/GDPR concepts, and data governance. - Exposure to Hive Metastore, Trino, or Apache Ranger. - Azure data platform experience, including ADLS Gen2, Synapse, or ADF. - Experience with observability tools and structured logging. - Previous data migration and pipeline parity experience. - Databricks or equivalent Spark certification.
If you meet the criteria for this role, please send your CV to [Email hidden - Login to reveal]. Alternatively, you can contact the IT team at XXX-XXXX or visit our website at https://mspstaffingza.co/.
NOTE: Include the reference number in the subject line when responding to the advert. Communication will only be conducted with shortlisted candidates. If you do not hear back within 3 days, please consider your application unsuccessful.
APPLY FROM SOURCE
Interested and qualified? Make sure you are logged in or register an account if you dont have one then click to goto Python/Spark/AI Developer – Remote application page to apply.
APPLICATION INFORMATION
-
Make sure you are logged in and your email is verified (Register if you dont have an account).
-
Click the Apply Now button above.
-
Your default email application or application link will open.
-
Attach your Application letter, updated Curriculum Vitae (CV) and any supporting documents required.
-
Use a professional subject line such as Application for "Indicate Position"
-
Send your application before the closing date.
Note: Only shortlisted candidates are contacted.
