Job Description
Responsibilities
- Design and develop ETL pipelines using Python for multi-source data ingestion, transformation, and validation at scale.
- Develop the API Program to integrate external APIs for data exchange and data collections, including authentication, pagination, data processing and error handling.
- Develop backend services using Django (Python) to process, store, and automate large datasets.
- Handle and optimize large-volume data processing, high traffic of transactions, ensuring scalability, reliability, and high performance.
- Verify and maintain data integrity and data accuracy, completeness, and consistency across systems.
- Monitor and optimize custom system performance, including throughput, latency, and health metrics, with automated alerts.
- Monitor and optimize custom system performance, including throughput, latency, and health metrics, with automated alerts.
Qualifications
- Bachelor's d...
Ready to Apply?
Take the next step in your AI career. Submit your application to MR DIY Malaysia today.
Submit Application