Job Description

Responsibilities

  • Design and develop ETL pipelines using Python for multi-source data ingestion, transformation, and validation at scale.
  • Develop the API Program to integrate external APIs for data exchange and data collections, including authentication, pagination, data processing and error handling.
  • Develop backend services using Django (Python) to process, store, and automate large datasets.
  • Handle and optimize large-volume data processing, high traffic of transactions, ensuring scalability, reliability, and high performance.
  • Verify and maintain data integrity and data accuracy, completeness, and consistency across systems.
  • Monitor and optimize custom system performance, including throughput, latency, and health metrics, with automated alerts.
  • Monitor and optimize custom system performance, including throughput, latency, and health metrics, with automated alerts.

Qualifications

  • Bachelor's d...

Ready to Apply?

Take the next step in your AI career. Submit your application to MR DIY Malaysia today.

Submit Application