Job Description

Responsibilities:

  • Responsible for pipeline maintenance, transformations, and platform reliability.

Skills:

  • Scheduling Monitoring: Azure Data Factory (ADF) triggers, Azure Monitor, Log Analytics (KQL)
  • Ingestion Validation: ADF, Event Hub, APIs, PySpark, schema drift handling
  • CI/CD: Azure DevOps YAML pipelines, deployment for ADF/Synapse/Databricks
  • Transformation Performance: PySpark, Delta Lake optimization (partitioning, caching)
  • Security: Azure RBAC, Key Vault, NSGs, IR config
  • Stability RCA: RCA documentation, disaster recovery playbooks, proactive alerting


Skills Required
Azure Data Factory, Pyspark, Azure Devops

Ready to Apply?

Take the next step in your AI career. Submit your application to Syren Technologies Private Limited today.

Submit Application