Job Description

Responsibilities

1. Lakehouse/Warehouse Design and Maintenance

  • Architect and maintain Lakehouses using Microsoft Fabric’s OneLake and Delta Lake technologies.

  • Implement medallion architecture (Bronze, Silver, Gold layers) for scalable and modular data processing.

  • Optimize storage formats (e.g., Parquet, Delta) for performance and cost-efficiency.

    • 2. Pipeline Development and Orchestration

  • Build robust Data Factory pipelines or Fabric Dataflows Gen2 to ingest data from diverse sources (SQL, APIs, cloud storage, etc.).

  • Schedule and orchestrate ETL/ELT workflows using Fabric Pipelines or notebooks.

  • Implement incremental loads, schema evolution, and error handling mechanisms.

    • 3. Data Cleansing and Transformation

  • Apply data quality rules and transformations using...

    • Ready to Apply?

    Take the next step in your AI career. Submit your application to Cerberus today.

    Submit Application