Senior Python Data Engineer

We are looking for a Senior Python Data Engineer to craft scalable Python data services and pipelines in an Azure-first environment. You will combine FastAPI, Pandas/Polars, and DuckDB with GitHub Actions and IaC via Bicep to ship reliable lakehouse solutions and reporting—apply today.

Responsibilities

• Build web services and background jobs with FastAPI
• Optimize data processing and reporting using Pandas, Polars, openpyxl, and DuckDB
• Architect pipelines using data lakes, medallion architecture, and star schema
• Set up and maintain CI/CD workflows through GitHub Actions
• Implement Azure components with Container Apps, Azure Storage, Service Bus, and SignalR
• Provision and update infrastructure via Bicep on Azure or with AWS CDK or Terraform experience
• Use specification-driven development practices supported by GitHub Copilot and Claude Code
• Connect and maintain orchestration and reporting flows with Airflo...