Job Description
Role Summary
We are seeking a Hands-On Python Lead Engineer to lead the design and implementation of enterprise-grade big data pipelines. This is a technical leadership role requiring significant daily coding. The successful candidate will architect scalable ETL frameworks using Python , PySpark , and Apache Airflow , serving as both a lead developer and a system designer. Experience integrating with Salesforce ecosystems is strongly preferred.
Core Responsibilities
Architectural Design & Framework Development
ETL Framework Design: Architect modular, metadata-driven ETL frameworks to standardize data ingestion and processing across the organization.
Airflow Orchestration: Design complex workflow orchestration strategies. Customize Airflow environments, including developing custom operators, sensors, and plugins to support business logic.
Scalability & Performance: Engineer high-performance pipelines capable of handling large-scale datasets; optimize DAG exec...
We are seeking a Hands-On Python Lead Engineer to lead the design and implementation of enterprise-grade big data pipelines. This is a technical leadership role requiring significant daily coding. The successful candidate will architect scalable ETL frameworks using Python , PySpark , and Apache Airflow , serving as both a lead developer and a system designer. Experience integrating with Salesforce ecosystems is strongly preferred.
Core Responsibilities
Architectural Design & Framework Development
ETL Framework Design: Architect modular, metadata-driven ETL frameworks to standardize data ingestion and processing across the organization.
Airflow Orchestration: Design complex workflow orchestration strategies. Customize Airflow environments, including developing custom operators, sensors, and plugins to support business logic.
Scalability & Performance: Engineer high-performance pipelines capable of handling large-scale datasets; optimize DAG exec...
Ready to Apply?
Take the next step in your AI career. Submit your application to Myridius today.
Submit Application