Lead Spark Data Engineer

About Fusemachines

Fusemachines is a leading AI strategy, talent, and education services provider. Fusemachines has a core mission of democratizing AI, with a presence in 4 countries (Nepal, the United States, Canada, and the Dominican Republic) and more than 450 full-time employees. The company provides a suite of enterprise AI offerings and specialty services to help organizations implement and scale AI.

Job Description

We are looking for an experienced Lead Data Engineer to join our team to build the Brain of an IoT platform, a library that allows definition and metrics, validates it against a Virtual Schema, and generates optimized execution plans for both Spark (Batch) and Flink (Stream).

Qualifications / Skill Set

• 5+ years of hands-on data engineering experience with deep expertise in the Azure ecosystem
• Expert-level Java, Python and SQL
• Deep understanding of Apache Spark Internals (Catalyst Optimizer, Logical ...