Job Description

Job Title

Databricks Data Engineer

Role Summary

&

Role Description

We are looking for a seasoned Data engineer worked extensively on Data Engineering and implementation at large scale. Have experience on both Azure and AWS cloud and expertise in Databricks platform.

  • Databricks Platform Expertise (Notebooks, Clusters, Jobs, Delta Lake)
  • Unity Catalog and RBAC configuration
  • Programming & Data Processing using (Scala, Python, PySpark, SQL)
  • Apache Spark optimization techniques
  • Azure Services (Data Factory, Blob Storage, Azure Databricks)
  • CI/CD with Azure DevOps
  • Ability to debug and optimize PySpark/SQL code
  • Real-world coding challenge performance
  • Communication and articulation of technical concepts
  • Secure Coding principles in Databricks, Data Governance and Compliance standards

    • Core/Must have skills

    Databricks Platform Expertise (No...

    Ready to Apply?

    Take the next step in your AI career. Submit your application to State Street today.

    Submit Application