Job Description

Location: KY and NJ

Consultant either has to be local or need to relocate to any of the locations that is KY or NJ

Mandatory skills: Python, Pyspark, Azure Databricks, ETL,

Key Responsibilities

  • Designing developing and maintaining scalable data pipelines and ETL processes using Azure Databricks Data Factory and other Azure services
  • Implementing and optimizing Spark jobs data transformations and workflows within Databricks
  • Developing and maintaining data models and data dictionaries
  • Developing and maintaining data quality checks governance policies and security procedures
  • Designing and creating ETL processes to supply data to various destinations including data warehouses
  • Integrating data from various sources into Azure Databricks
  • Working with other teams including data engineers data scientists and analysts to ensure data quality and consistency
  • Implementing effective monitoring pro...

    • Ready to Apply?

    Take the next step in your AI career. Submit your application to MSRCosmos LLC today.

    Submit Application