Data Engineer

Responsibilities:
Implement resource composition logic provided by the Product team into scalable and efficient PySpark code.
Develop, optimize, and maintain PySpark applications within the Databricks environment.
Utilize and maintain existing CI/CD pipelines in Databricks for automated build, testing, and deployment.
Write and maintain unit tests to ensure high code quality and reliability.
Perform data validation and quality checks to ensure compliance with defined business rules
Support and manage production deployments, ensuring system stability and performance.
Troubleshoot and resolve issues across development, testing, and production environments.
Collaborate with Product, QA, DevOps, and healthcare domain teams to ensure accurate implementation.
Maintain technical documentation for code, workflows, and deployment processes.
Pull from and push code to GitHub repositories, following version control and branching best practices.
Mandatory Skills De...