PySpark Developer

We are seeking a skilled PySpark Developer with strong working experience in Python programming and a focus on PySpark. You must have hands-on experience with AWS Glue and PySpark, along with strong knowledge of popular libraries such as pandas and numpy. This role requires experience in parallel batch processing, AWS Batch, and Step Functions, as well as knowledge of other AWS services like ECS, ECR, Docker, CloudWatch, and Athena.

Roles & Responsibilities:

• Utilize strong working experience in Python programming to develop data processing solutions.
• Apply expertise with the PySpark framework for big data processing.
• Work extensively with AWS Glue and PySpark for building and managing data pipelines.
• Use popular Python libraries such as pandas, numpy, and joblib to enhance data manipulation and processing.
• Conduct parallel bat...