Job Description
Pyspark , AWS Developer
Location: Plano, TX / Jersey City, NJ - hybrid onsite
Core responsibilities
- Data pipeline development Design, develop, and maintain high-performance data pipelines using PySpark.
- Performance optimization Optimize and tune existing data processing workflows for better performance and efficiency.
- Data transformation Implement complex data transformations and integrations, such as reading from external sources, merging data, and loading into target destinations.
- Troubleshooting Monitor and troubleshoot performance issues, errors, and other problems in data processing systems.
- Collaboration Work with cross-functional teams like data scientists, data engineers, and business analysts to understand requirements and deliver solutions.
Required skills and qualifications
- Technical skills Strong proficiency in Python and Apache Spark is essential, along with exp...
Location: Plano, TX / Jersey City, NJ - hybrid onsite
Core responsibilities
- Data pipeline development Design, develop, and maintain high-performance data pipelines using PySpark.
- Performance optimization Optimize and tune existing data processing workflows for better performance and efficiency.
- Data transformation Implement complex data transformations and integrations, such as reading from external sources, merging data, and loading into target destinations.
- Troubleshooting Monitor and troubleshoot performance issues, errors, and other problems in data processing systems.
- Collaboration Work with cross-functional teams like data scientists, data engineers, and business analysts to understand requirements and deliver solutions.
Required skills and qualifications
- Technical skills Strong proficiency in Python and Apache Spark is essential, along with exp...
Ready to Apply?
Take the next step in your AI career. Submit your application to Q1 Technologies, Inc today.
Submit Application